Comparison of Overall Accuracy and Cohen’s kappa coefficient of the Manufacturers and the Operators
Table 3 presents a comparison of the overall accuracy and Cohen’s kappa coefficient of three different manufacturers’ ICT kits and the operators’ COVID-19 immunochromatographic rapid test (ICT) kits. Overall accuracy varies with disease prevalence, and it may mislead if the study population differs from the actual population. Cohen’s kappa coefficient was used as an alternative to compare the prediction performance of the ICT kits to rRT-PCR with kappa values indicating agreement levels; >75% implying excellent/total agreement, 40-75% good agreement, and <40% poor agreement with rRT-PCR.
When the manufacturers’ and operators’ analysis are compared, the overall accuracy and Cohen’s kappa coefficient of the operators’ analysis is lower than that of the manufacturers’ analysis for all three kits. Nonetheless, the results still indicate that the DG Rapid kit is the most reliable ICT kit in both manufacturers’ and operators’ analysis.