Home|Journals Follow on Twitter| Subscribe to List

Directory for Medical Articles

Open Access

Original Research

Ann Med Res. 2012; 19(4): 220-227

Comparison of Agreement Statistics in Case of Multiple-Raters and Diagnostic Test Being Categorical: A Simulation Study

E. Arzu Kanýk1, GĂĽlhan Ă–rekici Temel1, Semra Erdođan1, Ýrem Ersöz Kaya2



Aim: When the number of raters and the number of categories of diagnostic tests are two or more, put forward agreement statistics’ conditions of being affected by the sample size, the number of raters and the number of categories of scale used. Material and Methods: AC1 statistic, Fleiss Kappa and Krippendorff’s Alpha values belonging to state where there was no agreement between raters and states where agreement was 0.90 for those combinations were recorded for 1000 simulation study. Results: The expected agreement between raters is 0.90, AC1 statistic and Fleiss Kappa coefficient offer similar results and take equivalent values, to the expected value of agreement in all combinations. When Krippendorff’s Alpha coefficient examined, it is not affected by sample size but affected by the number of raters and the number of categories pertaining to diagnostic test. Conclusion: If prevalence value is known and a bear significant for study, use of AC1 statistic is recommended among agreement statistics, if the existence of missing data is the case in study, Krippendorff’s Alpha coefficient is the most appropriate agreement statistic, except these cases mentioned, use of Fleiss Kappa coefficient is recommended. Key Words: Fleiss Kappa; Gwet’s AC1 Statistics; Krippendorff Alpha; Agreement between Raters.

Share this Article

American Journal of Preventive Medicine and Public Health


BiblioMed Home
Follow ScopeMed on Twitter
Author Tools
eJPort Journal Hosting
About BiblioMed
License Information
Terms & Conditions
Privacy Policy
Contact Us

The articles in Bibliomed are open access articles licensed under the terms of the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License (https://creativecommons.org/licenses/by-nc-sa/4.0/) which permits unrestricted, non-commercial use, distribution and reproduction in any medium, provided the work is properly cited.
ScopeMed is a Database Service for Scientific Publications. Copyright © ScopeMed® Information Services.