Factors affecting intercoder reliability: a Monte Carlo experiment
Author
Abstract
Suggested Citation
DOI: 10.1007/s11135-012-9745-9
Download full text from publisher
As the access to this document is restricted, you may want to search for a different version of it.
References listed on IDEAS
- Matthijs Warrens, 2010. "A Formal Proof of a Paradox Associated with Cohen’s Kappa," Journal of Classification, Springer;The Classification Society, vol. 27(3), pages 322-332, November.
- Quinn McNemar, 1947. "Note on the sampling error of the difference between correlated proportions or percentages," Psychometrika, Springer;The Psychometric Society, vol. 12(2), pages 153-157, June.
- Helena Kraemer, 1979. "Ramifications of a population model forκ as a coefficient of reliability," Psychometrika, Springer;The Psychometric Society, vol. 44(4), pages 461-472, December.
- Janet Rosenbaum, 2010. "Bayesian Methods for Measures of Agreement," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 173(1), pages 270-270, January.
- de Mast, Jeroen, 2007. "Agreement and Kappa-Type Indices," The American Statistician, American Statistical Association, vol. 61, pages 148-153, May.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Matthijs Warrens, 2010. "A Formal Proof of a Paradox Associated with Cohen’s Kappa," Journal of Classification, Springer;The Classification Society, vol. 27(3), pages 322-332, November.
- Uttam Bandyopadhyay & Atanu Biswas & Shirsendu Mukherjee, 2009. "Adaptive two-treatment two-period crossover design for binary treatment responses incorporating carry-over effects," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 18(1), pages 13-33, March.
- Chacón, José E. & Fernández Serrano, Javier, 2024. "Bayesian taut splines for estimating the number of modes," Computational Statistics & Data Analysis, Elsevier, vol. 196(C).
- Matthijs Warrens, 2010. "Inequalities Between Kappa and Kappa-Like Statistics for k×k Tables," Psychometrika, Springer;The Psychometric Society, vol. 75(1), pages 176-185, March.
- Bester Tawona Mudereri & Elfatih M. Abdel-Rahman & Shepard Ndlela & Louisa Delfin Mutsa Makumbe & Christabel Chiedza Nyanga & Henri E. Z. Tonnang & Samira A. Mohamed, 2022. "Integrating the Strength of Multi-Date Sentinel-1 and -2 Datasets for Detecting Mango ( Mangifera indica L.) Orchards in a Semi-Arid Environment in Zimbabwe," Sustainability, MDPI, vol. 14(10), pages 1-23, May.
- Matthijs J. Warrens, 2014. "Power Weighted Versions of Bennett, Alpert, and Goldstein’s," Journal of Mathematics, Hindawi, vol. 2014, pages 1-9, December.
- Nosi, Costanza & D’Agostino, Antonella & Pratesi, Carlo Alberto & Barbarossa, Camilla, 2021. "Evaluating a social marketing campaign on healthy nutrition and lifestyle among primary-school children: A mixed-method research design," Evaluation and Program Planning, Elsevier, vol. 89(C).
- John E. Core, 2010. "Discussion of Chief Executive Officer Equity Incentives and Accounting Irregularities," Journal of Accounting Research, Wiley Blackwell, vol. 48(2), pages 273-287, May.
- Preety Srivastava & Xueyan Zhao, 2010.
"What Do the Bingers Drink? Micro‐Unit Evidence on Negative Externalities and Drinker Characteristics of Alcohol Consumption by Beverage Types,"
Economic Papers, The Economic Society of Australia, vol. 29(2), pages 229-250, June.
- Preety Srivastava, 2010. "What Do the Bingers Drink? Micro-unit Evidence on Negative Externalities and Drinker Characteristics of Alcohol Consumption by Beverage Types," Wine Economics Research Centre Working Papers 2010-07, University of Adelaide, Wine Economics Research Centre.
- Hanousek Jan & Kočenda Evžen & Novotný Jan, 2012.
"The identification of price jumps,"
Monte Carlo Methods and Applications, De Gruyter, vol. 18(1), pages 53-77, January.
- Jan Hanousek & Evzen Kocenda & Jan Novotny, 2011. "The Identification of Price Jumps," CERGE-EI Working Papers wp434, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
- Monnery, Benjamin & Wolff, François-Charles & Henneguelle, Anaïs, 2020.
"Prison, semi-liberty and recidivism: Bounding causal effects in a survival model,"
International Review of Law and Economics, Elsevier, vol. 61(C).
- Benjamin Monnery, 2018. "Prison, Semi-Liberty and Recidivism: Bounding Causal Effects in a Survival Model," Post-Print hal-01900258, HAL.
- Benjamin Monnery & François-Charles Wolff & Anaïs Henneguelle, 2019. "Prison, Semi-Liberty and Recidivism: Bounding Causal Effects in a Survival Model," EconomiX Working Papers 2019-20, University of Paris Nanterre, EconomiX.
- Benjamin Monnery, 2018. "Prison, Semi-Liberty and Recidivism: Bounding Causal Effects in a Survival Model," Post-Print hal-01900259, HAL.
- Benjamin Monnery & François-Charles Wolff & Anaïs Henneguelle, 2019. "Prison, Semi-Liberty and Recidivism: Bounding Causal Effects in a Survival Model," Working Papers hal-04141863, HAL.
- Benjamin Monnery & François-Charles Wolff & Anaïs Henneguelle, 2020. "Prison, Semi-Liberty and Recidivism: Bounding Causal Effects in a Survival Model," Post-Print hal-02423761, HAL.
- Holger Schwender & Margaret A. Taub & Terri H. Beaty & Mary L. Marazita & Ingo Ruczinski, 2012. "Rapid Testing of SNPs and Gene–Environment Interactions in Case–Parent Trio Data Based on Exact Analytic Parameter Estimation," Biometrics, The International Biometric Society, vol. 68(3), pages 766-773, September.
- Matysková, Ludmila & Rogers, Brian & Steiner, Jakub & Sun, Keh-Kuan, 2020.
"Habits as adaptations: An experimental study,"
Games and Economic Behavior, Elsevier, vol. 122(C), pages 391-406.
- Steiner, Jakub & Matyskova, Ludmila & Rogers, Brian & Sun, Keh-Kuan, 2018. "Habits as Adaptations: An Experimental Study," CEPR Discussion Papers 13300, C.E.P.R. Discussion Papers.
- Ludmila Matyskova & Brian Rogers & Jakub Steiner & Keh-Kuan Sun, 2019. "Habits as Adaptations: An Experimental Study," CRC TR 224 Discussion Paper Series crctr224_2019_113, University of Bonn and University of Mannheim, Germany.
- André, Kévin, 2013. "Applying the Capability Approach to the French Education System: An Assessment of the "Pourquoi pas moi ?"," ESSEC Working Papers WP1316, ESSEC Research Center, ESSEC Business School.
- repec:hal:journl:hal-00880246 is not listed on IDEAS
- Matthijs J. Warrens, 2021. "Kappa coefficients for dichotomous-nominal classifications," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 15(1), pages 193-208, March.
- Matthijs Warrens, 2010. "Inequalities between multi-rater kappas," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 4(4), pages 271-286, December.
- Ruiz-Frau, A. & Krause, T. & Marbà, N., 2018. "The use of sociocultural valuation in sustainable environmental management," Ecosystem Services, Elsevier, vol. 29(PA), pages 158-167.
- repec:cup:judgdm:v:8:y:2013:i:3:p:278-298 is not listed on IDEAS
- Shaub, David, 2020. "Fast and accurate yearly time series forecasting with forecast combinations," International Journal of Forecasting, Elsevier, vol. 36(1), pages 116-120.
- AlMalki, Hameeda A. & Durugbo, Christopher M., 2023. "Evaluating critical institutional factors of Industry 4.0 for education reform," Technological Forecasting and Social Change, Elsevier, vol. 188(C).
- Guevara, C. Angelo & Fukushi, Mitsuyoshi, 2016. "Modeling the decoy effect with context-RUM Models: Diagrammatic analysis and empirical evidence from route choice SP and mode choice RP case studies," Transportation Research Part B: Methodological, Elsevier, vol. 93(PA), pages 318-337.
More about this item
Keywords
Intercoder reliability; Prevalence; Simulation;All these keywords.
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:qualqt:v:47:y:2013:i:5:p:2959-2982. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.