Including Omission Mistakes in the Calculation of Cohen's Kappa and an Analysis of the Coefficient's Paradox Features
Bibliographic Data
| ID | 20282938 |
|---|---|
| Authors | Patricia Simons (0000-0002-3322-6933, University of Regensburg, corresponding author), Patricia Simon (University of Regensburg) |
| Year | 2006 |
| Volume | 66 |
| Issue | 5 |
| Pages | 765-777 |
| Publication date | 2006-10-01 |
| Peer Reviewed | Yes |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Educational and Psychological Measurement (JOURNAL) |
| Journal identifiers | ISSN: 0013-1644 • E-ISSN: 1552-3888 |
| Publisher | SAGE Publications (PUBLISHER • US) |
| DOI | 10.1177/0013164405285548 |
| OpenAlex | W2048839183 |
| Language | EN |
| Citations received | 6 |
| References cited | 16 |
The application range of Cohen's Kappa is extended to the field of sequential observation data, where omission mistakes of an observer may often occur. It is shown how the omission mistakes can be incorporated into the calculation of the Kappa coefficient without violating the statistic it is based on. The enhanced coefficient is termed Kappa Coefficient With Omission Calculation (K woc ). In addition, the so-called paradox features of the Kappa coefficient, the base-rate problem, and the observer bias are discussed. It is shown that, in the case of observation data, these attributes are desirable features of the Kappa coefficient
Coefficient of variation · Cohen's kappa · Geometry · Kappa · Observer (physics) · Physics · Range (aeronautics) · Statistic · Statistics · Advanced Statistical Methods and Models · Hemodynamic Monitoring and Therapy · Mathematics · Reliability and Agreement in Measurement
Observing leadership as behavior in teams and herds – An ethological approach to shared leadership research
Teachers’ direct and indirect promotion of self-regulated learning in primary and secondary school mathematics classes – insights from video-based classroom observations and teacher interviews
Correlates of hepatitis B testing in Ghana
Kappa Coefficients for Missing Data
The Effect of the Raters' Marginal Distributions on Their Matched Agreement
Using Pooled Kappa to Summarize Interrater Agreement across Many Items
Interaction process analysis
Bias, prevalence and kappa
High agreement but low kappa
High agreement but low Kappa
Interaction process analysis
Coefficient Kappa
A Coefficient of Agreement for Nominal Scales
A Coefficient of Agreement for Nominal Scales
Measures of response agreement for qualitative data
Reliability of Content Analysis
Another look at interrater agreement
Diversity of decision-making models and the measurement of interrater agreement
| Unique citing works | 6 |
|---|---|
| Citations per year | 0,33 |
| Citation span | 2008 - 2022 (15) |
| Citation velocity | historical |
| Highly cited | No |
| Citation types | Neutral: 5 |