Interjudge Agreement and the Maximum Value of Kappa
Bibliographic Data
| ID | 20286178 |
|---|---|
| Authors | U N UMESH (0000-0003-0725-0160, Washington State University), Robert A Peterson (0000-0001-8433-4590, The University of Texas at Austin), Matthew H Sauber (0000-0002-2014-2984, Eastern Michigan University) |
| Year | 1989 |
| Volume | 49 |
| Issue | 4 |
| Pages | 835-850 |
| Publication date | 1989-12-01 |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Educational and Psychological Measurement (JOURNAL) |
| Journal identifiers | ISSN: 0013-1644 • E-ISSN: 1552-3888 |
| Publisher | SAGE Publications (PUBLISHER • US) |
| DOI | 10.1177/001316448904900407 |
| OpenAlex | W2166440088 |
| Language | EN |
| Citations received | 7 |
| References cited | 5 |
The observed degree of agreement between judges is commonly summarized using Cohen's (1960) kappa. Previous research has related values of kappa to the marginal distributions of the agreement matrix. This manuscript provides an approach for calculating maximum values of kappa as a function of observed agreement proportions between judges. Solutions are provided separately for matrices of size 2 x 2, 3 x 3, 4 x 4, and k X k; plots are provided for the 2 x 2, 3 x 3, and 4 x 4 matrices
Agreement · Cohen's kappa · Combinatorics · Geometry · Kappa · Matrix (chemical analysis) · Statistics · Value (mathematics) · Chemistry · Delphi Technique in Research · Mathematics · Reliability and Agreement in Measurement · Statistical Methods in Epidemiology
Content-Analysis Research
Validation Guidelines for Is Positivist Research
Sequential Analysis and Observational Methods for the Behavioral Sciences
Web Site Usability, Design, and Performance Metrics
Naturalistic Language Assessment of LEP Students in Classroom Interactions
Inside Transitional Bilingual Classrooms
Virtual Community Attraction
| Citations per year | 0.2 |
|---|---|
| Citation span | 1991 - 2011 (21) |
| Highly cited | No |