Computer Programs for Assessing Rater Agreement and Rater Bias for Qualitative Data
Bibliographic Data
| ID | 20282901 |
|---|---|
| Authors | Domenic V Cicchetti (Veterans Administration Hospital West Haven, Connecticut), Sandra L Aivano (Yale University), Joseph Vitale (Yale University), Joseph N Vitale (0000-0003-3837-6161, Yale University) |
| Year | 1977 |
| Volume | 37 |
| Issue | 1 |
| Pages | 195-201 |
| Publication date | 1977-04-01 |
| Peer Reviewed | Yes |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Educational and Psychological Measurement (JOURNAL) |
| Journal identifiers | ISSN: 0013-1644 • E-ISSN: 1552-3888 |
| Publisher | SAGE Publications (PUBLISHER • US) |
| DOI | 10.1177/001316447703700120 |
| OpenAlex | W2047160353 |
| Language | EN |
| Citations received | 7 |
| References cited | 9 |
The programs described compute rater agreement and rater bias statistics with qualitative data. They also utilize techniques for (a) selecting the most reliable from a set of raters and (b) identifying those cases which are the most diflicult for raters to classify
Agreement · Data set · Developmental psychology · Inter-rater reliability · Qualitative property · Rating scale · Set (abstract data type) · Statistics · Computer Science · Mathematics · Meta-analysis and systematic reviews · Psychology · Reliability and Agreement in Measurement · Statistical Methods in Epidemiology
The reliability of peer review for manuscript and grant submissions
A Computer Program for Assessing Specific Category Rater Agreement for Qualitative Data
A Computer Program for Determining the Significance of the Difference Between Pairs of Independently Derived Values of Kappa or Weighted Kappa
A Computer Program for Measuring Levels of Overall and Partial Congruence Among Multiple Observers on Nominal Scales
A Computer Program for Assessing the Reliability of Nominal Scales Using Varying Sets of Multiple Raters
The Efficiency of Various Estimations of Reliability of Rating Scales
The Quantification of Violence Scale
Note on the Sampling Error of the Difference Between Correlated Proportions or Percentages
A Computer Program for Assessing the Reliability and Systematic Bias of Individual Measurements1
A Coefficient of Agreement for Nominal Scales
The Brief Psychiatric Rating Scale
Large sample standard errors of kappa and weighted kappa
Weighted kappa
| Unique citing works | 7 |
|---|---|
| Citations per year | 0,15 |
| Citation span | 1978 - 2007 (30) |
| Citation velocity | historical |
| Highly cited | No |
| Citation types | Neutral: 7 |