Weighted kappa
Nominal scale agreement provision for scaled disagreement or partial credit
Bibliographic Data
| ID | 4423409 |
|---|---|
| Authors | Jacob Cohen (0000-0003-2862-6550, corresponding author) |
| Year | 1968 |
| Volume | 70 |
| Issue | 4 |
| Pages | 213-220 |
| Publication date | 1968-01-01 |
| Peer Reviewed | Yes |
| Open Access | No |
| Type | ARTICLE |
| Venue | Psychological Bulletin (JOURNAL) |
| Journal identifiers | ISSN: 0033-2909 • E-ISSN: 1939-1455 |
| Publisher | American Psychological Association (APA) (PUBLISHER) |
| DOI | 10.1037/h0026256 |
| PMID | 19673146 |
| OpenAlex | W2037789405 |
| Language | EN |
| Citations received | 665 |
| References cited | 7 |
A previously described coefficient of agreement for nominal scales, kappa, treats all disagreements equally. A generalization to weighted kappa (Kw) is presented. The Kw provides for the incorpation of ratio-scaled degrees of disagreement (or agreement) to each of the cells of the k * k table of joi
Actuarial science · Agreement · Cohen's kappa · Econometrics · Economics · Kappa · Level of measurement · Physics · Scale (ratio) · Statistics · Delphi Technique in Research · Mathematics · Meta-analysis and systematic reviews · Psychology · Reliability and Agreement in Measurement
Molar crenulation trait definition and variation in modern human populations
When to diversify, and with whom? Choosing partners among out-group strangers in lowland Bolivia
Neonatal interactions in pig-tailed macque (M. nemestrina) dyads
Families' Response to Aids
Evaluation of discriminant functions for sexing skulls from visually assessed traits applied in the Rainer Osteological Collection (Bucharest, Romania)
Sex Differences in Bilateral Asymmetry Among Hunter‐Gatherers From the Lower Paraná River Wetlands (Argentina)
Inter-annotator agreement in spoken language annotation
Local Governments Leverage Selfie Culture with #CityHallSelfie Campaign
Assumptions behind Intercoder Reliability Indices
Does the Duration of Each Waldenström Stage Affect the Final Outcome of Legg–Calvé–Perthes Disease Onset before 6 Years of Age
Effects of Maternal Depression and Sensitivity on Infant Emotion Regulation
Associations between maternal control and child defiance among Puerto Rican-origin adolescent mothers and their toddlers
Making sense of posttraumatic stress disorder
Improving the Assessment of Childhood Adversity
Computer-Assisted Topic Classification for Mixed-Methods Social Science Research
Validation of a Complementary Food Frequency Questionnaire to assess infant nutrient intake
Analysis of game actions in professional male padel
Reliability and Validity of Six Selected Observational Methods for Risk Assessment of Hand Intensive and Repetitive Work
Development of the Web-Based Spanish Version of the Barthel Index in Patients with Multiple Sclerosis
Cohen’s Kappa Coefficient as a Measure to Assess Classification Improvement following the Addition of a New Marker to a Regression Model
Quantification of the Ecological Value of Railroad Development Areas Using Logistic Regression Analysis
Measurement Approaches to Partnership Success
Factors that influence SBIRT implementation in non-medical settings
Investigating appraisal-driven facial expression and inference in emotion communication
Pengajaran Sarana Kohesi dalam Proses Penulisan Karangan
Estrategias de evaluación mediadas por las tecnologías de la información y comunicación (TIC)
Use patterns of natural resources supporting livelihoods of smallholder communities and implications for climate change adaptation in Zimbabwe
The influence of cultural orientation on associations between Puerto Rican adolescent mothers’ parenting and toddler compliance and defiance
Minding the (Information) Gap
Parent and Teen Agreement on Driving Expectations Prior to Teen Licensure
A New Autopsy Interview for the Assessment of Factors Potentially Related to Death in Depressed Medical Patients
Couple therapy and the developmental phase of couple relations with students
Observação das interacções educador-criança
La Evolución Programática De Los Partidos Chilenos 1970-2009
The Information Value of Fomc Meeting Notes and Policy Directives
Mealtime behaviors associated with consumption of unfamiliar foods by young children with autism spectrum disorder
Does Inservice Training Make a Difference
A standardized psychiatric interview for use in community surveys
Triagem neonatal para hemoglobinopatias
Material Parenting
The Supreme Court and Federal Administrative Agencies
Some Models for the Multiway Contingency Table with a One-to-One Correspondence among Categories
Encarcelamiento, lazos familiares y reincidencia. Explorando los límites del familismo
Large sample variance of kappa in the case of different sets of raters
Effects of deficient reporting on meta-analysis
Measuring nominal scale agreement among many raters
Modeling ordinal scale disagreement
Comparison of sequences
Measures of response agreement for qualitative data
Large sample standard errors of kappa and weighted kappa
Measuring Physician Behavior
Measuring Functional Outcomes in Chronic Disease
A Computer Consultation Program for Primary Care Physicians Impact of Decisionmaking Model and Explanation Capability
Barriers to Colorectal Cancer Screening
The Abbreviated Injury Scale and Injury Severity Score
Openness to experience, identity flexibility, and life change in adults
Motivation gains of inferior group members
Trait interrelations in implicit personality theories and questionnaire data
The relationship between materialism and personal well-being
Attributions and attribution–behavior relations
Subjective agreement with the presidential candidates of 1976 and 1980
The process of brainstorming
The Situational Eight DIAMONDS
Subsistence Economy, Family Structure, and the Status of the Elderly
A New Approach to the Measurement of Patients' Understanding of What They Are Told in Medical Consultations
Tau-b or Not Tau-b
The Effects of Initially Misclassified Data on the Effectiveness of Discriminant Function Analysis and Finite Mixture Modeling
Previously institutionalized toddlers’ social and emotional competence and kindergarten adjustment
Marital quality and gender differences in parent-child interaction
Behavior-state matching and synchrony in mother-infant interactions of nondepressed versus depressed dyads
Friendship and aggressiveness as determinants of conflict outcomes in middle childhood
Sex-related strategies for coping with interpersonal conflict in children aged five and seven
Social interaction skills and theory of mind in young children
Identity development in the late twenties
Infant arousal in an en-face exchange with a new partner
Expressive control during a disappointment
Social impact and social preference as determinants of children's peer group status
Reliability of reviews for the American Psychologist
Stressful life events and perceived parental control in formerly homeless families
A contextually relevant approach to assessing health risk behavior in a rural sub-Saharan Africa setting
A Comprehensive Study on the Role of Healthcare Providers in Influencing Patients' Health Behaviour in China
Critical points in the views of G7’s country leaders on national agendas for SDGs and SFDRR
Toward Computational Model of Emotion from Individual Difference in Perceiving Facial Expressions
Resampling Permutation Probability Values for Weighted Kappa
Weighted Specific-Category Kappa Measure of Interobserver Agreement
Talking to the Dead in the Classroom
Test-Retest Reliability of Self-Reported Substance Use and Sexual Risk Behavior Among at-Risk Adolescents
Resampling Permutation Probability Values for Weighted Kappa
The Use of Chance Corrected Percentage of Agreement to Interpret the Results of a Discriminant Analysis
A Latent-Variable Modeling Approach Toassessing Interrater Reliability, Topic Generalizability, and Validity of a Content Assessment Scoring Rubric
Empirical methods for bioethics
The Measurement of Observer Agreement for Categorical Data
Genetics of Personality
Human Factors in Privacy Research
The Handbook of Research Synthesis and Meta-Analysis
Sequential Analysis and Observational Methods for the Behavioral Sciences
Best Practices in Quantitative Methods
Evaluating transdisciplinary science
Evolutionary Personality Psychology
Media Legitimation Effects in the Market for Initial Public Offerings.
| Unique citing works | 665 |
|---|---|
| Citations per year | 11,67 |
| Citation span | 1969 - 2026 (58) |
| Citation velocity | current |
| Highly cited | Yes |
| Citation types | Neutral: 586 |