A Note on the Reliability of Ranked Items
Bibliographic Data
| ID | 10941553 |
|---|---|
| Authors | Dawn Vanleeuwen (0000-0002-9347-4517, New Mexico State University, corresponding author), DAWN M VANLEEUWEN (New Mexico State University), KEITH H MANDABACH (New Mexico State University) |
| Year | 2002 |
| Volume | 31 |
| Issue | 1 |
| Pages | 87-105 |
| Publication date | 2002-08-01 |
| Peer Reviewed | Yes |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Sociological Methods & Research (JOURNAL) |
| Journal identifiers | ISSN: 0049-1241 • E-ISSN: 1552-8294 |
| Publisher | SAGE Publications (PUBLISHER • US) |
| DOI | 10.1177/0049124102031001004 |
| OpenAlex | W2061386913 |
| Language | EN |
| Citations received | 5 |
| References cited | 12 |
Instruments may be designed to use either Likert-type items (ratings) or ranks to obtain priority rankings of items. Models commonly used in generalizability theory (GT) provide a basis for assessing the reliability of item measurements based on ratings. However, these commonly used models do not apply when respondents are required to rank a set of items. Unlike ratings, ranks force subject effects to zero. Furthermore, ranks violate independence assumptions, and the dependence between ranks assigned to different items affects the standard error of item mean differences and, consequently, the reliability of the item comparisons. A GT analysis for ranked items is presented and used to derive standard errors for differences between item means as well as an item measurement reliability coefficient. This analysis uses a linear model that is not typically used in GT analyses but that models those features unique to ranks
Econometrics · Generalizability theory · Independence (probability theory · Item analysis · Item response theory · Likert scale · Psychometrics · Rank (graph theory · Reliability (semiconductor · Set (abstract data type · Standard error · Statistics · Computer Science · Mathematics · Multi-Criteria Decision Making · Psychology · Psychometric Methodologies and Testing
Analysis of the Perception of the department of Tourism and Hotel Management Associate Degree Students about the Concept of
Survey Data Collection and Integration
Line Worker, Supervisor, and Manager Perceptions of Supervisory Practices and Tasks in Child Welfare
Sex is power belief and women’s mental health
Examining Objectification Theory
Rank Transformations as a Bridge between Parametric and Nonparametric Statistics
The Calculation of Reliability From a Split-Plot Factorial Design
Comparison of Rated and Ranked Health and Lifestyle Values
Estimating the Reliability of Aggregate-Level Variables Based on Individual-Level Characteristics
The Measurement of Personal Values in Survey Research
The Measurement of Values in Surveys
The Factor Analysis of Ipsative Measures
| Unique citing works | 5 |
|---|---|
| Citations per year | 0.26 |
| Citation span | 2007 - 2021 (15) |
| Citation velocity | historical |
| Highly cited | No |
| Citation types | Neutral: 5 |