Test-retest
Agreement or reliability
Bibliographic Data
| ID | 4563709 |
|---|---|
| Authors | André Berchtold (0000-0002-0711-2254, FORS – Swiss Centre of Expertise in the Social Sciences, corresponding author) |
| Year | 2016 |
| Volume | 9 |
| Publication date | 2016-01-01 |
| Peer Reviewed | Yes |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Methodological Innovations (JOURNAL) |
| Journal identifiers | ISSN: 2059-7991 • E-ISSN: 2059-7991 |
| Publisher | SAGE Publications Inc (PUBLISHER) |
| DOI | 10.1177/2059799116672875 |
| OpenAlex | W2530415750 |
| Language | EN |
| Citations received | 27 |
| References cited | 20 |
Test-retest is a concept that is routinely evaluated during the validation phase of many measurement tools. However, this term covers at least two related but very different concepts: reliability and agreement. Reliability is the ability of a measure applied twice upon the same respondents to produce the same ranking on both occasions. Agreement requires the measurement tool to produce twice the same exact values. An analysis of research papers showed that the distinction between both concepts remains anything but clear, and that the current practice is to evaluate reliability only, generally on the basis of the sole Pearson's correlation. This practice is very problematic in the context of longitudinal studies because it becomes difficult to determine whether a difference between two successive observations is attributable to a real change of the respondents or only to the characteristics of the measurement tool, which then leads to a possible misinterpretation of the results. More focus should be given on the real interpretation of linear correlation, and when agreement is required in addition to reliability, then correct alternative, such as the Bland-Altman plot, should be more generally used
Bland–Altman plot · Context (archaeology · Data mining · Geography · Interpretation (philosophy · Limits of agreement · Measure (data warehouse · Nuclear medicine · Ranking (information retrieval · Reliability (semiconductor · Reliability engineering · Statistics · Term (time · Test (biology · Behavioral Health and Interventions · Computer Science · Engineering · Mathematics · Medicine · Psychology · Psychometric Methodologies and Testing · Reliability and Agreement in Measurement · Artificial Intelligence
Basic social justice orientations—measuring order-related justice in the European Social Survey Round 9
Development and psychometric validity evidence of a curriculum-based and adaptive mathematics assessment tool
Here’s the TRIQ
Psychometric properties and correlates of the German version of the Fear of Food Questionnaire
The drug abuse screening test
The Dark Side of Humanity Scale
Subjective versus objective knowledge of online safety/dangers as predictors of children’s perceived online safety and attitudes towards e-safety education in the United Kingdom
The reliability of language-switch costs in bilingual one- and two-digit number naming
Evaluation of two red cell inclusion staining methods for assessing spleen function among sickle cell disease patients in North-East Nigeria
The Food Media Content Gratifications Scale Conceptualization, Development, and Validation
Turkish adaptation, validity and reliability study of the “erlangen team cohesion at work scale”
Development of a balanced instrument to measure global health-related quality of life
Model of goal directed behavior for limiting Latino preschoolers’ television viewing
Validation of the Indonesian resilience evaluation scale in an undergraduate student population
Prevalence and predictors of tobacco use among Saudi adolescents
Comparative analysis of pediatric anxiety measures in clinical sample
Trait-like stability of selfhood triumvirate and its constituent aspects
Surveying drug consumption
The park physical activity questionnaire (Park-PAQ)
What users of global risk indicators should know
Development of Momentary Appetite Capture (MAC)
Towards more reliable survey items
A Standardized Set of 380 Pictures for Lebanese Arabic
The Measurement Properties of Aggregated Relational Data and NSUM-Estimated Network Size
Reliability of test battery
Resolving the test-retest agreement or reliability dilemma
Assessing the visual Q method online research tool
The practice of radiology needs to change
A Concordance Correlation Coefficient to Evaluate Reproducibility
Forming inferences about some intraclass correlation coefficients.
Measuring change over time
The ASA Statement on p -Values
Measurement in Medicine
Computing Inter-Rater Reliability for Observational Data
Statistical Methods for Assessing Agreement Between Two Methods of Clinical Measurement
Can we measure homelessness? A critical evaluation of the method of 'capture-recapture
Stability versus change, dependability versus error
Panel Attrition
| Unique citing works | 27 |
|---|---|
| Citations per year | 3 |
| Citation span | 2017 - 2026 (10) |
| Citation velocity | current |
| Highly cited | No |
| Citation types | Neutral: 27 |