Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Measurement error in psychological research

Lessons from 26 research scenarios.

Bibliographic Data

ID23339804
AuthorsFrank L Schmidt (0000-0002-0927-8418, University of Iowa), J E Hunter (0000-0002-9693-2878)
Year1996
Volume1
Issue2
Pages199-223
Publication date1996-06-01
Peer ReviewedYes
Open AccessNo
TypeARTICLE
VenuePsychological Methods (JOURNAL)
Journal identifiersISSN: 1082-989X • E-ISSN: 1939-1463
PublisherAmerican Psychological Association (APA) (PUBLISHER)
DOI10.1037/1082-989x.1.2.199
OpenAlexW2051130243
LanguageEN
Citations received115
References cited7

technical principles to concrete research problems that appear in a wide variety of forms and with a myriad of obscuring features, details, and idiosyncracies. This article is based on a different approach: examination of a series of concrete research scenarios that we have encountered in our work as researchers, advisors to researchers, or reviewers. This article examines 26 real-world case studies and explicates them on the basis of the principles of reliability theory found in Cronbach (1947, 1951) and Cronbach et al. (1972). Although we cite and rely on these sources, other sources (e.g., Thorndike, 1951) would yield identical resolutions; only the terminology would be sometimes (slightly) different. In classical measurement theory, the fundamental general formula for the observed correlation between any two measures, x and y, is yields the dissattenuation formula

Econometrics · Psychometrics · Statistical analysis · Statistics · Applied Psychology · Behavioral and Psychological Studies · Clinical Psychology · Mathematics · Psychological Testing and Assessment · Psychology · Psychometric Methodologies and Testing

  • Dirty dishes or dirty laundry? Comparing two methods for quantifying American consumers' preferences for load management in a smart home

    Open Access•Patricia A Aloise‐Young, Salvador Lurbé et al.•Energy Research & Social Science•2020

  • Familywise Error in Multiple Comparisons

    Masaki Matsunaga•Communication Methods and Measures•2007

  • The jingle and jangle of emotion assessment

    Aaron C Weidman, Conor M Steckler et al.•Emotion•2016

  • "Causes" Of Pesticide Safety Behavior Change in Latino Farmworker Families

    J G Grzywacz, T A Arcury et al.•American Journal of Health Behavior•2013

  • Statistical significance testing and cumulative knowledge in psychology

    Frank L Schmidt•Psychological Methods•1996

  • Cumulative research knowledge and social policy formulation

    J E Hunter, Frank L Schmidt•Psychology Public Policy and Law•1996

  • Evaluating the validity of brief prototype‐based informant ratings of triarchic psychopathy traits in prisoners

    Open Access•Kelsey L Lowman, Christopher J Patrick et al.•Behavioral Sciences & the Law•2021

  • Individual differences in rational thought.

    Keith E Stanovich, Richard F West•Journal of Experimental…•1998

  • The validity of the multi-informant approach to assessing child and adolescent mental health

    Open Access•Andres De Los Reyes, Tara M Augenstein et al.•Psychological Bulletin•2015

  • Stability and change of personality traits, self-esteem, and well-being

    Ivana Anusic, Ulrich Schimmack•Journal of Personality and Social…•2016

  • What is being assessed and why it matters

    Michael Chmielewski, Michael S Chmielewski et al.•Journal of Personality and Social…•2009

  • Religion and the Forgiving Personality

    Open Access•Michael E Mccullough, Everett L Worthington et al.•Journal of Personality•1999

  • Contents and Correlates of Whites' and Blacks' Racial Attitudes

    Open Access•Margo J Monteith, C Vincent Spicer•Journal of Experimental Social…•2000

  • Invariance of the Measurement Model Underlying the Wechsler Adult Intelligence Scale-IV in the United States and Canada

    Open Access•Stephen C Bowden, Donald H Saklofske et al.•Educational and Psychological…•2011

  • Developmental change in the acuity of approximate number and area representations

    Darko Odic, Melissa E Libertus et al.•Developmental Psychology•2013

  • The Meta-Analysis of Clinical Judgment Project

    Open Access•Paul M Spengler, Michael J White et al.•The Counseling Psychologist•2007

  • Meta‐Analysis

    Open Access•Frank L Schmidt•Handbook of Psychology, Second…•2012

  • Clinical Versus Mechanical Prediction

    Open Access•Paul M Spengler•Handbook of Psychology, Second…•2012

  • Well-Being for Public Policy

    Ed Diener, Richard E Lucas et al.•Well-being for public policy•2009

  • The Essential Guide to Effect Sizes

    Open Access•Paul D Ellis•Essential Guide to Effect Sizes•2010

  • The relationship of age to ten dimensions of job performance.

    Thomas W H Ng, Daniel C Feldman•Journal of Applied Psychology•2008

  • Turnover rates and organizational performance

    Tae-Youn Park, Jennie Deo Shaw et al.•Journal of Applied Psychology•2013

  • Reliability from α to ω

    Open Access•William Revelle, David M Condon•Psychological Assessment•2019

  • Role of social desirability in personality testing for personnel selection

    Deniz S Ones, Chockalingam Viswesvaran et al.•Journal of Applied Psychology•1996

  • Uses and abuses of coefficient alpha.

    Neal Schmitt•Psychological Assessment•1996

  • A Monte Carlo Simulation of Observable Versus Latent Variable Structural Equation Modeling Techniques

    Open Access•Michael T Stephenson, R L Holbert•Communication Research•2003

  • The problem of empirical redundancy of constructs in organizational research

    Open Access•Huy Le, Frank L Schmidt et al.•Organizational Behavior and Human…•2010

  • Coefficient Alpha

    Open Access•Yanyun Yang, Yanyun Yang Yanyun Yang et al.•Journal of Psychoeducational…•2011

  • Personality and leadership

    Timothy A Judge, Joyce E Bono et al.•Journal of Applied Psychology•2002

  • Transgression-Related Motivational Dispositions

    Open Access•Michael E Mccullough, William T Hoyt•Personality and Social Psychology…•2002

  • The Convergent Validity between Self and Observer Ratings of Personality

    Open Access•James J T Connolly, James J Connolly et al.•International Journal of…•2007

  • Self-report multicultural counseling competence scales

    Madonna G Constantine, Nicholas Ladany•Journal of Counseling Psychology•2000

  • Five-factor model of personality and job satisfaction

    Timothy A Judge, Daniel Heller et al.•Journal of Applied Psychology•2002

  • An Overview of Coefficient Alpha and a Reliability Matrix for Estimating Adequacy of Internal Consistency Coefficients with Psychological Research Measures

    Open Access•Joseph G Ponterotto, Daniel E Ruckdeschel•Perceptual and Motor Skills•2007

  • Measuring Belief in Conspiracy Theories

    Open Access•Anthony Lantian, Dominique Muller et al.•International Review of Social…•2016

  • Business-unit-level relationship between employee satisfaction, employee engagement, and business outcomes

    James K Harter, Frank L Schmidt et al.•Journal of Applied Psychology•2002

  • A meta-analytic review of occupational commitment

    Kibeom Lee, Julie J Carswell et al.•Journal of Applied Psychology•2000

  • Deliberate Practice and Performance in Music, Games, Sports, Education, and Professions

    Open Access•Brooke N Macnamara, David Z Hambrick et al.•Psychological Science•2014

  • Moral Virtues, Fairness Heuristics, Social Entities, and Other Denizens of Organizational Justice

    Open Access•Russell Cropanzano, Zinta S Byrne et al.•Journal of Vocational Behavior•2001

  • Objective Light-Intensity Physical Activity Associations With Rated Health in Older Adults

    Matthew P Buman, Eric B Hekler et al.•American Journal of Epidemiology•2010

  • Predicting and Explaining Intentions and Behavior

    Open Access•Susan Sutton, Stephen Sutton•Journal of Applied Social…•1998

  • Climate for Creativity

    Samuel T Hunter, Katrina E Bedell et al.•Creativity Research Journal•2007

  • Understanding attitudes toward affirmative action programs in employment

    David A Harrison, David A Kravitz et al.•Journal of Applied Psychology•2006

  • A Review and Synthesis of the Measurement Invariance Literature

    Open Access•Robert J Vandenberg, Charles E Lance•Organizational Research Methods•2000

  • The Moderating Effects of Age in the Relationships of Job Autonomy to Work Outcomes

    Tst Ng, T W H Ng et al.•Work Aging and Retirement•2014

  • On the Integrity of Reliability Estimation in Classical Test Theory

    Gilbert Becker•Psychological Reports•2008

  • Meta-Analysis in Organizational Research

    Open Access•Scott B Morris•Annual Review of Organizational…•2022

  • Controlling Decremental and Inflationary Effects in Reliability Estimation Resulting from Violations of Assumptions

    Open Access•Gilbert Becker•Psychological Reports•2001

  • Factor Analysis to Examine Psychometric Properties of Family Functioning Measures

    Nikki Bellamy•Psychological Reports•2006

  • On the Integrity of Reliability Estimation in Classical Test Theory

    Open Access•Gilbert Becker•Psychological Reports•2008

  • Factor Analysis to Examine Psychometric Properties of Family Functioning Measures

    Open Access•Nikki Bellamy, Resa F Matthew et al.•Psychological Reports•2006

  • Controlling Decremental and Inflationary Effects in Reliability Estimation Resulting From Violations of Assumptions

    Gilbert Becker•Psychological Reports•2001

  • A Brief Introduction to Unified Test Theory

    Gilbert Becker•Psychological Reports•2003

  • On the Far Reaching Effects of Using Biased Estimates of Score Reliability

    Open Access•Gilbert Becker•Psychological Reports•2001

  • Invariance of the Measurement Model Underlying the Wechsler Adult Intelligence Scale—III in the United States and Canada

    Open Access•Stephen C Bowden, Rael T Lange et al.•Educational and Psychological…•2008

  • On the Far Reaching Effects of Using Biased Estimates of Score Reliability

    Gilbert Becker•Psychological Reports•2001

  • Coefficient Alpha

    Open Access•Gilbert Becker•Psychological Reports•2000

  • A Brief Introduction to Unified Test Theory

    Open Access•Gilbert Becker•Psychological Reports•2003

  • On the problems of construct proliferation and redundancy

    Open Access•Brian Manata, Franklin J Boster et al.•Communication Monographs•2026

  • Equal Precision Measurement Structural Models

    Phillip K Wood, Wolfgang Wiedermann et al.•Structural Equation Modeling: A…•2023

  • Preference for and tolerance of the intensity of exercise questionnaire (PRETIE-Q)

    Open Access•Diogo Teixeira, P Ekkekakis et al.•Current Psychology•2023

  • Perceptions of Justice in Clinical Learning Environments

    Open Access•Michael J Cullen, Jessica Hane et al.•Academic Medicine•2024

  • Differences in Trainee Evaluations of Faculty by Rater and Ratee Gender

    Open Access•Michael J Cullen, You Zhou et al.•Academic Medicine•2023

  • Evidence on the Dimensionality and Reliability of Professional References’ Ratings of Teacher Applicants

    Open Access•Dan Goldhaber, Cyrus Grout et al.•Economics of Education Review•2021

  • Whose Words Hurt? Contextual Determinants of Offensive Speech

    Open Access•Manuel Almagro, Ivar R Hannikainen et al.•Personality and Social Psychology…•2022

  • Estimating the Reliability and Stability of Cognitive Processes Contributing to Responses on the Implicit Association Test

    Open Access•Jacob Elder, Liz Wilson et al.•Personality and Social Psychology…•2024

  • Character, contact, and stigma reduction

    Rachel A Smith, Ruth A Osoro et al.•Journal of Applied Communication…•2024

  • Methodological challenges and insights for future international business research

    Open Access•Herman Aguinis, Donald Bergh et al.•Journal of International Business…•2023

  • Decision-Making Styles in Medical Students and Healthcare Professionals

    Martin Sedlár, Jitka Gurňáková•The Journal of Psychology•2025

  • Dimensionality, Item Response Theory, Effect Size Attenuation, and Test Bias Analyses of the Self-Importance of Moral Identity Scale (Simis)

    Paul K Lutz, Brian P O’connor et al.•Journal of Personality Assessment•2022

  • Estimating Item Wording Effects in Self-Report Measures with Generalizability Theory-Based SEMs

    Walter P Vispoel, Hyeri Hong et al.•Journal of Personality Assessment•2026

  • Face recognition's practical relevance

    Open Access•Laura M Engfors, Jeremy Wilmer et al.•Cognition•2024

  • The Influences of Video Gaming on US Children's Moral Reasoning About Violence

    Edward T Vieira, Marina Krcmar•Journal of Children and Media•2011

  • Overqualification and Selection in Leadership Training

    Open Access•Saul Fine•Journal of Leadership &…•2007

  • An empirical validation study of Spolsky's language policy model

    Victoria Van Oss, Piet Van Avermaet et al.•Current Issues in Language Planning•2021

  • To prosper, organizational psychology should … overcome methodological barriers to progress

    Open Access•Jeffrey R Edwards•Journal of Organizational Behavior•2008

  • Thriving at work

    Open Access•Anne-Kathrin Kleine, Cort W Rudolph et al.•Journal of Organizational Behavior•2019

  • A meta‐analysis of the interrelationships between employee lateness, absenteeism, and turnover

    Open Access•Christopher M Berry, Ariel M Lelchook et al.•Journal of Organizational Behavior•2011

  • Influence tactics and work outcomes

    Open Access•Chad A Higgins, Timothy A Judge et al.•Journal of Organizational Behavior•2002

  • The need for work

    Open Access•Karsten I Paul, Bernad Batinic•Journal of Organizational Behavior•2009

  • Self-Care and Quality of Life

    Nicole Nicotera, In Young Park et al.•Journal of Teaching in Social Work•2023

  • Preschool Self-Regulation Assessment (PSRA)

    Endam Düzyol Türk, Özen Yıldırım•Measurement and Evaluation in…•2026

  • False Positives in Multiple Regression

    Open Access•Benjamin R Shear, Bruno D Zumbo•Educational and Psychological…•2013

  • Bootstrapped Deattenuated Correlation

    Open Access•Miguel A Padilla, Anna Veprinsky•Educational and Psychological…•2014

  • Multiple Approaches to Analyzing Count Data in Studies of Individual Differences

    Open Access•Michael C Sturman•Educational and Psychological…•1999

  • Reliability Generalization

    Johanna E Nilsson, Christa K Schmidt et al.•Educational and Psychological…•2002

  • Measurement Error in “Big Five Factors” Personality Assessment

    Open Access•Chockalingam Viswesvaran, Deniz S Ones•Educational and Psychological…•2000

  • Correlation Attenuation Due to Measurement Error

    Open Access•Miguel A Padilla, Anna Veprinsky•Educational and Psychological…•2012

  • Correcting for Measurement Error Attenuation in Structural Equation Models

    Open Access•Arthur G Bedeian, David V Day et al.•Educational and Psychological…•1997

  • Evaluating Job Demands and Control Measures for Use in Farm Worker Health Surveillance

    Open Access•Toni Alterman, Susan Gabbard et al.•Journal of Immigrant and Minority…•2014

  • Facets of visual aesthetics

    Open Access•Morten Moshagen, Meinald T Thielsch•International Journal of…•2010

  • Enhancing skill practice and feedback in a higher education teacher training course using the online flipped teaching in Taiwan

    Open Access•Hui-Ting Wang, Hui‐Ting Wang et al.•Teaching and Teacher Education•2025

  • Facets of Website Content

    Meinald T Thielsch, Gerrit Hirschfeld•Human-Computer Interaction•2018

  • Evaluating Contextual Models for Intensive Longitudinal Data in the Presence of Noise

    Open Access•Anja F Ernst, Eva Ceulemans et al.•Multivariate Behavioral Research•2025

  • Loneliness and Personality

    Open Access•Paddy Maher, Yavor Dragostinov et al.•Journal of Personality•2026

  • Marriage Matters

    Open Access•Joshua N Hook, Everett L Worthington et al.•Pastoral Psychology•2011

  • The job satisfaction–job performance relationship

    Timothy A Judge, Carl J Thoresen et al.•Psychological Bulletin•2001

  • The Affective Underpinnings of Job Perceptions and Attitudes

    Carl J Thoresen, Seth A Kaplan et al.•Psychological Bulletin•2003

  • Multicultural experience

    Open Access•Zeynep G Aytug, Mary C Kern et al.•International Journal of…•2018

  • A multi-informant study of the influence of targets’ and perceivers’ social desirability on self-other agreement in ratings of the Hexaco personality dimensions

    Open Access•Marcus Roth, Tobias Altmann•Journal of Research in Personality•2019

  • Statistical Theories of Mental Test Scores

    Frederic M Lord, Melvin R Novick•Statistical Theories of Mental…•2008

  • Personnel selection in organizations

    Neal Schmitt, Walter C Borman•Personnel selection in…•1992

  • The Dependability of behavioral measurements

    Lee J Cronbach•The Dependability of behavioral…•1972

  • Methods of Meta-Analysis

    Frank L Schmidt, J E Hunter•Methods of Meta-Analysis•2015

  • Retranslation of expectations

    Patricia C Smith, Lorne M Kendall•Journal of Applied Psychology•1963

  • What do data really mean? Research findings, meta-analysis, and cumulative knowledge in psychology

    Frank L Schmidt•American Psychologist•1992

  • Coefficient alpha and the internal structure of tests

    Open Access•Lee J Cronbach•Psychometrika•1951

Unique citing works115
Citations per year3,83
Citation span1996 - 2026 (31)
Citation velocitycurrent
Highly citedYes
Citation typesNeutral: 99

Tools

Open DOISci-Hub
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae