Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

The Attack of the Psychometricians

Bibliographic Data

ID23323969
AuthorsDenny Borsboom (0000-0001-9720-4162, Amsterdam University of Applied Sciences, corresponding author)
Year2006
Volume71
Issue3
Pages425-440
Publication date2006-09-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenuePsychometrika (JOURNAL)
Journal identifiersISSN: 0033-3123 • E-ISSN: 1860-0980
PublisherCambridge University Press (CUP) (PUBLISHER)
DOI10.1007/s11336-006-1447-6
PMID19946599
PMCIDPMC2779444
OpenAlexW2141730267
LanguageEN
Citations received95
References cited53

This paper analyzes the theoretical, pragmatic, and substantive factors that have hampered the integration between psychology and psychometrics. Theoretical factors include the operationalist mode of thinking which is common throughout psychology, the dominance of classical test theory, and the use of “construct validity” as a catch-all category for a range of challenging psychometric problems. Pragmatic factors include the lack of interest in mathematically precise thinking in psychology, inadequate representation of psychometric modeling in major statistics programs, and insufficient mathematical training in the psychological curriculum. Substantive factors relate to the absence of psychological theories that are sufficiently strong to motivate the structure of psychometric models. Following the identification of these problems, a number of promising recent developments are discussed, and suggestions are made to further the integration of psychology and psychometrics.

Construct (python library) · Construct validity · Identification (biology) · Item response theory · Psychometrics · Test theory · Advanced Statistical Modeling Techniques · Clinical Psychology · Computer Science · Psychology · Psychometric Methodologies and Testing · Statistics Education and Methodologies

  • Holding on to our functional roots when exploring new intellectual islands

    Open Access•Sean Hughes, Dermot Barnes-Holmes et al.•Journal of Contextual Behavioral…•2012

  • Evidências De Validade Interna Da Escala De Regulação Interna No Esporte

    Open Access•Eduarda Miranda Peixoto, Evandro Morais Peixoto et al.•Pensar a Prática•2018

  • Exploring the various interpretations of “test bias”

    Russell T Warne, Myeongsun Yoon et al.•Cultural Diversity & Ethnic…•2014

  • The relationship between telework and job characteristics

    Open Access•Julian Schulze, Stefan Krumm et al.•Applied Psychology•2024

  • Are patient-centered constructs measurable?

    Open Access•Leah McClimans•Studies in History and Philosophy…•2026

  • Methodological issues in the validation of implicit measures

    Bertram Gawronski, Etienne P Lebel et al.•Psychological Bulletin•2009

  • Implicit measures

    Jan De Houwer, Sarah Teige-Mocigemba et al.•Psychological Bulletin•2009

  • A meta-analysis of procedures to change implicit measures

    Open Access•Patrick S Forscher, Calvin K Lai et al.•Journal of Personality and Social…•2019

  • Development of identity clarity and content in adulthood

    Open Access•Jennifer Lodi-Smith, Seth M Spain et al.•Journal of Personality and Social…•2017

  • The Rasch Rating Model and the Disordered Threshold Controversy

    Open Access•Raymond J Adams, Margaret Wu et al.•Educational and Psychological…•2012

  • Formulating the Rasch Differential Item Functioning Model Under the Marginal Maximum Likelihood Estimation Context and Its Comparison With Mantel–Haenszel Procedure in Short Test and Small Sample Conditions

    Open Access•Insu Paek, Mark Wilson•Educational and Psychological…•2011

  • On the Relationship Between Differential Item Functioning and Item Difficulty

    Open Access•Maria Veronica Santelices, Mark Wilson•Educational and Psychological…•2012

  • Measurement invariance of big-five factors over the life span

    Herbert W Marsh, Benjamin Nagengast et al.•Developmental Psychology•2013

  • Item Parameter Invariance of the Kaufman Adolescent and Adult Intelligence Test Across Male and Female Samples

    Open Access•Jason C Immekus, Susan J Maller•Educational and Psychological…•2009

  • Variability and Consistency in Early Language Learning

    Michael C Frank, Mika Braginsky et al.•Variability and Consistency in…•2021

  • Fundamental Psychometric Considerations in Assessment

    Open Access•John D Wasserman, Bruce A Bracken•Handbook of Psychology, Second…•2012

  • Item Response Theory and Measuring Abilities

    Open Access•Karen M Schmidt, Susan E Embretson•Handbook of Psychology, Second…•2012

  • Psychometrics

    Open Access•James Algina, Hariharan Swaminathan•International Encyclopedia of the…•2015

  • Psychometrics

    Open Access•Denny Borsboom, Dylan Molenaar•International Encyclopedia of the…•2015

  • Dimensionality assessment of ordered polytomous items with parallel analysis.

    Marieke E Timmerman, Urbano Lorenzo‐Seva•Psychological Methods•2011

  • El análisis factorial exploratorio de los ítems

    Open Access•Susana Lloret-Segura, Adoración Ferreres-Traver et al.•Anales de Psicología•2014

  • Reporting effect sizes in original psychological research

    Open Access•Jolynn Pek, David B Flora•Psychological Methods•2018

  • Social inferences from faces

    Open Access•Clare A M Sutherland, Julian A Oldmeadow et al.•Cognition•2013

  • The Implicit Association Test

    Open Access•Ulrich Schimmack•Perspectives on Psychological…•2021

  • Person-Centered Methodologies in the Organizational Sciences

    Open Access•Alexandre J S Morin, Aleksandra Bujacz et al.•Organizational Research Methods•2018

  • Construct Validity

    Milton E Strauss, Gregory T Smith•Annual Review of Clinical…•2009

  • Dimensions of Normal Personality as Networks in Search of Equilibrium

    Open Access•Angélique O J Cramer, Sophie Van Der Sluis et al.•European Journal of Personality•2012

  • Psychometric perspectives on diagnostic systems

    Open Access•Denny Borsboom•Journal of Clinical Psychology•2008

  • Doubly Latent Multilevel Analyses of Classroom Climate

    Alexandre J S Morin, Herbert W Marsh et al.•The Journal of Experimental…•2014

  • Analyzing Observed Composite Differences Across Groups

    Open Access•Holger Steinmetz•Methodology•2013

  • A Primer to (Cross-Cultural) Multi-Group Invariance Testing Possibilities in R

    Open Access•Ronald Fischer, Johannes A Karl•Frontiers in Psychology•2019

  • Item Response Theory and Clinical Measurement

    Steven P Reise, Niels G Waller•Annual Review of Clinical…•2009

  • On the Use, the Misuse, and the Very Limited Usefulness of Cronbach’s Alpha

    Open Access•Klaas Sijtsma•Psychometrika•2009

  • Associations Between Loneliness, Epigenetic Aging, and Multimorbidity Through Older Adulthood

    Open Access•Colin Freilich, Kristian E Markon et al.•The Journals of Gerontology…•2024

  • The Science and Practice of Item Response Theory in Organizations

    Jonas W B Lang, Louis Tay•Annual Review of Organizational…•2020

  • Self- and surrogate-reported communication functioning in aphasia

    Open Access•Patrick J Doyle, William D Hula et al.•Quality of Life Research•2012

  • Update on the Decline in the Education and Training in Psychological Measurement and Assessment

    Open Access•Peter F Merenda•Psychological Reports•2007

  • Update on the Decline in the Education and Training in Psychological Measurement and Assessment

    Peter F Merenda•Psychological Reports•2007

  • Measuring Emotional Experiences with Music

    Open Access•Connor Kirts, Suvi Saarikallio et al.•Music & Science•2026

  • La validité psychométrique

    Open Access•Nathalie André, Nathalie Loye et al.•Mesure et évaluation en éducation•2016

  • La méthode de notation d’un questionnaire importe-t-elle

    Open Access•Christophe Chénier•Mesure et évaluation en éducation•2017

  • Mesurer les attitudes des enseignants vis-à-vis de l’intégration scolaire

    Open Access•Valérie Benoit, Marjorie Valls•Mesure et évaluation en éducation•2019

  • Vermessen? Zur Möglichkeit philosophischer Beiträge für den Diskurs der quantitativen Psychologie

    Open Access•Josh Joseph Ramminger•cultura & psyché•2023

  • Digital archetypes

    Open Access•César Viloria-Núñez, Marcela Tovar et al.•Humanities and Social Sciences…•2023

  • Sordid genealogies

    Open Access•Michael Wintroub•Humanities and Social Sciences…•2020

  • Exploring the measurement of political trust A multilevel observational analysis of six Swedish public agencies

    Open Access•Oskar Rydén, Karl De Fine Licht et al.•Social Sciences & Humanities Open•2024

  • Modeling Individual Differences in Children’s Information Integration During Pragmatic Word Learning

    Open Access•Maria Bohn, Louisa S Schmidt et al.•Open MIND•2022

  • Why Hypothesis Testers Should Spend Less Time Testing Hypotheses

    Open Access•Anne M Scheel, Leonid Tiokhin et al.•Perspectives on Psychological…•2021

  • Repositioning Construct Validity Theory

    Open Access•Brian D Haig•Perspectives on Psychological…•2025

  • Values in Psychometrics

    Open Access•Lisa D Wijsen, Denny Borsboom et al.•Perspectives on Psychological…•2022

  • Recherche et dogmatisme

    Open Access•Enka Blanchard, Zacharie Boubli•Questions de communication•2022

  • Are women truly “more emotional” than men? Sex differences in an indirect model-based measure of emotional feelings

    Open Access•Ella Givon, Rotem Berkovich et al.•Current Psychology•2023

  • Foreign language learning boredom

    Open Access•Chengchen Li, Enhao Feng et al.•Studies in Second Language…•2024

  • Development and Validation of a Scale to Measure Student Dispositions Toward Scientific Uncertainty Navigation

    Open Access•Jongchan Park, Ying-Chih Chen et al.•Journal of Research in Science…•2026

  • Critically evaluating and advancing research and statistical methods in vocational behavior research

    Open Access•Brenton M Wiernik, Blake A Allan et al.•Journal of Vocational Behavior•2021

  • Individual Differences in First Language Acquisition

    Evan Kidd, Seamus Donnelly•Annual Review of Linguistics•2019

  • On a dubious theory of cross-country differences in intelligence

    Keith Denny•Journal of Evolutionary Psychology•2009

  • A person‐centered approach to commitment research

    Open Access•J-P Meyer, Alexandre J S Morin•Journal of Organizational Behavior•2016

  • To prosper, organizational psychology should… expand the values of organizational psychology to match the quality of its ethics

    Open Access•Joel Lefkowitz•Journal of Organizational Behavior•2008

  • Base rate effects on the IAT

    Open Access•Matthias Bluemke, Klaus Fiedler•Consciousness and Cognition•2009

  • The cat came back

    Open Access•Keith A Markus, Denny Borsboom•Theory & Psychology•2012

  • Respectful operationalism

    Open Access•Elina Vessonen•Theory & Psychology•2021

  • Research based on scientific realism should not make preliminary assumptions about mathematical structure representing human behavior

    Open Access•Václav Linkov•Theory & Psychology•2021

  • Laying the cornerstone of construct validity theory

    Open Access•Kathleen L Slaney•Theory & Psychology•2012

  • Dimensionality Assessment Using the Full-Information Item Bifactor Analysis for Graded Response Data

    Open Access•Jason C Immekus, P K Imbrie•Educational and Psychological…•2008

  • Factor Structure Invariance of the Kaufman Adolescent and Adult Intelligence Test Across Male and Female Samples

    Open Access•Jason C Immekus, Susan J Maller•Educational and Psychological…•2010

  • Artificial Neural Networks for Short-Form Development of Psychometric Tests

    Open Access•Monica Casella, Pasquale Dolce et al.•Educational and Psychological…•2024

  • Personality assessment and model comparison with behavioral data

    Open Access•Jordan S Martin, Scott A Suarez•American Journal of Primatology•2017

  • An introduction to Language Testing ’s first Virtual Special Issue

    Open Access•Carol A Chapelle•Language Testing•2020

  • Nonlinear Growth Models as Measurement Models

    Daniel McNeish, Dominique Dumas et al.•Multivariate Behavioral Research•2017

  • What is boredom proneness? A comparison of three characterizations

    Open Access•Katy Y Y Tam, Wijnand A P Van Tilburg et al.•Journal of Personality•2021

  • A confirmatory examination of age‐associated personality differences

    Open Access•Gabriel Olaru, Ulrich Schroeders et al.•Journal of Personality•2018

  • Unpacking the Global Measure of Sexual Satisfaction

    Andrew Hay, Charlene F Belu et al.•The Journal of Sex Research•2026

  • Exploring and integrating discrete and dimensional approaches while inducing negative emotional states

    Riccardo Maria Martoni, Paola M V Rancoita et al.•The Journal of General Psychology•2018

  • How to do (or not to do)… Measuring health worker motivation in surveys in low- and middle-income countries

    Open Access•Josephine Borghi, Johannes Lohmann et al.•Health Policy and Planning•2018

  • States of mind

    Open Access•Charlotte Van den Driessche, Clotilde Chappé et al.•Consciousness and Cognition•2025

  • A Scoping Review of Measures Assessing Gender Microaggressions Against Women

    Open Access•Rachel E Gartner, Paul R Sterzing et al.•Psychology of Women Quarterly•2020

  • Test theories, educational priorities and reliability of public examinations in England

    Jo‐Anne Baird, Jo-Anne Baird et al.•Research Papers in Education•2013

  • Eating traits questionnaires as a continuum of a single concept. Uncontrolled eating

    Open Access•Uku Vainik, Selin Neseliler et al.•Appetite•2015

  • Examining the structure of visual analogue scales to capture motivation to eat in fasting and post-meal conditions

    Open Access•Clarissa A Dakin, Cristiana Duarte et al.•Appetite•2026

  • Evidencias de validez del Cuestionario de Evaluación de la Competencia Docente Universitaria

    Open Access•Erika Paola Reyes Piñuelas, Edna Luna Serrano et al.•Perfiles Educativos•2020

  • Conceptual engineering and operationalism in psychology

    Open Access•Elina Vessonen•Synthese•2021

  • Fricker on testimonial justification

    Open Access•Igor Douven, Stefaan E Cuypers•Studies in History and Philosophy…•2009

  • Clinical outcome measurement

    Open Access•Leah McClimans, John Browne et al.•Studies in History and Philosophy…•2017

  • A Suggested Change in Terminology and Emphasis Regarding Validity and Education

    Open Access•Robert W Lissitz, Karen Samuelsen•Educational Researcher•2007

  • Making inferential leaps

    Open Access•Stefan L K Gruijter, Stefan L K Gruijters•Journal of Experimental Social…•2021

  • Factorial validity and measurement invariance of the uncertainty response scale

    Open Access•Mariana Lucas Casanova, Lara S Pacheco et al.•Psicologia Reflexão e Crítica•2019

  • An Analysis of Anes Items and Their Use in the Construction of Political Knowledge Scales

    Open Access•Matthew T Pietryka, Randall C Macintosh•Political Analysis•2013

  • Language Proficiency in Native and Non-native Speakers

    Jan H Hulstijn•Language proficiency in native…•2015

  • Concepts, Measures, and Measuring Well

    Open Access•Ryan Saylor•Sociological Methods & Research•2013

  • Self-Informant Agreement in Well-Being Ratings

    Open Access•Leann Schneider, Ulrich Schimmack•Social Indicators Research•2009

  • Unconscious Racism

    Hart Blanton, James Jaccard•Annual Review of Sociology•2008

  • Operationalism and realism in psychometrics

    Open Access•Elina Vessonen•Philosophy Compass•2019

  • What is the best measure for assessing diabetes distress? A comparison of the Problem Areas in Diabetes and Diabetes Distress Scale

    Open Access•Eva K Fenwick, Eva Fenwick et al.•Journal of Health Psychology•2018

  • Black Measurement

    Open Access•Paris B Adkins-Jackson, Janine A Jackson et al.•Journal of Black Studies•2024

  • Statistical Theories of Mental Test Scores

    Frederic M Lord, Melvin R Novick•Statistical Theories of Mental…•2008

  • The Dependability of behavioral measurements

    Lee J Cronbach•The Dependability of behavioral…•1972

  • A theory and procedure of scale analysis

    Robert Jan Mokken•A theory and procedure of scale…•1970

  • Introduction to Nonparametric Item Response Theory

    Klaas Sijtsma, Ivo Molenaar et al.•Introduction to Nonparametric…•2002

  • Measuring the Mind

    Open Access•Denny Borsboom•Measuring the Mind•2005

  • IQ and the Wealth of Nations

    Richard Lynn, Tatu Vanhanen•IQ and the Wealth of Nations•2002

  • Explanatory Item Response Models

    Open Access•Paul De Boeck, Mark Wilson•Explanatory Item Response Models•2004

  • Loglinear models with Latent Variables

    Jacques A Hagenaars, Jacques Hagenaars•Loglinear models with Latent…•1993

  • A Manifesto on Psychology as Idiographic Science

    Peter C M Molenaar•Measurement: Interdisciplinary…•2004

  • Item bias and item response theory

    Open Access•Gideon J Mellenbergh•International Journal of…•1989

  • Patterns of Continuity

    R Chris Fraley, Brent W Roberts•Psychological Review•2005

  • The Concept of Validity.

    Denny Borsboom, Gideon J Mellenbergh et al.•Psychological Review•2004

  • On the nature and direction of relationships between constructs and measures.

    Jeffrey R Edwards, Richard P Bagozzi•Psychological Methods•2000

  • Methodology Review

    Open Access•Roger E Millsap, Howard T Everson•Applied Psychological Measurement•1993

  • The theoretical status of latent variables.

    Denny Borsboom, Gideon J Mellenbergh et al.•Psychological Review•2003

  • Measurement Invariance, Factor Analysis and Factorial Invariance

    Open Access•William Meredith•Psychometrika•1993

  • Structural Equations with Latent Variables

    Open Access•K A Bollen•Structural Equations with Latent…•1989

  • The Logic of Scientific Discovery

    Karl R Popper, Karl Popper et al.•Physics Today•1959

  • Statistical Test of the Rule Assessment Methodology by Latent Class Analysis

    Open Access•Bjørn Jansen, Brenda R J Jansen et al.•Developmental Review•1997

  • Constrained and Unconstrained Multivariate Normal Finite Mixture Modeling of Piagetian Data

    Conor V Dolan, Bjørn Jansen et al.•Multivariate Behavioral Research•2004

  • Statistical Modeling of the Individual

    Ellen L Hamaker, Conor V Dolan et al.•Multivariate Behavioral Research•2005

  • Modeling Affective Processes in Dyadic Relations via Dynamic Factor Analysis

    Emilio Ferrer, John R Nesselroade•Emotion•2003

  • Generalized linear item response theory

    Gideon J Mellenbergh•Psychological Bulletin•1994

  • Nature over nurture

    Robert R Mccrae, Paul T Costa et al.•Journal of Personality and Social…•2000

  • Decoding the implicit association test

    Open Access•Hart Blanton, James Jaccard et al.•Journal of Experimental Social…•2005

  • Generalized linear item response theory

    Gideon J Mellenbergh•Psychological Bulletin•1994

  • Stereotype Threat and Group Differences in Test Performance

    Jelte M Wicherts, Conor V Dolan et al.•Journal of Personality and Social…•2005

  • Evaluating replicability of factors in the Revised NEO Personality Inventory

    Robert R Mccrae, Alan B Zonderman et al.•Journal of Personality and Social…•1996

  • Measuring individual differences in implicit cognition

    Anthony G Greenwald, Debbie E Mcghee et al.•Journal of Personality and Social…•1998

  • Racial and gender bias in ability and achievement tests

    J E Hunter, Frank L Schmidt•Psychology Public Policy and Law•2000

  • The New Rules of Measurement

    Susan E Embretson, Scott L Hershberger•New Rules of Measurement•1999

  • Conventional wisdom on measurement

    K A Bollen, Kenneth Bollen et al.•Psychological Bulletin•1991

  • Construct validity in psychological tests

    Lee J Cronbach, Paul E Meehl•Psychological Bulletin•1955

Unique citing works95
Citations per year5
Citation span2007 - 2026 (20)
Citation velocitycurrent
Highly citedNo
Citation typesNeutral: 82

Tools

Open DOISci-HubOpen Access
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae