Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Classification Accuracy of Multidimensional Tests

Quantifying the Impact of Noninvariance

Bibliographic Data

ID21641932
AuthorsMark H C Lai (0000-0002-9196-7406, University of Southern California, corresponding author), Yichi Zhang (0000-0002-3697-833X, University of Southern California)
Year2022
Volume29
Issue4
Pages620-629
Publication date2022-07-04
Open AccessYes
TypeARTICLE
VenueStructural Equation Modeling: A Multidisciplinary Journal (JOURNAL)
Journal identifiersISSN: 1070-5511 • E-ISSN: 1532-8007
PublisherInforma UK Limited (PUBLISHER • GB)
DOI10.1080/10705511.2021.1977936
OpenAlexW4206830778
LanguageEN
Citations received1
References cited35

There has been tremendous growth in research on measurement invariance over the past two decades. However, given that psychological tests are commonly used for making classification decisions such as personnel selections or diagnoses, surprisingly, there has been little research on how noninvariance impacts classification accuracy. Millsap and Kwok previously proposed a selection accuracy framework for that purpose, which has been recently extended to categorical data. Their framework, however, only deals with classification using a unidimensional test. In contrast, classification in practice usually involves multidimensional tests (e.g., personality) or multiple tests, with different weights assigned to each dimension. In the current paper, we extend Millsap and Kwok's framework for examining the impact of noninvariance to a multidimensional test on classification. We also provide an R script for the proposed method and illustrate it with a personnel selection example using data from a published report featuring a five-factor personality inventory

Categorical variable · Data mining · Econometrics · Machine learning · Advanced Statistical Methods and Models · Computer Science · Mathematics · Psychology · Psychometric Methodologies and Testing · Artificial Intelligence

  • Multi-Group Multidimensional Classification Accuracy Analysis (MMCAA)

    Meltem Özcan, Mark H C Lai•Multivariate Behavioral Research•2026

  • Statistical Approaches to Measurement Invariance

    Roger E Millsap•Statistical Approaches to…•2012

  • Item bias and item response theory

    Open Access•Gideon J Mellenbergh•International Journal of…•1989

  • Measurement invariance

    Open Access•Neal Schmitt, Goran Kuljanin•Human Resource Management Review•2008

  • A practical and theoretical guide to measurement invariance in aging research

    John L Horn, John J Mcardle•Experimental Aging Research•1992

  • Personality and job performance

    Gregory M Hurtz, John J Donovan•Journal of Applied Psychology•2000

  • Evaluating the Impact of Partial Factorial Invariance on Selection in Two Populations.

    Roger E Millsap, Oi-Man Kwok•Psychological Methods•2004

  • Toward a Further Understanding of and Improvement in Measurement Invariance Methods and Procedures

    Open Access•Robert J Vandenberg•Organizational Research Methods•2002

  • The Mini-Ipip Scales

    M Brent Donnellan, Frederick L Oswald et al.•Psychological Assessment•2006

  • Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance

    Gordon W Cheung, Roger B Rensvold•Structural Equation Modeling: A…•2002

  • Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance

    Fangfang Chen, Fang Fang Chen•Structural Equation Modeling: A…•2007

  • Measurement Invariance, Factor Analysis and Factorial Invariance

    Open Access•William Meredith•Psychometrika•1993

  • The Big Five Personality Dimensions and Job Performance

    Open Access•Murray R Barrick, Michael K Mount•Personnel Psychology•1991

  • A Scaled Difference Chi-Square Test Statistic for Moment Structure Analysis

    Open Access•Albert Satorra, Peter M Bentler•Psychometrika•2001

  • Multiple factor analysis

    Paul Horst•Psychological Bulletin•1948

  • Measurement invariance conventions and reporting

    Open Access•Diane L Putnick, Marc H Bornstein•Developmental Review•2016

  • Comparative fit indexes in structural models

    Peter M Bentler•Psychological Bulletin•1990

  • The validity and utility of selection methods in personnel psychology

    Frank L Schmidt, J E Hunter•Psychological Bulletin•1998

Citations per year1
Citation span2026 - 2026 (1)
Highly citedNo

Tools

Open DOI
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae