Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Testing Measurement Invariance

A Comparison of Multiple-Group Categorical CFA and IRT

Bibliographic Data

ID23365706
AuthorsEunsook Kim (0000-0003-1054-1735, Mitchell Institute), Eun Sook Kim (0000-0002-9311-4642), Myeongsun Yoon (0000-0001-7876-4826, Mitchell Institute)
Year2011
Volume18
Issue2
Pages212-228
Publication date2011-04-06
Peer ReviewedYes
Open AccessNo
TypeARTICLE
VenueStructural Equation Modeling: A Multidisciplinary Journal (JOURNAL)
Journal identifiersISSN: 1070-5511 • E-ISSN: 1532-8007
PublisherInforma UK Limited (PUBLISHER • GB)
DOI10.1080/10705511.2011.557337
OpenAlexW2051142423
LanguageEN
Citations received67
References cited31

This study investigated two major approaches in testing measurement invariance for ordinal measures: multiple-group categorical confirmatory factor analysis (MCCFA) and item response theory (IRT). Unlike the ordinary linear factor analysis, MCCFA can appropriately model the ordered-categorical measures with a threshold structure. A simulation study under various conditions was conducted for the comparison of MCCFA and IRT with respect to the power to detect the lack of invariance across groups. Both MCCFA and IRT showed reasonable power to identify the noninvariant item when differential item functioning (DIF) was large. The false positive rates were relatively high in both methods, however. The adjustment of critical values improved the performance of MCCFA by reducing false positive rates substantially and yet yielding adequate power. Alternative model fit indexes of MCCFA were also examined and they were found to be reliable to detect DIF, in general.

Categorical variable · Confirmatory factor analysis · Differential item functioning · Econometrics · Item response theory · Measurement invariance · Ordinal data · Polytomous Rasch model · Psychometrics · Statistics · Structural equation modeling · Advanced Statistical Methods and Models · Advanced Statistical Modeling Techniques · Mathematics · Psychology · Psychometric Methodologies and Testing

  • Bayesian SEM for Specification Search Problems in Testing Factorial Invariance

    Dexin Shi, Hairong Song et al.•Multivariate Behavioral Research•2017

  • Measurement of adolescent psychological wellbeing

    Open Access•Hena Thakur, Jae Wan Choi et al.•Journal of Research on Adolescence•2024

  • Are personality measures valid for different populations? A systematic review of measurement invariance across cultures, gender, and age

    Open Access•Yixiao Dong, Dominique Dumas et al.•Personality and Individual…•2020

  • Measurement equivalence

    Open Access•Laura L Pendergast, Nathaniel von der Embse et al.•Journal of School Psychology•2017

  • IRT studies of many groups

    Open Access•Bengt Muthén, Tihomir Asparouhov•Frontiers in Psychology•2014

  • Development and validation of a self-report social determinants of health questionnaire in Australia

    Open Access•Candice Oster, Bill Gransbury et al.•Health Promotion International•2023

  • Cross-cultural Measurement Equivalence of the KINDL Questionnaire for Quality of Life Assessment in Children and Adolescents

    Open Access•Peyman Jafari, Dejan Stevanović et al.•Child Psychiatry & Human…•2015

  • Testing the measurement invariance of the University of Washington Self-Efficacy Scale short form across four diagnostic subgroups

    Open Access•Hyewon Chung, Jiseon Kim et al.•Quality of Life Research•2016

  • Measurement Invariance of the Short Version of the Problematic Mobile Phone Use Questionnaire (PMPUQ-SV) across Eight Languages

    Open Access•Olatz López-Fernández, Daria J Ku et al.•International Journal of…•2018

  • Measuring health-related quality of life among school adolescents across Chinese Human Geography Regions

    Open Access•Juan Li, Yuhang Zhu et al.•Quality of Life Research•2025

  • Clinically derived 12-factor structure and confirmatory factor analysis of the neurodevelopmental parent report for outcome monitoring

    Open Access•Nicole Bäumer, Nicole T Baumer et al.•Frontiers in Psychiatry•2023

  • Measuring health-related quality of life in a Chinese Mainland adolescent population

    Open Access•Juan Li, Yuhang Zhu et al.•BMC Psychology•2024

  • Validation of factor structure of the neurodevelopmental parent report for outcome monitoring in down syndrome

    Open Access•Nicole Bäumer, Nicole T Baumer et al.•Frontiers in Psychiatry•2024

  • The Strengths and Difficulties Questionnaire

    Open Access•Lisanne L Stone, Jan M A M Janssens et al.•BMC Psychology•2015

  • Measurement Equivalence of the KINDL Questionnaire Across Child Self-reports and Parent Proxy-reports

    Open Access•Peyman Jafari, Zahra Sharafi et al.•Child Psychiatry & Human…•2013

  • Is Individualism Suicidogenic? Findings From a Multinational Study of Young Adults From 12 Countries

    Open Access•Mehmet Eskin, Ulrich S Tran et al.•Frontiers in Psychiatry•2020

  • Measurement Invariance of Psychotic-Like Symptoms as Measured With the Prodromal Questionnaire, Brief Version (PQ-B) in Adolescent and Adult Population Samples

    Open Access•Ulla Lång, Vijay A Mittal et al.•Frontiers in Psychiatry•2021

  • The Impact of Model Parameterization and Estimation Methods on Tests of Measurement Invariance With Ordered Polytomous Data

    Open Access•Natalie A Koziol, James A Bovaird•Educational and Psychological…•2017

  • Psychometric Evaluation and Evidence of Validity and Reliability of the Turkish Versions of the International Depression Questionnaire and the International Anxiety Questionnaire

    Open Access•Mustafa Batuhan Kurtoğlu, Canahmet Boz et al.•Journal of Clinical Psychology•2026

  • Mixture multigroup structural equation modelling for ordinal data

    Open Access•Andres Felipe Perez Alonso, Jeroen K Vermunt et al.•British Journal of Mathematical…•2026

  • A large-scale empirical investigation of measurement invariance decisions under multiple-group item response theory and multiple-group confirmatory factor analysis

    Open Access•Purya Baghaei, Rolf Strietholt et al.•Frontiers in Education•2026

  • Children’s perception of food parenting practices

    Open Access•Carola Del Valle, Horacio Miranda et al.•Frontiers in Public Health•2024

  • The impact of measurement noninvariance across time and group in longitudinal item response modeling

    Open Access•Incheol Choi, In-Hee Choi•Asia Pacific Education Review•2023

  • Tour guides’ interpretation and tourists’ pro-environmental behavior

    Yahya A Alzghoul, Malek M Jamaliah et al.•Journal of Ecotourism•2024

  • Mixed Effects of Item Parceling on Performance of Factor Mixture Modeling

    Eunsook Kim, Diep Nguyen et al.•Structural Equation Modeling: A…•2022

  • Detecting Measurement Noninvariance with Continuous Indicators Using Three Different Statistical Methods under the Framework of Latent Variable Modeling

    Mingcai Zhang, Lihong Yang•Structural Equation Modeling: A…•2022

  • The Impact of Model Size on the Sensitivity of Fit Measures in Measurement Invariance Testing

    Chunhua Cao, Xinya Liang•Structural Equation Modeling: A…•2022

  • The Impact of Ignoring Cross-loadings on the Sensitivity of Fit Measures in Measurement Invariance Testing

    Chunhua Cao, Xinya Liang•Structural Equation Modeling: A…•2024

  • Nine Versions of the Parent Financial Socialization Scale

    Open Access•Ashley B Lebaron-Black, Matthew T Saxey et al.•Journal of Family and Economic…•2024

  • A mediated moderation model of eco-guilt, personal and social norms and religiosity triggering pro-environmental behavior in tourists

    Open Access•Sami Ullah, Bei Lyu et al.•Current Psychology•2024

  • A solution for factorial validity testing of three-item scales

    Open Access•Stanisław K Czerwiński, Paweł A Atroszko•Current Psychology•2023

  • Measurement invariance and country difference in children’s social skills development

    Open Access•Zhu Zhu, Dandan Jiao et al.•Current Psychology•2023

  • Testing the measurement invariance of the work motivation scale for training and adult education in a nationwide study of Singapore

    Open Access•Zan Chen, Vahid Aryadoust•Current Psychology•2023

  • Validation of the Pennsylvania Kindergarten Entry Inventory

    Katherine M Barghaus, Katie Dahlke et al.•Early Education and Development•2023

  • Self-beliefs, engagement and motivation in science and mathematics

    Open Access•Victor Pedrero, Jorge Manzi•International Journal of…•2020

  • Measuring precarious employment in the European Working Conditions Survey

    Open Access•Eva Padrosa, Francesc Belvis et al.•Quality & Quantity•2021

  • Measuring social-emotional development in schoolchildren

    Open Access•Quentin H Riser, Heather L Rouse et al.•Journal of School Psychology•2024

  • Is There Only One Well-Being for Younger Children and Preadolescents? The Revision of the SCWBS Questionnaire with Detailed Psychometric Properties

    Marek Matouš Bula, Adam Klocek et al.•Journal of Personality Assessment•2026

  • Validation of the Italian Version of the Chronic and Acute Stress Index (Casi)

    Open Access•Stefano Isolani, Claudia Chiarolanza et al.•Interpersona An International…•2022

  • Confirmatory Factor Analysis and Measurement Invariance Testing with Ordinal Data

    Chong Xing, Jeffrey A Hall•Communication Methods and Measures•2015

  • Measurement Invariance Across Sex and Language Background of a Self-Report Social-Emotional Learning Questionnaire for Middle Childhood

    Open Access•Emma J Carpendale, Melissa J Green et al.•Child Indicators Research•2023

  • Gendered Racial Microaggressions Scale

    Open Access•Sara Matsuzaka, Laura Jamison et al.•Psychology of Women Quarterly•2022

  • Comparing Precarious Employment Across Countries

    Open Access•Eva Padrosa, Mireia Bolíbar et al.•Social Indicators Research•2020

  • Measurement invariance and differential item functioning of a care staff proxy measure of nursing home resident dementia-specific quality of life (Demqol-CH)

    Open Access•Matthias Hoben, Sevilay Kilmen et al.•Social Science & Medicine•2025

  • Motivation towards mathematics from 1980 to 2015

    Open Access•Erika Majoros, Andrés Christiansen et al.•Studies In Educational Evaluation•2022

  • Testing Measurement Invariance Using MIMIC

    Open Access•Eunsook Kim, Eun Sook Kim et al.•Educational and Psychological…•2012

  • Accounting for Differential Item Functioning Using Bayesian Approximate Measurement Invariance

    Open Access•Georgios D Sideridis, Ioannis Tsaousis et al.•Educational and Psychological…•2020

  • Multiple Group Analysis in Multilevel Data Across Within-Level Groups

    Open Access•Sookyoung Son, Andrea C Grundy et al.•Educational and Psychological…•2021

  • It Matters

    Open Access•Yutian Thompson, Yutian T Thompson et al.•Educational and Psychological…•2021

  • Testing Measurement Invariance Across Unobserved Groups

    Open Access•Yan Wang, Eunsook Kim et al.•Educational and Psychological…•2021

  • On the Complex Sources of Differential Item Functioning

    Open Access•Haeju Lee, Sijia Huang et al.•Educational and Psychological…•2026

  • Model Estimation Approaches for Fully-Latent Principal Stratification with Small Samples

    Soo‐yong Lee, Adam Sales et al.•Structural Equation Modeling: A…•2024

  • Measurement invariance of the multigroup ethnic identity scale in elderly population belonging to andean indigenous peoples of northern Chile

    Open Access•Julio Tereucán-Angulo, Miguel Galván-Cabello et al.•International Journal of…•2025

  • Perceived Similarity to Gender Groups Scale

    Open Access•Roberto Baiocco, Chiara Antoniucci et al.•Sexuality Research and Social…•2021

  • Beyond Sexual Attraction

    Open Access•Stefano Isolani, Mirco Costacurta et al.•Sexuality Research and Social…•2026

  • Evaluating Factorial Invariance

    Dexin Shi, Hairong Song et al.•Multivariate Behavioral Research•2019

  • Testing the Psychometric Properties and Equivalence of the Czech Version of the Satisfaction with Life Scale (SWLS) using Confirmatory Factor Analysis, Item Response Theory, and Bayesian Modelling

    Open Access•Radka Hanzlová, Petra Raudenská•Czech Sociological Review•2023

  • The Development of Scientific Strategy Knowledge Across Grades

    Open Access•Rebeca Scherer, Ronny Scherer et al.•SAGE Open•2014

  • Can we really use available scales for child and adolescent psychopathology across cultures? A systematic review of cross-cultural measurement invariance data

    Open Access•Dejan Stevanović, Peyman Jafari et al.•Transcultural Psychiatry•2017

  • Challenges in Multilevel Modelling

    Open Access•Artur Pokropek, Tomasz Żółtak et al.•Sociological Methods & Research•2025

  • Recent Methods for the Study of Measurement Invariance With Many Groups

    Open Access•Bengt Muthén, Tihomir Asparouhov•Sociological Methods & Research•2018

  • Measurement invariance in the social sciences

    Open Access•Heinz Leitgöb, Daniel Seddig et al.•Social Science Research•2023

  • Expanding Statistical Frontiers in Sexual Science

    John Kitchener Sakaluk•The Journal of Sex Research•2019

  • The Necessity of Testing Measurement Invariance in Cross-Cultural Research

    Open Access•David Lacko, Jiří Čeněk et al.•Cross-Cultural Research•2022

  • Replicating, Refining and Extending the Reconciliation Orientation Model (ROM)

    Open Access•Iwan Dinnick, Masi Noor et al.•European Journal of Social…•2025

  • Measurement Effects of Survey Mode on the Equivalence of Attitudinal Rating Scale Questions

    Open Access•Thomas Klausch, Joop J Hox et al.•Sociological Methods & Research•2013

  • Personality Differences Between the United States and the Netherlands

    Open Access•Annemarie Eigenhuis, Jan H Kamphuis et al.•Journal of Cross-Cultural…•2015

  • Statistical Theories of Mental Test Scores

    Frederic M Lord, Melvin R Novick•Statistical Theories of Mental…•2008

  • Item bias and item response theory

    Open Access•Gideon J Mellenbergh•International Journal of…•1989

  • A Comparison of Item Response Theory and Confirmatory Factor Analytic Methodologies for Establishing Measurement Equivalence/Invariance

    Open Access•Adam W Meade, Gary J Lautenschlager•Organizational Research Methods•2004

  • Detecting differential item functioning with confirmatory factor analysis and item response theory

    Stephen Stark, Oleksandr S Chernyshenko et al.•Journal of Applied Psychology•2006

  • The Area between Two Item Characteristic Curves

    Open Access•Nambury S Raju•Psychometrika•1988

  • Evaluating the Impact of Partial Factorial Invariance on Selection in Two Populations.

    Roger E Millsap, Oi-Man Kwok•Psychological Methods•2004

  • Beyond SEM

    Open Access•Bengt Muthén, Bengt O Muthén•Behaviormetrika•2002

  • Item factor analysis

    R Wirth, Michael C Edwards•Psychological Methods•2007

  • A Note on the Relation Between Factor Analytic and Item Response Theory Models

    Akihito Kamata, Daniel J Bauer•Structural Equation Modeling: A…•2008

  • Marginal Maximum Likelihood Estimation of Item Parameters

    Open Access•R Darrell Bock, Murray Aitkin•Psychometrika•1981

  • Methodology Review

    Open Access•Roger E Millsap, Howard T Everson•Applied Psychological Measurement•1993

  • On the Relationship between iTem Response Theory and Factor Analysis of Discretized Variables

    Open Access•YOSHIO TAKANE, Jan De Leeuw•Psychometrika•1987

  • Measurement equivalence

    Nambury S Raju, Larry J Laffitte et al.•Journal of Applied Psychology•2002

  • Cutoff criteria for fit indexes in covariance structure analysis

    Li‐tze Hu, Peter M Bentler•Structural Equation Modeling: A…•1999

  • Measurement Invariance, Factor Analysis and Factorial Invariance

    Open Access•William Meredith•Psychometrika•1993

  • Assessing Factorial Invariance in Ordered-Categorical Measures

    Roger E Millsap, Jenn Yun-Tein et al.•Multivariate Behavioral Research•2004

  • Impact of Differential Item Functioning on Age and Gender Differences in Functional Disability

    John A Fleishman, William D Spector et al.•The Journals of Gerontology…•2002

  • The concept of life satisfaction across cultures

    Open Access•Oishi•Journal of Research in Personality•2006

  • When Does Measurement Invariance Matter

    Denny Borsboom•Medical Care•2006

  • An Essay on Measurement and Factorial Invariance

    William Meredith, Jeanne A Teresi•Medical Care•2006

  • Confirmatory factor analysis and item response theory

    Steven P Reise, Keith F Widaman et al.•Psychological Bulletin•1993

Unique citing works67
Citations per year4,79
Citation span2012 - 2026 (15)
Citation velocitycurrent
Highly citedNo
Citation typesNeutral: 66
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae