Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Teacher's Corner

The Macs Approach to Testing for Multigroup Invariance of a Second-Order Structure: A Walk Through the Process

Bibliographic Data

ID23374080
AuthorsBarbara M Byrne, Sunita Mahtani Stewart (0000-0002-0642-781X)
Year2006
Volume13
Issue2
Pages287-321
Publication date2006-04-28
Peer ReviewedYes
Open AccessNo
TypeARTICLE
VenueStructural Equation Modeling: A Multidisciplinary Journal (JOURNAL)
Journal identifiersISSN: 1070-5511 • E-ISSN: 1532-8007
PublisherInforma UK Limited (PUBLISHER • GB)
DOI10.1207/s15328007sem1302_7
OpenAlexW2240216748
LanguageEN
Citations received106
References cited63

The overarching intent of this article is to exemplify strategies associated with tests for measurement invariance that are uncommonly applied and reported in the extant literature. Designed within a pedagogical framework, the primary purposes are 3-fold and illustrate (a) tests for measurement invariance based on the analysis of means and covariance structures (MACS), (b) use of the MACS approach in testing for an invariant higher order factor structure, and (c) tests for latent mean differences relative to both levels of a higher order factor structure. Addressing additional application limitations, the secondary purposes are 2-fold and illustrate (a) determination of invariance based on two substantially different sets of criteria and (b) interpretation of noninvariant measurement items within the context of an item response theory perspective. We are hopeful that readers will find the didactic approach to be helpful in gaining a better understanding of the invariance-testing process.

Confirmatory factor analysis · Context (archaeology) · Covariance · Econometrics · Extant taxon · Invariant (physics) · Machine learning · Measurement invariance · Order (exchange) · Perspective (graphical) · Process (computing) · Statistics · Structural equation modeling · Advanced Statistical Modeling Techniques · Artificial Intelligence · Behavioral and Psychological Studies · Computer Science · Mathematics · Psychology · Psychometric Methodologies and Testing

  • Be Prosocial My Friend

    Open Access•Álvaro Rodríguez-Franco, Gustavo Carlo et al.•International Journal of…•2023

  • Analyzing the Measurement Equivalence of a Translated Test in a Statewide Assessment Program

    Open Access•Jorge Carvajal-Espinoza, Greg Welch et al.•Revista Electrónica Educare•2016

  • Relational trauma in times of political violence

    Ruth Pat-Horenczyk, Yuval Ziv et al.•Peace and Conflict Journal of…•2013

  • An Updated Measure for Assessing Subtle Rape Myths

    Sarah Mcmahon, Ginny Farmer et al.•Social Work Research•2011

  • Propriedades psicométricas da versão portuguesa do Obsessive-Compulsive Inventory – Revised

    Open Access•Miguel Faria, Miguel Nuno Faria et al.•Análise Psicológica•2017

  • The Beck Depression Inventory, Second Edition (BDI-II)

    Kamden K Strunk, F Lane et al.•Measurement and Evaluation in…•2016

  • Toward a Culturally Robust Measure to Assess Marital Relationships

    Open Access•Hyanghee Lee•Journal of Family Issues•2021

  • The Intuitive Eating Scale–2

    Tracy L Tylka, Ashley M Kroon Van Diest•Journal of Counseling Psychology•2013

  • The interplay of occupational motivation and well-being during the transition from university to work

    Claudia M Haase, Jutta Heckhausen et al.•Developmental Psychology•2012

  • The “Immigrant Paradox” Phenomenon

    Open Access•Heejung Chun, Michael Mobley•The Journal of Primary Prevention•2014

  • Revision, Criterion Validity, and Multigroup Assessment of the Reactions to Homosexuality Scale

    Derek J Smolenski, Pamela M Diamond et al.•Journal of Personality Assessment•2010

  • Student engagement and its relationship with early high school dropout

    Open Access•Isabelle Archambault, Michel Janosz et al.•Journal of Adolescence•2009

  • Measurement invariance

    Open Access•Neal Schmitt, Goran Kuljanin•Human Resource Management Review•2008

  • The Body Appreciation Scale-2

    Open Access•Tracy L Tylka, Nichole L Wood-Barcalow et al.•Body Image•2015

  • The importance of attitudes toward technology for pre-service teachers' technological, pedagogical, and content knowledge

    Open Access•Rebeca Scherer, Ronny Scherer et al.•Computers in Human Behavior•2018

  • The assessment of school engagement

    Open Access•Ming-Te Wang, John B Willett et al.•Journal of School Psychology•2011

  • The Functionality Appreciation Scale (FAS)

    Open Access•Jessica M Alleva, Tracy L Tylka et al.•Body Image•2017

  • Construct Measurement and Validation Procedures in MIS and Behavioral Research

    Scott B Mackenzie, Mackenzie Mackenzie et al.•MIS Quarterly•2011

  • Testing for Measurement and Structural Equivalence in Large-Scale Cross-Cultural Studies

    Barbara M Byrne, Fons J R Van De Vijver•International Journal of Testing•2010

  • Measurement Equivalence Across Subnational Groups

    Oriane Sarrasin, E G T Green et al.•International Journal of Public…•2012

  • Measurement Invariance across Face-to-Face and Telephone Modes

    Galit Gordoni, Peter Schmidt et al.•International Journal of Public…•2011

  • Methodological and Substantive Issues in Conducting Multinational and Cross-Cultural Research

    Paul E Spector, Cong Liu et al.•Annual Review of Organizational…•2015

  • Assessing the Multidimensional and Hierarchical Structure of Servqual

    Jun Ma•Psychological Reports•2007

  • Psychometric properties of the Psy-flex scale

    Open Access•Duckhyun Jo, Byeori Seong et al.•Journal of Contextual Behavioral…•2023

  • Development and Validation of the Chinese Family Resilience Scale in Families in Hong Kong

    Open Access•Janet T Y Leung, D T L Shek et al.•International Journal of…•2023

  • The Mediating Roles of Emotional Regulation on Negative Emotion and Internet Addiction Among Chinese Adolescents From a Development Perspective

    Open Access•Lijuan Liang, Mingrui Zhu et al.•Frontiers in Psychiatry•2021

  • Developing the Cyberostracism Scale and Examining its Psychometric Characteristics

    Open Access•Osman Hatun, İbrahim Demırcı•International Journal of Mental…•2020

  • We Are Together, but How Much Are We Truly ‘We’

    Open Access•Burcu Özgülük Üçok, Selin Onaylı et al.•Emerging Adulthood•2025

  • The Development and Validation of the Healthcare Professional Humanization Scale (Humas) for Nursing

    Open Access•María Del Carmen Pérez-Fuentes, Iván Herrera‐Peco et al.•International Journal of…•2019

  • Design and Validation of the Adaptation to Change Questionnaire

    Open Access•María Del Carmen Pérez-Fuentes, María del Mar Molero Jurado et al.•International Journal of…•2020

  • Factorial invariance of pediatric patient self-reported fatigue across age and gender

    Open Access•James W Varni, A Alexander Beaujean et al.•Quality of Life Research•2013

  • Measuring mental wellbeing in clinical and non-clinical adolescents using the Compas-W Wellbeing Scale

    Open Access•Janine Lam, Janine R Lam et al.•Frontiers in Psychiatry•2024

  • An Assessment of Factors Related to Ocean Literacy Based on Gender-Invariance Measurement

    Open Access•Liang-Ting Tsai, Yen‐ling Lin et al.•International Journal of…•2019

  • How Appearance‐Related Avoidance Relates to Anxiety in Early Adolescence

    Open Access•Chelly Maes, Brianna A Ladd et al.•Social Development•2026

  • Advancing cleaner and responsible food consumption through sustainable diets

    Open Access•Pomi Shahbaz, Abida Hafeez et al.•Cleaner and Responsible Consumption•2026

  • Exploring the impact of self-regulation on vocabulary learning strategies and knowledge in CSL

    Open Access•Cong Wang, Sida Zhu et al.•Humanities and Social Sciences…•2025

  • Differences in Teacher Burnout Between Schools

    Open Access•Lotta Tikkanen, Kaisa Haverinen et al.•Frontiers in Education•2022

  • Psychometric properties and invariance of the self-efficacy for writing scale in Peruvian high school students

    Open Access•Matilde León-Gutiérrez, Wilter C Morales-García et al.•Frontiers in Education•2023

  • Relationship between behavioral inhibition/activation system and Internet addiction among Chinese college students

    Open Access•Zhihao Zhang, Yan Lin et al.•Frontiers in Public Health•2022

  • The Role of Academic Libraries in Promoting Environmental Sustainability in Higher Education Institutions

    Open Access•Jialu Ma, Naeem Shahzad•SAGE Open•2025

  • Inductive and combinatorial reasoning in international educational context

    Open Access•H Wu, Andi Rahmat Saleh et al.•Asia Pacific Education Review•2022

  • The cost of rude customers

    Angie Yeonsook Im, Seonghee Cho et al.•Current Issues in Tourism•2024

  • The Impact of Partial Measurement Invariance on Between-group Comparisons of Second-Order Factor Means

    Yixing Liu, Marilyn S Thompson•Structural Equation Modeling: A…•2022

  • Influence of neuroticism on depression among college students by gender

    Open Access•Xiaowen Hou, Xinyu Lai et al.•Current Psychology•2024

  • The longitudinal relationship between depression, Internet addiction and self-control during the repeated Covid-19 pandemics

    Open Access•Guangyu Zhang, Yan Lin et al.•Current Psychology•2024

  • New evidence on the psychometric properties of the portuguese version of the flourishing scale

    Open Access•Belén Rando, Ana Maria Abreu et al.•Current Psychology•2023

  • Reliability and validity of the Turkish version of forms of self-criticizing/attacking and self-reassuring scale (FSCRS) in clinical and non-clinical samples

    Open Access•Zümrüt Bellur, Emre Han Alpay et al.•Current Psychology•2023

  • Pandemie und Wertewandel

    Open Access•Anja Eder, Wolfgang Aschauer et al.•Österreichische Zeitschrift für…•2022

  • Validity and normative data of the Chinese Prospective and Retrospective Memory Questionnaire (PRMQ) across adolescence, adults and elderly people

    Tian-Xiao Yang, Ya Wang et al.•Memory•2022

  • Logfile analyses of successful and unsuccessful strategy use in complex problem-solving

    Open Access•H Wu, György Molnár•European Journal of Psychology of…•2021

  • Romantic Competence and Courtship Skills

    Open Access•Noemí Toledano, Carmen Viejo et al.•Journal of Adolescence•2025

  • The link between anger and admiration toward governmental actions and self‐reported preventive behaviour in the context of the Covid ‐19 pandemic

    Open Access•Mirjana Rupar, Magdalena Bobowik et al.•International Journal of Psychology•2024

  • Best Practices for Neglected Assumptions

    Open Access•Xiaohan Mei, Zachary Hamilton et al.•Crime & Delinquency•2025

  • Measurement Invariance, Validity, Reliability, and Factor Structure Examination of the Creativity Nurturing Behaviour Scale for Teachers

    Open Access•Ekta Sharma, S K Sharma et al.•Creativity Studies•2023

  • Psychometric evaluation of an Adverse Childhood Experiences (ACEs) measurement tool

    Open Access•Robert Jervis, Xiaohan Mei et al.•Health & Justice•2022

  • Modelling public confidence of the police

    Mike Perkins•Police Practice and Research•2016

  • Constructive patriotism predicts voting intentions

    Open Access•Mirjana Rupar, Maciej Sekerdej et al.•Journal of Social and Political…•2024

  • A Cross-Validation of the Relational Entitlement and Proprietariness Scale

    Annegret F Hannawa, Brian H Spitzberg•Communication Methods and Measures•2011

  • Testing for Measurement Invariance by Detecting Local Misspecification and an Illustration Across Online and Paper-and-Pencil Samples

    Open Access•Jan Cieciuch, Eldad Davidov et al.•European Political Science•2015

  • Assessment of Measurement Equivalence with Cross-National and Longitudinal Surveys in Political Science

    Open Access•G Ariely, Eldad Davidov•European Political Science•2011

  • Transformative, Mixed Methods Checklist for Psychological Research With Mexican Americans

    Open Access•Genevieve Canales•Journal of Mixed Methods Research•2012

  • Psychological Capital

    Open Access•Tara S Wernsing•Journal of Leadership &…•2013

  • The Adult Parental Acceptance–Rejection Questionnaire

    Vincenzo P Senese, Dario Bacchini et al.•Parenting•2016

  • Development and validation of the Leadership Effectiveness in Africa and the Diaspora (Lead) scale

    Open Access•James Michaud, Elena Lvina et al.•International Journal of Cross…•2020

  • The Chinese Family Assessment Instrument (C-FAI)

    Open Access•D T L Shek, Cecilia M•Research on Social Work Practice•2009

  • Living Local

    Open Access•María Pilar López Belbeze, Josep Rialp Criado et al.•Sustainable Development•2025

  • Applying Longitudinal Mean and Covariance Structures (LMACS) Analysis to Assess Construct Stability Over Two Time Points

    Bozhidar M Bashkov, Sara J Finney•Measurement and Evaluation in…•2013

  • Cross-cultural measurement invariance of the fear of Covid-19 scale in seven Latin American countries

    Tomás Caycho-Rodríguez, Pablo D Valencia et al.•Death Studies•2021

  • Leadership and teacher learning in urban and rural schools in China

    Open Access•P Hallinger, Shangnan Liu•International Journal of…•2016

  • Measuring Attitudes Towards Social Europe

    Open Access•Sharon Baute, Bart Meuleman et al.•Social Indicators Research•2017

  • Validation of the Satisfaction with Life Scale to Brazilians

    Open Access•Cristian Zanon, Marucia P Bardagi et al.•Social Indicators Research•2013

  • Parents’ Educational Involvement

    Open Access•Nurit Kaplan Toren, Kumar Revathy•The Journal of Early Adolescence•2023

  • Reliability and validity evaluation of the stigma of loneliness scale in Chinese college students

    Open Access•Zhiguang Fan, Xiaoli Shi et al.•BMC Public Health•2024

  • Spiritual/Religious Perfectionism Scale in Iran

    Open Access•Mohammad Ali Besharat, Hojjatollah Farahani et al.•Journal of Religion and Health•2021

  • Testing for Multigroup Invariance of the Computer Anxiety Scale

    Open Access•George A Marcoulides, Christin Emrich et al.•Educational and Psychological…•2008

  • Psychometric evaluation of the Malay Filial Piety Scale (FPS-M) for adolescents in Malaysia

    Open Access•Chee Seng Tan, Soon-Aun Tan et al.•Journal of Pacific Rim Psychology•2019

  • The development of the Short Muslim Practice and Belief Scale

    Tayyiba S K AlMarri, Tian P S Oei et al.•Mental Health Religion & Culture•2009

  • Urban-rural differences in the longitudinal reciprocal relationship between assets and health among Chinese older adults

    Open Access•Siyuan Guo, Junyue Yue et al.•Social Science & Medicine•2026

  • Structural Validation and Multiple Group Assessment of the Short Internalized Homonegativity Scale in Homosexual and Bisexual Men in 38 European Countries

    Ha Tran, Michael W Ro et al.•The Journal of Sex Research•2017

  • The Development of the Positive Sexuality in Adolescence Scale (PSAS)

    Chelly Maes, Jolien Trekels et al.•The Journal of Sex Research•2022

  • The Link Between Subaltern and Global Identities and Expectations of Immigrants’ Linguistic Acculturation

    Open Access•Leire Amenabar Larrañaga, Leire Amenabar-Larrañaga et al.•Journal of Cross-Cultural…•2026

  • Examining the Relationship Between Ecological Commitment, Environmental Knowledge, and Farmers’ Nature-Friendly Behavior

    Open Access•Wei Wang, Pomi Shahbaz et al.•SAGE Open•2024

  • The Development of Scientific Strategy Knowledge Across Grades

    Open Access•Rebeca Scherer, Ronny Scherer et al.•SAGE Open•2014

  • Developing and validating a scale of host territoriality in peer-to-peer accommodation

    Open Access•Yuan Wang, Xiang Li•Tourism Management•2022

  • Development of learning to learn skills in primary school

    Mari–pauliina Vainikainen, Mari-Pauliina Vainikainen et al.•International Journal of Lifelong…•2015

  • The Plausibility of Cross-National Comparisons of Internet Use Types

    Ellen Helsper, Monica M Gerber•The Information Society•2012

  • Is family functioning stable and consistent over time and stakeholders? A comparison of adolescents’ and caregivers’ views

    Open Access•Natallia Sianko, James R Mcdonell•Children and Youth Services Review•2020

  • Measurement Invariance of the Brief Resilient Coping Scale (BRCS) in Peruvian and Spanish Older Adults

    Open Access•José M Tomás, Tomás Caycho-Rodríguez et al.•Journal of Cross-Cultural…•2021

  • Predicting Behavioral Intentions to Comply with Recommended Leave No Trace Practices

    Wade M Vagias, Robert B Powell et al.•Leisure Sciences•2014

  • An application of the social support deterioration deterrence model to rescue workers

    Open Access•Gabriele Prati, Luca Pietrantoni•Journal of Community Psychology•2010

  • Measurement invariance of the Beck Depression Inventory-Second Edition across race with South African university students

    Open Access•Malose Makhubela, Malose S Makhubela•South African Journal of Psychology•2016

  • Measurement invariance in the social sciences

    Open Access•Heinz Leitgöb, Daniel Seddig et al.•Social Science Research•2023

  • The Body Perfect Ideal and Eating Regulation Goals

    Open Access•Joke Verstuyf, Stijn Van Petegem et al.•Journal of Youth and Adolescence•2014

  • Active and Engaged Citizenship

    Open Access•Jonathan Zaff, Jonathan F Zaff et al.•Journal of Youth and Adolescence•2010

  • Testing for comparability of human values across countries and time with the third round of the European Social Survey

    Open Access•Eldad Davidov•International Journal of…•2010

  • The Cross-National Invariance Properties of a New Scale to Measure 19 Basic Human Values

    Open Access•Jan Cieciuch, Eldad Davidov et al.•Journal of Cross-Cultural…•2014

  • Students’ Value Orientations in Contemporary China

    Open Access•Eva Heim, Scholten et al.•Journal of Cross-Cultural…•2017

  • Cognitive, Affective and Eudemonic Well-Being in Later Life

    Open Access•Bram Vanhoutte, James Nazroo•Sociological Research Online•2014

  • What determines the rejection of immigrants through an integrative model

    Open Access•Ma Ángeles Cea D''Ancona, Angeles Cea De Ancona et al.•Social Science Research•2018

  • Transnational Solidarity Within the EU

    Open Access•Ann-Kathrin Reinl•Social Indicators Research•2022

  • Statistical analysis with missing data

    Roderick J A Little•Statistical analysis with missing…•2002

  • Simultaneous Factor Analysis in Several Populations

    Open Access•Karl G Jöreskog•Psychometrika•1971

  • Evaluating the Impact of Partial Factorial Invariance on Selection in Two Populations.

    Roger E Millsap, Oi-Man Kwok•Psychological Methods•2004

  • Exploring the measurement invariance of psychological instruments

    Keith F Widaman, Steven P Reise•The science of prevention•1997

  • Confirmatory factor analysis models of factorial invariance

    Herbert W Marsh•Structural Equation Modeling: A…•1994

  • A psychometric evaluation of the Beck Depression Inventory–II.

    David J A Dozois, Keith S Dobson et al.•Psychological Assessment•1998

  • A General Method for Studying Differences in Factor Means and Factor Structure Between Groups

    Open Access•Dag Sörbom•British Journal of Mathematical…•1974

  • On the Multivariate Asymptotic Distribution of Sequential Chi-Square Statistics

    Open Access•James H Steiger, Alexander Shapiro et al.•Psychometrika•1985

  • Statistical Analysis of Sets of Congeneric Tests

    Open Access•Karl G Jöreskog•Psychometrika•1971

  • Measures of multivariate skewness and kurtosis with applications

    Kanti V Mardia•Biometrika•1970

  • Measurement equivalence

    Nambury S Raju, Larry J Laffitte et al.•Journal of Applied Psychology•2002

  • Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance

    Gordon W Cheung, Roger B Rensvold•Structural Equation Modeling: A…•2002

  • Cutoff criteria for fit indexes in covariance structure analysis

    Li‐tze Hu, Peter M Bentler•Structural Equation Modeling: A…•1999

  • A Reliability Coefficient for Maximum Likelihood Factor Analysis

    Open Access•Ledyard R Tucker, Charles Lewis•Psychometrika•1973

  • Measurement Invariance, Factor Analysis and Factorial Invariance

    Open Access•William Meredith•Psychometrika•1993

  • Fit indices in covariance structure modeling

    Li‐tze Hu, Li-tze Hu et al.•Psychological Methods•1998

  • In Search of Golden Rules

    Herbert W Marsh, Kit-Tai Hau et al.•Structural Equation Modeling: A…•2004

  • The robustness of test statistics to nonnormality and specification error in confirmatory factor analysis.

    Patrick J Curran, Stephen G West et al.•Psychological Methods•1996

  • Structural Equations with Latent Variables

    Open Access•K A Bollen•Structural Equations with Latent…•1989

  • On Chi-Square Difference and z Tests in Mean and Covariance Structure Analysis when the Base Model is Misspecified

    Open Access•Ke-Hai Yuan, Peter M Bentler•Educational and Psychological…•2004

  • The Beck Depression Inventory

    Open Access•Barbara M Byrne, Pierre Baron et al.•Educational and Psychological…•1998

  • Detection of Differential Item Functioning on the Kirton Adaption-Innovation Inventory Using Multiple-Group Mean and Covariance Structure Analyses

    David Chan•Multivariate Behavioral Research•2000

  • Mean and Covariance Structures (Macs) Analyses of Cross-Cultural Data

    Todd D Little•Multivariate Behavioral Research•1997

  • Calibration of Invariant Item Parameters in a Continuous Item Response Model Using the Extended Lisrel Measurement Submodel

    Pere J Ferrando•Multivariate Behavioral Research•1996

  • Control of Type I Errors with Multiple Tests of Constraints in Structural Equation Modeling

    Samuel B Green, Michael A Babyak•Multivariate Behavioral Research•1997

  • Investigating Group Differences on Cognitive Tests Using Spearman's Hypothesis

    Gitta H Lubke, Conor V Dolan et al.•Multivariate Behavioral Research•2001

  • Structural Model Evaluation and Modification

    James H Steiger•Multivariate Behavioral Research•1990

  • Measuring Adolescent Depression

    Barbara M Byrne, Pierre Baron et al.•Journal of Research on Adolescence•1993

  • The Beck Depression Inventory (French Version)

    Open Access•Barbara M Byrne, Pierre Baron et al.•Journal of Adolescent Research•1994

  • Can test statistics in covariance structure analysis be trusted

    Li‐tze Hu, Li-tze Hu et al.•Psychological Bulletin•1992

  • Confirmatory factor analysis and item response theory

    Steven P Reise, Keith F Widaman et al.•Psychological Bulletin•1993

  • Testing for the equivalence of factor covariance and mean structures

    Barbara M Byrne, Richard J Shavelson et al.•Psychological Bulletin•1989

  • Significance tests and goodness of fit in the analysis of covariance structures

    Peter M Bentler, Douglas G Bonett•Psychological Bulletin•1980

  • Comparative fit indexes in structural models

    Peter M Bentler•Psychological Bulletin•1990

  • Alternative Ways of Assessing Model Fit

    Open Access•Michael W Browne, Robert Cudeck•Sociological Methods & Research•1992

  • Adolescent Self-Concept, Ability Grouping, and Social Comparison

    Open Access•Barbara M Byrne•Youth & Society•1988

  • Cross-Cultural Comparisons and the Presumption of Equivalent Measurement and Theoretical Structure

    Open Access•Barbara M Byrne, T Leanne Campbell•Journal of Cross-Cultural…•1999

Unique citing works106
Citations per year5,58
Citation span2007 - 2026 (20)
Citation velocitycurrent
Highly citedYes
Citation typesNeutral: 97
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae