Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

Masking misfit in confirmatory factor analysis by increasing unique variances

A cautionary note on the usefulness of cutoff values of fit indices.

Bibliographic Data

ID23330935
AuthorsMoritz Heene (0009-0007-4956-2417, University of Graz), Sven Hilbert (0000-0001-5808-8357, Ludwig-Maximilians-Universität München), Clemens Draxler (0000-0001-8692-9897, Ludwig-Maximilians-Universität München), Matthias Ziegler (0000-0003-4994-9519, Humboldt-Universität zu Berlin), Markus Bühner (0000-0002-0597-8708, University of Graz)
Year2011
Volume16
Issue3
Pages319-336
Publication date2011-09-01
Peer ReviewedYes
Open AccessNo
TypeARTICLE
VenuePsychological Methods (JOURNAL)
Journal identifiersISSN: 1082-989X • E-ISSN: 1939-1463
PublisherAmerican Psychological Association (APA) (PUBLISHER)
DOI10.1037/a0024917
PMID21843002
OpenAlexW2152225530
LanguageEN
Citations received106
References cited30

Fit indices are widely used in order to test the model fit for structural equation models. In a highly influential study, Hu and Bentler (1999) showed that certain cutoff values for these indices could be derived, which, over time, has led to the reification of these suggested thresholds as "golden rules" for establishing the fit or other aspects of structural equation models. The current study shows how differences in unique variances influence the value of the global chi-square model test and the most commonly used fit indices: Root-mean-square error of approximation, standardized root-mean-square residual, and the comparative fit index. Using data simulation, the authors illustrate how the value of the chi-square test, the root-mean-square error of approximation, and the standardized root-mean-square residual are decreased when unique variances are increased although model misspecification is present. For a broader understanding of the phenomenon, the authors used different sample sizes, number of observed variables per factor, and types of misspecification. A theoretical explanation is provided, and implications for the application of structural equation modeling are discussed.

Algorithm · Confirmatory factor analysis · Cutoff · Econometrics · Goodness of fit · Mean squared error · Residual · Root mean square · Sample size determination · Square root · Statistics · Structural equation modeling · Cognitive Abilities and Testing · Mathematics · Personality Traits and Psychology · Psychometric Methodologies and Testing

  • Perception Of Institutional Corruption In Peru

    Open Access•Alberto Remaycuna‐Vasquez, Luz Angélica Atoche-Silva et al.•MIGRATION LETTERS•2024

  • What is working memory capacity, and how can we measure it?

    Open Access•Oliver Wilhelm, Andrea Hildebrandt et al.•Frontiers in Psychology•2013

  • Cultural identity development in adult forced migrants

    Open Access•Débora B Maehler, Nivedita Bhaktha et al.•International Journal of…•2025

  • Probing for the multiplicative term in modern expectancy–value theory

    Ulrich Trautwein, Herbert W Marsh et al.•Journal of Educational Psychology•2012

  • Students’ emotion regulation and school-related well-being

    Open Access•Joanna Beaumont, Dave W Putwain et al.•Journal of Educational Psychology•2023

  • Teacher self-efficacy and burnout

    Loretta E Kim, Irena Burić•Journal of Educational Psychology•2020

  • Achievement emotions and elementary school children’s academic performance

    Stephanie Lichtenfeld, Reinhard Pekrun et al.•Journal of Educational Psychology•2023

  • Achievement emotions and academic achievement

    Dave W Putwain, Peter Wood et al.•Journal of Educational Psychology•2022

  • Warning students of the consequences of examination failure

    Dave W Putwain, Linda J Nicholson et al.•Journal of Educational Psychology•2022

  • Factor Structure and Psychometric Evaluation of the Parent–Child Sleep Interactions Scale (PSIS) Among Children Adopted From Foster Care

    Open Access•Alyssa Vieira, Darlynn M Rojo-Wissar et al.•Child Psychiatry & Human…•2025

  • Boredom and academic achievement

    Reinhard Pekrun, Nathan C Hall et al.•Journal of Educational Psychology•2014

  • Manifest variable path analysis

    David A Cole, Kristopher J Preacher•Psychological Methods•2014

  • Examination of the Weighted Root Mean Square Residual

    Christine Distefano, Jin Liu et al.•Structural Equation Modeling: A…•2018

  • Reciprocal relations between students’ academic enjoyment, boredom, and achievement over time

    Open Access•Dave W Putwain, Sandra Becker et al.•Learning and Instruction•2018

  • Use of Structural Equation Modeling in Tourism Research

    Open Access•Robin Nunkoo, Haywantee Ramkissoon et al.•Travel Research Bulletin•2013

  • The Thorny Relation Between Measurement Quality and Fit Index Cutoffs in Latent Variable Models

    Daniel McNeish, Ji An et al.•Journal of Personality Assessment•2018

  • An examination of the factorial and convergent validity of four measures of conspiracist ideation, with recommendations for researchers

    Open Access•Viren Swami, David Barron et al.•PLoS ONE•2017

  • Translation and validation of body image instruments

    Open Access•Viren Swami, David Barron•Body Image•2019

  • Thinking twice about sum scores

    Open Access•Daniel McNeish, Melissa Gordon Wolf•Behavior Research Methods•2020

  • Achievement Emotions and Academic Performance

    Open Access•Reinhard Pekrun, Stephanie Lichtenfeld et al.•Child Development•2017

  • The moderating effect of emotion regulation in the association between coping strategies and resilience in Lebanese adults

    Open Access•Emmanuelle Awad, Mirna Fawaz et al.•BMC Psychology•2022

  • Psychopathology, Protective Factors, and Covid-19 among Adolescents

    Open Access•Christin Scheiner, Christian Seis et al.•International Journal of…•2023

  • The Italian Validation of the Zimbardo Time Perspective Inventory and Its Comparison with Three Time Perspective Inventories

    Open Access•Monica Martoni, Marco Fabbri et al.•International Journal of…•2023

  • Our Vulnerable Dark Side—Two Laboratory Approaches

    Open Access•Lena Lämmle, Matthias Ziegler•International Journal of…•2021

  • Automated Algorithmic Data Analysis for Confirmatory Factor Analysis and Invariance Assessment

    Moritz Schemmerling, Patrick F Kotzur et al.•Social Cognition•2025

  • Work Environment Characteristics and Teacher Well-Being

    Open Access•Hubin Yin, Shenghua Huang et al.•International Journal of…•2016

  • Validation of the Arabic Version of the Community Assessment of Psychic Experiences (Cape-42) in a Large Sample of Young Adults from the General Population

    Open Access•Feten Fekih‐Romdhane, Nour Farah et al.•International Journal of Mental…•2023

  • Are Engaged Workaholics Protected against Job-Related Negative Affect and Anxiety before Sleep? A Study of the Moderating Role of Gender

    Open Access•Paola Spagnoli, Cristian Balducci et al.•International Journal of…•2018

  • The Performance of Equivalence-Based Fit Indices with Bootstrapped Confidence Intervals and Varied Tolerable Cutoffs

    Open Access•Tiffany A Whittaker, Jam Khojasteh et al.•Structural Equation Modeling: A…•2026

  • Unmooring tax compliance

    Open Access•Munyaradzi Duve, Daniel Schutte•Social Sciences & Humanities Open•2025

  • Social Well-Being at School

    Open Access•Lidón Moliner, Francisco Alegre et al.•Frontiers in Education•2021

  • How can applicants' reactions to scholastic aptitude tests be improved? A closer look at specific and general tests

    Open Access•Marek Denker, Clara Schütte et al.•Frontiers in Education•2023

  • Context-specificity to reduce bias in self-assessments

    Tamara Kastorff, Michael Sailer et al.•Journal of Research on Technology…•2023

  • Who (Really) Wins with Basic Income

    Open Access•Julia Malinka, Kristin Mitte et al.•Journal of Happiness Studies•2025

  • Assessing Cutoff Values of SEM Fit Indices

    Carmen Ximénez, Alberto Maydeu‐olivare et al.•Structural Equation Modeling: A…•2022

  • Direct Discrepancy Dynamic Fit Index Cutoffs for Arbitrary Covariance Structure Models

    Daniel McNeish, Melissa Gordon Wolf•Structural Equation Modeling: A…•2024

  • Dynamic Fit Index Cutoffs for Hierarchical and Second-Order Factor Models

    Daniel McNeish, Patrick D Manapat•Structural Equation Modeling: A…•2024

  • Model Specification Search in Correlated Factor Models Using Bee Swarm Optimization

    Open Access•Tim Trautwein, Florian Scharf et al.•Structural Equation Modeling: A…•2026

  • The SEM Reliability Paradox in a Bayesian Framework

    Timothy R Konold, Elizabeth A Sanders•Structural Equation Modeling: A…•2024

  • Investigating Structural Model Fit Evaluation

    Xijuan Zhang, Hao Wu•Structural Equation Modeling: A…•2024

  • Development of the hungarian version of the short dark triad questionnaire (SD3-HU)

    Open Access•Zsolt Péter Szabó, Andrea Czibor et al.•Current Psychology•2023

  • The Short Inventory of Creative Activities (S-ICA)

    Diana Steger, Selina Weiss et al.•Creativity Research Journal•2023

  • Does Interference Between Intuitive Conceptions and Scientific Concepts Produce Reliable Inter-individual Differences? A Psychometric Analysis

    Open Access•Peter A Edelsbrunner•Science & Education•2025

  • The indirect role of children’s screen time and the moderating role of problematic parental screen use on the relationships between different parental mediation strategies and preschoolers’ developmental outcomes

    Open Access•Siyu Wu, Xiaodan Yu et al.•Computers & Education•2026

  • A literature review of model fit and model comparisons with confirmatory factor analysis

    Open Access•M C Howard, Melanie Boudreaux et al.•Applied Psychology•2025

  • The role of motivational beliefs in the self-regulated learning of mathematics

    Open Access•Daria Rovan, Ema Petričević et al.•European Journal of Psychology of…•2024

  • What makes a student feel vital? Links between teacher-student relatedness and teachers’ engaging messages

    Open Access•Elisa Santana-Monagas, Juan L Núñez et al.•European Journal of Psychology of…•2023

  • Modelling the adoption of electronic vehicle diagnostic technology for vehicle repairs

    Open Access•Richard Fiifi Turkson, Charles Atombo et al.•Technological Forecasting and…•2023

  • Are We Thinking about the Same Disorder? A Trifactor Model Approach to Understand Parents’ and Their Adolescents’ Reports of Borderline Personality Pathology

    Salome Vanwoerden, Veronica McLaren et al.•Journal of Personality Assessment•2023

  • Disambiguating Tolerance of Ambiguity

    Diana Steger, Astrid Schütz•Journal of Personality Assessment•2026

  • Investigating working adults' intentions to participate in microlearning using the decomposed theory of planned behaviour

    Open Access•Shermain Puah, Muhammad Iskandar Shah Bin Mohmad Khalid et al.•British Journal of Educational…•2022

  • Factors influencing the intention to use e-wallet among generation Z and millennials in the Philippines

    Open Access•Zachariah John A Belmonte, Yogi Tri Prasetyo et al.•Acta Psychologica•2024

  • How does leader self‐sacrifice lead to employees' unethical pro‐organizational behavior? A moderated mediation model

    Open Access•Hao Ji, Shenjiang Mo et al.•Business Ethics, the Environment…•2025

  • Measuring shared cultural characteristics in Malaysia

    Open Access•Hassan Abu Bakar, Stacey L Connaughton•Cross Cultural & Strategic…•2019

  • Boredom in the classroom

    Open Access•Elisa Santana-Monagas, Juan L Núñez•Education Inquiry•2024

  • Teachers use of fear appeals and timing reminders prior to high-stakes examinations

    Open Access•Dave W Putwain, Nathaniel P von der Embse•Social Psychology of Education•2018

  • Teachers’ mindset meaning system

    Open Access•Marko Lüftenegger, Joy Muth•Social Psychology of Education•2024

  • Predicting police officer reported compliance and willingness to cooperate with internal affairs units

    Declan Brooks-Crew, Nikki Rajakaruna et al.•Policing & Society•2021

  • The effect of change in supervisor support and job control on change in vigor

    Open Access•Annekatrin Hoppe, Sharon Toker et al.•Journal of Organizational Behavior•2016

  • Does screen exposure necessarily relate to behavior problems? The buffering roles of emotion regulation and caregiver companionship

    Open Access•Zhen Wu, Jialu Yu et al.•Early Childhood Research Quarterly•2023

  • The Inventario de Perdón y Reconciliación

    Mario D Sobrino, Richard S Balkin•Measurement and Evaluation in…•2025

  • Optimal Number of Replications for Obtaining Stable Dynamic Fit Index Cutoffs

    Open Access•Xinran Liu, Daniel McNeish•Educational and Psychological…•2025

  • It Matters

    Open Access•Yutian Thompson, Yutian T Thompson et al.•Educational and Psychological…•2021

  • Understanding the Model Size Effect on SEM Fit Indices

    Open Access•Dexin Shi, Taehun Lee et al.•Educational and Psychological…•2019

  • Evaluating Model Fit of Measurement Models in Confirmatory Factor Analysis

    Open Access•David Goretzko, Karik Siemund et al.•Educational and Psychological…•2024

  • The Poor Fit of Model Fit for Selecting Number of Factors in Exploratory Factor Analysis for Scale Evaluation

    Open Access•Amanda Kay Montoya, Michael C Edwards•Educational and Psychological…•2021

  • Less Heuristic Approximate Local Fit Evaluation in Structural Equation Models

    Daniel McNeish•Structural Equation Modeling: A…•2025

  • A Simulation Study on the Interaction Effects of Underfactoring and Nuisance Parameters on Model Fit Indices

    Open Access•Melanie Viola Partsch, Philipp Sterner et al.•Structural Equation Modeling: A…•2025

  • Evaluation of Structural Equation Model Forests' Performance to Identify Omitted Influential Covariates

    Open Access•John Alexander Silva Díaz, Moritz Heene et al.•Structural Equation Modeling: A…•2024

  • Modelling, structure and development of domain-specific professional knowledge of Latin teachers

    Open Access•Sven Hilbert, Alfred Lindl•Teaching and Teacher Education•2023

  • Teachers’ engaging messages, students’ motivation to learn and academic performance

    Open Access•Samuel Falcón, Jesús B Alonso et al.•Teaching and Teacher Education•2023

  • Teachers use of fear appeals prior to a high-stakes examination

    Open Access•Dave W Putwain, Ghada Nakhla et al.•Teaching and Teacher Education•2016

  • Leveraging regulatory fit to enhance engagement

    Susan S Lee, Seon Ah Lee et al.•The Journal of Social Psychology•2024

  • Community-Based Risk Assessment of Elder Mistreatment and Self-Neglect

    Open Access•Jason Burnett, Carmel B Dyer et al.•Journal of the Society for Social…•2014

  • Modeling students’ instrumental (mis-) use of substances to enhance cognitive performance

    Open Access•Wanja Wolff, Ralf Brand et al.•BioPsychoSocial Medicine•2014

  • Entropy Fit Indices

    Hudson Golino, Robert Moulder et al.•Multivariate Behavioral Research•2021

  • Detecting Model Misfit in Structural Equation Modeling with Machine Learning—A Proof of Concept

    Open Access•Melanie Viola Partsch, David Goretzko•Multivariate Behavioral Research•2026

  • The Relationship Between the Standardized Root Mean Square Residual and Model Misspecification in Factor Analysis Models

    Dexin Shi, Alberto Maydeu‐olivare et al.•Multivariate Behavioral Research•2018

  • Model Conditioned Data Elasticity in Path Analysis

    Dustin Fife, Dustin A Fife et al.•Multivariate Behavioral Research•2014

  • The Problem with Having Two Watches

    Keke Lai, Samuel B Green•Multivariate Behavioral Research•2016

  • Small but Nontrivial

    Bo Zhang, Jing Luo et al.•Multivariate Behavioral Research•2023

  • Nonlinear Growth Models as Measurement Models

    Daniel McNeish, Dominique Dumas et al.•Multivariate Behavioral Research•2017

  • Dynamic

    Open Access•Melissa Gordon Wolf, Daniel McNeish•Multivariate Behavioral Research•2023

  • On the Computation of the RMSEA and CFI from the Mean-And-Variance Corrected Test Statistic with Nonnormal Data in SEM

    Victoria Savalei•Multivariate Behavioral Research•2018

  • Generalizability of Dynamic Fit Index, Equivalence Testing, and Hu & Bentler Cutoffs for Evaluating Fit in Factor Analysis

    Open Access•Daniel McNeish•Multivariate Behavioral Research•2023

  • Advancing Sustainable Development Goal 4 Through Systemic Digital Transformation in African Higher Education

    Open Access•Daniel Kangwa, Mgambi Msambwa Msafiri et al.•Sustainable Development•2026

  • Solutions to the problems of incremental validity testing in relationship science

    Open Access•Y Andre Wang, Paul W Eastwick•Personal Relationships•2020

  • Strategic deception in call centers

    Felicito Jabutay, Eunice Barbara C Novio et al.•The Journal of General Psychology•2024

  • To Check or Not to Check? A Comment on the Contemporary Psychometrics (ConPsy) Checklist for the Analysis of Questionnaire Items

    Open Access•Alexander Robitzsch•European Journal of Investigation…•2023

  • The Eating Motivation Survey

    Open Access•Gudrun Sproesser, Matthew B Ruby et al.•Public Health Nutrition•2018

  • The emerging techno-microsystem and its longitudinal influences on Chinese young children’s behavior problems

    Jialu Yu, Chengyi Xu et al.•Applied Developmental Science•2025

  • Sustainability of the Public–Benefit Preschool Education Service System in China

    Jie Zhou, Yong Jiang•Early Education and Development•2025

  • What determines urban household intention and behavior of solid waste separation? A case study in China

    Open Access•Yi Zhang, Guangzheng Wang et al.•Environmental Impact Assessment…•2022

  • Food choice motives among two disparate socioeconomic groups in Brazil

    Open Access•Jéssica Maria Muniz Moraes, Cesar Henrique Moraes et al.•Appetite•2020

  • Harnessing the power of virtual reality

    Open Access•Sinh Duc Hoang, Sandeep Kumar Dey et al.•Technology in Society•2023

  • Affective structure, measurement invariance, and reliability across different experience sampling protocols

    Open Access•Gudrun Eisele, Ginette Lafit et al.•Journal of Research in Personality•2021

  • Why do personality traits predict scholastic performance? A three-wave longitudinal study

    Open Access•Jing Zhang, Matthias Ziegler•Journal of Research in Personality•2018

  • The Need for Inclusion

    Open Access•Barbara Valcke, Alain Van Hiel et al.•European Journal of Social…•2020

  • Validade e confiabilidade do Eurohis-QOL 8-item para avaliar a qualidade de vida em adultos brasileiros

    Open Access•Samuel Salvi Romero, Tonantzin Ribeiro Gonçalves et al.•Cadernos de Saude Publica•2022

  • Rethinking political space in Europe

    Open Access•Αλεξία Κατσανίδου, Nils Jungmann•Journal of European Public Policy•2026

  • Human Cognitive Abilities

    Open Access•John B Carroll•Human Cognitive Abilities•1993

  • A contemplated revision of the NEO Five-Factor Inventory

    Open Access•Robert R Mccrae, Paul T Costa•Personality and Individual…•2004

  • Effect of the Number of Variables on Measures of Fit in Structural Equation Modeling

    D A Kenny, D Betsy Mccoach•Structural Equation Modeling: A…•2003

  • Testing Structural Equation Models or Detection of Misspecifications?

    Willem E Saris, Albert Satorra et al.•Structural Equation Modeling: A…•2009

  • How to Use a Monte Carlo Study to Decide on Sample Size and Determine Power

    Linda K Muthén, Bengt Muthén et al.•Structural Equation Modeling: A…•2002

  • Potential problems with "well fitting" models.

    Andrew J Tomarken, Niels G Waller•Journal of Abnormal Psychology•2003

  • Some Contributions to Maximum Likelihood Factor Analysis

    Open Access•Karl G Jöreskog•Psychometrika•1967

  • Sensitivity of Fit Indexes to Misspecified Structural or Measurement Model Components

    Xitao Fan, Stephen A Sivo•Structural Equation Modeling: A…•2005

  • Simulation Study on Fit Indexes in CFA Based on Data With Slightly Distorted Simple Structure

    André Beauducel, Werner W Wittmann•Structural Equation Modeling: A…•2005

  • A General Approach to Confirmatory Maximum Likelihood Factor Analysis

    Open Access•Karl G Jöreskog•Psychometrika•1969

  • Testing! testing! one, two, three – Testing the theory in structural equation models!

    Open Access•Leslie A Hayduk, Leslie Hayduk et al.•Personality and Individual…•2007

  • Cutoff criteria for fit indexes in covariance structure analysis

    Li‐tze Hu, Peter M Bentler•Structural Equation Modeling: A…•1999

  • In Search of Golden Rules

    Herbert W Marsh, Kit-Tai Hau et al.•Structural Equation Modeling: A…•2004

  • Principles and practice in reporting structural equation analyses.

    Roderick P McDonald, Moon-Ho Ringo Ho et al.•Psychological Methods•2002

  • Power analysis and determination of sample size for covariance structure modeling.

    Robert C Maccallum, Michael W Browne et al.•Psychological Methods•1996

  • Testing Structural Equation Models

    J Scott Long, Kenneth A Bollen•Testing Structural Equation Models•2012

  • To Parcel or Not to Parcel

    Todd D Little, William A Cunningham et al.•Structural Equation Modeling: A…•2002

  • Sensitivity of Fit Indices to Model Misspecification and Model Types

    Xitao Fan, Stephen A Sivo•Multivariate Behavioral Research•2007

  • On the Formal Differentiation of Traces and Determinants

    Peter H Schonemann•Multivariate Behavioral Research•1985

  • The Noncentral Chi-square Distribution in Misspecified Structural Equation Models

    Patrick J Curran, K A Bollen et al.•Multivariate Behavioral Research•2002

  • Fit Indices Versus Test Statistics

    Ke-Hai Yuan•Multivariate Behavioral Research•2005

  • A New Incremental Fit Index for General Structural Equation Models

    Open Access•K A Bollen•Sociological Methods & Research•1989

  • Monte Carlo Evaluations of Goodness of Fit Indices for Structural Equation Models

    Open Access•David W Gerbing, James C Anderson•Sociological Methods & Research•1992

  • Maximising the Specific Factors in the Analysis of Ability

    Open Access•Godfrey H Thomson•British Journal of Educational…•1938

  • Goodness-of-fit indexes in confirmatory factor analysis

    Herbert W Marsh, John R Balla et al.•Psychological Bulletin•1988

  • Overall fit in covariance structure models

    K A Bollen•Psychological Bulletin•1990

  • Evaluation of goodness-of-fit indices for structural equation models

    Stanley A Mulaik, Larry R James et al.•Psychological Bulletin•1989

  • Validation of the five-factor model of personality across instruments and observers

    Robert R Mccrae, Paul T Costa•Journal of Personality and Social…•1987

  • The Factorial Analysis of Human Ability

    Open Access•Godfrey H Thomson, Godfrey Thomson•British Journal of Educational…•1939

Unique citing works106
Citations per year7,57
Citation span2012 - 2026 (15)
Citation velocitycurrent
Highly citedYes
Citation typesNeutral: 97

Tools

Open DOISci-Hub
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae