IDEAS home Printed from https://ideas.repec.org/a/spr/psycho/v82y2017i3d10.1007_s11336-016-9552-7.html
   My bibliography  Save this article

Assessing the Size of Model Misfit in Structural Equation Models

Author

Listed:
  • Alberto Maydeu-Olivares

    (University of Barcelona
    University of South Carolina)

Abstract

When a statistically significant mean difference is found, the magnitude of the difference is judged qualitatively using an effect size such as Cohen’s d. In contrast, in a structural equation model (SEM), the result of the statistical test of model fit is often disregarded if significant, and inferences are drawn using “close” models retained based on point estimates of sample statistics (goodness-of-fit indices). However, when a SEM cannot be retained using a test of exact fit, all substantive inferences drawn from it are suspect. It is therefore important to determine the size of the model misfit. Standardized residual covariances and residual correlations provide standardized effect sizes of the misfit of SEM models. They can be summarized using the Standardized Root Mean Squared Residual (SRMSR) and the Correlation Root Mean Squared Residual (CRMSR) which can be used as overall effect sizes of the misfit. Statistical theory is provided that allows the construction of confidence intervals and tests of close fit based on the SRMSR and CRMSR. It is hoped that the use of standardized effect sizes of misfit will help reconcile current practices in SEM and elsewhere in statistics.

Suggested Citation

  • Alberto Maydeu-Olivares, 2017. "Assessing the Size of Model Misfit in Structural Equation Models," Psychometrika, Springer;The Psychometric Society, vol. 82(3), pages 533-558, September.
    • Handle: RePEc:spr:psycho:v:82:y:2017:i:3:d:10.1007_s11336-016-9552-7
    DOI: 10.1007/s11336-016-9552-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11336-016-9552-7
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11336-016-9552-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Feinian Chen & Patrick J. Curran & Kenneth A. Bollen & James Kirby & Pamela Paxton, 2008. "An Empirical Evaluation of the Use of Fixed Cutoff Points in RMSEA Test Statistic in Structural Equation Models," Sociological Methods & Research, , vol. 36(4), pages 462-494, May.
    2. Ke-Hai Yuan & Peter M. Bentler, 1999. "F Tests for Mean and Covariance Structure Analysis," Journal of Educational and Behavioral Statistics, , vol. 24(3), pages 225-243, September.
    3. Albert Maydeu-Olivares, 2006. "Limited information estimation and testing of discretized multivariate normal structural models," Psychometrika, Springer;The Psychometric Society, vol. 71(1), pages 57-77, March.
    4. S. Lee & R. Jennrich, 1979. "A study of algorithms for covariance structure analysis with specific comparisons using factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 44(1), pages 99-113, March.
    5. Rosseel, Yves, 2012. "lavaan: An R Package for Structural Equation Modeling," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 48(i02).
    6. Albert Satorra, 2015. "A Comment on a Paper by H. Wu and M. W. Browne (2014)," Psychometrika, Springer;The Psychometric Society, vol. 80(3), pages 613-618, September.
    7. Hao Wu & Michael Browne, 2015. "Quantifying Adventitious Error in a Covariance Structure as a Random Effect," Psychometrika, Springer;The Psychometric Society, vol. 80(3), pages 571-600, September.
    8. Haruhiko Ogasawara, 2001. "Standard errors of fit indices using residuals in structural equation modeling," Psychometrika, Springer;The Psychometric Society, vol. 66(3), pages 421-436, September.
    9. Albert Satorra, 1989. "Alternative test criteria in covariance structure analysis: A unified approach," Psychometrika, Springer;The Psychometric Society, vol. 54(1), pages 131-151, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Sanghee Lee & Jaeeun Jung & Sungeun Baek & Songyi Lee, 2022. "The Relationship between Career Decision-Making Self-Efficacy, Career Preparation Behaviour and Career Decision Difficulties among South Korean College Students," Sustainability, MDPI, vol. 14(21), pages 1-16, November.
    2. Lingfang Shao & Pengfei Ma & Zijin Zhou, 2024. "Research on the Impact of Landscape Planning on Visual and Spatial Perception in Historical District Tourism: A Case Study of Laomendong," Land, MDPI, vol. 13(8), pages 1-25, July.
    3. Zi Jia Ng & Eugene Scott Huebner & Alberto Maydeu-Olivares & Kimberly Joy Hills, 2018. "Confirmatory Factor Analytic Structure and Measurement Invariance of the Brief Multidimensional Students’ Life Satisfaction Scale (BMSLSS) in a Longitudinal Sample of Adolescents," Child Indicators Research, Springer;The International Society of Child Indicators (ISCI), vol. 11(4), pages 1237-1247, August.
    4. Jan-Benedict E. M. Steenkamp & Alberto Maydeu-Olivares, 2023. "Unrestricted factor analysis: A powerful alternative to confirmatory factor analysis," Journal of the Academy of Marketing Science, Springer, vol. 51(1), pages 86-113, January.
    5. Yang Liu & Weimeng Wang, 2022. "Semiparametric Factor Analysis for Item-Level Response Time Data," Psychometrika, Springer;The Psychometric Society, vol. 87(2), pages 666-692, June.
    6. Daniel Sanz-Martín & Eduardo Melguizo-Ibáñez & Germán Ruiz-Tendero & Félix Zurita-Ortega & José Luis Ubago-Jiménez, 2022. "Physical Activity, Energy Expenditure, Screen Time and Social Support in Spanish Adolescents—Towards an Explanatory Model about Health Risk Factors," IJERPH, MDPI, vol. 19(16), pages 1-11, August.
    7. Jan-Benedict E.M. Steenkamp & Alberto Maydeu-Olivares, 2021. "An updated paradigm for evaluating measurement invariance incorporating common method variance and its assessment," Journal of the Academy of Marketing Science, Springer, vol. 49(1), pages 5-29, January.
    8. Dirk Lubbe, 2023. "Advantages of Using Unweighted Approximation Error Measures for Model Fit Assessment," Psychometrika, Springer;The Psychometric Society, vol. 88(2), pages 413-433, June.
    9. Daniel Sanz-Martín & Eduardo Melguizo-Ibáñez & Germán Ruiz-Tendero & José Luis Ubago-Jiménez, 2022. "An Explanatory Model of the Relationships between Physical Activity, Social Support and Screen Time among Adolescents," IJERPH, MDPI, vol. 19(12), pages 1-12, June.
    10. Carmen Köhler & Alexander Robitzsch & Johannes Hartig, 2020. "A Bias-Corrected RMSD Item Fit Statistic: An Evaluation and Comparison to Alternatives," Journal of Educational and Behavioral Statistics, , vol. 45(3), pages 251-273, June.
    11. Daniel Sanz-Martín & José Luis Ubago-Jiménez & Germán Ruiz-Tendero & Félix Zurita-Ortega, 2022. "Moderate-Vigorous Physical Activity, Family Support, Peer Support, and Screen Time: An Explanatory Model," IJERPH, MDPI, vol. 19(23), pages 1-9, December.
    12. Zachary J. Kunicki & Lisa L. Harlow, 2020. "Towards a Higher-Order Model of Resilience," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 151(1), pages 329-344, August.
    13. Cristel Joy G. Cayaban & Yogi Tri Prasetyo & Satria Fadil Persada & Rianina D. Borres & Ma. Janice J. Gumasing & Reny Nadlifatin, 2023. "The Influence of Social Media and Sustainability Advocacy on the Purchase Intention of Filipino Consumers in Fast Fashion," Sustainability, MDPI, vol. 15(11), pages 1-20, May.
    14. Sandip Sinharay & Peter W. van Rijn, 2020. "Assessing Fit of the Lognormal Model for Response Times," Journal of Educational and Behavioral Statistics, , vol. 45(5), pages 534-568, October.
    15. Klein, Andreas & Sharma, Varinder M., 2022. "Consumer decision-making styles, involvement, and the intention to participate in online group buying," Journal of Retailing and Consumer Services, Elsevier, vol. 64(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sandip Sinharay & Peter W. van Rijn, 2020. "Assessing Fit of the Lognormal Model for Response Times," Journal of Educational and Behavioral Statistics, , vol. 45(5), pages 534-568, October.
    2. Jonas Moss & Steffen Grønneberg, 2023. "Partial Identification of Latent Correlations with Ordinal Data," Psychometrika, Springer;The Psychometric Society, vol. 88(1), pages 241-252, March.
    3. Hao Wu & Michael Browne, 2015. "Random Model Discrepancy: Interpretations and Technicalities (A Rejoinder)," Psychometrika, Springer;The Psychometric Society, vol. 80(3), pages 619-624, September.
    4. Edgar Merkle & Jinyan Fan & Achim Zeileis, 2014. "Testing for Measurement Invariance with Respect to an Ordinal Variable," Psychometrika, Springer;The Psychometric Society, vol. 79(4), pages 569-584, October.
    5. Steffen Grønneberg & Jonas Moss & Njål Foldnes, 2020. "Partial Identification of Latent Correlations with Binary Data," Psychometrika, Springer;The Psychometric Society, vol. 85(4), pages 1028-1051, December.
    6. Maximilian S. Ernst & Aaron Peikert & Andreas M. Brandmaier & Yves Rosseel, 2023. "A Note on the Connection Between Trek Rules and Separable Nonlinear Least Squares in Linear Structural Equation Models," Psychometrika, Springer;The Psychometric Society, vol. 88(1), pages 98-116, March.
    7. Steffen Grønneberg & Njål Foldnes, 2019. "A Problem with Discretizing Vale–Maurelli in Simulation Studies," Psychometrika, Springer;The Psychometric Society, vol. 84(2), pages 554-561, June.
    8. Alexander Robitzsch, 2023. "Modeling Model Misspecification in Structural Equation Models," Stats, MDPI, vol. 6(2), pages 1-17, June.
    9. Ogasawara, Haruhiko, 2017. "Expected predictive least squares for model selection in covariance structures," Journal of Multivariate Analysis, Elsevier, vol. 155(C), pages 151-164.
    10. Albert Satorra, 1990. "Robustness issues in structural equation modeling: a review of recent developments," Quality & Quantity: International Journal of Methodology, Springer, vol. 24(4), pages 367-386, November.
    11. Albert Satorra, 2015. "A Comment on a Paper by H. Wu and M. W. Browne (2014)," Psychometrika, Springer;The Psychometric Society, vol. 80(3), pages 613-618, September.
    12. Forthmann, Boris & Jendryczko, David & Scharfen, Jana & Kleinkorres, Ruben & Benedek, Mathias & Holling, Heinz, 2019. "Creative ideation, broad retrieval ability, and processing speed: A confirmatory study of nested cognitive abilities," Intelligence, Elsevier, vol. 75(C), pages 59-72.
    13. Keke Lai, 2019. "Creating Misspecified Models in Moment Structure Analysis," Psychometrika, Springer;The Psychometric Society, vol. 84(3), pages 781-801, September.
    14. Edgar Merkle & Achim Zeileis, 2013. "Tests of Measurement Invariance Without Subgroups: A Generalization of Classical Methods," Psychometrika, Springer;The Psychometric Society, vol. 78(1), pages 59-82, January.
    15. Steffen Grønneberg & Njål Foldnes, 2017. "Covariance Model Simulation Using Regular Vines," Psychometrika, Springer;The Psychometric Society, vol. 82(4), pages 1035-1051, December.
    16. Alexander Robitzsch, 2022. "Comparing the Robustness of the Structural after Measurement (SAM) Approach to Structural Equation Modeling (SEM) against Local Model Misspecifications with Alternative Estimation Approaches," Stats, MDPI, vol. 5(3), pages 1-42, July.
    17. Njål Foldnes & Steffen Grønneberg, 2019. "On Identification and Non-normal Simulation in Ordinal Covariance and Item Response Models," Psychometrika, Springer;The Psychometric Society, vol. 84(4), pages 1000-1017, December.
    18. Ting Wang & Carolin Strobl & Achim Zeileis & Edgar C. Merkle, 2018. "Score-Based Tests of Differential Item Functioning via Pairwise Maximum Likelihood Estimation," Psychometrika, Springer;The Psychometric Society, vol. 83(1), pages 132-155, March.
    19. Ting Wang & Edgar C. Merkle & Achim Zeileis, 2013. "Score-Based Tests of Measurement Invariance: Use in Practice," Working Papers 2013-33, Faculty of Economics and Statistics, Universität Innsbruck.
    20. Yutaka Kano & Masamori Ihara, 1994. "Identification of inconsistent variates in factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 59(1), pages 5-20, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:psycho:v:82:y:2017:i:3:d:10.1007_s11336-016-9552-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.