IDEAS home Printed from https://ideas.repec.org/a/kap/asiapa/v41y2024i2d10.1007_s10490-023-09871-y.html
   My bibliography  Save this article

Reporting reliability, convergent and discriminant validity with structural equation modeling: A review and best-practice recommendations

Author

Listed:
  • Gordon W. Cheung

    (The University of Auckland)

  • Helena D. Cooper-Thomas

    (Auckland University of Technology)

  • Rebecca S. Lau
  • Linda C. Wang

    (The Hang Seng University of Hong Kong)

Abstract

Many constructs in management studies, such as perceptions, personalities, attitudes, and behavioral intentions, are not directly observable. Typically, empirical studies measure such constructs using established scales with multiple indicators. When the scales are used in a different population, the items are translated into other languages or revised to adapt to other populations, it is essential for researchers to report the quality of measurement scales before using them to test hypotheses. Researchers commonly report the quality of these measurement scales based on Cronbach’s alpha and confirmatory factor analysis results. However, these results are usually inadequate and sometimes inappropriate. Moreover, researchers rarely consider sampling errors for these psychometric quality measures. In this best practice paper, we first critically review the most frequently-used approaches in empirical studies to evaluate the quality of measurement scales when using structural equation modeling. Next, we recommend best practices in assessing reliability, convergent and discriminant validity based on multiple criteria and taking sampling errors into consideration. Then, we illustrate with numerical examples the application of a specifically-developed R package, measureQ, that provides a one-stop solution for implementing the recommended best practices and a template for reporting the results. measureQ is easy to implement, even for those new to R. Our overall aim is to provide a best-practice reference for future authors, reviewers, and editors in reporting and reviewing the quality of measurement scales in empirical management studies.

Suggested Citation

  • Gordon W. Cheung & Helena D. Cooper-Thomas & Rebecca S. Lau & Linda C. Wang, 2024. "Reporting reliability, convergent and discriminant validity with structural equation modeling: A review and best-practice recommendations," Asia Pacific Journal of Management, Springer, vol. 41(2), pages 745-783, June.
    • Handle: RePEc:kap:asiapa:v:41:y:2024:i:2:d:10.1007_s10490-023-09871-y
    DOI: 10.1007/s10490-023-09871-y
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10490-023-09871-y
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10490-023-09871-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Xiaoyu Yu & Yajie Li & Zhongfeng Su & Yida Tao & Bang Nguyen & Fan Xia, 2020. "Entrepreneurial bricolage and its effects on new venture growth and adaptiveness in an emerging economy," Asia Pacific Journal of Management, Springer, vol. 37(4), pages 1141-1163, December.
    2. Gerbing, David W & Anderson, James C, 1984. "On the Meaning of Within-Factor Correlated Measurement Errors," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 11(1), pages 572-580, June.
    3. Wilmar Schaufeli & Marisa Salanova & Vicente González-romá & Arnold Bakker, 2002. "The Measurement of Engagement and Burnout: A Two Sample Confirmatory Factor Analytic Approach," Journal of Happiness Studies, Springer, vol. 3(1), pages 71-92, March.
    4. Tao Wang & Ting Zhang & Zhigang Shou, 2021. "The double-edged sword effect of political ties on performance in emerging markets: The mediation of innovation capability and legitimacy," Asia Pacific Journal of Management, Springer, vol. 38(3), pages 1003-1030, September.
    5. Bagozzi, Richard P, 1983. "Issues in the Application of Covariance Structure Analysis: A Further Comment," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 9(4), pages 449-450, March.
    6. Anderson, Brian S. & Eshima, Yoshihiro, 2013. "The influence of firm age and intangible resources on the relationship between entrepreneurial orientation and firm growth among Japanese SMEs," Journal of Business Venturing, Elsevier, vol. 28(3), pages 413-429.
    7. Ziyi Wei & Quyen T. K. Nguyen, 2020. "Local responsiveness strategy of foreign subsidiaries of Chinese multinationals: The impacts of relational-assets, market-seeking FDI, and host country institutional environments," Asia Pacific Journal of Management, Springer, vol. 37(3), pages 661-692, September.
    8. Rajdeep Grewal & Joseph A. Cote & Hans Baumgartner, 2004. "Multicollinearity and Measurement Error in Structural Equation Models: Implications for Theory Testing," Marketing Science, INFORMS, vol. 23(4), pages 519-529, June.
    9. Feng Wang & Wendian Shi, 2022. "The effect of work-leisure conflict on front-line employees’ work engagement: A cross-level study from the emotional perspective," Asia Pacific Journal of Management, Springer, vol. 39(1), pages 225-247, March.
    10. Shiu, Edward & Pervan, Simon J. & Bove, Liliana L. & Beatty, Sharon E., 2011. "Reflections on discriminant validity: Reexamining the Bove et al. (2009) findings," Journal of Business Research, Elsevier, vol. 64(5), pages 497-500, May.
    11. Klaas Sijtsma, 2009. "On the Use, the Misuse, and the Very Limited Usefulness of Cronbach’s Alpha," Psychometrika, Springer;The Psychometric Society, vol. 74(1), pages 107-120, March.
    12. Grand, James A. & Rogelberg, Steven G. & Allen, Tammy D. & Landis, Ronald S. & Reynolds, Douglas H. & Scott, John C. & Tonidandel, Scott & Truxillo, Donald M., 2018. "A Systems-Based Approach to Fostering Robust Science in Industrial-Organizational Psychology," Industrial and Organizational Psychology, Cambridge University Press, vol. 11(1), pages 4-42, March.
    13. Clay M. Voorhees & Michael K. Brady & Roger Calantone & Edward Ramirez, 2016. "Discriminant validity testing in marketing: an analysis, causes for concern, and proposed remedies," Journal of the Academy of Marketing Science, Springer, vol. 44(1), pages 119-134, January.
    14. Shuang Ren & Guiyao Tang & Susan Jackson, 2018. "Green human resource management research in emergence: A review and future directions," Asia Pacific Journal of Management, Springer, vol. 35(3), pages 769-803, September.
    15. Richard Zinbarg & William Revelle & Iftah Yovel & Wen Li, 2005. "Cronbach’s α, Revelle’s β, and Mcdonald’s ω H : their relations with each other and two alternative conceptualizations of reliability," Psychometrika, Springer;The Psychometric Society, vol. 70(1), pages 123-133, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. C. B. Bhattacharya & Sankar Sen & Laura Marie Edinger-Schons & Michael Neureiter, 2023. "Corporate Purpose and Employee Sustainability Behaviors," Journal of Business Ethics, Springer, vol. 183(4), pages 963-981, April.
    2. Golossenko, Artyom & Pillai, Kishore Gopalakrishna & Aroean, Lukman, 2020. "Seeing brands as humans: Development and validation of a brand anthropomorphism scale," International Journal of Research in Marketing, Elsevier, vol. 37(4), pages 737-755.
    3. Franke, George R. & Sarstedt, Marko & Danks, Nicholas P., 2021. "Assessing measure congruence in nomological networks," Journal of Business Research, Elsevier, vol. 130(C), pages 318-334.
    4. Brittney K. Anderson & John P. Meyer & Chelsea Vaters & Jose A. Espinoza, 2020. "Measuring Personal Growth and Development in Context: Evidence of Validity in Educational and Work Settings," Journal of Happiness Studies, Springer, vol. 21(6), pages 2141-2167, August.
    5. Michael Hennessy & Amy Bleakley & Martin Fishbein, 2012. "Measurement Models for Reasoned Action Theory," The ANNALS of the American Academy of Political and Social Science, , vol. 640(1), pages 42-57, March.
    6. Engin Ari & Osman M. Karatepe & Hamed Rezapouraghdam & Turgay Avci, 2020. "A Conceptual Model for Green Human Resource Management: Indicators, Differential Pathways, and Multiple Pro-Environmental Outcomes," Sustainability, MDPI, vol. 12(17), pages 1-18, August.
    7. Mercy Gloria Ashepet & Liesbet Vranken & Caroline Michellier & Olivier Dewitte & Rodgers Mutyebere & Clovis Kabaseke & Ronald Twongyirwe & Violet Kanyiginya & Grace Kagoro-Rugunda & Tine Huyse & Liesb, 2024. "Assessing scale reliability in citizen science motivational research: lessons learned from two case studies in Uganda," Palgrave Communications, Palgrave Macmillan, vol. 11(1), pages 1-18, December.
    8. Salim Moussa, 2016. "A Comment on the Estimation of the Reliability of Multidimensional Marketing Constructs: A Store Personality Scale Application," Global Business Review, International Management Institute, vol. 17(5), pages 1125-1144, October.
    9. Jeanne A. Teresi & Katja Ocepek-Welikson & John A. Toner & Marjorie Kleinman & Mildred Ramirez & Joseph P. Eimicke & Barry J. Gurland & Albert Siu, 2017. "Methodological Issues in Measuring Subjective Well-Being and Quality-of-Life: Applications to Assessment of Affect in Older, Chronically and Cognitively Impaired, Ethnically Diverse Groups Using the F," Applied Research in Quality of Life, Springer;International Society for Quality-of-Life Studies, vol. 12(2), pages 251-288, June.
    10. Lena Busch & Till Utesch & Bernd Strauss, 2019. "Validation of the vignette-based German Exercise Causality Orientation Scale (G-ECOS)," PLOS ONE, Public Library of Science, vol. 14(10), pages 1-20, October.
    11. Adam Jon Lebowitz & Shinji Sato & Miyuki Aiba, 2018. "Correlating Post-disaster Support Network Density with Reciprocal Support Relation Satisfaction: An Elderly Cohort Within One Year of the 2011 Japan Disasters," Population Research and Policy Review, Springer;Southern Demographic Association (SDA), vol. 37(6), pages 923-939, December.
    12. Simon L. Albrecht & Camille R. Green & Andrew Marty, 2021. "Meaningful Work, Job Resources, and Employee Engagement," Sustainability, MDPI, vol. 13(7), pages 1-14, April.
    13. Yanhui Zhao & Roger J. Calantone & Clay M. Voorhees, 2018. "Identity change vs. strategy change: the effects of rebranding announcements on stock returns," Journal of the Academy of Marketing Science, Springer, vol. 46(5), pages 795-812, September.
    14. Paola Spagnoli & Cristian Balducci & Liliya Scafuri Kovalchuk & Francesco Maiorano & Carmela Buono, 2018. "Are Engaged Workaholics Protected against Job-Related Negative Affect and Anxiety before Sleep? A Study of the Moderating Role of Gender," IJERPH, MDPI, vol. 15(9), pages 1-18, September.
    15. Ayman Alshaabani & Farheen Naz & Ildikó Rudnák, 2021. "Impact of Green Human Resources Practices on Green Work Engagement in the Renewable Energy Departments," International Business Research, Canadian Center of Science and Education, vol. 14(6), pages 1-44, June.
    16. Piotr Tarka, 2018. "An overview of structural equation modeling: its beginnings, historical development, usefulness and controversies in the social sciences," Quality & Quantity: International Journal of Methodology, Springer, vol. 52(1), pages 313-354, January.
    17. Gumataw Kifle Abebe, 2020. "Effects of institutional pressures on the governance of food safety in emerging food supply chains: a case of Lebanese food processors," Agriculture and Human Values, Springer;The Agriculture, Food, & Human Values Society (AFHVS), vol. 37(4), pages 1125-1138, December.
    18. Saumya Aggarwal & Ajay Kumar Singh, 2024. "Developmental, Relational and Facilitating (DRF) Organizational Culture Scale: An Empirical Study in Select Colleges of University of Delhi," Global Business Review, International Management Institute, vol. 25(2_suppl), pages 78-89, April.
    19. Huseyin Arasli & Ahmet Nergiz & Mehmet Yesiltas & Tugrul Gunay, 2020. "Human Resource Management Practices and Service Provider Commitment of Green Hotel Service Providers: Mediating Role of Resilience and Work Engagement," Sustainability, MDPI, vol. 12(21), pages 1-22, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:asiapa:v:41:y:2024:i:2:d:10.1007_s10490-023-09871-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.