IDEAS home Printed from https://ideas.repec.org/a/kap/asiapa/v41y2024i2d10.1007_s10490-023-09871-y.html
   My bibliography  Save this article

Reporting reliability, convergent and discriminant validity with structural equation modeling: A review and best-practice recommendations

Author

Listed:
  • Gordon W. Cheung

    (The University of Auckland)

  • Helena D. Cooper-Thomas

    (Auckland University of Technology)

  • Rebecca S. Lau
  • Linda C. Wang

    (The Hang Seng University of Hong Kong)

Abstract

Many constructs in management studies, such as perceptions, personalities, attitudes, and behavioral intentions, are not directly observable. Typically, empirical studies measure such constructs using established scales with multiple indicators. When the scales are used in a different population, the items are translated into other languages or revised to adapt to other populations, it is essential for researchers to report the quality of measurement scales before using them to test hypotheses. Researchers commonly report the quality of these measurement scales based on Cronbach’s alpha and confirmatory factor analysis results. However, these results are usually inadequate and sometimes inappropriate. Moreover, researchers rarely consider sampling errors for these psychometric quality measures. In this best practice paper, we first critically review the most frequently-used approaches in empirical studies to evaluate the quality of measurement scales when using structural equation modeling. Next, we recommend best practices in assessing reliability, convergent and discriminant validity based on multiple criteria and taking sampling errors into consideration. Then, we illustrate with numerical examples the application of a specifically-developed R package, measureQ, that provides a one-stop solution for implementing the recommended best practices and a template for reporting the results. measureQ is easy to implement, even for those new to R. Our overall aim is to provide a best-practice reference for future authors, reviewers, and editors in reporting and reviewing the quality of measurement scales in empirical management studies.

Suggested Citation

  • Gordon W. Cheung & Helena D. Cooper-Thomas & Rebecca S. Lau & Linda C. Wang, 2024. "Reporting reliability, convergent and discriminant validity with structural equation modeling: A review and best-practice recommendations," Asia Pacific Journal of Management, Springer, vol. 41(2), pages 745-783, June.
    • Handle: RePEc:kap:asiapa:v:41:y:2024:i:2:d:10.1007_s10490-023-09871-y
    DOI: 10.1007/s10490-023-09871-y
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10490-023-09871-y
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10490-023-09871-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Feng Wang & Wendian Shi, 2022. "The effect of work-leisure conflict on front-line employees’ work engagement: A cross-level study from the emotional perspective," Asia Pacific Journal of Management, Springer, vol. 39(1), pages 225-247, March.
    2. Shiu, Edward & Pervan, Simon J. & Bove, Liliana L. & Beatty, Sharon E., 2011. "Reflections on discriminant validity: Reexamining the Bove et al. (2009) findings," Journal of Business Research, Elsevier, vol. 64(5), pages 497-500, May.
    3. Xiaoyu Yu & Yajie Li & Zhongfeng Su & Yida Tao & Bang Nguyen & Fan Xia, 2020. "Entrepreneurial bricolage and its effects on new venture growth and adaptiveness in an emerging economy," Asia Pacific Journal of Management, Springer, vol. 37(4), pages 1141-1163, December.
    4. Gerbing, David W & Anderson, James C, 1984. "On the Meaning of Within-Factor Correlated Measurement Errors," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 11(1), pages 572-580, June.
    5. Klaas Sijtsma, 2009. "On the Use, the Misuse, and the Very Limited Usefulness of Cronbach’s Alpha," Psychometrika, Springer;The Psychometric Society, vol. 74(1), pages 107-120, March.
    6. Wilmar Schaufeli & Marisa Salanova & Vicente González-romá & Arnold Bakker, 2002. "The Measurement of Engagement and Burnout: A Two Sample Confirmatory Factor Analytic Approach," Journal of Happiness Studies, Springer, vol. 3(1), pages 71-92, March.
    7. Tao Wang & Ting Zhang & Zhigang Shou, 2021. "The double-edged sword effect of political ties on performance in emerging markets: The mediation of innovation capability and legitimacy," Asia Pacific Journal of Management, Springer, vol. 38(3), pages 1003-1030, September.
    8. Bagozzi, Richard P, 1983. "Issues in the Application of Covariance Structure Analysis: A Further Comment," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 9(4), pages 449-450, March.
    9. Grand, James A. & Rogelberg, Steven G. & Allen, Tammy D. & Landis, Ronald S. & Reynolds, Douglas H. & Scott, John C. & Tonidandel, Scott & Truxillo, Donald M., 2018. "A Systems-Based Approach to Fostering Robust Science in Industrial-Organizational Psychology," Industrial and Organizational Psychology, Cambridge University Press, vol. 11(1), pages 4-42, March.
    10. Anderson, Brian S. & Eshima, Yoshihiro, 2013. "The influence of firm age and intangible resources on the relationship between entrepreneurial orientation and firm growth among Japanese SMEs," Journal of Business Venturing, Elsevier, vol. 28(3), pages 413-429.
    11. Ziyi Wei & Quyen T. K. Nguyen, 2020. "Local responsiveness strategy of foreign subsidiaries of Chinese multinationals: The impacts of relational-assets, market-seeking FDI, and host country institutional environments," Asia Pacific Journal of Management, Springer, vol. 37(3), pages 661-692, September.
    12. Clay M. Voorhees & Michael K. Brady & Roger Calantone & Edward Ramirez, 2016. "Discriminant validity testing in marketing: an analysis, causes for concern, and proposed remedies," Journal of the Academy of Marketing Science, Springer, vol. 44(1), pages 119-134, January.
    13. Rajdeep Grewal & Joseph A. Cote & Hans Baumgartner, 2004. "Multicollinearity and Measurement Error in Structural Equation Models: Implications for Theory Testing," Marketing Science, INFORMS, vol. 23(4), pages 519-529, June.
    14. Rosseel, Yves, 2012. "lavaan: An R Package for Structural Equation Modeling," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 48(i02).
    15. Shuang Ren & Guiyao Tang & Susan Jackson, 2018. "Green human resource management research in emergence: A review and future directions," Asia Pacific Journal of Management, Springer, vol. 35(3), pages 769-803, September.
    16. Richard Zinbarg & William Revelle & Iftah Yovel & Wen Li, 2005. "Cronbach’s α, Revelle’s β, and Mcdonald’s ω H : their relations with each other and two alternative conceptualizations of reliability," Psychometrika, Springer;The Psychometric Society, vol. 70(1), pages 123-133, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chih-Wen Ting & Hung-Xin Li & Kuei-Hsien Chen & Yue-Shi Lee & Show-Jane Yen, 2024. "How Can Organizational Leadership Promote Environmental Behaviors through Corporate Social Responsibility Policy Adoption? The Moderating Role of Environmental Awareness," Sustainability, MDPI, vol. 16(17), pages 1-13, September.
    2. Aminjonova, Gulrukhsor & Khasanova, Dilfuzakhon, 2024. "How Perceived CSR Drives Customer Value Co-Creation in E-Commerce: Examining the Moderating Effect of Gender and the Mediating Effect of Satisfaction," SocArXiv 69cdm, Center for Open Science.
    3. Meng Qi & Zulhamri Abdullah & Saiful Nujaimi Abdul Rahman, 2024. "Navigating the Digital Landscape: Evaluating the Impacts of Digital IMC on Building and Maintaining Destination Brand Equity," Sustainability, MDPI, vol. 16(20), pages 1-19, October.
    4. Sara Petrilli & Marianna Giunchi & Anne-Marie Vonthron, 2024. "Leader–Member Exchange (LMX) and Adjustment to the Work Mode as Protective Factors to Counteract Exhaustion and Turnover Intention: A Chain Mediation Model," Sustainability, MDPI, vol. 16(23), pages 1-20, November.
    5. Henry Inegbedion & Chinenye-Sylvia Okoye-uzu, 2024. "Tax audit on tax revenue of SMEs in Nigeria," Palgrave Communications, Palgrave Macmillan, vol. 11(1), pages 1-10, December.
    6. Suchart Tripopsakul, 2024. "The Moderating Roles of Environmental Awareness and Product Knowledge on the Impact of Marketing Mix Elements on Purchase Intention," International Review of Management and Marketing, Econjournals, vol. 14(6), pages 61-69, October.
    7. Wan Edura Wan Rashid & Norfadzilah Abdul Razak & Shamsul Bahrin Saihani, 2024. "Building the Future: Attitude, Knowledge, Digital Skills, and Adaptability in Student Learning," International Journal of Research and Innovation in Social Science, International Journal of Research and Innovation in Social Science (IJRISS), vol. 8(3s), pages 5755-5763, November.
    8. Stanislav Avsec & Magdalena Jagiełło-Kowalczyk & Agnieszka Żabicka & Joanna Gil-Mastalerczyk & Agata Gawlak, 2024. "Human-Centered Systems Thinking in Technology-Enhanced Sustainable and Inclusive Architectural Design," Sustainability, MDPI, vol. 16(22), pages 1-45, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mercy Gloria Ashepet & Liesbet Vranken & Caroline Michellier & Olivier Dewitte & Rodgers Mutyebere & Clovis Kabaseke & Ronald Twongyirwe & Violet Kanyiginya & Grace Kagoro-Rugunda & Tine Huyse & Liesb, 2024. "Assessing scale reliability in citizen science motivational research: lessons learned from two case studies in Uganda," Palgrave Communications, Palgrave Macmillan, vol. 11(1), pages 1-18, December.
    2. Lena Busch & Till Utesch & Bernd Strauss, 2019. "Validation of the vignette-based German Exercise Causality Orientation Scale (G-ECOS)," PLOS ONE, Public Library of Science, vol. 14(10), pages 1-20, October.
    3. Piotr Tarka, 2018. "An overview of structural equation modeling: its beginnings, historical development, usefulness and controversies in the social sciences," Quality & Quantity: International Journal of Methodology, Springer, vol. 52(1), pages 313-354, January.
    4. Hernán Bejarano & Pedro Hancevic & Yadira Peralta, 2024. "Pro-Environmental Values and Energy Practices in Mexican Small and Medium-Sized Enterprises: Insights from the New Ecological Paradigm," Working Papers DTE 636, CIDE, División de Economía.
    5. Anna Jasinenko & Josephina Steuber, 2023. "Perceived Organizational Purpose: Systematic Literature Review, Construct Definition, Measurement and Potential Employee Outcomes," Journal of Management Studies, Wiley Blackwell, vol. 60(6), pages 1415-1447, September.
    6. Jorge Sinval & M. Joseph Sirgy & Dong-Jin Lee & João Marôco, 2020. "The Quality of Work Life Scale: Validity Evidence from Brazil and Portugal," Applied Research in Quality of Life, Springer;International Society for Quality-of-Life Studies, vol. 15(5), pages 1323-1351, November.
    7. C. B. Bhattacharya & Sankar Sen & Laura Marie Edinger-Schons & Michael Neureiter, 2023. "Corporate Purpose and Employee Sustainability Behaviors," Journal of Business Ethics, Springer, vol. 183(4), pages 963-981, April.
    8. Golossenko, Artyom & Pillai, Kishore Gopalakrishna & Aroean, Lukman, 2020. "Seeing brands as humans: Development and validation of a brand anthropomorphism scale," International Journal of Research in Marketing, Elsevier, vol. 37(4), pages 737-755.
    9. Franke, George R. & Sarstedt, Marko & Danks, Nicholas P., 2021. "Assessing measure congruence in nomological networks," Journal of Business Research, Elsevier, vol. 130(C), pages 318-334.
    10. Brittney K. Anderson & John P. Meyer & Chelsea Vaters & Jose A. Espinoza, 2020. "Measuring Personal Growth and Development in Context: Evidence of Validity in Educational and Work Settings," Journal of Happiness Studies, Springer, vol. 21(6), pages 2141-2167, August.
    11. Michael Hennessy & Amy Bleakley & Martin Fishbein, 2012. "Measurement Models for Reasoned Action Theory," The ANNALS of the American Academy of Political and Social Science, , vol. 640(1), pages 42-57, March.
    12. Piotr Koc, 2021. "Measuring Non-electoral Political Participation: Bi-factor Model as a Tool to Extract Dimensions," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 156(1), pages 271-287, July.
    13. Nuria González-Castellano & Eulogio Cordón-Pozo & Silvia Pueyo-Villa & María Jesús Colmenero-Ruiz, 2021. "Higher Education Teachers’ Training in Attention to SEN Students: Testing a Mediation Model," Sustainability, MDPI, vol. 13(9), pages 1-13, April.
    14. Engin Ari & Osman M. Karatepe & Hamed Rezapouraghdam & Turgay Avci, 2020. "A Conceptual Model for Green Human Resource Management: Indicators, Differential Pathways, and Multiple Pro-Environmental Outcomes," Sustainability, MDPI, vol. 12(17), pages 1-18, August.
    15. Salim Moussa, 2016. "A Comment on the Estimation of the Reliability of Multidimensional Marketing Constructs: A Store Personality Scale Application," Global Business Review, International Management Institute, vol. 17(5), pages 1125-1144, October.
    16. Jeanne A. Teresi & Katja Ocepek-Welikson & John A. Toner & Marjorie Kleinman & Mildred Ramirez & Joseph P. Eimicke & Barry J. Gurland & Albert Siu, 2017. "Methodological Issues in Measuring Subjective Well-Being and Quality-of-Life: Applications to Assessment of Affect in Older, Chronically and Cognitively Impaired, Ethnically Diverse Groups Using the F," Applied Research in Quality of Life, Springer;International Society for Quality-of-Life Studies, vol. 12(2), pages 251-288, June.
    17. Adam Jon Lebowitz & Shinji Sato & Miyuki Aiba, 2018. "Correlating Post-disaster Support Network Density with Reciprocal Support Relation Satisfaction: An Elderly Cohort Within One Year of the 2011 Japan Disasters," Population Research and Policy Review, Springer;Southern Demographic Association (SDA), vol. 37(6), pages 923-939, December.
    18. Tormod Bøe & Mari Hysing & Jens Christoffer Skogen & Kyrre Breivik, 2016. "The Strengths and Difficulties Questionnaire (SDQ): Factor Structure and Gender Equivalence in Norwegian Adolescents," PLOS ONE, Public Library of Science, vol. 11(5), pages 1-15, May.
    19. Simon L. Albrecht & Camille R. Green & Andrew Marty, 2021. "Meaningful Work, Job Resources, and Employee Engagement," Sustainability, MDPI, vol. 13(7), pages 1-14, April.
    20. Érika Martins Silva Ramos & Cecilia Jakobsson Bergstad, 2021. "The Psychology of Sharing: Multigroup Analysis among Users and Non-Users of Carsharing," Sustainability, MDPI, vol. 13(12), pages 1-17, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:asiapa:v:41:y:2024:i:2:d:10.1007_s10490-023-09871-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.