IDEAS home Printed from https://ideas.repec.org/a/eee/jbrese/v169y2023ics0148296323006501.html
   My bibliography  Save this article

Toward open science in PLS-SEM: Assessing the state of the art and future perspectives

Author

Listed:
  • Adler, Susanne Jana
  • Sharma, Pratyush Nidhi
  • Radomir, Lăcrămioara

Abstract

Driven by the high-profile failures to reproduce and replicate published findings, there have been increasing demands to adopt open science practices across scientific disciplines in order to enhance research transparency. Critics have highlighted the use of underpowered studies and researchers’ analytical degrees of freedom as factors contributing to these issues. Despite methodological advances and updated guidelines, similar concerns persist regarding studies utilizing partial least squares structural equation modeling (PLS-SEM). Open science practices can help alleviate these concerns by facilitating transparency in PLS-SEM-based studies. However, the current level of adherence to these practices remains unknown. In this article, we conduct a comprehensive literature review of leading marketing journals to assess the extent to which open science practices are implemented in PLS-SEM-based studies. Based on the observed lack of adoption, we propose a PLS-SEM-specific preregistration template that researchers can use to foster transparency in their analyses, thereby bolstering confidence in their findings.

Suggested Citation

  • Adler, Susanne Jana & Sharma, Pratyush Nidhi & Radomir, Lăcrămioara, 2023. "Toward open science in PLS-SEM: Assessing the state of the art and future perspectives," Journal of Business Research, Elsevier, vol. 169(C).
    • Handle: RePEc:eee:jbrese:v:169:y:2023:i:c:s0148296323006501
    DOI: 10.1016/j.jbusres.2023.114291
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0148296323006501
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jbusres.2023.114291?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Aparna A. Labroo & Natalie Mizik & Russell Winer, 2022. "Introducing Marketing Letters’ data policy," Marketing Letters, Springer, vol. 33(3), pages 361-364, September.
    2. Cheah, Jun-Hwa & Amaro, Suzanne & Roldán, José L., 2023. "Multigroup analysis of more than two groups in PLS-SEM: A review, illustration, and recommendations," Journal of Business Research, Elsevier, vol. 156(C).
    3. Lynch, John G. & Bradlow, Eric T. & Huber, Joel C. & Lehmann, Donald R., 2015. "Reflections on the replication corner: In praise of conceptual replications," International Journal of Research in Marketing, Elsevier, vol. 32(4), pages 333-342.
    4. Tom E. Hardwicke & Eric-Jan Wagenmakers, 2023. "Reducing bias, increasing transparency and calibrating confidence with preregistration," Nature Human Behaviour, Nature, vol. 7(1), pages 15-26, January.
    5. Nicholas Berente & Stefan Seidel & Hani Safadi, 2019. "Research Commentary—Data-Driven Computationally Intensive Theory Development," Service Science, INFORMS, vol. 30(1), pages 50-64, March.
    6. Wicherts, Jelte M. & Veldkamp, Coosje Lisabet Sterre & Augusteijn, Hilde & Bakker, Marjan & van Aert, Robbie Cornelis Maria & van Assen, Marcel A. L. M., 2016. "Degrees of freedom in planning, running, analyzing, and reporting psychological studies A checklist to avoid p-hacking," OSF Preprints umq8d, Center for Open Science.
    7. Jun-Hwa Cheah & Hiram Ting & T. Ramayah & Mumtaz Ali Memon & Tat-Huei Cham & Enrico Ciavolino, 2019. "A comparison of five reflective–formative estimation approaches: reconsideration and recommendations for tourism research," Quality & Quantity: International Journal of Methodology, Springer, vol. 53(3), pages 1421-1458, May.
    8. Ryan, James C. & A Tipu, Syed A., 2022. "Business and management research: Low instances of replication studies and a lack of author independence in replications," Research Policy, Elsevier, vol. 51(1).
    9. Vicente-Saez, Ruben & Martinez-Fuentes, Clara, 2018. "Open Science now: A systematic literature review for an integrated definition," Journal of Business Research, Elsevier, vol. 88(C), pages 428-436.
    10. Esther Maassen & Marcel A L M van Assen & Michèle B Nuijten & Anton Olsson-Collentine & Jelte M Wicherts, 2020. "Reproducibility of individual effect sizes in meta-analyses in psychology," PLOS ONE, Public Library of Science, vol. 15(5), pages 1-18, May.
    11. Courtney K. Soderberg & Timothy M. Errington & Sarah R. Schiavone & Julia Bottesini & Felix Singleton Thorn & Simine Vazire & Kevin M. Esterling & Brian A. Nosek, 2021. "Initial evidence of research quality of registered reports compared with the standard publishing model," Nature Human Behaviour, Nature, vol. 5(8), pages 990-997, August.
    12. Alexander Etz & Joachim Vandekerckhove, 2016. "A Bayesian Perspective on the Reproducibility Project: Psychology," PLOS ONE, Public Library of Science, vol. 11(2), pages 1-12, February.
    13. Danks, Nicholas P. & Sharma, Pratyush N. & Sarstedt, Marko, 2020. "Model selection uncertainty and multimodel inference in partial least squares structural equation modeling (PLS-SEM)," Journal of Business Research, Elsevier, vol. 113(C), pages 13-24.
    14. Shmueli, Galit & Ray, Soumya & Velasquez Estrada, Juan Manuel & Chatla, Suneel Babu, 2016. "The elephant in the room: Predictive performance of PLS models," Journal of Business Research, Elsevier, vol. 69(10), pages 4552-4564.
    15. Rudolf R. Sinkovics & Eva A. Alfoldi, 2012. "Progressive Focusing and Trustworthiness in Qualitative Research," Management International Review, Springer, vol. 52(6), pages 817-845, December.
    16. Nosek, Brian A. & Ebersole, Charles R. & DeHaven, Alexander Carl & Mellor, David Thomas, 2018. "The Preregistration Revolution," OSF Preprints 2dxu5, Center for Open Science.
    17. Matthew J Page & Joanne E McKenzie & Patrick M Bossuyt & Isabelle Boutron & Tammy C Hoffmann & Cynthia D Mulrow & Larissa Shamseer & Jennifer M Tetzlaff & Elie A Akl & Sue E Brennan & Roger Chou & Jul, 2021. "The PRISMA 2020 statement: An updated guideline for reporting systematic reviews," PLOS Medicine, Public Library of Science, vol. 18(3), pages 1-15, March.
    18. Daniël Lakens, 2023. "Is my study useless? Why researchers need methodological review boards," Nature, Nature, vol. 613(7942), pages 9-9, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Adler, Susanne Jana & Röseler, Lukas & Schöniger, Martina Katharina, 2023. "A toolbox to evaluate the trustworthiness of published findings," Journal of Business Research, Elsevier, vol. 167(C).
    2. Shaw, Steven D. & Nave, Gideon, 2023. "Don't hate the player, hate the game: Realigning incentive structures to promote robust science and better scientific practices in marketing," Journal of Business Research, Elsevier, vol. 167(C).
    3. Riggs, Randy & Felipe, Carmen M. & Roldán, José L. & Real, Juan C., 2024. "Information systems capabilities value creation through circular economy practices in uncertain environments: A conditional mediation model," Journal of Business Research, Elsevier, vol. 175(C).
    4. Jasper Brinkerink, 2023. "When Shooting for the Stars Becomes Aiming for Asterisks: P-Hacking in Family Business Research," Entrepreneurship Theory and Practice, , vol. 47(2), pages 304-343, March.
    5. Colin F. Camerer & Anna Dreber & Felix Holzmeister & Teck-Hua Ho & Jürgen Huber & Magnus Johannesson & Michael Kirchler & Gideon Nave & Brian A. Nosek & Thomas Pfeiffer & Adam Altmejd & Nick Buttrick , 2018. "Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015," Nature Human Behaviour, Nature, vol. 2(9), pages 637-644, September.
    6. Lim, Xin-Jean & Cheah, Jun-Hwa & Ngo, Liem Viet & Chan, Kara & Ting, Hiram, 2023. "How do crazy rich Asians perceive sustainable luxury? Investigating the determinants of consumers’ willingness to pay a premium price," Journal of Retailing and Consumer Services, Elsevier, vol. 75(C).
    7. Cassia, Fabio & Magno, Francesca, 2024. "The value of self-determination theory in marketing studies: Insights from the application of PLS-SEM and NCA to anti-food waste apps," Journal of Business Research, Elsevier, vol. 172(C).
    8. Enrico Ciavolino & Massimo Aria & Jun-Hwa Cheah & José Luis Roldán, 2022. "A tale of PLS Structural Equation Modelling: Episode I— A Bibliometrix Citation Analysis," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 164(3), pages 1323-1348, December.
    9. Felix Holzmeister & Magnus Johannesson & Robert Böhm & Anna Dreber & Jürgen Huber & Michael Kirchler, 2023. "Heterogeneity in effect size estimates: Empirical evidence and practical implications," Working Papers 2023-17, Faculty of Economics and Statistics, Universität Innsbruck.
    10. Mathur, Maya B & VanderWeele, Tyler, 2018. "Statistical methods for evidence synthesis," Thesis Commons kd6ja, Center for Open Science.
    11. Chin, Jason & Zeiler, Kathryn, 2021. "Replicability in Empirical Legal Research," LawArXiv 2b5k4, Center for Open Science.
    12. Brinkerink, Jasper & De Massis, Alfredo & Kellermanns, Franz, 2022. "One finding is no finding: Toward a replication culture in family business research," Journal of Family Business Strategy, Elsevier, vol. 13(4).
    13. Capeau, Fanny & Valette-Florence, Pierre & Cova, Véronique, 2024. "A consumer demands-resources model of engagement: Theoretical and managerial contributions from a cross-validated predictive ability test procedure," Journal of Business Research, Elsevier, vol. 177(C).
    14. Sarstedt, Marko & Hair, Joseph F. & Cheah, Jun-Hwa & Becker, Jan-Michael & Ringle, Christian M., 2019. "How to specify, estimate, and validate higher-order constructs in PLS-SEM," Australasian marketing journal, Elsevier, vol. 27(3), pages 197-211.
    15. Maya B. Mathur & Tyler J. VanderWeele, 2020. "New statistical metrics for multisite replication projects," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 183(3), pages 1145-1166, June.
    16. Basco, Rodrigo & Hair, Joseph F. & Ringle, Christian M. & Sarstedt, Marko, 2022. "Advancing family business research through modeling nonlinear relationships: Comparing PLS-SEM and multiple regression," Journal of Family Business Strategy, Elsevier, vol. 13(3).
    17. Mansoor, Mahnaz & Paul, Justin & Saeed, Abid & Cheah, Jun-Hwa, 2024. "When mass meets prestige: The impact of symbolic motivations, inspirations, and purchase intentions for Masstige products," Journal of Business Research, Elsevier, vol. 176(C).
    18. Cheah, Jun-Hwa & Waller, David & Thaichon, Park & Ting, Hiram & Lim, Xin-Jean, 2020. "Price image and the sugrophobia effect on luxury retail purchase intention," Journal of Retailing and Consumer Services, Elsevier, vol. 57(C).
    19. Kraft-Todd, Gordon T. & Rand, David G., 2021. "Practice what you preach: Credibility-enhancing displays and the growth of open science," Organizational Behavior and Human Decision Processes, Elsevier, vol. 164(C), pages 1-10.
    20. Alexander Maedche & Edona Elshan & Hartmut Höhle & Christiane Lehrer & Jan Recker & Ali Sunyaev & Benjamin Sturm & Oliver Werth, 2024. "Open Science," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 66(4), pages 517-532, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jbrese:v:169:y:2023:i:c:s0148296323006501. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jbusres .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.