IDEAS home Printed from https://ideas.repec.org/a/spr/manrev/v73y2023i3d10.1007_s11301-022-00269-6.html
   My bibliography  Save this article

Replication studies in top management journals: An empirical investigation of prevalence, types, outcomes, and impact

Author

Listed:
  • Jörn H. Block

    (Trier University
    Erasmus University Rotterdam
    Witten Institute for Family Business, Witten/Herdecke University)

  • Christian Fisch

    (University of Luxembourg)

  • Narmeen Kanwal

    (Trier University)

  • Solvej Lorenzen

    (Witten Institute for Family Business, Witten/Herdecke University)

  • Anna Schulze

    (Trier University)

Abstract

Replication studies are important for the empirical research process. Yet, while there is an increased awareness of the need for replication in management research, it appears that such studies are rarely published in leading management journals. Importantly, we lack a comprehensive overview of replication studies in the top management journals that spans all sub-disciplines. Our systematic review closes this gap and provides an overview of the prevalence, types, outcomes, and impact of replication studies in management journals. We find that differences in the prevalence of replications between sub-disciplines exist and that most replications are wide replications. With regard to the replication outcome, our review shows that the share of non-confirming replications is low. Moreover, such replications are cited less often than confirming replications pointing towards a confirmation bias in management research. We discuss the implications of our results for authors, reviewers, and editors of management journals.

Suggested Citation

  • Jörn H. Block & Christian Fisch & Narmeen Kanwal & Solvej Lorenzen & Anna Schulze, 2023. "Replication studies in top management journals: An empirical investigation of prevalence, types, outcomes, and impact," Management Review Quarterly, Springer, vol. 73(3), pages 1109-1134, September.
    • Handle: RePEc:spr:manrev:v:73:y:2023:i:3:d:10.1007_s11301-022-00269-6
    DOI: 10.1007/s11301-022-00269-6
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11301-022-00269-6
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11301-022-00269-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Richard A. Bettis & Constance E. Helfat & J. Myles Shaver & Richard A. Bettis & Constance E. Helfat & J. Myles Shaver, 2016. "The necessity, logic, and forms of replication," Strategic Management Journal, Wiley Blackwell, vol. 37(11), pages 2193-2203, November.
    2. Shuonan Yuan & Marc Oliver Rieger & Nilüfer Caliskan, 2020. "Maxing out: the puzzling influence of past maximum returns on future asset prices in a cross-country analysis," Management Review Quarterly, Springer, vol. 70(4), pages 567-589, November.
    3. Mueller-Langer, Frank & Fecher, Benedikt & Harhoff, Dietmar & Wagner, Gert G., 2019. "Replication studies in economics—How many and which papers are chosen for replication, and why?," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 48(1), pages 62-83.
    4. Paul M. Guest, 2021. "Risk Management in Financial Institutions: A Replication," Journal of Finance, American Finance Association, vol. 76(5), pages 2689-2707, October.
    5. Arthur, W Brian, 1989. "Competing Technologies, Increasing Returns, and Lock-In by Historical Events," Economic Journal, Royal Economic Society, vol. 99(394), pages 116-131, March.
    6. Anne-Wil Harzing, 2013. "A preliminary test of Google Scholar as a source for citation data: a longitudinal study of Nobel prize winners," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(3), pages 1057-1075, March.
    7. Jörn Block & Andreas Kuckertz, 2018. "Seven principles of effective replication studies: strengthening the evidence base of management research," Management Review Quarterly, Springer, vol. 68(4), pages 355-359, November.
    8. Ryan, James C. & A Tipu, Syed A., 2022. "Business and management research: Low instances of replication studies and a lack of author independence in replications," Research Policy, Elsevier, vol. 51(1).
    9. Herman Aguinis & Wayne F. Cascio & Ravi S. Ramani, 2017. "Science’s reproducibility and replicability crisis: International business is not immune," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 48(6), pages 653-663, August.
    10. Camerer, Colin & Dreber, Anna & Forsell, Eskil & Ho, Teck-Hua & Huber, Jurgen & Johannesson, Magnus & Kirchler, Michael & Almenberg, Johan & Altmejd, Adam & Chan, Taizan & Heikensten, Emma & Holzmeist, 2016. "Evaluating replicability of laboratory experiments in Economics," MPRA Paper 75461, University Library of Munich, Germany.
    11. Hubbard, Raymond & Vetter, Daniel E., 1996. "An empirical comparison of published replication research in accounting, economics, finance, management, and marketing," Journal of Business Research, Elsevier, vol. 35(2), pages 153-164, February.
    12. Hensel, Przemysław G., 2021. "Reproducibility and replicability crisis: How management compares to psychology and economics – A systematic review of literature," European Management Journal, Elsevier, vol. 39(5), pages 577-594.
    13. James R. Scotter, 2020. "Narcissism in CEO research: a review and replication of the archival approach," Management Review Quarterly, Springer, vol. 70(4), pages 629-674, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Brinkerink, Jasper & De Massis, Alfredo & Kellermanns, Franz, 2022. "One finding is no finding: Toward a replication culture in family business research," Journal of Family Business Strategy, Elsevier, vol. 13(4).
    2. Hensel, Przemysław G., 2021. "Reproducibility and replicability crisis: How management compares to psychology and economics – A systematic review of literature," European Management Journal, Elsevier, vol. 39(5), pages 577-594.
    3. G. Christopher Crawford & Vitaliy Skorodziyevskiy & Casey J. Frid & Thomas E. Nelson & Zahra Booyavi & Diana M. Hechavarria & Xuanye Li & Paul D. Reynolds & Ehsan Teymourian, 2022. "Advancing Entrepreneurship Theory Through Replication: A Case Study on Contemporary Methodological Challenges, Future Best Practices, and an Entreaty for Communality," Entrepreneurship Theory and Practice, , vol. 46(3), pages 779-799, May.
    4. Francesco Debellis & Michele Pinelli & Marcel Hülsbeck & Anne Heider, 2023. "Ownership, governance, and internationalization in family firms: a replication and extension," Small Business Economics, Springer, vol. 61(4), pages 1437-1459, December.
    5. Dreber, Anna & Johannesson, Magnus, 2023. "A framework for evaluating reproducibility and replicability in economics," I4R Discussion Paper Series 38, The Institute for Replication (I4R).
    6. Tom Coupé & Thomas Logchies & W. Robert Reed, 2024. "Do Replications Really Receive Fewer Citations?," Working Papers in Economics 24/15, University of Canterbury, Department of Economics and Finance.
    7. Hensel, Przemysław G., 2019. "Supporting replication research in management journals: Qualitative analysis of editorials published between 1970 and 2015," European Management Journal, Elsevier, vol. 37(1), pages 45-57.
    8. Wu, Tao & Delios, Andrew & Chen, Zhaowei & Wang, Xin, 2023. "Rethinking corruption in international business: An empirical review," Journal of World Business, Elsevier, vol. 58(2).
    9. Nick Huntington‐Klein & Andreu Arenas & Emily Beam & Marco Bertoni & Jeffrey R. Bloem & Pralhad Burli & Naibin Chen & Paul Grieco & Godwin Ekpe & Todd Pugatch & Martin Saavedra & Yaniv Stopnitzky, 2021. "The influence of hidden researcher decisions in applied microeconomics," Economic Inquiry, Western Economic Association International, vol. 59(3), pages 944-960, July.
    10. Zhang, Jianhong & van Witteloostuijn, Arjen & Zhou, Chaohong & Zhou, Shengyang, 2024. "Cross-border acquisition completion by emerging market MNEs revisited: Inductive evidence from a machine learning analysis," Journal of World Business, Elsevier, vol. 59(2).
    11. Markku Maula & Wouter Stam, 2020. "Enhancing Rigor in Quantitative Entrepreneurship Research," Entrepreneurship Theory and Practice, , vol. 44(6), pages 1059-1090, November.
    12. Thibaut Arpinon & Marianne Lefebvre, 2024. "Registered Reports and Associated Benefits for Agricultural Economics," Post-Print hal-04635986, HAL.
    13. Hardcopf, Rick & Liu, Gensheng (Jason) & Shah, Rachna, 2021. "Lean production and operational performance: The influence of organizational culture," International Journal of Production Economics, Elsevier, vol. 235(C).
    14. Cristina Blanco-Perez & Abel Brodeur, 2019. "Transparency in empirical economic research," IZA World of Labor, Institute of Labor Economics (IZA), pages 467-467, November.
    15. Abel Brodeur & Nikolai Cook & Carina Neisser, 2024. "p-Hacking, Data type and Data-Sharing Policy," The Economic Journal, Royal Economic Society, vol. 134(659), pages 985-1018.
    16. Guillaume Coqueret, 2023. "Forking paths in financial economics," Papers 2401.08606, arXiv.org.
    17. Isager, Peder Mortvedt & van Aert, Robbie Cornelis Maria & Bahník, Štěpán & Brandt, Mark John & DeSoto, Kurt Andrew & Giner-Sorolla, Roger & Krueger, Joachim & Perugini, Marco & Ropovik, Ivan & van 't, 2020. "Deciding what to replicate: A formal definition of “replication value” and a decision model for replication study selection," MetaArXiv 2gurz, Center for Open Science.
    18. Igor Asanov & Christoph Buehren & Panagiota Zacharodimou, 2020. "The power of experiments: How big is your n?," MAGKS Papers on Economics 202032, Philipps-Universität Marburg, Faculty of Business Administration and Economics, Department of Economics (Volkswirtschaftliche Abteilung).
    19. Miller, Stewart R. & Moore, Fiona & Eden, Lorraine, 2024. "Ethics and international business research: Considerations and best practices," International Business Review, Elsevier, vol. 33(1).
    20. Ankel-Peters, Jörg & Fiala, Nathan & Neubauer, Florian, 2023. "Do economists replicate?," Journal of Economic Behavior & Organization, Elsevier, vol. 212(C), pages 219-232.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:manrev:v:73:y:2023:i:3:d:10.1007_s11301-022-00269-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.