IDEAS home Printed from https://ideas.repec.org/a/eee/respol/v51y2022i1s0048733321002043.html
   My bibliography  Save this article

Business and management research: Low instances of replication studies and a lack of author independence in replications

Author

Listed:
  • Ryan, James C.
  • A Tipu, Syed A.

Abstract

Increasing awareness of the credibility crisis and related replication crisis in business research drives calls for greater understanding of the state of replication studies. This research addresses these calls by analyzing the 10-year publication history of 121 leading journals (Academic Journal Guide (AJG 2018)). Examination of 83,682 articles reveals 4,412 potential replications. Detailed analysis of 500 randomly selected articles offers further insights. Results indicate most replications are conceptual in nature, support prior findings and represent only 1.47% of published research in leading journals. Significantly, most replications occur as part of within-study or intrastudy designs. Replications by independent researchers are very rare, raising credibility concerns due to author overlap and associated researcher and measurement biases. Recommendations for the improvement of replication efforts are made.

Suggested Citation

  • Ryan, James C. & A Tipu, Syed A., 2022. "Business and management research: Low instances of replication studies and a lack of author independence in replications," Research Policy, Elsevier, vol. 51(1).
    • Handle: RePEc:eee:respol:v:51:y:2022:i:1:s0048733321002043
    DOI: 10.1016/j.respol.2021.104408
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0048733321002043
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.respol.2021.104408?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Hall, Jeremy & Martin, Ben R., 2019. "Towards a taxonomy of research misconduct: The case of business school research," Research Policy, Elsevier, vol. 48(2), pages 414-427.
    2. Garret Christensen & Edward Miguel, 2018. "Transparency, Reproducibility, and the Credibility of Economics Research," Journal of Economic Literature, American Economic Association, vol. 56(3), pages 920-980, September.
    3. Evanschitzky, Heiner & Baumgarth, Carsten & Hubbard, Raymond & Armstrong, J. Scott, 2007. "Replication research's disturbing trend," Journal of Business Research, Elsevier, vol. 60(4), pages 411-415, April.
    4. Fricke, Hans & Grogger, Jeffrey & Steinmayr, Andreas, 2018. "Exposure to academic fields and college major choice," Economics of Education Review, Elsevier, vol. 64(C), pages 199-213.
    5. Herman Aguinis & Angelo M. Solarino, 2019. "Transparency and replicability in qualitative research: The case of interviews with elite informants," Strategic Management Journal, Wiley Blackwell, vol. 40(8), pages 1291-1315, August.
    6. Hubbard, Raymond & Lindsay, R. Murray, 2013. "From significant difference to significant sameness: Proposing a paradigm shift in business research," Journal of Business Research, Elsevier, vol. 66(9), pages 1377-1388.
    7. Hubbard, Raymond & Vetter, Daniel E., 1996. "An empirical comparison of published replication research in accounting, economics, finance, management, and marketing," Journal of Business Research, Elsevier, vol. 35(2), pages 153-164, February.
    8. Jeremy Hall & Ben R. Martin, 2019. "Towards a Taxonomy of Academic Misconduct: The Case of Business School Research," SPRU Working Paper Series 2019-02, SPRU - Science Policy Research Unit, University of Sussex Business School.
    9. Evanschitzky, Heiner & Armstrong, J. Scott, 2010. "Replications of forecasting research," International Journal of Forecasting, Elsevier, vol. 26(1), pages 4-8, January.
    10. David Moher & Alessandro Liberati & Jennifer Tetzlaff & Douglas G Altman & The PRISMA Group, 2009. "Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement," PLOS Medicine, Public Library of Science, vol. 6(7), pages 1-6, July.
    11. Rossi, Luciano & Damaceno, Rafael J.P. & Freire, Igor L. & Bechara, Etelvino J.H. & Mena-Chalco, Jesús P., 2018. "Topological metrics in academic genealogy graphs," Journal of Informetrics, Elsevier, vol. 12(4), pages 1042-1058.
    12. Easley, Richard W. & Madden, Charles S. & Dunn, Mark G., 2000. "Conducting Marketing Science: The Role of Replication in the Research Process," Journal of Business Research, Elsevier, vol. 48(1), pages 83-92, April.
    13. J. Britt Holbrook & Stephen Curry & Shina C. L. Kamerlin, 2018. "Debate on academic freedom and open access is healthy," Nature, Nature, vol. 562(7728), pages 494-494, October.
    14. ., 2018. "The academic publishing market," Chapters, in: The Economics of Open Access, chapter 2, pages 10-56, Edward Elgar Publishing.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. O’Boyle, Ernest H. & Götz, Martin & Zivic, Damian C., 2024. "Increasing the practical relevance of management research: In honor of Timothy T. Baldwin," Business Horizons, Elsevier, vol. 67(2), pages 161-171.
    2. Dreber, Anna & Johannesson, Magnus, 2023. "A framework for evaluating reproducibility and replicability in economics," I4R Discussion Paper Series 38, The Institute for Replication (I4R).
    3. Adler, Susanne Jana & Sharma, Pratyush Nidhi & Radomir, Lăcrămioara, 2023. "Toward open science in PLS-SEM: Assessing the state of the art and future perspectives," Journal of Business Research, Elsevier, vol. 169(C).
    4. Tom Coupé & Thomas Logchies & W. Robert Reed, 2024. "Do Replications Really Receive Fewer Citations?," Working Papers in Economics 24/15, University of Canterbury, Department of Economics and Finance.
    5. Chai, Daniel & Ali, Searat & Brosnan, Mark & Hasso, Tim, 2024. "Understanding researchers' perceptions and experiences in finance research replication studies: A pre-registered report," Pacific-Basin Finance Journal, Elsevier, vol. 86(C).
    6. Adler, Susanne Jana & Sharma, Pratyush N & Radomir, Lăcrămioara, 2023. "Toward open science in PLS-SEM: Assessing the state of the art and future perspectives," OSF Preprints sbpe9, Center for Open Science.
    7. Jörn H. Block & Christian Fisch & Narmeen Kanwal & Solvej Lorenzen & Anna Schulze, 2023. "Replication studies in top management journals: An empirical investigation of prevalence, types, outcomes, and impact," Management Review Quarterly, Springer, vol. 73(3), pages 1109-1134, September.
    8. Coupé, Tom & Reed, W. Robert & Zimmermann, Christian, 2023. "Getting seen: Results from an online experiment to draw more attention to replications," Research Policy, Elsevier, vol. 52(8).
    9. Athreye, Suma & Kathuria, Vinish & Martelli, Alessandro & Piscitello, Lucia, 2023. "Intellectual property rights and the international transfer of climate change mitigating technologies," Research Policy, Elsevier, vol. 52(9).
    10. Brinkerink, Jasper & De Massis, Alfredo & Kellermanns, Franz, 2022. "One finding is no finding: Toward a replication culture in family business research," Journal of Family Business Strategy, Elsevier, vol. 13(4).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hensel, Przemysław G., 2021. "Reproducibility and replicability crisis: How management compares to psychology and economics – A systematic review of literature," European Management Journal, Elsevier, vol. 39(5), pages 577-594.
    2. Ahi, Alan A. & Sinkovics, Noemi & Shildibekov, Yelnur & Sinkovics, Rudolf R. & Mehandjiev, Nikolay, 2022. "Advanced technologies and international business: A multidisciplinary analysis of the literature," International Business Review, Elsevier, vol. 31(4).
    3. Francisco J. Conejo & Lawrence F. Cunningham & Clifford E. Young, 2020. "Revisiting the Brand Luxury Index: new empirical evidence and future directions," Journal of Brand Management, Palgrave Macmillan, vol. 27(1), pages 108-122, January.
    4. Peterson, Robert A. & Merunka, Dwight R., 2014. "Convenience samples of college students and research reproducibility," Journal of Business Research, Elsevier, vol. 67(5), pages 1035-1041.
    5. Riefler, Petra & Diamantopoulos, Adamantios, 2009. "Consumer cosmopolitanism: Review and replication of the CYMYC scale," Journal of Business Research, Elsevier, vol. 62(4), pages 407-419, April.
    6. Uncles, Mark D. & Kwok, Simon, 2013. "Designing research with in-built differentiated replication," Journal of Business Research, Elsevier, vol. 66(9), pages 1398-1405.
    7. Evanschitzky, Heiner & Armstrong, J. Scott, 2013. "Research with In-built replications: Comment and further suggestions for replication research," Journal of Business Research, Elsevier, vol. 66(9), pages 1406-1408.
    8. Hubbard, Raymond & Lindsay, R. Murray, 2013. "From significant difference to significant sameness: Proposing a paradigm shift in business research," Journal of Business Research, Elsevier, vol. 66(9), pages 1377-1388.
    9. Rakesh Sambharya & Martina Musteen, 2014. "Institutional environment and entrepreneurship: An empirical study across countries," Journal of International Entrepreneurship, Springer, vol. 12(4), pages 314-330, December.
    10. Hensel, Przemysław G., 2019. "Supporting replication research in management journals: Qualitative analysis of editorials published between 1970 and 2015," European Management Journal, Elsevier, vol. 37(1), pages 45-57.
    11. Daniele Fanelli, 2012. "Negative results are disappearing from most disciplines and countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 90(3), pages 891-904, March.
    12. Nayeem, Tahmid & Casidy, Riza, 2015. "Australian consumers' decision-making styles for everyday products," Australasian marketing journal, Elsevier, vol. 23(1), pages 67-74.
    13. Sovacool, Benjamin K. & Martiskainen, Mari & Furszyfer Del Rio, Dylan D., 2021. "Knowledge, energy sustainability, and vulnerability in the demographics of smart home technology diffusion," Energy Policy, Elsevier, vol. 153(C).
    14. Kristina Haberstroh & Ulrich R. Orth & Stefan Hoffmann & Berit Brunk, 2017. "Consumer Response to Unethical Corporate Behavior: A Re-Examination and Extension of the Moral Decoupling Model," Journal of Business Ethics, Springer, vol. 140(1), pages 161-173, January.
    15. Sadok El Ghoul & Omrane Guedhami & Robert Nash & Ajay Patel, 2019. "New Evidence on the Role of the Media in Corporate Social Responsibility," Journal of Business Ethics, Springer, vol. 154(4), pages 1051-1079, February.
    16. Tomáš Havránek & T. D. Stanley & Hristos Doucouliagos & Pedro Bom & Jerome Geyer‐Klingeberg & Ichiro Iwasaki & W. Robert Reed & Katja Rost & R. C. M. van Aert, 2020. "Reporting Guidelines For Meta‐Analysis In Economics," Journal of Economic Surveys, Wiley Blackwell, vol. 34(3), pages 469-475, July.
    17. Rubin, Amir & Rubin, Eran & Segal, Dan, 2023. "Editor home bias?," Research Policy, Elsevier, vol. 52(6).
    18. Hardcopf, Rick & Liu, Gensheng (Jason) & Shah, Rachna, 2021. "Lean production and operational performance: The influence of organizational culture," International Journal of Production Economics, Elsevier, vol. 235(C).
    19. Fayez Nahedh Alsehani & Ainuddin Wahid Bin Abdul Wahab & Liyana Shuib, 2023. "Exploring Social Media and Organisational Sustainability Performance Goals: Themes, Functional Areas, and Practices Learning from the Preceding Decade," Sustainability, MDPI, vol. 15(3), pages 1-17, January.
    20. Kim, Jisun & Kim, Dong Ha & Lee, Jihyun & Cheon, Youngseo & Yoo, Seunghyun, 2022. "A scoping review of qualitative geographic information systems in studies addressing health issues," Social Science & Medicine, Elsevier, vol. 314(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:respol:v:51:y:2022:i:1:s0048733321002043. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/respol .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.