IDEAS home Printed from https://ideas.repec.org/a/eee/eurman/v37y2019i1p45-57.html
   My bibliography  Save this article

Supporting replication research in management journals: Qualitative analysis of editorials published between 1970 and 2015

Author

Listed:
  • Hensel, Przemysław G.

Abstract

Management literature may be populated by studies that report exaggerated levels of significance, and one potential solution to this problem is providing support for replication research. Drawing on the analysis of editorials published by top management journals between 1970 and 2015, I show how the issue of replication research was framed and discussed and how policy toward replication research was communicated to the readers. Only 67 of 1901 editorials published within that period invoke the issue of replication research (3.5% of all editorials). The analysis of editors' academic background indicates that replication research is mentioned mainly by editors with training in psychology, operations research, logistics, and STEM. Editors who discuss the issue usually provide symbolic and substantial support for such research. However, it is often twinned with language and argumentation that contribute to the negative perception of replications as a substandard form of research. Toward the end of the article, suggestions regarding the ways to address this problem are given.

Suggested Citation

  • Hensel, Przemysław G., 2019. "Supporting replication research in management journals: Qualitative analysis of editorials published between 1970 and 2015," European Management Journal, Elsevier, vol. 37(1), pages 45-57.
    • Handle: RePEc:eee:eurman:v:37:y:2019:i:1:p:45-57
    DOI: 10.1016/j.emj.2018.03.004
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0263237318300318
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.emj.2018.03.004?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Richard A. Bettis & Sendil Ethiraj & Alfonso Gambardella & Constance Helfat & Will Mitchell, 2016. "Creating repeatable cumulative knowledge in strategic management," Strategic Management Journal, Wiley Blackwell, vol. 37(2), pages 257-261, February.
    2. Richard A. Bettis & Constance E. Helfat & J. Myles Shaver & Richard A. Bettis & Constance E. Helfat & J. Myles Shaver, 2016. "The necessity, logic, and forms of replication," Strategic Management Journal, Wiley Blackwell, vol. 37(11), pages 2193-2203, November.
    3. Zeki Simsek & Ciaran Heavey & Justin J. P. Jansen, 2013. "Journal Impact as a Diffusion Process: A Conceptualization and the Case of the Journal of Management Studies," Journal of Management Studies, Wiley Blackwell, vol. 50(8), pages 1374-1407, December.
    4. Timothy Clark & Mike Wright, 2007. "Reviewing Journal Rankings and Revisiting Peer Reviews: Editorial Perspectives," Journal of Management Studies, Wiley Blackwell, vol. 44(4), pages 612-621, June.
    5. Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2016. "Star Wars: The Empirics Strike Back," American Economic Journal: Applied Economics, American Economic Association, vol. 8(1), pages 1-32, January.
    6. Evanschitzky, Heiner & Baumgarth, Carsten & Hubbard, Raymond & Armstrong, J. Scott, 2007. "Replication research's disturbing trend," Journal of Business Research, Elsevier, vol. 60(4), pages 411-415, April.
    7. March, James G., 2005. "Parochialism in the Evolution of a Research Community: The Case of Organization Studies," Management and Organization Review, Cambridge University Press, vol. 1(1), pages 5-22, March.
    8. Leung, Kwok, 2011. "Presenting Post Hoc Hypotheses as A Priori: Ethical and Theoretical Issues," Management and Organization Review, Cambridge University Press, vol. 7(3), pages 471-479, November.
    9. Maren Duvendack & Richard W. Palmer-Jones & W. Robert Reed, 2015. "Replications in Economics: A Progress Report," Econ Journal Watch, Econ Journal Watch, vol. 12(2), pages 164–191-1, May.
    10. Daniele Fanelli, 2009. "How Many Scientists Fabricate and Falsify Research? A Systematic Review and Meta-Analysis of Survey Data," PLOS ONE, Public Library of Science, vol. 4(5), pages 1-11, May.
    11. Uncles, Mark D. & Kwok, Simon, 2013. "Designing research with in-built differentiated replication," Journal of Business Research, Elsevier, vol. 66(9), pages 1398-1405.
    12. Hubbard, Raymond & Vetter, Daniel E., 1996. "An empirical comparison of published replication research in accounting, economics, finance, management, and marketing," Journal of Business Research, Elsevier, vol. 35(2), pages 153-164, February.
    13. Dewald, William G & Thursby, Jerry G & Anderson, Richard G, 1986. "Replication in Empirical Economics: The Journal of Money, Credit and Banking Project," American Economic Review, American Economic Association, vol. 76(4), pages 587-603, September.
    14. Gerardo Patriotta & Jean‐Pascal Gond & Friederike Schultz, 2011. "Maintaining Legitimacy: Controversies, Orders of Worth, and Public Justifications," Journal of Management Studies, Wiley Blackwell, vol. 48(8), pages 1804-1836, December.
    15. Kenworthy, Thomas P. & Sparks, John R., 2016. "A scientific realism perspective on scientific progress in marketing: An analysis of theory testing in marketing's major journals," European Management Journal, Elsevier, vol. 34(5), pages 466-474.
    16. Sidney G. Winter & Gabriel Szulanski, 2001. "Replication as Strategy," Organization Science, INFORMS, vol. 12(6), pages 730-743, December.
    17. Marcus R. Munafò & Brian A. Nosek & Dorothy V. M. Bishop & Katherine S. Button & Christopher D. Chambers & Nathalie Percie du Sert & Uri Simonsohn & Eric-Jan Wagenmakers & Jennifer J. Ware & John P. A, 2017. "A manifesto for reproducible science," Nature Human Behaviour, Nature, vol. 1(1), pages 1-9, January.
    18. Benson Honig & Joseph Lampel & Donald Siegel & Paul Drnevich, 2014. "Ethics in the Production and Dissemination of Management Research: Institutional Failure or Individual Fallibility?," Journal of Management Studies, Wiley Blackwell, vol. 51(1), pages 118-142, January.
    19. Easley, Richard W. & Madden, Charles S. & Gray, Van, 2013. "A tale of two cultures: Revisiting journal editors' views of replication research," Journal of Business Research, Elsevier, vol. 66(9), pages 1457-1459.
    20. Richard A. Bettis & Constance E. Helfat & J. Myles Shaver & Sendil K. Ethiraj & Alfonso Gambardella & Constance E. Helfat, 2016. "Replication in strategic management," Strategic Management Journal, Wiley Blackwell, vol. 37(11), pages 2191-2192, November.
    21. Julie Battilana & Bernard Leca & Eva Boxenbaum, 2009. "How actors change institutions : Towards a theory of institutional entrepreneurship," Post-Print hal-00576509, HAL.
    22. Andrew C. Chang & Phillip Li, 2015. "Is Economics Research Replicable? Sixty Published Papers from Thirteen Journals Say \"Usually Not\"," Finance and Economics Discussion Series 2015-83, Board of Governors of the Federal Reserve System (U.S.).
    23. Richard A. Bettis, 2012. "The search for asterisks: Compromised statistical tests and flawed theories," Strategic Management Journal, Wiley Blackwell, vol. 33(1), pages 108-113, January.
    24. Hunter, John E, 2001. "The Desperate Need for Replications," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 28(1), pages 149-158, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Tim M. Lindquist & Alexandra Rausch, 2021. "The impact of procedural and distributive justice on satisfaction and manufacturing performance: a replication of Lindquist (1995) with a focus on the importance of common metrics in experimental desi," Journal of Management Control: Zeitschrift für Planung und Unternehmenssteuerung, Springer, vol. 32(2), pages 161-195, June.
    2. Johan Lindeque & Olga Samuel & Corin Kraft, 2022. "Small Businesses’ Social Responsibility and Political Activity Survey Studies: A Review, Synthesis, and Research Agenda," SAGE Open, , vol. 12(2), pages 21582440221, April.
    3. Brinkerink, Jasper & De Massis, Alfredo & Kellermanns, Franz, 2022. "One finding is no finding: Toward a replication culture in family business research," Journal of Family Business Strategy, Elsevier, vol. 13(4).
    4. Zachlod, Cécile & Samuel, Olga & Ochsner, Andrea & Werthmüller, Sarah, 2022. "Analytics of social media data – State of characteristics and application," Journal of Business Research, Elsevier, vol. 144(C), pages 1064-1076.
    5. Hensel, Przemysław G., 2021. "Reproducibility and replicability crisis: How management compares to psychology and economics – A systematic review of literature," European Management Journal, Elsevier, vol. 39(5), pages 577-594.
    6. Andrzej Janowski, 2020. "Philanthropy and the Contribution of Andrew Carnegie to Corporate Social Responsibility," Sustainability, MDPI, vol. 13(1), pages 1-26, December.
    7. Andrzej Janowski, 2021. "CSR in Management Sciences: Is It “a Road to Nowhere”?," Economies, MDPI, vol. 9(4), pages 1-15, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hensel, Przemysław G., 2021. "Reproducibility and replicability crisis: How management compares to psychology and economics – A systematic review of literature," European Management Journal, Elsevier, vol. 39(5), pages 577-594.
    2. Mueller-Langer, Frank & Fecher, Benedikt & Harhoff, Dietmar & Wagner, Gert G., 2019. "Replication studies in economics—How many and which papers are chosen for replication, and why?," Research Policy, Elsevier, vol. 48(1), pages 62-83.
    3. Luis Alfonso Dau & Grazia D. Santangelo & Arjen Witteloostuijn, 2022. "Replication studies in international business," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 53(2), pages 215-230, March.
    4. Gary A. Hoover & Christian Hopp, 2017. "What Crisis? Taking Stock of Management Researchers' Experiences with and Views of Scholarly Misconduct," CESifo Working Paper Series 6611, CESifo.
    5. Evanschitzky, Heiner & Armstrong, J. Scott, 2013. "Research with In-built replications: Comment and further suggestions for replication research," Journal of Business Research, Elsevier, vol. 66(9), pages 1406-1408.
    6. Michael A. Clemens, 2017. "The Meaning Of Failed Replications: A Review And Proposal," Journal of Economic Surveys, Wiley Blackwell, vol. 31(1), pages 326-342, February.
    7. Francisco J. Conejo & Lawrence F. Cunningham & Clifford E. Young, 2020. "Revisiting the Brand Luxury Index: new empirical evidence and future directions," Journal of Brand Management, Palgrave Macmillan, vol. 27(1), pages 108-122, January.
    8. Eszter Czibor & David Jimenez‐Gomez & John A. List, 2019. "The Dozen Things Experimental Economists Should Do (More of)," Southern Economic Journal, John Wiley & Sons, vol. 86(2), pages 371-432, October.
    9. Evanschitzky, Heiner & Armstrong, J. Scott, 2010. "Replications of forecasting research," International Journal of Forecasting, Elsevier, vol. 26(1), pages 4-8, January.
    10. Garret Christensen & Edward Miguel, 2018. "Transparency, Reproducibility, and the Credibility of Economics Research," Journal of Economic Literature, American Economic Association, vol. 56(3), pages 920-980, September.
    11. Zacharias Maniadis & Fabio Tufano & John A. List, 2017. "To Replicate or Not To Replicate? Exploring Reproducibility in Economics through the Lens of a Model and a Pilot Study," Economic Journal, Royal Economic Society, vol. 127(605), pages 209-235, October.
    12. Brent Goldfarb & Liyue Yan, 2021. "Revisiting Zuckerman's (1999) categorical imperative: An application of epistemic maps for replication," Strategic Management Journal, Wiley Blackwell, vol. 42(11), pages 1963-1992, November.
    13. Bu, Maoliang & Xu, Liang & Tang, Ryan W., 2023. "MNEs’ transfer of socially irresponsible practices: A replication with new extensions," Journal of World Business, Elsevier, vol. 58(2).
    14. Chai, Daniel & Ali, Searat & Brosnan, Mark & Hasso, Tim, 2024. "Understanding researchers' perceptions and experiences in finance research replication studies: A pre-registered report," Pacific-Basin Finance Journal, Elsevier, vol. 86(C).
    15. Maren Duvendack & Richard Palmer-Jones & W. Robert Reed, 2017. "What Is Meant by "Replication" and Why Does It Encounter Resistance in Economics?," American Economic Review, American Economic Association, vol. 107(5), pages 46-51, May.
    16. Anderson, Brian S. & Wennberg, Karl & McMullen, Jeffery S., 2019. "Editorial: Enhancing quantitative theory-testing entrepreneurship research," Journal of Business Venturing, Elsevier, vol. 34(5), pages 1-1.
    17. Wennberg, Karl & Anderson, Brian S. & McMullen, Jeffrey, 2019. "2 Editorial: Enhancing Quantitative Theory-Testing Entrepreneurship Research," Ratio Working Papers 323, The Ratio Institute.
    18. Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2016. "Star Wars: The Empirics Strike Back," American Economic Journal: Applied Economics, American Economic Association, vol. 8(1), pages 1-32, January.
    19. Andrew Y. Chen & Tom Zimmermann, 2022. "Open Source Cross-Sectional Asset Pricing," Critical Finance Review, now publishers, vol. 11(2), pages 207-264, May.
    20. Markku Maula & Wouter Stam, 2020. "Enhancing Rigor in Quantitative Entrepreneurship Research," Entrepreneurship Theory and Practice, , vol. 44(6), pages 1059-1090, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:eurman:v:37:y:2019:i:1:p:45-57. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/115/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.