IDEAS home Printed from https://ideas.repec.org/a/eee/soceco/v114y2025ics2214804324001642.html
   My bibliography  Save this article

Incentives and the replication crisis in social sciences: A critical review of open science practices

Author

Listed:
  • Balafoutas, Loukas
  • Celse, Jeremy
  • Karakostas, Alexandros
  • Umashev, Nicholas

Abstract

The replication crisis in the social sciences has revealed systemic issues undermining the credibility of research findings, primarily driven by misaligned incentives that encourage questionable research practices (QRPs). This paper offers a comprehensive and critical review of recent empirical evidence on the effectiveness of Open Science initiatives—such as replication studies, reproducibility efforts, pre-registrations, and registered reports—in addressing the root causes of the replication crisis. Building upon and extending prior reviews, we integrate recent theoretical models from economics with empirical findings across several social science disciplines to assess how these practices impact research integrity. Our review demonstrates that while measures like pre-registration and data sharing have advanced transparency, they often fall short in mitigating QRPs due to persistent incentive misalignments. In contrast, registered reports and megastudies show greater promise by fundamentally reshaping the incentive structure, shifting the focus from producing statistically significant results to emphasizing methodological rigor and meaningful research questions. We argue that realigning incentives is crucial for fostering a culture of integrity and offer policy recommendations involving key stakeholders—including authors, journals, editors, reviewers, and institutions—to promote practices that enhance research reliability and credibility across the social sciences.

Suggested Citation

  • Balafoutas, Loukas & Celse, Jeremy & Karakostas, Alexandros & Umashev, Nicholas, 2025. "Incentives and the replication crisis in social sciences: A critical review of open science practices," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 114(C).
  • Handle: RePEc:eee:soceco:v:114:y:2025:i:c:s2214804324001642
    DOI: 10.1016/j.socec.2024.102327
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S2214804324001642
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.socec.2024.102327?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    More about this item

    Keywords

    Replication crisis; Preregistration; Registered reports; Reproducibility; Publish or perish;
    All these keywords.

    JEL classification:

    • A11 - General Economics and Teaching - - General Economics - - - Role of Economics; Role of Economists
    • B49 - Schools of Economic Thought and Methodology - - Economic Methodology - - - Other
    • C18 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Methodolical Issues: General
    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:soceco:v:114:y:2025:i:c:s2214804324001642. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/620175 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.