IDEAS home Printed from https://ideas.repec.org/p/osf/metaar/svzyc.html
   My bibliography  Save this paper

Will knowledge about more efficient study designs increase the willingness to pre-register?

Author

Listed:
  • Lakens, Daniel

    (Eindhoven University of Technology)

Abstract

Pre-registration is a straightforward way to make science more transparant, and control Type 1 error rates. Pre-registration is often presented as beneficial for science in general, but rarely as a practice that leads to immediate individual benefits for researchers. One benefit of pre-registered studies is that they allow for non-conventional research designs that are more efficient than conventional designs. For example, by performing one-tailed tests and sequential analyses researchers can perform well-powered studies much more efficiently. Here, I examine whether such non-conventional but more efficient designs are considered appropriate by editors under the pre-condition that the analysis plans are pre-registered, and if so, whether researchers are more willing to pre-register their analysis plan to take advantage of the efficiency benefits of non-conventional designs. Study 1 shows the large majority of editors judged one-tailed tests and sequential analyses to be appropriate in psychology, but only when such analyses are pre-registered. In Study 2 I asked experimental psychologists to indicate their attitude towards pre-registration. Half of these researchers first read about the acceptence of one-tailed tests and sequential analyses by editors, and the efficiency gains of using these procedures. However, learning about the efficiency benefits associated with one-tailed tests and sequential analyses did not substantially influence researchers' attitudes about benefits and costs of pre-registration, or their willingness to pre-register studies. The self-reported likelihood of pre-registering studies in the next two years, as well as the percentage of studies researchers planned to pre-register in the future, was surprisingly high. 47% of respondents already had experience pre-registering, and 94% of respondents indicating that they would consider pre-registering at least some of their research in the future. Given this already strong self-reported willingness to pre-register studies, pointing out immediate individual benefits seems unlikely to be a useful way to increase researchers' willingness to pre-register any further.

Suggested Citation

  • Lakens, Daniel, 2017. "Will knowledge about more efficient study designs increase the willingness to pre-register?," MetaArXiv svzyc, Center for Open Science.
  • Handle: RePEc:osf:metaar:svzyc
    DOI: 10.31219/osf.io/svzyc
    as

    Download full text from publisher

    File URL: https://osf.io/download/58c7d9b6594d9001f71d85c1/
    Download Restriction: no

    File URL: https://libkey.io/10.31219/osf.io/svzyc?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Shane Frederick & George Loewenstein & Ted O'Donoghue, 2002. "Time Discounting and Time Preference: A Critical Review," Journal of Economic Literature, American Economic Association, vol. 40(2), pages 351-401, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Teklewold, Hailemariam, 2011. "Farming or burning? shadow prices and farmer’s impatience on the allocation of multi-purpose resource in the mixed farming system of Ethiopia," 2011 International Congress, August 30-September 2, 2011, Zurich, Switzerland 116080, European Association of Agricultural Economists.
    2. van den Bergh, J.C.J.M. & Botzen, W.J.W., 2015. "Monetary valuation of the social cost of CO2 emissions: A critical survey," Ecological Economics, Elsevier, vol. 114(C), pages 33-46.
    3. Robert Gazzale & Julian Jamison & Alexander Karlan & Dean Karlan, 2013. "Ambiguous Solicitation: Ambiguous Prescription," Economic Inquiry, Western Economic Association International, vol. 51(1), pages 1002-1011, January.
    4. Hinnosaar, Marit, 2016. "Time inconsistency and alcohol sales restrictions," European Economic Review, Elsevier, vol. 87(C), pages 108-131.
    5. Caroline Flammer & Michael W. Toffel & Kala Viswanathan, 2021. "Shareholder activism and firms' voluntary disclosure of climate change risks," Strategic Management Journal, Wiley Blackwell, vol. 42(10), pages 1850-1879, October.
    6. Min Gong & David Krantz & Elke Weber, 2014. "Why Chinese discount future financial and environmental gains but not losses more than Americans," Journal of Risk and Uncertainty, Springer, vol. 49(2), pages 103-124, October.
    7. Matteo Iacoviello, 2008. "Household Debt and Income Inequality, 1963–2003," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 40(5), pages 929-965, August.
    8. Cosmo, Valeria Di & O’Hora, Denis, 2017. "Nudging electricity consumption using TOU pricing and feedback: evidence from Irish households," Journal of Economic Psychology, Elsevier, vol. 61(C), pages 1-14.
    9. repec:cup:judgdm:v:16:y:2021:i:3:p:709-728 is not listed on IDEAS
    10. Richard M. H. Suen, 2014. "Time Preference And The Distributions Of Wealth And Income," Economic Inquiry, Western Economic Association International, vol. 52(1), pages 364-381, January.
    11. Mitchell, O.S. & Piggott, J., 2016. "Workplace-Linked Pensions for an Aging Demographic," Handbook of the Economics of Population Aging, in: Piggott, John & Woodland, Alan (ed.), Handbook of the Economics of Population Aging, edition 1, volume 1, chapter 0, pages 865-904, Elsevier.
    12. Aman, Hiroyuki & Motonishi, Taizo & Ogawa, Kazuhito & Omori, Kozo, 2024. "The effect of financial literacy on long-term recognition and short-term trade in mutual funds: Evidence from Japan," International Review of Economics & Finance, Elsevier, vol. 89(PB), pages 762-783.
    13. Kimmich, Christian & Fischbacher, Urs, 2016. "Behavioral determinants of supply chain integration and coexistence," Journal of Forest Economics, Elsevier, vol. 25(C), pages 55-77.
    14. Filiz-Ozbay, Emel & Guryan, Jonathan & Hyndman, Kyle & Kearney, Melissa & Ozbay, Erkut Y., 2015. "Do lottery payments induce savings behavior? Evidence from the lab," Journal of Public Economics, Elsevier, vol. 126(C), pages 1-24.
    15. Stephen L. Cheung & Agnieszka Tymula & Xueting Wang, 2022. "Present bias for monetary and dietary rewards," Experimental Economics, Springer;Economic Science Association, vol. 25(4), pages 1202-1233, September.
    16. Lex Borghans & Angela Lee Duckworth & James J. Heckman & Bas ter Weel, 2008. "The Economics and Psychology of Personality Traits," Journal of Human Resources, University of Wisconsin Press, vol. 43(4).
    17. Luc Arrondel & André Masson, 2013. "Measuring savers' preferences how and why?," PSE Working Papers halshs-00834203, HAL.
    18. David Laibson, 1997. "Golden Eggs and Hyperbolic Discounting," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 112(2), pages 443-478.
    19. Yue Wang & Xiaoyu Wang & Xiao Yang & Fangyuan Yuan & Ying Li, 2023. "View of Times and Temporal Focus under the Pace of Life on the Impact of Intertemporal Decision Making," IJERPH, MDPI, vol. 20(5), pages 1-13, February.
    20. Andreoni, James & Serra-Garcia, Marta, 2021. "Time inconsistent charitable giving," Journal of Public Economics, Elsevier, vol. 198(C).
    21. Atahan Afsar; José Elías Gallegos; Richard Jaimes; Edgar Silgado Gómez & José Elías Gallegos & Richard Jaimes & Edgar Silgado Gómez, 2020. "Reconciling Empirics and Theory: The Behavioral Hybrid New Keynesian Model," Vniversitas Económica 18560, Universidad Javeriana - Bogotá.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:metaar:svzyc. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://osf.io/preprints/metaarxiv .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.