Research Registries: Facts, Myths, and Possible Improvements
Author
Abstract
Suggested Citation
Note: DEV ED PE
Download full text from publisher
Other versions of this item:
- Eliot Abrams & Jonathan Libgober & John List, 2020. "Research Registries: Facts, Myths, and Possible Improvements," Artefactual Field Experiments 00703, The Field Experiments Website.
References listed on IDEAS
- Robinson, Joan, 1977. "What Are the Questions?," Journal of Economic Literature, American Economic Association, vol. 15(4), pages 1318-1339, December.
- Shuo Liu & Harry Pei, 2017. "Monotone equilibria in signalling games," ECON - Working Papers 252, Department of Economics - University of Zurich.
- Omar Al-Ubaydli & John A. List & Dana Suskind, 2019.
"The Science of Using Science: Towards an Understanding of the Threats to Scaling Experiments,"
NBER Working Papers
25848, National Bureau of Economic Research, Inc.
- Omar Al-Ubaydli & John List & Dana Suskind, 2019. "The science of using science: Towards an understanding of the threats to scaling experiments," Artefactual Field Experiments 00670, The Field Experiments Website.
- Eva Vivalt, 0. "How Much Can We Generalize From Impact Evaluations?," Journal of the European Economic Association, European Economic Association, vol. 18(6), pages 3045-3089.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2016.
"Star Wars: The Empirics Strike Back,"
American Economic Journal: Applied Economics, American Economic Association, vol. 8(1), pages 1-32, January.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2012. "Star wars: The empirics strike back," PSE Working Papers halshs-00710122, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2015. "Star Wars: The Empirics Strike Back," Working Papers 1505E, University of Ottawa, Department of Economics.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2016. "Star Wars: The Empirics Strike Back," PSE-Ecole d'économie de Paris (Postprint) hal-01447851, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2015. "Star Wars: The Empirics Strike Back," PSE Working Papers halshs-01158500, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2015. "Star Wars: The Empirics Strike Back," Working Papers halshs-01158500, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2015. "Star Wars: The Empirics Strike Back," AMSE Working Papers 1523, Aix-Marseille School of Economics, France, revised May 2015.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2012. "Star wars: The empirics strike back," Working Papers halshs-00710122, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2012. "Star wars: The empirics strike back," SciencePo Working papers Main halshs-00710122, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2016. "Star Wars: The Empirics Strike Back," Post-Print hal-01447851, HAL.
- Brodeur, Abel & Lé, Mathias & Sangnier, Marc & Zylberberg, Yanos, 2013. "Star Wars: The Empirics Strike Back," IZA Discussion Papers 7268, Institute of Labor Economics (IZA).
- Abhijit Banerjee & Esther Duflo & Amy Finkelstein & Lawrence F. Katz & Benjamin A. Olken & Anja Sautmann, 2020. "In Praise of Moderation: Suggestions for the Scope and Use of Pre-Analysis Plans for RCTs in Economics," NBER Working Papers 26993, National Bureau of Economic Research, Inc.
- Rachael Meager, 2019. "Understanding the Average Impact of Microcredit Expansions: A Bayesian Hierarchical Analysis of Seven Randomized Experiments," American Economic Journal: Applied Economics, American Economic Association, vol. 11(1), pages 57-91, January.
- Michael D. Jennions & Anders Pape Møller, 2003. "A survey of the statistical power of research in behavioral ecology and animal behavior," Behavioral Ecology, International Society for Behavioral Ecology, vol. 14(3), pages 438-445, May.
- Eva Vivalt, 2019. "Specification Searching and Significance Inflation Across Time, Methods and Disciplines," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 81(4), pages 797-816, August.
- Richard A. Bettis, 2012. "The search for asterisks: Compromised statistical tests and flawed theories," Strategic Management Journal, Wiley Blackwell, vol. 33(1), pages 108-113, January.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
Cited by:
- Kim, Hyunjung & Li, Tongzhe, 2024. "Rethinking the Significance of Scientific Information: A Field Experiment with Agricultural Producers," 2024 Annual Meeting, July 28-30, New Orleans, LA 344038, Agricultural and Applied Economics Association.
- Alec Brandon & Justin E. Holz & Andrew Simon & Haruka Uchida, 2023. "Minimum Wages and Racial Discrimination in Hiring: Evidence from a Field Experiment," Upjohn Working Papers 23-389, W.E. Upjohn Institute for Employment Research.
- Thibaut Arpinon & Romain Espinosa, 2023. "A practical guide to Registered Reports for economists," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 9(1), pages 90-122, June.
- John A. List & Ragan Petrie & Anya Samek, 2023.
"How Experiments with Children Inform Economics,"
Journal of Economic Literature, American Economic Association, vol. 61(2), pages 504-564, June.
- John A. List & Ragan Petrie & Anya Samek, 2021. "How Experiments with Children Inform Economics," NBER Working Papers 28825, National Bureau of Economic Research, Inc.
- John List & Ragan Petrie & Anya Samek, 2021. "How Experiments with Children Inform Economics," Artefactual Field Experiments 00729, The Field Experiments Website.
- Anna Dreber & Magnus Johannesson & Yifan Yang, 2024.
"Selective reporting of placebo tests in top economics journals,"
Economic Inquiry, Western Economic Association International, vol. 62(3), pages 921-932, July.
- Dreber, Anna & Johannesson, Magnus & Yang, Yifan, 2023. "Selective Reporting of Placebo Tests in Top Economics Journals," I4R Discussion Paper Series 31, The Institute for Replication (I4R).
- Thibaut Arpinon & Romain Espinosa, 2023. "A Practical Guide to Registered Reports for Economists," Post-Print halshs-03897719, HAL.
- Abel Brodeur & Nikolai M. Cook & Jonathan S. Hartley & Anthony Heyes, 2024.
"Do Preregistration and Preanalysis Plans Reduce p-Hacking and Publication Bias? Evidence from 15,992 Test Statistics and Suggestions for Improvement,"
Journal of Political Economy Microeconomics, University of Chicago Press, vol. 2(3), pages 527-561.
- Brodeur, Abel & Cook, Nikolai M. & Hartley, Jonathan S. & Heyes, Anthony, 2023. "Do Pre-Registration and Pre-Analysis Plans Reduce p-Hacking and Publication Bias?: Evidence from 15,992 Test Statistics and Suggestions for Improvement," GLO Discussion Paper Series 1147 [pre.], Global Labor Organization (GLO).
- Brodeur, Abel & Cook, Nikolai M. & Hartley, Jonathan S. & Heyes, Anthony, 2024. "Do Pre-Registration and Pre-Analysis Plans Reduce p-Hacking and Publication Bias? Evidence from 15,992 Test Statistics and Suggestions for Improvement," I4R Discussion Paper Series 101, The Institute for Replication (I4R).
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Eszter Czibor & David Jimenez‐Gomez & John A. List, 2019.
"The Dozen Things Experimental Economists Should Do (More of),"
Southern Economic Journal, John Wiley & Sons, vol. 86(2), pages 371-432, October.
- Eszter Czibor & David Jimenez-Gomez & John List, 2019. "The Dozen Things Experimental Economists Should Do (More of)," Artefactual Field Experiments 00648, The Field Experiments Website.
- Eszter Czibor & David Jimenez-Gomez & John A. List, 2019. "The Dozen Things Experimental Economists Should Do (More of)," NBER Working Papers 25451, National Bureau of Economic Research, Inc.
- Omar Al-Ubaydli & John List & Claire Mackevicius & Min Sok Lee & Dana Suskind, 2019. "How Can Experiments Play a Greater Role in Public Policy? 12 Proposals from an Economic Model of Scaling," Artefactual Field Experiments 00679, The Field Experiments Website.
- Stefano DellaVigna & Elizabeth Linos, 2022.
"RCTs to Scale: Comprehensive Evidence From Two Nudge Units,"
Econometrica, Econometric Society, vol. 90(1), pages 81-116, January.
- Stefano DellaVigna & Elizabeth Linos, 2020. "RCTs to Scale: Comprehensive Evidence from Two Nudge Units," NBER Working Papers 27594, National Bureau of Economic Research, Inc.
- Abel Brodeur & Nikolai M. Cook & Jonathan S. Hartley & Anthony Heyes, 2024.
"Do Preregistration and Preanalysis Plans Reduce p-Hacking and Publication Bias? Evidence from 15,992 Test Statistics and Suggestions for Improvement,"
Journal of Political Economy Microeconomics, University of Chicago Press, vol. 2(3), pages 527-561.
- Brodeur, Abel & Cook, Nikolai M. & Hartley, Jonathan S. & Heyes, Anthony, 2023. "Do Pre-Registration and Pre-Analysis Plans Reduce p-Hacking and Publication Bias?: Evidence from 15,992 Test Statistics and Suggestions for Improvement," GLO Discussion Paper Series 1147 [pre.], Global Labor Organization (GLO).
- Brodeur, Abel & Cook, Nikolai M. & Hartley, Jonathan S. & Heyes, Anthony, 2024. "Do Pre-Registration and Pre-Analysis Plans Reduce p-Hacking and Publication Bias? Evidence from 15,992 Test Statistics and Suggestions for Improvement," I4R Discussion Paper Series 101, The Institute for Replication (I4R).
- Bruns, Stephan B. & Asanov, Igor & Bode, Rasmus & Dunger, Melanie & Funk, Christoph & Hassan, Sherif M. & Hauschildt, Julia & Heinisch, Dominik & Kempa, Karol & König, Johannes & Lips, Johannes & Verb, 2019. "Reporting errors and biases in published empirical findings: Evidence from innovation research," Research Policy, Elsevier, vol. 48(9), pages 1-1.
- Abel Brodeur, Nikolai M. Cook, Anthony Heyes, 2022.
"We Need to Talk about Mechanical Turk: What 22,989 Hypothesis Tests Tell Us about Publication Bias and p-Hacking in Online Experiments,"
LCERPA Working Papers
am0133, Laurier Centre for Economic Research and Policy Analysis.
- Brodeur, Abel & Cook, Nikolai & Heyes, Anthony, 2022. "We Need to Talk about Mechanical Turk: What 22,989 Hypothesis Tests Tell Us about Publication Bias and p-Hacking in Online Experiments," MetaArXiv a9vhr, Center for Open Science.
- Brodeur, Abel & Cook, Nikolai & Heyes, Anthony, 2022. "We Need to Talk about Mechanical Turk: What 22,989 Hypothesis Tests Tell Us about Publication Bias and p-Hacking in Online Experiments," IZA Discussion Papers 15478, Institute of Labor Economics (IZA).
- Hensel, Przemysław G., 2019. "Supporting replication research in management journals: Qualitative analysis of editorials published between 1970 and 2015," European Management Journal, Elsevier, vol. 37(1), pages 45-57.
- Bruns, Stephan B. & Ioannidis, John P.A., 2020. "Determinants of economic growth: Different time different answer?," Journal of Macroeconomics, Elsevier, vol. 63(C).
- Graham Elliott & Nikolay Kudrin & Kaspar Wüthrich, 2022.
"Detecting p‐Hacking,"
Econometrica, Econometric Society, vol. 90(2), pages 887-906, March.
- Graham Elliott & Nikolay Kudrin & Kaspar Wuthrich, 2019. "Detecting p-hacking," Papers 1906.06711, arXiv.org, revised May 2021.
- Elliott, Graham & Kudrin, Nikolay & Wüthrich, Kaspar, 2022. "Detecting p‐Hacking," University of California at San Diego, Economics Working Paper Series qt2p04s3dr, Department of Economics, UC San Diego.
- Marcel Fafchamps & Julien Labonne, 2016. "Using Split Samples to Improve Inference about Causal Effects," NBER Working Papers 21842, National Bureau of Economic Research, Inc.
- Fernando Hoces de la Guardia & Sean Grant & Edward Miguel, 2021.
"A framework for open policy analysis,"
Science and Public Policy, Oxford University Press, vol. 48(2), pages 154-163.
- Hoces de la Guardia, Fernando & Grant, Sean & Miguel, Edward, 2018. "A Framework for Open Policy Analysis," MetaArXiv jnyqh, Center for Open Science.
- de la Guardia, Fernando Hoces & Grant, Sean & Miguel, Edward, 2021. "A framework for open policy analysis," Department of Economics, Working Paper Series qt05r470xk, Department of Economics, Institute for Business and Economic Research, UC Berkeley.
- Brodeur, Abel & Cook, Nikolai & Heyes, Anthony, 2022.
"We Need to Talk about Mechanical Turk: What 22,989 Hypothesis Tests Tell us about p-Hacking and Publication Bias in Online Experiments,"
GLO Discussion Paper Series
1157, Global Labor Organization (GLO).
- Brodeur, Abel & Cook, Nikolai & Heyes, Anthony, 2022. "We Need to Talk about Mechanical Turk: What 22,989 Hypothesis Tests Tell us about p-Hacking and Publication Bias in Online Experiments," I4R Discussion Paper Series 8, The Institute for Replication (I4R).
- Abel Brodeur & Scott Carrell & David Figlio & Lester Lusher, 2023.
"Unpacking P-hacking and Publication Bias,"
American Economic Review, American Economic Association, vol. 113(11), pages 2974-3002, November.
- Brodeur, Abel & Carrell, Scott & Figlio, David & Lusher, Lester, 2023. "Unpacking P-Hacking and Publication Bias," I4R Discussion Paper Series 52, The Institute for Replication (I4R).
- Abel Brodeur & Scott E. Carrell & David N. Figlio & Lester R. Lusher, 2023. "Unpacking P-Hacking and Publication Bias," NBER Working Papers 31548, National Bureau of Economic Research, Inc.
- Brodeur, Abel & Carrell, Scott E. & Figlio, David N. & Lusher, Lester, 2023. "Unpacking P-Hacking and Publication Bias," IZA Discussion Papers 16369, Institute of Labor Economics (IZA).
- Andor, Mark A. & Gerster, Andreas & Peters, Jörg, 2022.
"Information campaigns for residential energy conservation,"
European Economic Review, Elsevier, vol. 144(C).
- Andor, Mark Andreas & Gerster, Andreas & Peters, Jörg, 2020. "Information campaigns for residential energy conservation," Ruhr Economic Papers 871, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
- Anna Dreber & Magnus Johannesson & Yifan Yang, 2024.
"Selective reporting of placebo tests in top economics journals,"
Economic Inquiry, Western Economic Association International, vol. 62(3), pages 921-932, July.
- Dreber, Anna & Johannesson, Magnus & Yang, Yifan, 2023. "Selective Reporting of Placebo Tests in Top Economics Journals," I4R Discussion Paper Series 31, The Institute for Replication (I4R).
- Mueller-Langer, Frank & Fecher, Benedikt & Harhoff, Dietmar & Wagner, Gert G., 2019.
"Replication studies in economics—How many and which papers are chosen for replication, and why?,"
Research Policy, Elsevier, vol. 48(1), pages 62-83.
- Mueller-Langer, Frank & Fecher, Benedikt & Harhoff, Dietmar & Wagner, Gert G., 2019. "Replication studies in economics—How many and which papers are chosen for replication, and why?," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 48(1), pages 62-83.
- Frank Mueller-Langer & Benedikt Fecher & Dietmar Harhoff & Gert G. Wagner, 2018. "Replication Studies in Economics: How Many and Which Papers Are Chosen for Replication, and Why?," JRC Working Papers on Digital Economy 2018-01, Joint Research Centre.
- Nathan Fiala & Ana Garcia-Hernandez & Kritika Narula & Nishith Prakash, 2022. "Wheels of Change: Transforming Girls’ Lives with Bicycles," Working papers 2022-04, University of Connecticut, Department of Economics.
- Graham Elliott & Nikolay Kudrin & Kaspar Wuthrich, 2022. "The Power of Tests for Detecting $p$-Hacking," Papers 2205.07950, arXiv.org, revised Apr 2024.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2016.
"Star Wars: The Empirics Strike Back,"
American Economic Journal: Applied Economics, American Economic Association, vol. 8(1), pages 1-32, January.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2012. "Star wars: The empirics strike back," PSE Working Papers halshs-00710122, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2015. "Star Wars: The Empirics Strike Back," PSE Working Papers halshs-01158500, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2016. "Star Wars: The Empirics Strike Back," PSE-Ecole d'économie de Paris (Postprint) hal-01447851, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2015. "Star Wars: The Empirics Strike Back," Working Papers halshs-01158500, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2015. "Star Wars: The Empirics Strike Back," AMSE Working Papers 1523, Aix-Marseille School of Economics, France, revised May 2015.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2012. "Star wars: The empirics strike back," SciencePo Working papers Main halshs-00710122, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2015. "Star Wars: The Empirics Strike Back," Working Papers 1505E, University of Ottawa, Department of Economics.
- Brodeur, Abel & Lé, Mathias & Sangnier, Marc & Zylberberg, Yanos, 2013. "Star Wars: The Empirics Strike Back," IZA Discussion Papers 7268, Institute of Labor Economics (IZA).
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2012. "Star wars: The empirics strike back," Working Papers halshs-00710122, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2016. "Star Wars: The Empirics Strike Back," Post-Print hal-01447851, HAL.
- Brodeur, Abel & Cook, Nikolai & Heyes, Anthony, 2022. "We Need to Talk about Mechanical Turk: What 22,989 Hypothesis Tests Tell Us about Publication Bias and p-Hacking in Online Experiments," MetaArXiv a9vhr_v1, Center for Open Science.
More about this item
JEL classification:
- B41 - Schools of Economic Thought and Methodology - - Economic Methodology - - - Economic Methodology
- C9 - Mathematical and Quantitative Methods - - Design of Experiments
- C91 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Individual Behavior
- C92 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Group Behavior
- C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
NEP fields
This paper has been announced in the following NEP Reports:- NEP-EXP-2020-06-29 (Experimental Economics)
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:27250. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.