In Praise of Moderation: Suggestions for the Scope and Use of Pre-Analysis Plans for RCTs in Economics
Author
Abstract
Suggested Citation
Note: DEV LS PE
Download full text from publisher
References listed on IDEAS
- Garret Christensen & Edward Miguel, 2018.
"Transparency, Reproducibility, and the Credibility of Economics Research,"
Journal of Economic Literature, American Economic Association, vol. 56(3), pages 920-980, September.
- Garret S. Christensen & Edward Miguel, 2016. "Transparency, Reproducibility, and the Credibility of Economics Research," NBER Working Papers 22989, National Bureau of Economic Research, Inc.
- Christensen, Garret & Miguel, Edward & Sturdy, Jennifer, 2017. "Transparency, Reproducibility, and the Credibility of Economics Research," MetaArXiv 9a3rw, Center for Open Science.
- Christensen, Garret & Miguel, Edward, 2017. "Transparency, Reproducibility, and the Credibility of Economics Research," Department of Economics, Working Paper Series qt52h6x1cq, Department of Economics, Institute for Business and Economic Research, UC Berkeley.
- Alexandre Belloni & Victor Chernozhukov & Christian Hansen, 2014.
"High-Dimensional Methods and Inference on Structural and Treatment Effects,"
Journal of Economic Perspectives, American Economic Association, vol. 28(2), pages 29-50, Spring.
- Alexandre Belloni & Victor Chernozhukov & Christian Hansen, 2013. "High dimensional methods and inference on structural and treatment effects," CeMMAP working papers 59/13, Institute for Fiscal Studies.
- Alexandre Belloni & Victor Chernozhukov & Christian Hansen, 2013. "High dimensional methods and inference on structural and treatment effects," CeMMAP working papers CWP59/13, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Humphreys, Macartan & Sanchez de la Sierra, Raul & van der Windt, Peter, 2013. "Fishing, Commitment, and Communication: A Proposal for Comprehensive Nonbinding Research Registration," Political Analysis, Cambridge University Press, vol. 21(1), pages 1-20, January.
- Victor Chernozhukov & Mert Demirer & Esther Duflo & Iván Fernández-Val, 2018. "Generic Machine Learning Inference on Heterogeneous Treatment Effects in Randomized Experiments, with an Application to Immunization in India," NBER Working Papers 24678, National Bureau of Economic Research, Inc.
- Amy Finkelstein & Sarah Taubman & Bill Wright & Mira Bernstein & Jonathan Gruber & Joseph P. Newhouse & Heidi Allen & Katherine Baicker, 2012.
"The Oregon Health Insurance Experiment: Evidence from the First Year,"
The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 127(3), pages 1057-1106.
- Amy Finkelstein & Sarah Taubman & Bill Wright & Mira Bernstein & Jonathan Gruber & Joseph P. Newhouse & Heidi Allen & Katherine Baicker & The Oregon Health Study Group, 2011. "The Oregon Health Insurance Experiment: Evidence from the First Year," NBER Working Papers 17190, National Bureau of Economic Research, Inc.
- Finkelstein, Amy, et al., 2011. "The Oregon Health Insurance Experiment: Evidence from the First Year," Working Paper Series rwp11-040, Harvard University, John F. Kennedy School of Government.
- Alexandre Belloni & Victor Chernozhukov & Christian Hansen, 2014. "Inference on Treatment Effects after Selection among High-Dimensional Controlsâ€," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 81(2), pages 608-650.
- Isaiah Andrews & Maximilian Kasy, 2019.
"Identification of and Correction for Publication Bias,"
American Economic Review, American Economic Association, vol. 109(8), pages 2766-2794, August.
- Isaiah Andrews & Maximilian Kasy, 2017. "Identification of and correction for publication bias," Papers 1711.10527, arXiv.org.
- Kasy, Maximilian & Andrews, Isaiah, 2018. "Identification of and correction for publication bias," MetaArXiv 49yst, Center for Open Science.
- Isaiah Andrews & Maximilian Kasy, 2017. "Identification of and Correction for Publication Bias," NBER Working Papers 23298, National Bureau of Economic Research, Inc.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Sarah A. Janzen & Jeffrey D. Michler, 2021.
"Ulysses' pact or Ulysses' raft: Using pre‐analysis plans in experimental and nonexperimental research,"
Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 43(4), pages 1286-1304, December.
- Janzen, Sarah & Michler, Jeffrey D, 2020. "Ulysses' Pact or Ulysses' Raft: Using Pre-Analysis Plans in Experimental and Non-Experimental Research," MetaArXiv wkmht_v1, Center for Open Science.
- Janzen, Sarah & Michler, Jeffrey D, 2020. "Ulysses' Pact or Ulysses' Raft: Using Pre-Analysis Plans in Experimental and Non-Experimental Research," MetaArXiv wkmht, Center for Open Science.
- Alexandre Belloni & Victor Chernozhukov & Denis Chetverikov & Christian Hansen & Kengo Kato, 2018.
"High-dimensional econometrics and regularized GMM,"
CeMMAP working papers
CWP35/18, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Alexandre Belloni & Victor Chernozhukov & Denis Chetverikov & Christian Hansen & Kengo Kato, 2018. "High-Dimensional Econometrics and Regularized GMM," Papers 1806.01888, arXiv.org, revised Jun 2018.
- Alexander Frankel & Maximilian Kasy, 2022.
"Which Findings Should Be Published?,"
American Economic Journal: Microeconomics, American Economic Association, vol. 14(1), pages 1-38, February.
- Kasy, Maximilian & Frankel, Alexander, 2018. "Which findings should be published?," MetaArXiv mbvz3, Center for Open Science.
- Pedro Carneiro & Sokbae Lee & Daniel Wilhelm, 2020.
"Optimal data collection for randomized control trials,"
The Econometrics Journal, Royal Economic Society, vol. 23(1), pages 1-31.
- Pedro Carneiro & Sokbae (Simon) Lee & Daniel Wilhelm, 2016. "Optimal data collection for randomized control trials," CeMMAP working papers CWP15/16, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Pedro Carneiro & Sokbae (Simon) Lee & Daniel Wilhelm, 2017. "Optimal data collection for randomized control trials," CeMMAP working papers 15/17, Institute for Fiscal Studies.
- Pedro Carneiro & Sokbae (Simon) Lee & Daniel Wilhelm, 2017. "Optimal data collection for randomized control trials," CeMMAP working papers 45/17, Institute for Fiscal Studies.
- Pedro Carneiro & Sokbae (Simon) Lee & Daniel Wilhelm, 2017. "Optimal data collection for randomized control trials," CeMMAP working papers CWP15/17, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Carneiro, Pedro & Lee, Sokbae & Wilhelm, Daniel, 2016. "Optimal Data Collection for Randomized Control Trials," IZA Discussion Papers 9908, Institute of Labor Economics (IZA).
- Pedro Carneiro & Sokbae (Simon) Lee & Daniel Wilhelm, 2019. "Optimal Data Collection for Randomized Control Trials," CeMMAP working papers CWP21/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Pedro Carneiro & Sokbae (Simon) Lee & Daniel Wilhelm, 2016. "Optimal data collection for randomized control trials," CeMMAP working papers 15/16, Institute for Fiscal Studies.
- Pedro Carneiro & Sokbae (Simon) Lee & Daniel Wilhelm, 2017. "Optimal data collection for randomized control trials," CeMMAP working papers CWP45/17, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Pedro Carneiro & Sokbae Lee & Daniel Wilhelm, 2016. "Optimal Data Collection for Randomized Control Trials," Papers 1603.03675, arXiv.org, revised Aug 2016.
- Stefano DellaVigna & Elizabeth Linos, 2022.
"RCTs to Scale: Comprehensive Evidence From Two Nudge Units,"
Econometrica, Econometric Society, vol. 90(1), pages 81-116, January.
- Stefano DellaVigna & Elizabeth Linos, 2020. "RCTs to Scale: Comprehensive Evidence from Two Nudge Units," NBER Working Papers 27594, National Bureau of Economic Research, Inc.
- Stanley, T. D. & Doucouliagos, Chris, 2019. "Practical Significance, Meta-Analysis and the Credibility of Economics," IZA Discussion Papers 12458, Institute of Labor Economics (IZA).
- Michael C. Knaus, 2021.
"A double machine learning approach to estimate the effects of musical practice on student’s skills,"
Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 184(1), pages 282-300, January.
- Knaus, Michael C., 2018. "A Double Machine Learning Approach to Estimate the Effects of Musical Practice on Student's Skills," IZA Discussion Papers 11547, Institute of Labor Economics (IZA).
- Michael C. Knaus, 2018. "A Double Machine Learning Approach to Estimate the Effects of Musical Practice on Student's Skills," Papers 1805.10300, arXiv.org, revised Jan 2019.
- Michael C Knaus & Michael Lechner & Anthony Strittmatter, 2021.
"Machine learning estimation of heterogeneous causal effects: Empirical Monte Carlo evidence,"
The Econometrics Journal, Royal Economic Society, vol. 24(1), pages 134-161.
- Knaus, Michael C. & Lechner, Michael & Strittmatter, Anthony, 2018. "Machine Learning Estimation of Heterogeneous Causal Effects: Empirical Monte Carlo Evidence," IZA Discussion Papers 12039, Institute of Labor Economics (IZA).
- Lechner, Michael & Knaus, Michael C. & Strittmatter, Anthony, 2018. "Machine Learning Estimation of Heterogeneous Causal Effects: Empirical Monte Carlo Evidence," CEPR Discussion Papers 13402, C.E.P.R. Discussion Papers.
- Knaus, Michael C. & Lechner, Michael & anthony.strittmatter@unisg.ch, 2018. "Machine Learning Estimation of Heterogeneous Causal Effects: Empirical Monte Carlo Evidence," Economics Working Paper Series 1817, University of St. Gallen, School of Economics and Political Science.
- Michael C. Knaus & Michael Lechner & Anthony Strittmatter, 2018. "Machine Learning Estimation of Heterogeneous Causal Effects: Empirical Monte Carlo Evidence," Papers 1810.13237, arXiv.org, revised Dec 2018.
- Christopher Snyder & Ran Zhuo, 2018. "Sniff Tests as a Screen in the Publication Process: Throwing out the Wheat with the Chaff," NBER Working Papers 25058, National Bureau of Economic Research, Inc.
- Andrew Y Chen & Tom Zimmermann & Jeffrey Pontiff, 2020.
"Publication Bias and the Cross-Section of Stock Returns,"
The Review of Asset Pricing Studies, Society for Financial Studies, vol. 10(2), pages 249-289.
- Andrew Y. Chen & Tom Zimmermann, 2018. "Publication Bias and the Cross-Section of Stock Returns," Finance and Economics Discussion Series 2018-033, Board of Governors of the Federal Reserve System (U.S.).
- Everding, Jakob & Marcus, Jan, 2020.
"The effect of unemployment on the smoking behavior of couples,"
EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 29(2), pages 154-170.
- Jakob Everding & Jan Marcus, 2020. "The effect of unemployment on the smoking behavior of couples," Health Economics, John Wiley & Sons, Ltd., vol. 29(2), pages 154-170, February.
- Everding, Jakob & Marcus, Jan, 2019. "The effect of unemployment on the smoking behavior of couples," hche Research Papers 17, University of Hamburg, Hamburg Center for Health Economics (hche).
- Jakob Everding & Jan Marcus, 2019. "The Effect of Unemployment on the Smoking Behavior of Couples," SOEPpapers on Multidisciplinary Panel Data Research 1037, DIW Berlin, The German Socio-Economic Panel (SOEP).
- Patrick Vu, 2022. "Can the Replication Rate Tell Us About Publication Bias?," Papers 2206.15023, arXiv.org, revised Jul 2022.
- Zigraiova, Diana & Havranek, Tomas & Irsova, Zuzana & Novak, Jiri, 2021.
"How puzzling is the forward premium puzzle? A meta-analysis,"
European Economic Review, Elsevier, vol. 134(C).
- Havranek, Tomas & Novak, Jiri & Zigraiova, Diana, 2020. "How puzzling is the forward premium puzzle? A meta-analysis," MetaArXiv 348kc, Center for Open Science.
- Havranek, Tomas & Novak, Jiri & Zigraiova, Diana, 2020. "How puzzling is the forward premium puzzle? A meta-analysis," MetaArXiv 348kc_v1, Center for Open Science.
- Diana Zigraiova & Tomas Havranek & Jiri Novak, 2020. "How Puzzling Is the Forward Premium Puzzle? A Meta-Analysis," Working Papers IES 2020/6, Charles University Prague, Faculty of Social Sciences, Institute of Economic Studies, revised Feb 2020.
- Zigraiova, Diana & Havranek, Tomas & Novak, Jiri, 2020. "How Puzzling Is the Forward Premium Puzzle? A Meta-Analysis," EconStor Preprints 213578, ZBW - Leibniz Information Centre for Economics.
- Diana Zigraiova & Tomas Havranek & Jiri Novak, 2020. "How puzzling is the forward premium puzzle? A meta-analysis," Working Papers 46, European Stability Mechanism.
- Havranek, Tomas & Zigraiova, Diana & Irsova, Zuzana & Novak, Jiri, 2021. "How Puzzling Is the Forward Premium Puzzle? A Meta-Analysis," CEPR Discussion Papers 15817, C.E.P.R. Discussion Papers.
- Briole, Simon & Gurgand, Marc & Maurin, Eric & McNally, Sandra & Ruiz-Valenzuela, Jenifer & Santín, Daniel, 2022.
"The Making of Civic Virtues: A School-Based Experiment in Three Countries,"
IZA Discussion Papers
15141, Institute of Labor Economics (IZA).
- Simon Briole & Marc Gurgand & Eric Maurin & Sandra Mcnally & Jenifer Ruiz-Valenzuela & Daniel Santin, 2024. "The Making of Civic Virtues: A School-Based Experiment in Three Countries," Working Papers halshs-04720970, HAL.
- Simon Briole & Marc Gurgand & Eric Maurin & Sandra Mcnally & Jenifer Ruiz-Valenzuela & Daniel Santin, 2024. "The Making of Civic Virtues: A School-Based Experiment in Three Countries," PSE Working Papers halshs-04720970, HAL.
- Simon Briole & Marc Gurgand & Eric Maurin & Sandra McNally & Jenifer Ruiz-Valenzuela & Daniel Santin, 2022. "The making of civic virtues: a school-based experiment in three countries," CEP Discussion Papers dp1830, Centre for Economic Performance, LSE.
- Chris Doucouliagos & Jakob de Haan & Jan-Egbert Sturm, 2022.
"What drives financial development? A Meta-regression analysis [A new database of financial reforms],"
Oxford Economic Papers, Oxford University Press, vol. 74(3), pages 840-868.
- Chris Doucouliagos & Jakob de Haan & Jan-Egbert Sturm, 2020. "What Drives Financial Development? A Meta-Regression Analysis," CESifo Working Paper Series 8356, CESifo.
- Maximilian Kasy & Jann Spiess, 2022.
"Optimal Pre-Analysis Plans: Statistical Decisions Subject to Implementability,"
Papers
2208.09638, arXiv.org, revised Jul 2024.
- Kasy, Maximilian & Spiess, Jann, 2024. "Optimal Pre-analysis Plans: Statistical Decisions Subject to Implementability," IZA Discussion Papers 17187, Institute of Labor Economics (IZA).
- Maximilian Kasy & Jann Spiess, 2024. "Optimal Pre-Analysis Plans: Statistical Decisions Subject to Implementability," CESifo Working Paper Series 11258, CESifo.
- Graham Elliott & Nikolay Kudrin & Kaspar Wüthrich, 2022.
"Detecting p‐Hacking,"
Econometrica, Econometric Society, vol. 90(2), pages 887-906, March.
- Graham Elliott & Nikolay Kudrin & Kaspar Wuthrich, 2019. "Detecting p-hacking," Papers 1906.06711, arXiv.org, revised May 2021.
- Elliott, Graham & Kudrin, Nikolay & Wüthrich, Kaspar, 2022. "Detecting p‐Hacking," University of California at San Diego, Economics Working Paper Series qt2p04s3dr, Department of Economics, UC San Diego.
- Denis Fougère & Nicolas Jacquemet, 2020.
"Policy Evaluation Using Causal Inference Methods,"
SciencePo Working papers Main
hal-03455978, HAL.
- Denis Fougère & Nicolas Jacquemet, 2020. "Policy Evaluation Using Causal Inference Methods," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) hal-03455978, HAL.
- Denis Fougère & Nicolas Jacquemet, 2021. "Policy Evaluation Using Causal Inference Methods," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) hal-03098058, HAL.
- Denis Fougère & Nicolas Jacquemet, 2021. "Policy Evaluation Using Causal Inference Methods," PSE-Ecole d'économie de Paris (Postprint) hal-03098058, HAL.
- Denis Fougère & Nicolas Jacquemet, 2020. "Policy Evaluation Using Causal Inference Methods," Working Papers hal-03455978, HAL.
- Denis Fougère & Nicolas Jacquemet, 2021. "Policy Evaluation Using Causal Inference Methods," Post-Print hal-03098058, HAL.
- Denis Fougère & Nicolas Jacquemet, 2021. "Policy Evaluation Using Causal Inference Methods," SciencePo Working papers Main hal-03098058, HAL.
- Fougère, Denis & Jacquemet, Nicolas, 2020. "Policy Evaluation Using Causal Inference Methods," IZA Discussion Papers 12922, Institute of Labor Economics (IZA).
- Burlig, Fiona, 2018.
"Improving transparency in observational social science research: A pre-analysis plan approach,"
Economics Letters, Elsevier, vol. 168(C), pages 56-60.
- Burlig, Fiona, 2017. "Improving transparency in observational social science research: A pre-analysis plan approach," MetaArXiv qemkz, Center for Open Science.
- Kasy, Maximilian & Frankel, Alexander, 2018. "Which findings should be published?," MetaArXiv mbvz3_v1, Center for Open Science.
More about this item
JEL classification:
- A0 - General Economics and Teaching - - General
NEP fields
This paper has been announced in the following NEP Reports:- NEP-EXP-2020-05-04 (Experimental Economics)
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:26993. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.