In Praise of Moderation: Suggestions for the Scope and Use of Pre-Analysis Plans for RCTs in Economics
Author
Abstract
Suggested Citation
Note: DEV LS PE
Download full text from publisher
References listed on IDEAS
- Garret Christensen & Edward Miguel, 2018.
"Transparency, Reproducibility, and the Credibility of Economics Research,"
Journal of Economic Literature, American Economic Association, vol. 56(3), pages 920-980, September.
- Garret S. Christensen & Edward Miguel, 2016. "Transparency, Reproducibility, and the Credibility of Economics Research," NBER Working Papers 22989, National Bureau of Economic Research, Inc.
- Christensen, Garret & Miguel, Edward & Sturdy, Jennifer, 2017. "Transparency, Reproducibility, and the Credibility of Economics Research," MetaArXiv 9a3rw, Center for Open Science.
- Christensen, Garret & Miguel, Edward, 2017. "Transparency, Reproducibility, and the Credibility of Economics Research," Department of Economics, Working Paper Series qt52h6x1cq, Department of Economics, Institute for Business and Economic Research, UC Berkeley.
- Humphreys, Macartan & Sanchez de la Sierra, Raul & van der Windt, Peter, 2013. "Fishing, Commitment, and Communication: A Proposal for Comprehensive Nonbinding Research Registration," Political Analysis, Cambridge University Press, vol. 21(1), pages 1-20, January.
- Alexandre Belloni & Victor Chernozhukov & Christian Hansen, 2014. "Inference on Treatment Effects after Selection among High-Dimensional Controlsâ€," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 81(2), pages 608-650.
- Isaiah Andrews & Maximilian Kasy, 2019.
"Identification of and Correction for Publication Bias,"
American Economic Review, American Economic Association, vol. 109(8), pages 2766-2794, August.
- Isaiah Andrews & Maximilian Kasy, 2017. "Identification of and correction for publication bias," Papers 1711.10527, arXiv.org.
- Kasy, Maximilian & Andrews, Isaiah, 2018. "Identification of and correction for publication bias," MetaArXiv 49yst, Center for Open Science.
- Isaiah Andrews & Maximilian Kasy, 2017. "Identification of and Correction for Publication Bias," NBER Working Papers 23298, National Bureau of Economic Research, Inc.
- Alexandre Belloni & Victor Chernozhukov & Christian Hansen, 2014.
"High-Dimensional Methods and Inference on Structural and Treatment Effects,"
Journal of Economic Perspectives, American Economic Association, vol. 28(2), pages 29-50, Spring.
- Alexandre Belloni & Victor Chernozhukov & Christian Hansen, 2013. "High dimensional methods and inference on structural and treatment effects," CeMMAP working papers CWP59/13, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Alexandre Belloni & Victor Chernozhukov & Christian Hansen, 2013. "High dimensional methods and inference on structural and treatment effects," CeMMAP working papers 59/13, Institute for Fiscal Studies.
- Amy Finkelstein & Sarah Taubman & Bill Wright & Mira Bernstein & Jonathan Gruber & Joseph P. Newhouse & Heidi Allen & Katherine Baicker, 2012.
"The Oregon Health Insurance Experiment: Evidence from the First Year,"
The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 127(3), pages 1057-1106.
- Finkelstein, Amy, et al., 2011. "The Oregon Health Insurance Experiment: Evidence from the First Year," Working Paper Series rwp11-040, Harvard University, John F. Kennedy School of Government.
- Amy Finkelstein & Sarah Taubman & Bill Wright & Mira Bernstein & Jonathan Gruber & Joseph P. Newhouse & Heidi Allen & Katherine Baicker & The Oregon Health Study Group, 2011. "The Oregon Health Insurance Experiment: Evidence from the First Year," NBER Working Papers 17190, National Bureau of Economic Research, Inc.
- Victor Chernozhukov & Mert Demirer & Esther Duflo & Iván Fernández-Val, 2018. "Generic Machine Learning Inference on Heterogeneous Treatment Effects in Randomized Experiments, with an Application to Immunization in India," NBER Working Papers 24678, National Bureau of Economic Research, Inc.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Sarah A. Janzen & Jeffrey D. Michler, 2021.
"Ulysses' pact or Ulysses' raft: Using pre‐analysis plans in experimental and nonexperimental research,"
Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 43(4), pages 1286-1304, December.
- Janzen, Sarah & Michler, Jeffrey D, 2020. "Ulysses' Pact or Ulysses' Raft: Using Pre-Analysis Plans in Experimental and Non-Experimental Research," MetaArXiv wkmht, Center for Open Science.
- Stefano DellaVigna & Elizabeth Linos, 2022.
"RCTs to Scale: Comprehensive Evidence From Two Nudge Units,"
Econometrica, Econometric Society, vol. 90(1), pages 81-116, January.
- Stefano DellaVigna & Elizabeth Linos, 2020. "RCTs to Scale: Comprehensive Evidence from Two Nudge Units," NBER Working Papers 27594, National Bureau of Economic Research, Inc.
- Michael C. Knaus, 2021.
"A double machine learning approach to estimate the effects of musical practice on student’s skills,"
Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 184(1), pages 282-300, January.
- Knaus, Michael C., 2018. "A Double Machine Learning Approach to Estimate the Effects of Musical Practice on Student's Skills," IZA Discussion Papers 11547, Institute of Labor Economics (IZA).
- Michael C. Knaus, 2018. "A Double Machine Learning Approach to Estimate the Effects of Musical Practice on Student's Skills," Papers 1805.10300, arXiv.org, revised Jan 2019.
- Everding, Jakob & Marcus, Jan, 2020.
"The effect of unemployment on the smoking behavior of couples,"
EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 29(2), pages 154-170.
- Jakob Everding & Jan Marcus, 2020. "The effect of unemployment on the smoking behavior of couples," Health Economics, John Wiley & Sons, Ltd., vol. 29(2), pages 154-170, February.
- Everding, Jakob & Marcus, Jan, 2019. "The effect of unemployment on the smoking behavior of couples," hche Research Papers 17, University of Hamburg, Hamburg Center for Health Economics (hche).
- Jakob Everding & Jan Marcus, 2019. "The Effect of Unemployment on the Smoking Behavior of Couples," SOEPpapers on Multidisciplinary Panel Data Research 1037, DIW Berlin, The German Socio-Economic Panel (SOEP).
- Patrick Vu, 2022. "Can the Replication Rate Tell Us About Publication Bias?," Papers 2206.15023, arXiv.org, revised Jul 2022.
- Pedro Carneiro & Sokbae Lee & Daniel Wilhelm, 2020.
"Optimal data collection for randomized control trials,"
The Econometrics Journal, Royal Economic Society, vol. 23(1), pages 1-31.
- Carneiro, Pedro & Lee, Sokbae & Wilhelm, Daniel, 2016. "Optimal Data Collection for Randomized Control Trials," IZA Discussion Papers 9908, Institute of Labor Economics (IZA).
- Pedro Carneiro & Sokbae (Simon) Lee & Daniel Wilhelm, 2017. "Optimal data collection for randomized control trials," CeMMAP working papers CWP15/17, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Pedro Carneiro & Sokbae (Simon) Lee & Daniel Wilhelm, 2017. "Optimal data collection for randomized control trials," CeMMAP working papers 15/17, Institute for Fiscal Studies.
- Pedro Carneiro & Sokbae (Simon) Lee & Daniel Wilhelm, 2019. "Optimal Data Collection for Randomized Control Trials," CeMMAP working papers CWP21/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Pedro Carneiro & Sokbae (Simon) Lee & Daniel Wilhelm, 2017. "Optimal data collection for randomized control trials," CeMMAP working papers 45/17, Institute for Fiscal Studies.
- Pedro Carneiro & Sokbae Lee & Daniel Wilhelm, 2016. "Optimal Data Collection for Randomized Control Trials," Papers 1603.03675, arXiv.org, revised Aug 2016.
- Pedro Carneiro & Sokbae (Simon) Lee & Daniel Wilhelm, 2017. "Optimal data collection for randomized control trials," CeMMAP working papers CWP45/17, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Pedro Carneiro & Sokbae (Simon) Lee & Daniel Wilhelm, 2016. "Optimal data collection for randomized control trials," CeMMAP working papers 15/16, Institute for Fiscal Studies.
- Pedro Carneiro & Sokbae (Simon) Lee & Daniel Wilhelm, 2016. "Optimal data collection for randomized control trials," CeMMAP working papers CWP15/16, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Chris Doucouliagos & Jakob de Haan & Jan-Egbert Sturm, 2022.
"What drives financial development? A Meta-regression analysis [A new database of financial reforms],"
Oxford Economic Papers, Oxford University Press, vol. 74(3), pages 840-868.
- Chris Doucouliagos & Jakob de Haan & Jan-Egbert Sturm, 2020. "What Drives Financial Development? A Meta-Regression Analysis," CESifo Working Paper Series 8356, CESifo.
- Graham Elliott & Nikolay Kudrin & Kaspar Wüthrich, 2022.
"Detecting p‐Hacking,"
Econometrica, Econometric Society, vol. 90(2), pages 887-906, March.
- Graham Elliott & Nikolay Kudrin & Kaspar Wuthrich, 2019. "Detecting p-hacking," Papers 1906.06711, arXiv.org, revised May 2021.
- Elliott, Graham & Kudrin, Nikolay & Wüthrich, Kaspar, 2022. "Detecting p‐Hacking," University of California at San Diego, Economics Working Paper Series qt2p04s3dr, Department of Economics, UC San Diego.
- Denis Fougère & Nicolas Jacquemet, 2020.
"Policy Evaluation Using Causal Inference Methods,"
Working Papers
hal-03455978, HAL.
- Denis Fougère & Nicolas Jacquemet, 2020. "Policy Evaluation Using Causal Inference Methods," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) hal-03455978, HAL.
- Denis Fougère & Nicolas Jacquemet, 2021. "Policy Evaluation Using Causal Inference Methods," SciencePo Working papers Main hal-03098058, HAL.
- Fougère, Denis & Jacquemet, Nicolas, 2020. "Policy Evaluation Using Causal Inference Methods," IZA Discussion Papers 12922, Institute of Labor Economics (IZA).
- Denis Fougère & Nicolas Jacquemet, 2020. "Policy Evaluation Using Causal Inference Methods," SciencePo Working papers Main hal-03455978, HAL.
- Denis Fougère & Nicolas Jacquemet, 2021. "Policy Evaluation Using Causal Inference Methods," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) hal-03098058, HAL.
- Denis Fougère & Nicolas Jacquemet, 2021. "Policy Evaluation Using Causal Inference Methods," PSE-Ecole d'économie de Paris (Postprint) hal-03098058, HAL.
- Denis Fougère & Nicolas Jacquemet, 2021. "Policy Evaluation Using Causal Inference Methods," Post-Print hal-03098058, HAL.
- Burlig, Fiona, 2018.
"Improving transparency in observational social science research: A pre-analysis plan approach,"
Economics Letters, Elsevier, vol. 168(C), pages 56-60.
- Burlig, Fiona, 2017. "Improving transparency in observational social science research: A pre-analysis plan approach," MetaArXiv qemkz, Center for Open Science.
- Brito, Igor R.S. & Oliveira, Alessandro V.M. & Dresner, Martin E., 2021. "An econometric study of the effects of airport privatization on airfares in Brazil," Transport Policy, Elsevier, vol. 114(C), pages 338-349.
- Santos, Luca J. & Oliveira, Alessandro V.M. & Aldrighi, Dante Mendes, 2021.
"Testing the differentiated impact of the COVID-19 pandemic on air travel demand considering social inclusion,"
Journal of Air Transport Management, Elsevier, vol. 94(C).
- Luca J. Santos & Alessandro V. M. Oliveira & Dante M. Aldrighi, 2021. "Testing the differentiated impact of the COVID-19 pandemic on air travel demand considering social inclusion," Working Papers, Department of Economics 2021_14, University of São Paulo (FEA-USP).
- Luca J. Santos & Alessandro V. M. Oliveira & Dante Mendes Aldrighi, 2021. "Testing the differentiated impact of the COVID-19 pandemic on air travel demand considering social inclusion," Papers 2108.00850, arXiv.org.
- Alexander Frankel & Maximilian Kasy, 2022.
"Which Findings Should Be Published?,"
American Economic Journal: Microeconomics, American Economic Association, vol. 14(1), pages 1-38, February.
- Kasy, Maximilian & Frankel, Alexander, 2018. "Which findings should be published?," MetaArXiv mbvz3, Center for Open Science.
- Maximilian Kasy & Jann Spiess, 2022.
"Optimal Pre-Analysis Plans: Statistical Decisions Subject to Implementability,"
Papers
2208.09638, arXiv.org, revised Jul 2024.
- Maximilian Kasy & Jann Spiess, 2024. "Optimal Pre-Analysis Plans: Statistical Decisions Subject to Implementability," CESifo Working Paper Series 11258, CESifo.
- Kasy, Maximilian & Spiess, Jann, 2024. "Optimal Pre-analysis Plans: Statistical Decisions Subject to Implementability," IZA Discussion Papers 17187, Institute of Labor Economics (IZA).
- Tomas Havranek & Zuzana Irsova & Lubica Laslopova & Olesia Zeynalova, 2020.
"Skilled and Unskilled Labor Are Less Substitutable than Commonly Thought,"
Working Papers IES
2020/29, Charles University Prague, Faculty of Social Sciences, Institute of Economic Studies, revised Sep 2020.
- Havranek, Tomas & Irsova, Zuzana & Laslopova, Lubica & Zeynalova, Olesia, 2021. "Skilled and Unskilled Labor Are Less Substitutable than Commonly Thought," CEPR Discussion Papers 15724, C.E.P.R. Discussion Papers.
- Havranek, Tomas & Irsova, Zuzana & Laslopova, Lubica & Zeynalova, Olesia, 2020. "Skilled and Unskilled Labor Are Less Substitutable than Commonly Thought," EconStor Preprints 223060, ZBW - Leibniz Information Centre for Economics.
- Simon Briole & Marc Gurgand & Eric Maurin & Sandra McNally & Jenifer Ruiz-Valenzuela & Daniel Santin, 2022.
"The making of civic virtues: a school-based experiment in three countries,"
CEP Discussion Papers
dp1830, Centre for Economic Performance, LSE.
- Simon Briole & Marc Gurgand & Eric Maurin & Sandra Mcnally & Jenifer Ruiz-Valenzuela & Daniel Santin, 2024. "The Making of Civic Virtues: A School-Based Experiment in Three Countries," Working Papers halshs-04720970, HAL.
- Simon Briole & Marc Gurgand & Eric Maurin & Sandra Mcnally & Jenifer Ruiz-Valenzuela & Daniel Santin, 2024. "The Making of Civic Virtues: A School-Based Experiment in Three Countries," PSE Working Papers halshs-04720970, HAL.
- Briole, Simon & Gurgand, Marc & Maurin, Eric & McNally, Sandra & Ruiz-Valenzuela, Jenifer & Santín, Daniel, 2022. "The Making of Civic Virtues: A School-Based Experiment in Three Countries," IZA Discussion Papers 15141, Institute of Labor Economics (IZA).
- Abel Brodeur & Scott Carrell & David Figlio & Lester Lusher, 2023.
"Unpacking P-hacking and Publication Bias,"
American Economic Review, American Economic Association, vol. 113(11), pages 2974-3002, November.
- Brodeur, Abel & Carrell, Scott & Figlio, David & Lusher, Lester, 2023. "Unpacking P-Hacking and Publication Bias," I4R Discussion Paper Series 52, The Institute for Replication (I4R).
- Abel Brodeur & Scott E. Carrell & David N. Figlio & Lester R. Lusher, 2023. "Unpacking P-Hacking and Publication Bias," NBER Working Papers 31548, National Bureau of Economic Research, Inc.
- Brodeur, Abel & Carrell, Scott E. & Figlio, David N. & Lusher, Lester, 2023. "Unpacking P-Hacking and Publication Bias," IZA Discussion Papers 16369, Institute of Labor Economics (IZA).
- Phillip Heiler, 2022. "Heterogeneous Treatment Effect Bounds under Sample Selection with an Application to the Effects of Social Media on Political Polarization," Papers 2209.04329, arXiv.org, revised Jul 2024.
- Damian Kozbur, 2017.
"Testing-Based Forward Model Selection,"
American Economic Review, American Economic Association, vol. 107(5), pages 266-269, May.
- Damian Kozbur, 2015. "Testing-Based Forward Model Selection," ECON - Working Papers 283, Department of Economics - University of Zurich, revised Apr 2018.
- Simon Calmar Andersen & Louise Beuchert & Phillip Heiler & Helena Skyt Nielsen, 2023. "A Guide to Impact Evaluation under Sample Selection and Missing Data: Teacher's Aides and Adolescent Mental Health," Papers 2308.04963, arXiv.org.
More about this item
JEL classification:
- A0 - General Economics and Teaching - - General
NEP fields
This paper has been announced in the following NEP Reports:- NEP-EXP-2020-05-04 (Experimental Economics)
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:26993. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.