Lessons from the p-value debate and the replication crisis for "open Q science" – the editor's perspective or: will the revolution devour its children?
Author
Abstract
Suggested Citation
Download full text from publisher
References listed on IDEAS
- Dietmar Wolfram & Peiling Wang & Adam Hembree & Hyoungjoo Park, 2020. "Open peer review: promoting transparency in open science," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1033-1051, November.
- Bornmann, Lutz & Mutz, Rüdiger & Daniel, Hans-Dieter, 2007. "Gender differences in grant peer review: A meta-analysis," Journal of Informetrics, Elsevier, vol. 1(3), pages 226-238.
- Abel Brodeur & Nikolai Cook & Anthony Heyes, 2020. "Methods Matter: p-Hacking and Publication Bias in Causal Analysis in Economics," American Economic Review, American Economic Association, vol. 110(11), pages 3634-3660, November.
- Regina Nuzzo, 2015. "How scientists fool themselves – and how they can stop," Nature, Nature, vol. 526(7572), pages 182-185, October.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2016.
"Star Wars: The Empirics Strike Back,"
American Economic Journal: Applied Economics, American Economic Association, vol. 8(1), pages 1-32, January.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2012. "Star wars: The empirics strike back," PSE Working Papers halshs-00710122, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2015. "Star Wars: The Empirics Strike Back," Working Papers 1505E, University of Ottawa, Department of Economics.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2016. "Star Wars: The Empirics Strike Back," PSE-Ecole d'économie de Paris (Postprint) hal-01447851, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2015. "Star Wars: The Empirics Strike Back," PSE Working Papers halshs-01158500, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2015. "Star Wars: The Empirics Strike Back," Working Papers halshs-01158500, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2015. "Star Wars: The Empirics Strike Back," AMSE Working Papers 1523, Aix-Marseille School of Economics, France, revised May 2015.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2012. "Star wars: The empirics strike back," SciencePo Working papers Main halshs-00710122, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2012. "Star wars: The empirics strike back," Working Papers halshs-00710122, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2016. "Star Wars: The Empirics Strike Back," Post-Print hal-01447851, HAL.
- Brodeur, Abel & Lé, Mathias & Sangnier, Marc & Zylberberg, Yanos, 2013. "Star Wars: The Empirics Strike Back," IZA Discussion Papers 7268, Institute of Labor Economics (IZA).
- Paul J. Ferraro & Pallavi Shukla, 2020. "Feature—Is a Replicability Crisis on the Horizon for Environmental and Resource Economics?," Review of Environmental Economics and Policy, University of Chicago Press, vol. 14(2), pages 339-351.
- Broder, Ivy E, 1993. "Review of NSF Economics Proposals: Gender and Institutional Patterns," American Economic Review, American Economic Association, vol. 83(4), pages 964-970, September.
- T. D. Stanley, 2005. "Beyond Publication Bias," Journal of Economic Surveys, Wiley Blackwell, vol. 19(3), pages 309-345, July.
- Heß, Sebastian & Bergmann, Holger & Sudmann, Lüder, 2006. "Die Förderung alternativer Energien - eine kritische Bestandsaufnahme," Department of Agricultural and Rural Development (DARE) Discussion Papers 187446, Georg-August-Universitaet Goettingen, Department of Agricultural Economics and Rural Development (DARE).
- Chris Doucouliagos, 2005. "Publication Bias in the Economic Freedom and Economic Growth Literature," Journal of Economic Surveys, Wiley Blackwell, vol. 19(3), pages 367-387, July.
- Stefan Wimmer & Robert Finger, 2023. "A note on synthetic data for replication purposes in agricultural economics," Journal of Agricultural Economics, Wiley Blackwell, vol. 74(1), pages 316-323, February.
- Heß, Sebastian & Bergmann, Holger & Sudmann, Lüder, 2006. "Die Förderung alternativer Energien - eine kritische Bestandsaufnahme," 54th Annual Conference, Goettingen, Germany, September 17-19, 2014 187446, German Association of Agricultural Economists (GEWISOLA).
- Hirschauer Norbert & Mußhoff Oliver & Grüner Sven & Frey Ulrich & Theesfeld Insa & Wagner Peter, 2016. "Die Interpretation des p-Wertes – Grundsätzliche Missverständnisse," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 236(5), pages 557-575, October.
- Antonio J. Herrera, 1999. "Language bias discredits the peer-review system," Nature, Nature, vol. 397(6719), pages 467-467, February.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Abel Brodeur & Scott Carrell & David Figlio & Lester Lusher, 2023.
"Unpacking P-hacking and Publication Bias,"
American Economic Review, American Economic Association, vol. 113(11), pages 2974-3002, November.
- Brodeur, Abel & Carrell, Scott & Figlio, David & Lusher, Lester, 2023. "Unpacking P-Hacking and Publication Bias," I4R Discussion Paper Series 52, The Institute for Replication (I4R).
- Abel Brodeur & Scott E. Carrell & David N. Figlio & Lester R. Lusher, 2023. "Unpacking P-Hacking and Publication Bias," NBER Working Papers 31548, National Bureau of Economic Research, Inc.
- Brodeur, Abel & Carrell, Scott E. & Figlio, David N. & Lusher, Lester, 2023. "Unpacking P-Hacking and Publication Bias," IZA Discussion Papers 16369, Institute of Labor Economics (IZA).
- Christopher Snyder & Ran Zhuo, 2018. "Sniff Tests as a Screen in the Publication Process: Throwing out the Wheat with the Chaff," NBER Working Papers 25058, National Bureau of Economic Research, Inc.
- Dreber, Anna & Johannesson, Magnus, 2023.
"A framework for evaluating reproducibility and replicability in economics,"
Ruhr Economic Papers
1055, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
- Dreber, Anna & Johannesson, Magnus, 2023. "A framework for evaluating reproducibility and replicability in economics," I4R Discussion Paper Series 38, The Institute for Replication (I4R).
- Alexander L. Brown & Taisuke Imai & Ferdinand M. Vieider & Colin F. Camerer, 2024.
"Meta-analysis of Empirical Estimates of Loss Aversion,"
Journal of Economic Literature, American Economic Association, vol. 62(2), pages 485-516, June.
- Brown, Alexander L. & Imai, Taisuke & Vieider, Ferdinand & Camerer, Colin, 2020. "Meta-Analysis of Empirical Estimates of Loss-Aversion," MetaArXiv hnefr, Center for Open Science.
- Brown, Alexander L. & Imai, Taisuke & Vieider, Ferdinand M. & Camerer, Colin F., 2021. "Meta-Analysis of Empirical Estimates of Loss-Aversion," Rationality and Competition Discussion Paper Series 275, CRC TRR 190 Rationality and Competition.
- Alexander, L. Brown & Taisuke Imai & Ferdinand M. Vieider & Colin Camerer, 2021. "Meta-Analysis of Empirical Estimates of Loss-Aversion," CESifo Working Paper Series 8848, CESifo.
- Heckelei, Thomas & Huettel, Silke & Odening, Martin & Rommel, Jens, 2021. "The replicability crisis and the p-value debate – what are the consequences for the agricultural and food economics community?," Discussion Papers 316369, University of Bonn, Institute for Food and Resource Economics.
- Cazachevici, Alina & Havranek, Tomas & Horvath, Roman, 2019.
"Remittances and Economic Growth: A Quantitative Survey,"
EconStor Preprints
205812, ZBW - Leibniz Information Centre for Economics.
- Cazachevici, Alina & Havranek, Tomas & Horvath, Roman, 2019. "Remittances and Economic Growth: A Quantitative Survey," MPRA Paper 96823, University Library of Munich, Germany.
- Matteo Picchio & Michele Ubaldi, 2024.
"Unemployment and health: A meta‐analysis,"
Journal of Economic Surveys, Wiley Blackwell, vol. 38(4), pages 1437-1472, September.
- Picchio, Matteo & Ubaldi, Michele, 2022. "Unemployment and Health: A Meta-Analysis," GLO Discussion Paper Series 1128, Global Labor Organization (GLO).
- Matteo Picchio & Michele Ubaldi, 2022. "Unemployment And Health: A Meta-Analysis," Working Papers 467, Universita' Politecnica delle Marche (I), Dipartimento di Scienze Economiche e Sociali.
- Picchio, Matteo & Ubaldi, Michele, 2022. "Unemployment and Health: A Meta-Analysis," IZA Discussion Papers 15433, Institute of Labor Economics (IZA).
- Thibaut Arpinon & Marianne Lefebvre, 2024. "Registered Reports and Associated Benefits for Agricultural Economics," Post-Print hal-04635986, HAL.
- Cazachevici, Alina & Havranek, Tomas & Horvath, Roman, 2020.
"Remittances and economic growth: A meta-analysis,"
World Development, Elsevier, vol. 134(C).
- Alina Cazachevici & Tomas Havranek & Roman Horvath, 2019. "Remittances and Economic Growth: A Meta-Analysis," Working Papers IES 2019/35, Charles University Prague, Faculty of Social Sciences, Institute of Economic Studies, revised Oct 2019.
- Dominika Ehrenbergerova & Josef Bajzik & Tomas Havranek, 2023.
"When Does Monetary Policy Sway House Prices? A Meta-Analysis,"
IMF Economic Review, Palgrave Macmillan;International Monetary Fund, vol. 71(2), pages 538-573, June.
- Havranek, Tomas & Kolcunova, Dominika & Bajzik, Josef, 2021. "When Does Monetary Policy Sway House Prices? A Meta-Analysis," CEPR Discussion Papers 16196, C.E.P.R. Discussion Papers.
- Josef Bajzik & Dominika Ehrenbergerova & Tomas Havranek, 2021. "When Does Monetary Policy Sway House Prices? A Meta-Analysis," Working Papers IES 2021/17, Charles University Prague, Faculty of Social Sciences, Institute of Economic Studies, revised May 2021.
- Ehrenbergerova, Dominika & Bajzik, Josef & Havranek, Tomas, 2021. "When Does Monetary Policy Sway House Prices? A Meta-Analysis," EconStor Preprints 234126, ZBW - Leibniz Information Centre for Economics.
- Snyder, Christopher & Zhuo, Ran, 2018. "Sniff Tests in Economics: Aggregate Distribution of Their Probability Values and Implications for Publication Bias," MetaArXiv 8vdrh, Center for Open Science.
- Ankel-Peters, Jörg & Fiala, Nathan & Neubauer, Florian, 2023.
"Do economists replicate?,"
Journal of Economic Behavior & Organization, Elsevier, vol. 212(C), pages 219-232.
- Fiala, Nathan & Neubauer, Florian & Peters, Jörg, 2022. "Do economists replicate?," Ruhr Economic Papers 939, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
- Ankel-Peters, Jörg & Fiala, Nathan & Neubauer, Florian, 2023. "Do Economists Replicate?," I4R Discussion Paper Series 13, The Institute for Replication (I4R).
- Guillaume Coqueret, 2023. "Forking paths in financial economics," Papers 2401.08606, arXiv.org.
- Fan Yang & Tomas Havranek & Zuzana Irsova & Jiri Novak, 2024. "Is research on hedge fund performance published selectively? A quantitative survey," Journal of Economic Surveys, Wiley Blackwell, vol. 38(4), pages 1085-1131, September.
- Römer, Ulf & Weber, Ron & Mußhoff, Oliver & Turvey, Calcum G., 2017.
"Truth and consequences: Bogus pipeline experiment in informal small business lending,"
DARE Discussion Papers
1702, Georg-August University of Göttingen, Department of Agricultural Economics and Rural Development (DARE).
- Römer, Ulf & Mußhoff, Oliver & Weber, Ron & Turvey, Calum G., 2017. "Truth and consequences: Bogus pipeline experiment in informal small business lending," Department of Agricultural and Rural Development (DARE) Discussion Papers 260765, Georg-August-Universitaet Goettingen, Department of Agricultural Economics and Rural Development (DARE).
- Ulf Römer & Oliver Musshoff, 2017.
"Can agricultural credit scoring for microfinance institutions be implemented and improved by weather data?,"
Agricultural Finance Review, Emerald Group Publishing Limited, vol. 78(1), pages 83-97, December.
- Römer, Ulf & Mußhoff, Oliver, 2017. "Can agricultural credit scoring for microfinance institutions be implemented and improved by weather data?," DARE Discussion Papers 1703, Georg-August University of Göttingen, Department of Agricultural Economics and Rural Development (DARE).
- Römer, Ulf & Mußhoff, Oliver, 2017. "Can agricultural credit scoring for microfinance institutions be implemented and improved by weather data?," Department of Agricultural and Rural Development (DARE) Discussion Papers 260766, Georg-August-Universitaet Goettingen, Department of Agricultural Economics and Rural Development (DARE).
- Stanley, T.D. & Doucouliagos, Chris & Jarrell, Stephen B., 2008.
"Meta-regression analysis as the socio-economics of economics research,"
Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 37(1), pages 276-292, February.
- Stanley, T. D. & Doucouliagos, Chris & Jarrell, Stephen B., 2006. "Meta-regression analysis as the socio-economics of economic research," Working Papers eco_2006_21, Deakin University, Department of Economics.
- Stefano DellaVigna & Elizabeth Linos, 2022.
"RCTs to Scale: Comprehensive Evidence From Two Nudge Units,"
Econometrica, Econometric Society, vol. 90(1), pages 81-116, January.
- Stefano DellaVigna & Elizabeth Linos, 2020. "RCTs to Scale: Comprehensive Evidence from Two Nudge Units," NBER Working Papers 27594, National Bureau of Economic Research, Inc.
- Stanley, T. D. & Doucouliagos, Chris, 2019. "Practical Significance, Meta-Analysis and the Credibility of Economics," IZA Discussion Papers 12458, Institute of Labor Economics (IZA).
- Bruns, Stephan & Herwartz, Helmut & Ioannidis, John P.A. & Islam, Chris-Gabriel & Raters, Fabian H. C., 2023. "Statistical reporting errors in economics," MetaArXiv mbx62, Center for Open Science.
More about this item
NEP fields
This paper has been announced in the following NEP Reports:- NEP-SOG-2023-10-09 (Sociology of Economics)
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:daredp:2302. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/iagoede.html .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.