The replicability crisis and the p-value debate – what are the consequences for the agricultural and food economics community?
Author
Abstract
Suggested Citation
DOI: 10.22004/ag.econ.316369
Download full text from publisher
References listed on IDEAS
- Guido W. Imbens, 2021. "Statistical Significance, p-Values, and the Reporting of Uncertainty," Journal of Economic Perspectives, American Economic Association, vol. 35(3), pages 157-174, Summer.
- Deirdre N. McCloskey & Stephen T. Ziliak, 1996. "The Standard Error of Regressions," Journal of Economic Literature, American Economic Association, vol. 34(1), pages 97-114, March.
- Stephen T. Ziliak & Deirdre N. McCloskey, 2004.
"Size Matters: The Standard Error of Regressions in the American Economic Review,"
Econ Journal Watch, Econ Journal Watch, vol. 1(2), pages 331-358, August.
- Ziliak, Stephen T. & McCloskey, Deirdre N., 2004. "Size matters: the standard error of regressions in the American Economic Review," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 33(5), pages 527-546, November.
- Zoe Rahwan & Erez Yoeli & Barbara Fasolo, 2019. "Heterogeneity in banker culture and its influence on dishonesty," Nature, Nature, vol. 575(7782), pages 345-349, November.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2016.
"Star Wars: The Empirics Strike Back,"
American Economic Journal: Applied Economics, American Economic Association, vol. 8(1), pages 1-32, January.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2012. "Star wars: The empirics strike back," PSE Working Papers halshs-00710122, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2016. "Star Wars: The Empirics Strike Back," PSE-Ecole d'économie de Paris (Postprint) hal-01447851, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2015. "Star Wars: The Empirics Strike Back," PSE Working Papers halshs-01158500, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2015. "Star Wars: The Empirics Strike Back," Working Papers halshs-01158500, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2015. "Star Wars: The Empirics Strike Back," AMSE Working Papers 1523, Aix-Marseille School of Economics, France, revised May 2015.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2012. "Star wars: The empirics strike back," SciencePo Working papers Main halshs-00710122, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2015. "Star Wars: The Empirics Strike Back," Working Papers 1505E, University of Ottawa, Department of Economics.
- Brodeur, Abel & Lé, Mathias & Sangnier, Marc & Zylberberg, Yanos, 2013. "Star Wars: The Empirics Strike Back," IZA Discussion Papers 7268, Institute of Labor Economics (IZA).
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2012. "Star wars: The empirics strike back," Working Papers halshs-00710122, HAL.
- Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2016. "Star Wars: The Empirics Strike Back," Post-Print hal-01447851, HAL.
- Jens Rommel & Meike Weltin, 2021.
"Is There a Cult of Statistical Significance in Agricultural Economics?,"
Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 43(3), pages 1176-1191, September.
- Rommel, Jens & Weltin, Meike, 2017. "Is there a cult of statistical significance in Agricultural Economics?," 57th Annual Conference, Weihenstephan, Germany, September 13-15, 2017 261998, German Association of Agricultural Economists (GEWISOLA).
- Sander Greenland, 2019. "Valid P-Values Behave Exactly as They Should: Some Misleading Criticisms of P-Values and Their Resolution With S-Values," The American Statistician, Taylor & Francis Journals, vol. 73(S1), pages 106-114, March.
- L'industria, 2021. "Call for papers," L'industria, Società editrice il Mulino, issue 4, pages 771-786.
- Nick Huntington‐Klein & Andreu Arenas & Emily Beam & Marco Bertoni & Jeffrey R. Bloem & Pralhad Burli & Naibin Chen & Paul Grieco & Godwin Ekpe & Todd Pugatch & Martin Saavedra & Yaniv Stopnitzky, 2021.
"The influence of hidden researcher decisions in applied microeconomics,"
Economic Inquiry, Western Economic Association International, vol. 59(3), pages 944-960, July.
- Huntington-Klein, Nick & Arenas, Andreu & Beam, Emily A. & Bertoni, Marco & Bloem, Jeffrey R. & Burli, Pralhad & Chen, Naibin & Greico, Paul & Ekpe, Godwin & Pugatch, Todd & Saavedra, Martin & Stopnit, 2020. "The Influence of Hidden Researcher Decisions in Applied Microeconomics," IZA Discussion Papers 13233, Institute of Labor Economics (IZA).
- Huntington-Klein, Nick & Arenas, Andreu & Beam, Emily & Bertoni, Marco & Bloem, Jeffrey R. & Burli, Pralhad & Chen, Naibin & Greico, Paul & Ekpe, Godwin & Pugatch, Todd & Saavedra, Martin & Stopnitzky, 2020. "The Influence of Hidden Researcher Decisions in Applied Microeconomics," GLO Discussion Paper Series 537, Global Labor Organization (GLO).
- L'industria, 2021. "Call for paper," L'industria, Società editrice il Mulino, issue 3, pages 579-593.
- Andrew Gelman & John Carlin, 2017. "Some Natural Solutions to the -Value Communication Problem—and Why They Won’t Work," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(519), pages 899-901, July.
- Casper Albers, 2019. "The problem with unadjusted multiple and sequential statistical testing," Nature Communications, Nature, vol. 10(1), pages 1-4, December.
- Norbert Hirschauer & Oliver Mußhoff & Sven Grüner, 2017. "False Discoveries und Fehlinterpretationen wissenschaftlicher Ergebnisse [False Discoveries and Misinterpretations of Scientific Findings — Implications for Science Communication]," Wirtschaftsdienst, Springer;ZBW - Leibniz Information Centre for Economics, vol. 97(3), pages 201-206, March.
- Joachim I. Krueger & Patrick R. Heck, 2019. "Putting the P-Value in its Place," The American Statistician, Taylor & Francis Journals, vol. 73(S1), pages 122-128, March.
- Geweke, John & Koop, Gary & van Dijk, Herman (ed.), 2011. "The Oxford Handbook of Bayesian Econometrics," OUP Catalogue, Oxford University Press, number 9780199559084.
- Hirschauer, Norbert & Grüner, Sven & Mußhoff, Oliver & Becker, Claudia & Jantsch, Antje, 2020.
"Can p-values be meaningfully interpreted without random sampling?,"
EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 14, pages 71-91.
- Hirschauer, Norbert & Gruener, Sven & Mußhoff, Oliver & Becker, Claudia & Jantsch, Antje, 2019. "Can p-values be meaningfully interpreted without random sampling?," SocArXiv yazr8, Center for Open Science.
- David Giofrè & Geoff Cumming & Luca Fresc & Ingrid Boedker & Patrizio Tressoldi, 2017. "The influence of journal submission guidelines on authors' reporting of statistics and use of open research practices," PLOS ONE, Public Library of Science, vol. 12(4), pages 1-15, April.
- L'industria, 2020. "Call for papers," L'industria, Società editrice il Mulino, issue 2, pages 367-370.
- L'industria, 2020. "Call for Papers," L'industria, Società editrice il Mulino, issue 4, pages 787-801.
- Marjan Bakker & Coosje L S Veldkamp & Marcel A L M van Assen & Elise A V Crompvoets & How Hwee Ong & Brian A Nosek & Courtney K Soderberg & David Mellor & Jelte M Wicherts, 2020. "Ensuring the quality and specificity of preregistrations," PLOS Biology, Public Library of Science, vol. 18(12), pages 1-18, December.
- The Editors, 2021. "Call for Paper," Action Learning: Research and Practice, Taylor & Francis Journals, vol. 18(3), pages 195-197, September.
- Abhijit Banerjee & Esther Duflo & Amy Finkelstein & Lawrence F. Katz & Benjamin A. Olken & Anja Sautmann, 2020. "In Praise of Moderation: Suggestions for the Scope and Use of Pre-Analysis Plans for RCTs in Economics," NBER Working Papers 26993, National Bureau of Economic Research, Inc.
- Campbell R. Harvey, 2017. "Presidential Address: The Scientific Outlook in Financial Economics," Journal of Finance, American Finance Association, vol. 72(4), pages 1399-1440, August.
- Jonathan W. Schooler, 2014. "Metascience could rescue the ‘replication crisis’," Nature, Nature, vol. 515(7525), pages 9-9, November.
- Logg, Jennifer M. & Dorison, Charles A., 2021. "Pre-registration: Weighing costs and benefits for researchers," Organizational Behavior and Human Decision Processes, Elsevier, vol. 167(C), pages 18-27.
- Ronald L. Wasserstein & Nicole A. Lazar, 2016. "The ASA's Statement on p -Values: Context, Process, and Purpose," The American Statistician, Taylor & Francis Journals, vol. 70(2), pages 129-133, May.
- Balazs Aczel & Rink Hoekstra & Andrew Gelman & Eric-Jan Wagenmakers & Irene G. Klugkist & Jeffrey N. Rouder & Joachim Vandekerckhove & Michael D. Lee & Richard D. Morey & Wolf Vanpaemel & Zoltan Diene, 2020. "Discussion points for Bayesian inference," Nature Human Behaviour, Nature, vol. 4(6), pages 561-563, June.
- Ronald D. Fricker & Katherine Burke & Xiaoyan Han & William H. Woodall, 2019. "Assessing the Statistical Analyses Used in Basic and Applied Social Psychology After Their p-Value Ban," The American Statistician, Taylor & Francis Journals, vol. 73(S1), pages 374-384, March.
- Paul J. Ferraro & Pallavi Shukla, 2020. "Feature—Is a Replicability Crisis on the Horizon for Environmental and Resource Economics?," Review of Environmental Economics and Policy, University of Chicago Press, vol. 14(2), pages 339-351.
- L'industria, 2020. "Call for papers," L'industria, Società editrice il Mulino, issue 1, pages 173-187.
- Benjamin A. Olken, 2015. "Promises and Perils of Pre-analysis Plans," Journal of Economic Perspectives, American Economic Association, vol. 29(3), pages 61-80, Summer.
- Hirschauer, Norbert & Grüner , Sven, 2021.
"A Primer on p-Value Thresholds and α-Levels – Two Different Kettles of Fish,"
German Journal of Agricultural Economics, Humboldt-Universitaet zu Berlin, Department for Agricultural Economics, vol. 70(02), January.
- Hirschauer, Norbert & Gruener, Sven & Mußhoff, Oliver & Becker, Claudia, 2020. "A primer on p-value thresholds and α-levels – two different kettles of fish," SocArXiv d46m2, Center for Open Science.
- Rahwan, Zoe & Yoeli, Erez & Fasolo, Barbara, 2019. "Heterogeneity in banker culture and its influence on dishonesty," LSE Research Online Documents on Economics 102656, London School of Economics and Political Science, LSE Library.
- L'industria, 2021. "Call for Papers," L'industria, Società editrice il Mulino, issue 2, pages 377-391.
- Stuart Buck, 2021. "Beware performative reproducibility," Nature, Nature, vol. 595(7866), pages 151-151, July.
- Valentin Amrhein & Sander Greenland & Blake McShane, 2019. "Scientists rise up against statistical significance," Nature, Nature, vol. 567(7748), pages 305-307, March.
- Hirschauer Norbert & Mußhoff Oliver & Grüner Sven & Frey Ulrich & Theesfeld Insa & Wagner Peter, 2016. "Die Interpretation des p-Wertes – Grundsätzliche Missverständnisse," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 236(5), pages 557-575, October.
- L'industria, 2021. "Call for Papers," L'industria, Società editrice il Mulino, issue 1, pages 175-189.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
Cited by:
- Riccardo Vecchio, 2022. "Fostering the debate among scholars to support the advancement of knowledge in the food-related consumer research: A commentary," Economia agro-alimentare, FrancoAngeli Editore, vol. 24(2), pages 1-15.
- Lehberger, Mira & Gruener, Sven, 2023. "(Why) Do farmers’ Big Five personality traits matter? – A systematic literature review," OSF Preprints jbx4p, Center for Open Science.
- Vecchio, Riccardo, 2022. "Fostering the debate among scholars to support the advancement of knowledge in the food-related consumer research: A commentary," Economia agro-alimentare / Food Economy, Italian Society of Agri-food Economics/Società Italiana di Economia Agro-Alimentare (SIEA), vol. 24(2), September.
- Thibaut Arpinon & Marianne Lefebvre, 2024. "Registered Reports and Associated Benefits for Agricultural Economics," Post-Print hal-04635986, HAL.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Thibaut Arpinon & Romain Espinosa, 2023. "A practical guide to Registered Reports for economists," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 9(1), pages 90-122, June.
- Thibaut Arpinon & Romain Espinosa, 2023. "A Practical Guide to Registered Reports for Economists," Post-Print halshs-03897719, HAL.
- Genevieve LeBaron, 2021. "The Role of Supply Chains in the Global Business of Forced Labour," Journal of Supply Chain Management, Institute for Supply Management, vol. 57(2), pages 29-42, April.
- Spiekermann, Sarah & Krasnova, Hanna & Hinz, Oliver & Baumann, Annika & Benlian, Alexander & Gimpel, Henner & Heimbach, Irina & Köster, Antonia & Maedche, Alexander & Niehaves, Björn & Risius, Marten , 2022. "Values and Ethics in Information Systems – A State-of-the-Art Analysis and Avenues for Future Research," Publications of Darmstadt Technical University, Institute for Business Studies (BWL) 130842, Darmstadt Technical University, Department of Business Administration, Economics and Law, Institute for Business Studies (BWL).
- Rainer Alt, 2021. "Electronic Markets on digital platforms and AI," Electronic Markets, Springer;IIM University of St. Gallen, vol. 31(2), pages 233-241, June.
- Guillaume Coqueret, 2023. "Forking paths in financial economics," Papers 2401.08606, arXiv.org.
- Heckelei, Thomas & Hüttel, Silke & Odening, Martin & Rommel, Jens, 2023. "The p-Value Debate and Statistical (Mal)practice – Implications for the Agricultural and Food Economics Community," German Journal of Agricultural Economics, Humboldt-Universitaet zu Berlin, Department for Agricultural Economics, vol. 72(01), January.
- Jens Rommel & Meike Weltin, 2021.
"Is There a Cult of Statistical Significance in Agricultural Economics?,"
Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 43(3), pages 1176-1191, September.
- Rommel, Jens & Weltin, Meike, 2017. "Is there a cult of statistical significance in Agricultural Economics?," 57th Annual Conference, Weihenstephan, Germany, September 13-15, 2017 261998, German Association of Agricultural Economists (GEWISOLA).
- Jae H. Kim, 2022. "Moving to a world beyond p-value," Review of Managerial Science, Springer, vol. 16(8), pages 2467-2493, November.
- Gunter, Ulrich & Önder, Irem & Smeral, Egon, 2019. "Scientific value of econometric tourism demand studies," Annals of Tourism Research, Elsevier, vol. 78(C), pages 1-1.
- Bruns, Stephan B. & Asanov, Igor & Bode, Rasmus & Dunger, Melanie & Funk, Christoph & Hassan, Sherif M. & Hauschildt, Julia & Heinisch, Dominik & Kempa, Karol & König, Johannes & Lips, Johannes & Verb, 2019. "Reporting errors and biases in published empirical findings: Evidence from innovation research," Research Policy, Elsevier, vol. 48(9), pages 1-1.
- Sarah A. Janzen & Jeffrey D. Michler, 2021.
"Ulysses' pact or Ulysses' raft: Using pre‐analysis plans in experimental and nonexperimental research,"
Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 43(4), pages 1286-1304, December.
- Janzen, Sarah & Michler, Jeffrey D, 2020. "Ulysses' Pact or Ulysses' Raft: Using Pre-Analysis Plans in Experimental and Non-Experimental Research," MetaArXiv wkmht, Center for Open Science.
- Janzen, Sarah & Michler, Jeffrey D, 2020. "Ulysses' Pact or Ulysses' Raft: Using Pre-Analysis Plans in Experimental and Non-Experimental Research," MetaArXiv wkmht_v1, Center for Open Science.
- Hirschauer Norbert & Grüner Sven & Mußhoff Oliver & Becker Claudia, 2019. "Twenty Steps Towards an Adequate Inferential Interpretation of p-Values in Econometrics," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 239(4), pages 703-721, August.
- Garret Christensen & Edward Miguel, 2018.
"Transparency, Reproducibility, and the Credibility of Economics Research,"
Journal of Economic Literature, American Economic Association, vol. 56(3), pages 920-980, September.
- Garret S. Christensen & Edward Miguel, 2016. "Transparency, Reproducibility, and the Credibility of Economics Research," NBER Working Papers 22989, National Bureau of Economic Research, Inc.
- Christensen, Garret & Miguel, Edward & Sturdy, Jennifer, 2017. "Transparency, Reproducibility, and the Credibility of Economics Research," MetaArXiv 9a3rw, Center for Open Science.
- Christensen, Garret & Miguel, Edward, 2017. "Transparency, Reproducibility, and the Credibility of Economics Research," Department of Economics, Working Paper Series qt52h6x1cq, Department of Economics, Institute for Business and Economic Research, UC Berkeley.
- Keith R Lohse & Kristin L Sainani & J Andrew Taylor & Michael L Butson & Emma J Knight & Andrew J Vickers, 2020. "Systematic review of the use of “magnitude-based inference” in sports science and medicine," PLOS ONE, Public Library of Science, vol. 15(6), pages 1-22, June.
- Rostami-Tabar, Bahman & Ali, Mohammad M. & Hong, Tao & Hyndman, Rob J. & Porter, Michael D. & Syntetos, Aris, 2022.
"Forecasting for social good,"
International Journal of Forecasting, Elsevier, vol. 38(3), pages 1245-1257.
- Bahman Rostami-Tabar & Mohammad M Ali & Tao Hong & Rob J Hyndman & Michael D Porter & Aris Syntetos, 2020. "Forecasting for Social Good," Monash Econometrics and Business Statistics Working Papers 37/20, Monash University, Department of Econometrics and Business Statistics.
- Ankel-Peters, Jörg & Fiala, Nathan & Neubauer, Florian, 2023.
"Do economists replicate?,"
Journal of Economic Behavior & Organization, Elsevier, vol. 212(C), pages 219-232.
- Fiala, Nathan & Neubauer, Florian & Peters, Jörg, 2022. "Do economists replicate?," Ruhr Economic Papers 939, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
- Ankel-Peters, Jörg & Fiala, Nathan & Neubauer, Florian, 2023. "Do Economists Replicate?," I4R Discussion Paper Series 13, The Institute for Replication (I4R).
- Basso, Gaetano & Boeri, Tito & Caiumi, Alessandro & Paccagnella, Marco, 2020.
"The New Hazardous Jobs and Worker Reallocation,"
IZA Discussion Papers
13532, Institute of Labor Economics (IZA).
- Boeri, Tito & Basso, Gaetano & Caiumi, Alessandro & Paccagnella, Marco, 2020. "The new hazardous jobs and worker reallocation," CEPR Discussion Papers 15100, C.E.P.R. Discussion Papers.
- Gaetano Basso & Tito Boeri & Alessandro Caiumi & Marco Paccagnella, 2020. "The new hazardous jobs and worker reallocation," OECD Social, Employment and Migration Working Papers 247, OECD Publishing.
- Wesley Mendes-da-Silva, 2021. "The Journal of Contemporary Administration (RAC)’s 2018 - 2021 Managerial Report and a Farewell," RAC - Revista de Administração Contemporânea (Journal of Contemporary Administration), ANPAD - Associação Nacional de Pós-Graduação e Pesquisa em Administração, vol. 25(6), pages 210100-2101.
- Denis Fougère & Nicolas Jacquemet, 2020.
"Policy Evaluation Using Causal Inference Methods,"
Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers)
hal-03455978, HAL.
- Denis Fougère & Nicolas Jacquemet, 2020. "Policy Evaluation Using Causal Inference Methods," SciencePo Working papers Main hal-03455978, HAL.
- Denis Fougère & Nicolas Jacquemet, 2021. "Policy Evaluation Using Causal Inference Methods," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) hal-03098058, HAL.
- Denis Fougère & Nicolas Jacquemet, 2021. "Policy Evaluation Using Causal Inference Methods," PSE-Ecole d'économie de Paris (Postprint) hal-03098058, HAL.
- Denis Fougère & Nicolas Jacquemet, 2020. "Policy Evaluation Using Causal Inference Methods," Working Papers hal-03455978, HAL.
- Denis Fougère & Nicolas Jacquemet, 2021. "Policy Evaluation Using Causal Inference Methods," Post-Print hal-03098058, HAL.
- Fougère, Denis & Jacquemet, Nicolas, 2020. "Policy Evaluation Using Causal Inference Methods," IZA Discussion Papers 12922, Institute of Labor Economics (IZA).
- Denis Fougère & Nicolas Jacquemet, 2021. "Policy Evaluation Using Causal Inference Methods," SciencePo Working papers Main hal-03098058, HAL.
More about this item
Keywords
Research Methods/ Statistical Methods;NEP fields
This paper has been announced in the following NEP Reports:- NEP-AGR-2021-12-13 (Agricultural Economics)
- NEP-HME-2021-12-13 (Heterodox Microeconomics)
- NEP-SOG-2021-12-13 (Sociology of Economics)
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ags:ubfred:316369. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: AgEcon Search (email available below). General contact details of provider: https://edirc.repec.org/data/zefbnde.html .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.