IDEAS home Printed from https://ideas.repec.org/a/wly/apecpp/v45y2023i3p1275-1291.html
   My bibliography  Save this article

Credibility crisis in agricultural economics

Author

Listed:
  • Paul J. Ferraro
  • Pallavi Shukla

Abstract

We provide empirical evidence of research practices that can undermine the credibility of empirical research in agricultural economics. We find that, in four popular journals, most studies are underpowered, a characteristic that, when coupled with publication bias, yields unreliable and exaggerated effect sizes. This problem is exacerbated by selective reporting of statistically significant results and multiple hypothesis testing without any adjustments to statistical inferences. Survey respondents self‐report engaging in practices that are consistent with these empirical findings. Addressing these problems in agricultural economics will require that editors, reviewers, and donors change the norms and incentives for authors.

Suggested Citation

  • Paul J. Ferraro & Pallavi Shukla, 2023. "Credibility crisis in agricultural economics," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 45(3), pages 1275-1291, September.
    • Handle: RePEc:wly:apecpp:v:45:y:2023:i:3:p:1275-1291
    DOI: 10.1002/aepp.13323
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/aepp.13323
    Download Restriction: no
    File URL: https://libkey.io/10.1002/aepp.13323?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Stefano DellaVigna & Elizabeth Linos, 2022. "RCTs to Scale: Comprehensive Evidence From Two Nudge Units," Econometrica, Econometric Society, vol. 90(1), pages 81-116, January.
    2. Chris Chambers, 2019. "What’s next for Registered Reports?," Nature, Nature, vol. 573(7773), pages 187-189, September.
    3. Paul J. Ferraro & Pallavi Shukla, 2020. "Feature—Is a Replicability Crisis on the Horizon for Environmental and Resource Economics?," Review of Environmental Economics and Policy, University of Chicago Press, vol. 14(2), pages 339-351.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Casati, Mirta & Soregaroli, Claudio & Rommel, Jens & Luzzani, Gloria & Stranieri, Stefanella, 2023. "Please keep ordering! A natural field experiment assessing a carbon label introduction," Food Policy, Elsevier, vol. 120(C).
    2. Shukla, Pallavi & Messer, Kent D. & Ferraro, Paul J., 2023. "Applying behavioral science to agriculture, food, and agri-environmental policymaking," Food Policy, Elsevier, vol. 120(C).
    3. Robert Finger & Carola Grebitus & Arne Henningsen, 2024. "Improving Agricultural Policy Decisions through Replications," EuroChoices, The Agricultural Economics Society, vol. 23(1), pages 63-66, April.
    4. Thibaut Arpinon & Marianne Lefebvre, 2024. "Registered Reports and Associated Benefits for Agricultural Economics," Post-Print hal-04635986, HAL.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Abel Brodeur & Scott Carrell & David Figlio & Lester Lusher, 2023. "Unpacking P-hacking and Publication Bias," American Economic Review, American Economic Association, vol. 113(11), pages 2974-3002, November.
    2. Klege, Rebecca A. & Amuakwa-Mensah, Franklin & Visser, Martine, 2022. "Tenancy and energy choices in Rwanda. A replication and extension study," World Development Perspectives, Elsevier, vol. 26(C).
    3. Christina Gravert, 2024. "From Intent to Inertia: Experimental Evidence from the Retail Electricity Market," CESifo Working Paper Series 11139, CESifo.
    4. Lars Behlen & Oliver Himmler & Robert Jäckle, 2023. "Defaults and effortful tasks," Experimental Economics, Springer;Economic Science Association, vol. 26(5), pages 1022-1059, November.
    5. Gee, Laura K. & Kiyawat, Anoushka & Meer, Jonathan & Schreck, Michael J., 2024. "Pivotal or popular: The effects of social information and feeling pivotal on civic actions," Journal of Economic Behavior & Organization, Elsevier, vol. 219(C), pages 404-413.
    6. Despoina Alempaki & Genyue Fu & Jingcheng Fu, 2021. "Lying and social norms: a lab-in-the-field experiment with children," Discussion Papers 2021-01, The Centre for Decision Research and Experimental Economics, School of Economics, University of Nottingham.
    7. Houdek, Petr, 2024. "Nudging in organizations: How to avoid behavioral interventions being just a façade," Journal of Business Research, Elsevier, vol. 182(C).
    8. Brodeur, Abel & Cook, Nikolai & Heyes, Anthony, 2022. "We Need to Talk about Mechanical Turk: What 22,989 Hypothesis Tests Tell us about p-Hacking and Publication Bias in Online Experiments," GLO Discussion Paper Series 1157, Global Labor Organization (GLO).
    9. Higney, Anthony & Hanley, Nick & Moro, Mirko, 2022. "The lead-crime hypothesis: A meta-analysis," Regional Science and Urban Economics, Elsevier, vol. 97(C).
    10. Hagmann, David & Liao, Yi-tsen & Chater, Nick & Loewenstein, George, 2023. "Costly Distractions: Focusing on Individual Behavior Undermines Support for Systemic Reforms," OSF Preprints z2vwb_v1, Center for Open Science.
    11. Azevedo, Eduardo M. & Mao, David & Montiel Olea, José Luis & Velez, Amilcar, 2023. "The A/B testing problem with Gaussian priors," Journal of Economic Theory, Elsevier, vol. 210(C).
    12. Maria Bekker‐Nielsen Dunbar & Felix Hofmann & Leonhard Held, 2022. "Session 3 of the RSS Special Topic Meeting on Covid‐19 Transmission: Replies to the discussion," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(S1), pages 158-164, November.
    13. Luigi Butera & Philip Grossman & Daniel Houser & John List & Marie-Claire Villeval, 2020. "A New Mechanism to Alleviate the Crises of Confidence in Science - With an Application to the Public Goods Game," Artefactual Field Experiments 00684, The Field Experiments Website.
    14. Susan Athey & Kristen Grabarz & Michael Luca & Nils Wernerfelt, 2023. "Digital public health interventions at scale: The impact of social media advertising on beliefs and outcomes related to COVID vaccines," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 120(5), pages 2208110120-, January.
    15. Rustam Romaniuc & Andrea Guido & Pierre Baudry & Cécile Bazart & Loïc Berger & Noémi Berlin & Aurélie Bonein & Imen Bouhlel & Kene Boun My & Michela Chessa & Paolo Crosetto & Etienne Dagorn & Quentin , 2024. "The limits of behavioral nudges to increase youth turnout: Experimental evidence from two French elections," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) hal-04677596, HAL.
    16. Brade, Raphael, 2022. "Social Information and Educational Investment - Nudging Remedial Math Course Participation," MPRA Paper 113076, University Library of Munich, Germany.
    17. Paulius Yamin & Luis Artavia-Mora & Benita Martunaite & Shaon Lahiri, 2023. "Installations for Civic Culture: Behavioral Policy Interventions to Promote Social Sustainability," Sustainability, MDPI, vol. 15(4), pages 1-21, February.
    18. Gruner, Sven & Lehberger, Mira & Hirschauer, Norbert & Mußhoff, Oliver, 2022. "How (un)informative are experiments with students for other social groups? A study of agricultural students and farmers," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 66(03), January.
    19. Christopher Hoy & Luke McKenzie & Mathias Sinning, 2024. "Improving Tax Compliance without Increasing Revenue: Evidence from Population-Wide Randomized Controlled Trials in Papua New Guinea," Economic Development and Cultural Change, University of Chicago Press, vol. 72(2), pages 691-723.
    20. John Jackson & William N. S. Arlidge & Rodrigo Oyanedel & Katrina Joan Davis, 2024. "The global extent and severity of operational interactions between conflicting pinnipeds and fisheries," Nature Communications, Nature, vol. 15(1), pages 1-10, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:apecpp:v:45:y:2023:i:3:p:1275-1291. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://doi.org/10.1002/(ISSN)2040-5804 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.