IDEAS home Printed from https://ideas.repec.org/a/wly/apecpp/v45y2023i3p1275-1291.html
   My bibliography  Save this article

Credibility crisis in agricultural economics

Author

Listed:
  • Paul J. Ferraro
  • Pallavi Shukla

Abstract

We provide empirical evidence of research practices that can undermine the credibility of empirical research in agricultural economics. We find that, in four popular journals, most studies are underpowered, a characteristic that, when coupled with publication bias, yields unreliable and exaggerated effect sizes. This problem is exacerbated by selective reporting of statistically significant results and multiple hypothesis testing without any adjustments to statistical inferences. Survey respondents self‐report engaging in practices that are consistent with these empirical findings. Addressing these problems in agricultural economics will require that editors, reviewers, and donors change the norms and incentives for authors.

Suggested Citation

  • Paul J. Ferraro & Pallavi Shukla, 2023. "Credibility crisis in agricultural economics," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 45(3), pages 1275-1291, September.
    • Handle: RePEc:wly:apecpp:v:45:y:2023:i:3:p:1275-1291
    DOI: 10.1002/aepp.13323
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/aepp.13323
    Download Restriction: no
    File URL: https://libkey.io/10.1002/aepp.13323?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Stefano DellaVigna & Elizabeth Linos, 2022. "RCTs to Scale: Comprehensive Evidence From Two Nudge Units," Econometrica, Econometric Society, vol. 90(1), pages 81-116, January.
    2. Chris Chambers, 2019. "What’s next for Registered Reports?," Nature, Nature, vol. 573(7773), pages 187-189, September.
    3. Paul J. Ferraro & Pallavi Shukla, 2020. "Feature—Is a Replicability Crisis on the Horizon for Environmental and Resource Economics?," Review of Environmental Economics and Policy, University of Chicago Press, vol. 14(2), pages 339-351.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Casati, Mirta & Soregaroli, Claudio & Rommel, Jens & Luzzani, Gloria & Stranieri, Stefanella, 2023. "Please keep ordering! A natural field experiment assessing a carbon label introduction," Food Policy, Elsevier, vol. 120(C).
    2. Shukla, Pallavi & Messer, Kent D. & Ferraro, Paul J., 2023. "Applying behavioral science to agriculture, food, and agri-environmental policymaking," Food Policy, Elsevier, vol. 120(C).
    3. Robert Finger & Carola Grebitus & Arne Henningsen, 2024. "Improving Agricultural Policy Decisions through Replications," EuroChoices, The Agricultural Economics Society, vol. 23(1), pages 63-66, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Klege, Rebecca A. & Amuakwa-Mensah, Franklin & Visser, Martine, 2022. "Tenancy and energy choices in Rwanda. A replication and extension study," World Development Perspectives, Elsevier, vol. 26(C).
    2. Lars Behlen & Oliver Himmler & Robert Jäckle, 2023. "Defaults and effortful tasks," Experimental Economics, Springer;Economic Science Association, vol. 26(5), pages 1022-1059, November.
    3. Despoina Alempaki & Genyue Fu & Jingcheng Fu, 2021. "Lying and social norms: a lab-in-the-field experiment with children," Discussion Papers 2021-01, The Centre for Decision Research and Experimental Economics, School of Economics, University of Nottingham.
    4. Brodeur, Abel & Cook, Nikolai & Heyes, Anthony, 2022. "We Need to Talk about Mechanical Turk: What 22,989 Hypothesis Tests Tell us about p-Hacking and Publication Bias in Online Experiments," GLO Discussion Paper Series 1157, Global Labor Organization (GLO).
    5. Abel Brodeur & Scott Carrell & David Figlio & Lester Lusher, 2023. "Unpacking P-hacking and Publication Bias," American Economic Review, American Economic Association, vol. 113(11), pages 2974-3002, November.
    6. Higney, Anthony & Hanley, Nick & Moro, Mirko, 2022. "The lead-crime hypothesis: A meta-analysis," Regional Science and Urban Economics, Elsevier, vol. 97(C).
    7. Azevedo, Eduardo M. & Mao, David & Montiel Olea, José Luis & Velez, Amilcar, 2023. "The A/B testing problem with Gaussian priors," Journal of Economic Theory, Elsevier, vol. 210(C).
    8. Maria Bekker‐Nielsen Dunbar & Felix Hofmann & Leonhard Held, 2022. "Session 3 of the RSS Special Topic Meeting on Covid‐19 Transmission: Replies to the discussion," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(S1), pages 158-164, November.
    9. Luigi Butera & Philip Grossman & Daniel Houser & John List & Marie-Claire Villeval, 2020. "A New Mechanism to Alleviate the Crises of Confidence in Science - With an Application to the Public Goods Game," Artefactual Field Experiments 00684, The Field Experiments Website.
    10. Susan Athey & Kristen Grabarz & Michael Luca & Nils Wernerfelt, 2023. "Digital public health interventions at scale: The impact of social media advertising on beliefs and outcomes related to COVID vaccines," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 120(5), pages 2208110120-, January.
    11. Brade, Raphael, 2022. "Social Information and Educational Investment - Nudging Remedial Math Course Participation," MPRA Paper 113076, University Library of Munich, Germany.
    12. Paulius Yamin & Luis Artavia-Mora & Benita Martunaite & Shaon Lahiri, 2023. "Installations for Civic Culture: Behavioral Policy Interventions to Promote Social Sustainability," Sustainability, MDPI, vol. 15(4), pages 1-21, February.
    13. Sven Grüner & Mira Lehberger & Norbert Hirschauer & Oliver Mußhoff, 2022. "How (un)informative are experiments with students for other social groups? A study of agricultural students and farmers," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 66(3), pages 471-504, July.
    14. Christopher Hoy & Luke McKenzie & Mathias Sinning, 2024. "Improving Tax Compliance without Increasing Revenue: Evidence from Population-Wide Randomized Controlled Trials in Papua New Guinea," Economic Development and Cultural Change, University of Chicago Press, vol. 72(2), pages 691-723.
    15. Björn Bartling & Alexander W. Cappelen & Henning Hermes & Marit Skivenes & Bertil Tungodden, 2023. "Free to fail? Paternalistic preferences in the United States," ECON - Working Papers 436, Department of Economics - University of Zurich.
    16. Andreas Löschel & Matthias Rodemeier & Madeline Werthschulte, 2020. "When Nudges Fail to Scale: Field Experimental Evidence from Goal Setting on Mobile Phones," CESifo Working Paper Series 8485, CESifo.
    17. Koch, Alexander K. & Monster, Dan & Nafziger, Julia, 2023. "Nudging in Complex Environments," IZA Discussion Papers 16137, Institute of Labor Economics (IZA).
    18. Eugen Dimant & Tobias Gesche, 2021. "Nudging Enforcers: How Norm Perceptions and Motives for Lying Shape Sanctions," CESifo Working Paper Series 9385, CESifo.
    19. Daniele Curzi & Sylvain Chabé‐Ferret & Salvatore Di Falco & Laure Kuhfuss & Marianne Lefebvre & Alan Matthews, 2022. "Using Experiments to Design and Evaluate the CAP: Insights from an Expert Panel," EuroChoices, The Agricultural Economics Society, vol. 21(2), pages 28-34, August.
    20. Timmons, Shane & Robertson, Deirdre & Lunn, Pete, 2022. "Combining nudges and boosts to increase precautionary saving: A large-scale field experiment," Papers WP722, Economic and Social Research Institute (ESRI).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:apecpp:v:45:y:2023:i:3:p:1275-1291. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://doi.org/10.1002/(ISSN)2040-5804 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.