IDEAS home Printed from https://ideas.repec.org/p/ces/ceswps/_11224.html
   My bibliography  Save this paper

On Credibility and Causality in Economics: A Critical Appraisal

Author

Listed:
  • Andreas Bergh
  • Philipp C. Wichardt
  • Philipp Christoph Wichardt

Abstract

Establishing causal relationships is a core aspect of empirical economics. Borrowing ideas from the medical sciences, we propose tentative guidelines for reliable causal inferences that cover aspects related to both the study itself and its fit with the existing background knowledge. We argue that the current paradigm in economics (often connected to the credibility revolution) tends to put too much emphasis on internal aspects related solely to the study itself. To illustrate and substantiate this view, we discuss various excellent studies from different fields of economics, which all express causal and highly policy relevant claims. From an applied point of view, the conclusion drawn is that policy implications based on single studies are inherently uncertain, even when the respective studies are state of the art.

Suggested Citation

  • Andreas Bergh & Philipp C. Wichardt & Philipp Christoph Wichardt, 2024. "On Credibility and Causality in Economics: A Critical Appraisal," CESifo Working Paper Series 11224, CESifo.
  • Handle: RePEc:ces:ceswps:_11224
    as

    Download full text from publisher

    File URL: https://www.cesifo.org/DocDL/cesifo1_wp11224.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Joshua D. Angrist & Jörn-Steffen Pischke, 2010. "The Credibility Revolution in Empirical Economics: How Better Research Design Is Taking the Con out of Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 24(2), pages 3-30, Spring.
    2. Angus Deaton, 2010. "Instruments, Randomization, and Learning about Development," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 424-455, June.
    3. David Autor & David Dorn & Gordon Hanson & Kaveh Majlesi, 2020. "Importing Political Polarization? The Electoral Consequences of Rising Trade Exposure," American Economic Review, American Economic Association, vol. 110(10), pages 3139-3183, October.
    4. Erik Lindqvist & Robert Östling & David Cesarini, 2020. "Long-Run Effects of Lottery Wealth on Psychological Well-Being," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 87(6), pages 2703-2726.
    5. Heckman, James J. & Urzúa, Sergio, 2010. "Comparing IV with structural models: What simple IV can and cannot identify," Journal of Econometrics, Elsevier, vol. 156(1), pages 27-37, May.
    6. Matthew W. Ridley & Gautam Rao & Frank Schilbach & Vikram H. Patel, 2020. "Poverty, Depression, and Anxiety: Causal Evidence and Mechanisms," NBER Working Papers 27157, National Bureau of Economic Research, Inc.
    7. Agnès Festré & Pierre Garrouste, 2015. "Theory And Evidence In Psychology And Economics About Motivation Crowding Out: A Possible Convergence?," Journal of Economic Surveys, Wiley Blackwell, vol. 29(2), pages 339-356, April.
    8. Christopher J. Bryan & Elizabeth Tipton & David S. Yeager, 2021. "Behavioural science is unlikely to change the world without a heterogeneity revolution," Nature Human Behaviour, Nature, vol. 5(8), pages 980-989, August.
    9. Florian H. Schneider & Pol Campos-Mercade & Stephan Meier & Devin Pope & Erik Wengström & Armando N. Meier, 2023. "Financial incentives for vaccination do not have negative unintended consequences," Nature, Nature, vol. 613(7944), pages 526-533, January.
    10. Guido W. Imbens, 2010. "Better LATE Than Nothing: Some Comments on Deaton (2009) and Heckman and Urzua (2009)," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 399-423, June.
    11. Josef Falkinger, 2000. "A Simple Mechanism for the Efficient Provision of Public Goods: Experimental Evidence," American Economic Review, American Economic Association, vol. 90(1), pages 247-264, March.
    12. Leeson, Peter T., 2020. "Economics is not statistics (and vice versa)," Journal of Institutional Economics, Cambridge University Press, vol. 16(4), pages 423-425, August.
    13. Daniel Knutsson & Björn Tyrefors, 2022. "The Quality and Efficiency of Public and Private Firms: Evidence from Ambulance Services [“When Should You Adjust Standard Errors for Clustering?,”]," The Quarterly Journal of Economics, Oxford University Press, vol. 137(4), pages 2213-2262.
    14. Albanese, Giuseppe & Barone, Guglielmo & de Blasio, Guido, 2022. "Populist voting and losers’ discontent: Does redistribution matter?," European Economic Review, Elsevier, vol. 141(C).
    15. Guala,Francesco, 2005. "The Methodology of Experimental Economics," Cambridge Books, Cambridge University Press, number 9780521618618, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. P. Dorian Owen, 2017. "Evaluating Ingenious Instruments for Fundamental Determinants of Long-Run Economic Growth and Development," Econometrics, MDPI, vol. 5(3), pages 1-33, September.
    2. David I. Stern, 2011. "From Correlation to Granger Causality," Crawford School Research Papers 1113, Crawford School of Public Policy, The Australian National University.
    3. Thoresen, Thor O. & Vattø, Trine E., 2015. "Validation of the discrete choice labor supply model by methods of the new tax responsiveness literature," Labour Economics, Elsevier, vol. 37(C), pages 38-53.
    4. Biørn, Erik, 2017. "Identification, Instruments, Omitted Variables, and Rudimentary Models: Fallacies in the ‘Experimental Approach’ to Econometrics," Memorandum 13/2017, Oslo University, Department of Economics.
    5. Thor O. Thoresen & Zhiyang Jia & Peter J. Lambert, 2016. "Is there More Redistribution Now? A Review of Methods for Evaluating Tax Redistributional Effects," FinanzArchiv: Public Finance Analysis, Mohr Siebeck, Tübingen, vol. 72(3), pages 302-333, September.
    6. Susan Athey & Raj Chetty & Guido Imbens, 2020. "Combining Experimental and Observational Data to Estimate Treatment Effects on Long Term Outcomes," Papers 2006.09676, arXiv.org.
    7. Breen, Richard & Ermisch, John, 2021. "Instrumental Variable Estimation in Demographic Studies: The LATE interpretation of the IV estimator with heterogenous effects," SocArXiv vx9m7, Center for Open Science.
    8. Denis Fougère & Nicolas Jacquemet, 2020. "Policy Evaluation Using Causal Inference Methods," SciencePo Working papers Main hal-03455978, HAL.
    9. Peter Hull & Michal Kolesár & Christopher Walters, 2022. "Labor by design: contributions of David Card, Joshua Angrist, and Guido Imbens," Scandinavian Journal of Economics, Wiley Blackwell, vol. 124(3), pages 603-645, July.
    10. Guido W. Imbens, 2020. "Potential Outcome and Directed Acyclic Graph Approaches to Causality: Relevance for Empirical Practice in Economics," Journal of Economic Literature, American Economic Association, vol. 58(4), pages 1129-1179, December.
    11. Jeffrey Smith & Arthur Sweetman, 2016. "Viewpoint: Estimating the causal effects of policies and programs," Canadian Journal of Economics, Canadian Economics Association, vol. 49(3), pages 871-905, August.
    12. Judith Favereau & Nicolas Brisset, 2016. "Randomization of What? Moving from Libertarian to "Democratic Paternalism"," GREDEG Working Papers 2016-34, Groupe de REcherche en Droit, Economie, Gestion (GREDEG CNRS), Université Côte d'Azur, France.
    13. Cunningham, A. Scott & Engelstätter, Benjamin & Ward, Michael R., 2011. "Understanding the effects of violent video games on violent crime," ZEW Discussion Papers 11-042, ZEW - Leibniz Centre for European Economic Research.
    14. Huber, Martin, 2019. "An introduction to flexible methods for policy evaluation," FSES Working Papers 504, Faculty of Economics and Social Sciences, University of Freiburg/Fribourg Switzerland.
    15. Jens Ludwig & Jeffrey R. Kling & Sendhil Mullainathan, 2011. "Mechanism Experiments and Policy Evaluations," Journal of Economic Perspectives, American Economic Association, vol. 25(3), pages 17-38, Summer.
    16. Ayyagari, Meghana & Demirguc-Kunt, Asli & Maksimovic, Vojislav, 2012. "Financing of firms in developing countries : lessons from research," Policy Research Working Paper Series 6036, The World Bank.
    17. Jordan Adamson & Lucas Rentschler, 2023. "Criminal justice from a public choice perspective: an introduction to the special issue," Public Choice, Springer, vol. 196(3), pages 223-227, September.
    18. Janet Currie & Henrik Kleven & Esmée Zwiers, 2020. "Technology and Big Data Are Changing Economics: Mining Text to Track Methods," AEA Papers and Proceedings, American Economic Association, vol. 110, pages 42-48, May.
    19. Angus Deaton, 2010. "Instruments, Randomization, and Learning about Development," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 424-455, June.
    20. Esterling, Kevin & Brady, David & Schwitzgebel, Eric, 2021. "The Necessity of Construct and External Validity for Generalized Causal Claims," OSF Preprints 2s8w5, Center for Open Science.

    More about this item

    Keywords

    causality; empirical economics; methodology; credibility;
    All these keywords.

    JEL classification:

    • B41 - Schools of Economic Thought and Methodology - - Economic Methodology - - - Economic Methodology
    • C90 - Mathematical and Quantitative Methods - - Design of Experiments - - - General
    • D90 - Microeconomics - - Micro-Based Behavioral Economics - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ces:ceswps:_11224. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Klaus Wohlrabe (email available below). General contact details of provider: https://edirc.repec.org/data/cesifde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.