IDEAS home Printed from https://ideas.repec.org/p/ces/ceswps/_11224.html
   My bibliography  Save this paper

On Credibility and Causality in Economics: A Critical Appraisal

Author

Listed:
  • Andreas Bergh
  • Philipp C. Wichardt
  • Philipp Christoph Wichardt

Abstract

Establishing causal relationships is a core aspect of empirical economics. Borrowing ideas from the medical sciences, we propose tentative guidelines for reliable causal inferences that cover aspects related to both the study itself and its fit with the existing background knowledge. We argue that the current paradigm in economics (often connected to the credibility revolution) tends to put too much emphasis on internal aspects related solely to the study itself. To illustrate and substantiate this view, we discuss various excellent studies from different fields of economics, which all express causal and highly policy relevant claims. From an applied point of view, the conclusion drawn is that policy implications based on single studies are inherently uncertain, even when the respective studies are state of the art.

Suggested Citation

  • Andreas Bergh & Philipp C. Wichardt & Philipp Christoph Wichardt, 2024. "On Credibility and Causality in Economics: A Critical Appraisal," CESifo Working Paper Series 11224, CESifo.
    • Handle: RePEc:ces:ceswps:_11224
    as

    Download full text from publisher

    File URL: https://www.cesifo.org/DocDL/cesifo1_wp11224.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Leeson, Peter T., 2020. "Economics is not statistics (and vice versa)," Journal of Institutional Economics, Cambridge University Press, vol. 16(4), pages 423-425, August.
    2. Joshua D. Angrist & Jörn-Steffen Pischke, 2010. "The Credibility Revolution in Empirical Economics: How Better Research Design Is Taking the Con out of Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 24(2), pages 3-30, Spring.
    3. Angus Deaton, 2010. "Instruments, Randomization, and Learning about Development," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 424-455, June.
    4. David Autor & David Dorn & Gordon Hanson & Kaveh Majlesi, 2020. "Importing Political Polarization? The Electoral Consequences of Rising Trade Exposure," American Economic Review, American Economic Association, vol. 110(10), pages 3139-3183, October.
    5. Heckman, James J. & Urzúa, Sergio, 2010. "Comparing IV with structural models: What simple IV can and cannot identify," Journal of Econometrics, Elsevier, vol. 156(1), pages 27-37, May.
    6. Daniel Knutsson & Björn Tyrefors, 2022. "The Quality and Efficiency of Public and Private Firms: Evidence from Ambulance Services [“When Should You Adjust Standard Errors for Clustering?,”]," The Quarterly Journal of Economics, Oxford University Press, vol. 137(4), pages 2213-2262.
    7. Guido W. Imbens, 2010. "Better LATE Than Nothing: Some Comments on Deaton (2009) and Heckman and Urzua (2009)," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 399-423, June.
    8. Judith M. Delaney & Paul J. Devereux, 2021. "Gender and Educational Achievement: Stylized Facts and Causal Evidence," Working Papers 202103, School of Economics, University College Dublin.
    9. Erik Lindqvist & Robert Östling & David Cesarini, 2020. "Long-Run Effects of Lottery Wealth on Psychological Well-Being," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 87(6), pages 2703-2726.
    10. Albanese, Giuseppe & Barone, Guglielmo & de Blasio, Guido, 2022. "Populist voting and losers’ discontent: Does redistribution matter?," European Economic Review, Elsevier, vol. 141(C).
    11. Agnès Festré & Pierre Garrouste, 2015. "Theory And Evidence In Psychology And Economics About Motivation Crowding Out: A Possible Convergence?," Journal of Economic Surveys, Wiley Blackwell, vol. 29(2), pages 339-356, April.
    12. Josef Falkinger, 2000. "A Simple Mechanism for the Efficient Provision of Public Goods: Experimental Evidence," American Economic Review, American Economic Association, vol. 90(1), pages 247-264, March.
    13. Matthew W. Ridley & Gautam Rao & Frank Schilbach & Vikram H. Patel, 2020. "Poverty, Depression, and Anxiety: Causal Evidence and Mechanisms," NBER Working Papers 27157, National Bureau of Economic Research, Inc.
    14. Guala,Francesco, 2005. "The Methodology of Experimental Economics," Cambridge Books, Cambridge University Press, number 9780521618618, November.
    15. Christopher J. Bryan & Elizabeth Tipton & David S. Yeager, 2021. "Behavioural science is unlikely to change the world without a heterogeneity revolution," Nature Human Behaviour, Nature, vol. 5(8), pages 980-989, August.
    16. Florian H. Schneider & Pol Campos-Mercade & Stephan Meier & Devin Pope & Erik Wengström & Armando N. Meier, 2023. "Financial incentives for vaccination do not have negative unintended consequences," Nature, Nature, vol. 613(7944), pages 526-533, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bergh, Andreas & Wichardt, Phillipp C., 2024. "On Credibility and Causality in Economics: A Critical Appraisal," Working Paper Series 1504, Research Institute of Industrial Economics.
    2. P. Dorian Owen, 2017. "Evaluating Ingenious Instruments for Fundamental Determinants of Long-Run Economic Growth and Development," Econometrics, MDPI, vol. 5(3), pages 1-33, September.
    3. David I. Stern, 2011. "From Correlation to Granger Causality," Crawford School Research Papers 1113, Crawford School of Public Policy, The Australian National University.
    4. Biørn, Erik, 2017. "Identification, Instruments, Omitted Variables, and Rudimentary Models: Fallacies in the ‘Experimental Approach’ to Econometrics," Memorandum 13/2017, Oslo University, Department of Economics.
    5. Thoresen, Thor O. & Vattø, Trine E., 2015. "Validation of the discrete choice labor supply model by methods of the new tax responsiveness literature," Labour Economics, Elsevier, vol. 37(C), pages 38-53.
    6. Thor O. Thoresen & Zhiyang Jia & Peter J. Lambert, 2016. "Is there More Redistribution Now? A Review of Methods for Evaluating Tax Redistributional Effects," FinanzArchiv: Public Finance Analysis, Mohr Siebeck, Tübingen, vol. 72(3), pages 302-333, September.
    7. Breen, Richard & Ermisch, John, 2021. "Instrumental Variable Estimation in Demographic Studies: The LATE interpretation of the IV estimator with heterogenous effects," SocArXiv vx9m7, Center for Open Science.
    8. Denis Fougère & Nicolas Jacquemet, 2020. "Policy Evaluation Using Causal Inference Methods," Working Papers hal-03455978, HAL.
    9. Peter Hull & Michal Kolesár & Christopher Walters, 2022. "Labor by design: contributions of David Card, Joshua Angrist, and Guido Imbens," Scandinavian Journal of Economics, Wiley Blackwell, vol. 124(3), pages 603-645, July.
    10. Guido W. Imbens, 2020. "Potential Outcome and Directed Acyclic Graph Approaches to Causality: Relevance for Empirical Practice in Economics," Journal of Economic Literature, American Economic Association, vol. 58(4), pages 1129-1179, December.
    11. Jeffrey Smith & Arthur Sweetman, 2016. "Viewpoint: Estimating the causal effects of policies and programs," Canadian Journal of Economics, Canadian Economics Association, vol. 49(3), pages 871-905, August.
    12. Judith Favereau & Nicolas Brisset, 2016. "Randomization of What? Moving from Libertarian to "Democratic Paternalism"," GREDEG Working Papers 2016-34, Groupe de REcherche en Droit, Economie, Gestion (GREDEG CNRS), Université Côte d'Azur, France.
    13. Cunningham, A. Scott & Engelstätter, Benjamin & Ward, Michael R., 2011. "Understanding the effects of violent video games on violent crime," ZEW Discussion Papers 11-042, ZEW - Leibniz Centre for European Economic Research.
    14. Jordan Adamson & Lucas Rentschler, 2023. "Criminal justice from a public choice perspective: an introduction to the special issue," Public Choice, Springer, vol. 196(3), pages 223-227, September.
    15. Jens Ludwig & Jeffrey R. Kling & Sendhil Mullainathan, 2011. "Mechanism Experiments and Policy Evaluations," Journal of Economic Perspectives, American Economic Association, vol. 25(3), pages 17-38, Summer.
    16. Kugler Franziska & Schwerdt Guido & Wößmann Ludger, 2014. "Ökonometrische Methoden zur Evaluierung kausaler Effekte der Wirtschaftspolitik," Perspektiven der Wirtschaftspolitik, De Gruyter, vol. 15(2), pages 105-132, June.
    17. Black, Dan A. & Joo, Joonhwi & LaLonde, Robert & Smith, Jeffrey A. & Taylor, Evan J., 2022. "Simple Tests for Selection: Learning More from Instrumental Variables," Labour Economics, Elsevier, vol. 79(C).
    18. John Rust, 2014. "The Limits of Inference with Theory: A Review of Wolpin (2013)," Journal of Economic Literature, American Economic Association, vol. 52(3), pages 820-850, September.
    19. Yang, Jinyang & Bazan Ruiz, Muchin I.A, 2021. "Are pilot experiments random? Social connections and policy expansion in China," The Journal of the Economics of Ageing, Elsevier, vol. 18(C).
    20. Angus Deaton, 2010. "Instruments, Randomization, and Learning about Development," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 424-455, June.

    More about this item

    Keywords

    causality; empirical economics; methodology; credibility;
    All these keywords.

    JEL classification:

    • B41 - Schools of Economic Thought and Methodology - - Economic Methodology - - - Economic Methodology
    • C90 - Mathematical and Quantitative Methods - - Design of Experiments - - - General
    • D90 - Microeconomics - - Micro-Based Behavioral Economics - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ces:ceswps:_11224. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Klaus Wohlrabe (email available below). General contact details of provider: https://edirc.repec.org/data/cesifde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.