IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2501.06873.html
   My bibliography  Save this paper

Causal Claims in Economics

Author

Listed:
  • Prashant Garg
  • Thiemo Fetzer

Abstract

We analyze over 44,000 NBER and CEPR working papers from 1980 to 2023 using a custom language model to construct knowledge graphs that map economic concepts and their relationships. We distinguish between general claims and those documented via causal inference methods (e.g., DiD, IV, RDD, RCTs). We document a substantial rise in the share of causal claims-from roughly 4% in 1990 to nearly 28% in 2020-reflecting the growing influence of the "credibility revolution." We find that causal narrative complexity (e.g., the depth of causal chains) strongly predicts both publication in top-5 journals and higher citation counts, whereas non-causal complexity tends to be uncorrelated or negatively associated with these outcomes. Novelty is also pivotal for top-5 publication, but only when grounded in credible causal methods: introducing genuinely new causal edges or paths markedly increases both the likelihood of acceptance at leading outlets and long-run citations, while non-causal novelty exhibits weak or even negative effects. Papers engaging with central, widely recognized concepts tend to attract more citations, highlighting a divergence between factors driving publication success and long-term academic impact. Finally, bridging underexplored concept pairs is rewarded primarily when grounded in causal methods, yet such gap filling exhibits no consistent link with future citations. Overall, our findings suggest that methodological rigor and causal innovation are key drivers of academic recognition, but sustained impact may require balancing novel contributions with conceptual integration into established economic discourse.

Suggested Citation

  • Prashant Garg & Thiemo Fetzer, 2025. "Causal Claims in Economics," Papers 2501.06873, arXiv.org.
  • Handle: RePEc:arx:papers:2501.06873
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2501.06873
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Eleonora Alabrese & Francesco Capozza & Prashant Garg, 2024. "Politicized Scientists: Credibility Cost of Political Expression on Twitter," CESifo Working Paper Series 11254, CESifo.
    2. Joshua D. Angrist & Jörn-Steffen Pischke, 2010. "The Credibility Revolution in Empirical Economics: How Better Research Design Is Taking the Con out of Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 24(2), pages 3-30, Spring.
    3. Ran Abramitzky & Lena Greska & Santiago Pérez & Joseph Price & Carlo Schwarz & Fabian Waldinger, 2024. "Climbing the Ivory Tower: How Socio-Economic Background Shapes Academia," NBER Working Papers 33289, National Bureau of Economic Research, Inc.
    4. Jonathan de Quidt & Johannes Haushofer & Christopher Roth, 2018. "Measuring and Bounding Experimenter Demand," American Economic Review, American Economic Association, vol. 108(11), pages 3266-3302, November.
    5. Angus Deaton, 2010. "Instruments, Randomization, and Learning about Development," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 424-455, June.
    6. James J. Heckman, 2001. "Micro Data, Heterogeneity, and the Evaluation of Public Policy: Nobel Lecture," Journal of Political Economy, University of Chicago Press, vol. 109(4), pages 673-748, August.
    7. Victor Chernozhukov & Denis Chetverikov & Mert Demirer & Esther Duflo & Christian Hansen & Whitney Newey & James Robins, 2018. "Double/debiased machine learning for treatment and structural parameters," Econometrics Journal, Royal Economic Society, vol. 21(1), pages 1-68, February.
    8. Abel Brodeur & Nikolai Cook & Carina Neisser, 2024. "p-Hacking, Data type and Data-Sharing Policy," The Economic Journal, Royal Economic Society, vol. 134(659), pages 985-1018.
    9. Fetzer, Thiemo & Lambert, Peter John & Feld, Bennet & Garg, Prashant, 2024. "AI-Generated Production Networks: Measurement and Applications to Global Trade," CAGE Online Working Paper Series 733, Competitive Advantage in the Global Economy (CAGE).
    10. Melissa Dell, 2024. "Deep Learning for Economists," Papers 2407.15339, arXiv.org, revised Nov 2024.
    11. Anton Korinek, 2023. "Generative AI for Economic Research: Use Cases and Implications for Economists," Journal of Economic Literature, American Economic Association, vol. 61(4), pages 1281-1317, December.
    12. Alexandra Baumann & Klaus Wohlrabe, 2020. "Where have all the working papers gone? Evidence from four major economics working paper series," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(3), pages 2433-2441, September.
    13. Michael Park & Erin Leahey & Russell J. Funk, 2023. "Papers and patents are becoming less disruptive over time," Nature, Nature, vol. 613(7942), pages 138-144, January.
    14. Daniel S. Hamermesh, 2013. "Six Decades of Top Economics Publishing: Who and How?," Journal of Economic Literature, American Economic Association, vol. 51(1), pages 162-172, March.
    15. David Card & Stefano DellaVigna, 2013. "Nine Facts about Top Journals in Economics," Journal of Economic Literature, American Economic Association, vol. 51(1), pages 144-161, March.
    16. Abhijit Banerjee & Esther Duflo & Rachel Glennerster & Cynthia Kinnan, 2015. "The Miracle of Microfinance? Evidence from a Randomized Evaluation," American Economic Journal: Applied Economics, American Economic Association, vol. 7(1), pages 22-53, January.
    17. Helen Pearson, 2024. "Can AI review the scientific literature — and figure out what it all means?," Nature, Nature, vol. 635(8038), pages 276-278, November.
    18. Henry Small, 1973. "Co‐citation in the scientific literature: A new measure of the relationship between two documents," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 24(4), pages 265-269, July.
    19. Xavier Gabaix, 2011. "The Granular Origins of Aggregate Fluctuations," Econometrica, Econometric Society, vol. 79(3), pages 733-772, May.
    20. Martin L. Weitzman, 1998. "Recombinant Growth," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 113(2), pages 331-360.
    21. Davies, Benjamin, 2022. "Gender sorting among economists: Evidence from the NBER," Economics Letters, Elsevier, vol. 217(C).
    22. Ludo Waltman & Nees Jan Eck, 2012. "A new methodology for constructing a publication-level classification system of science," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(12), pages 2378-2392, December.
    23. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    24. Michael P. Keane, 2010. "A Structural Perspective on the Experimentalist School," Journal of Economic Perspectives, American Economic Association, vol. 24(2), pages 47-58, Spring.
    25. Pinelopi Koujianou Goldberg & Amit Kumar Khandelwal & Nina Pavcnik & Petia Topalova, 2010. "Imported Intermediate Inputs and Domestic Product Growth: Evidence from India," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(4), pages 1727-1767.
    26. Raj Chetty & Nathaniel Hendren & Patrick Kline & Emmanuel Saez, 2014. "Where is the land of Opportunity? The Geography of Intergenerational Mobility in the United States," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 129(4), pages 1553-1623.
    27. Imbens,Guido W. & Rubin,Donald B., 2015. "Causal Inference for Statistics, Social, and Biomedical Sciences," Cambridge Books, Cambridge University Press, number 9780521885881, January.
    28. Christopher A. Sims, 2010. "But Economics Is Not an Experimental Science," Journal of Economic Perspectives, American Economic Association, vol. 24(2), pages 59-68, Spring.
    29. Eleonora Alabrese, 2022. "Bad Science: Retractions and Media Coverage," CESifo Working Paper Series 10195, CESifo.
    30. Anna Airoldi & Petra Moser, 2024. "Inequality in Science: Who Becomes a Star?," NBER Working Papers 33063, National Bureau of Economic Research, Inc.
    31. Melissa Dell, 2024. "Deep Learning for Economists," NBER Working Papers 32768, National Bureau of Economic Research, Inc.
    32. Marlène Koffi & Roland Pongou & Leonard Wantchekon, 2024. "The Color of Ideas: Racial Dynamics and Citations in Economics," NBER Working Papers 33150, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Garg, Prashant & Fetzer, Thiemo, 2024. "Causal Claims in Economics," OSF Preprints u4vgs_v1, Center for Open Science.
    2. Garg, Prashant & Fetzer, Thiemo, 2024. "Causal Claims in Economics," OSF Preprints u4vgs, Center for Open Science.
    3. John Gibson, 2021. "The micro‐geography of academic research: How distinctive is economics?," Scottish Journal of Political Economy, Scottish Economic Society, vol. 68(4), pages 467-484, September.
    4. Jiaming Mao & Jingzhi Xu, 2020. "Ensemble Learning with Statistical and Structural Models," Papers 2006.05308, arXiv.org.
    5. Pedro Carneiro & Sokbae Lee & Daniel Wilhelm, 2020. "Optimal data collection for randomized control trials," The Econometrics Journal, Royal Economic Society, vol. 23(1), pages 1-31.
    6. Michael Lechner, 2023. "Causal Machine Learning and its use for public policy," Swiss Journal of Economics and Statistics, Springer;Swiss Society of Economics and Statistics, vol. 159(1), pages 1-15, December.
    7. Guido W. Imbens, 2022. "Causality in Econometrics: Choice vs Chance," Econometrica, Econometric Society, vol. 90(6), pages 2541-2566, November.
    8. Denis Fougère & Nicolas Jacquemet, 2020. "Policy Evaluation Using Causal Inference Methods," SciencePo Working papers Main hal-03455978, HAL.
    9. Guido W. Imbens, 2020. "Potential Outcome and Directed Acyclic Graph Approaches to Causality: Relevance for Empirical Practice in Economics," Journal of Economic Literature, American Economic Association, vol. 58(4), pages 1129-1179, December.
    10. Jeffrey Smith & Arthur Sweetman, 2016. "Viewpoint: Estimating the causal effects of policies and programs," Canadian Journal of Economics, Canadian Economics Association, vol. 49(3), pages 871-905, August.
    11. Öberg, Stefan, 2021. "Treatment for natural experiments: How to improve causal estimates using conceptual definitions and substantive interpretations," SocArXiv pkyue, Center for Open Science.
    12. W. Bentley MacLeod, 2017. "Viewpoint: The human capital approach to inference," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 50(1), pages 5-39, February.
    13. Josh Angrist & Pierre Azoulay & Glenn Ellison & Ryan Hill & Susan Feng Lu, 2020. "Inside Job or Deep Impact? Extramural Citations and the Influence of Economic Scholarship," Journal of Economic Literature, American Economic Association, vol. 58(1), pages 3-52, March.
    14. David I. Stern, 2011. "From Correlation to Granger Causality," Crawford School Research Papers 1113, Crawford School of Public Policy, The Australian National University.
    15. Marion Fourcade & Etienne Ollion & Yann Algan, 2015. "La superioridad de los economistas," Revista de Economía Institucional, Universidad Externado de Colombia - Facultad de Economía, vol. 17(33), pages 13-43, July-Dece.
    16. Boris Salazar-Trujillo & Daniel Otero Robles, 2019. "La revolución empírica en economía," Apuntes del Cenes, Universidad Pedagógica y Tecnológica de Colombia, vol. 38(68), pages 15-48, July.
    17. Jiaming Mao & Zhesheng Zheng, 2020. "Structural Regularization," Papers 2004.12601, arXiv.org, revised Jun 2020.
    18. James J. Heckman, 2010. "Building Bridges between Structural and Program Evaluation Approaches to Evaluating Policy," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 356-398, June.
    19. Ashesh Rambachan & Neil Shephard, 2019. "When do common time series estimands have nonparametric causal meaning?," Papers 1903.01637, arXiv.org, revised Jan 2025.
    20. Leuz, Christian, 2022. "Towards a design-based approach to accounting research," Journal of Accounting and Economics, Elsevier, vol. 74(2).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2501.06873. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.