IDEAS home Printed from https://ideas.repec.org/p/bde/wpaper/2313.html
   My bibliography  Save this paper

The long-term causal effects of winning an ERC grant

Author

Listed:
  • Corinna Ghirelli

    (Banco de España)

  • Enkelejda Havari

    (IESEG School of Management)

  • Elena Meroni

    (European Commission, Joint Research Centre (JRC))

  • Stefano Verzillo

    (European Commission, Joint Research Centre (JRC))

Abstract

This paper investigates the long-term causal effects of receiving an ERC grant on researcher productivity, excellence and the ability to obtain additional research funding up to nine years after grant assignment. We use data on the universe of ERC applicants between 2007 and 2013 and information on their complete publication histories from the Scopus database. For identification, we first exploit the assignment rule based on rankings, comparing the outcomes of the winning and non-winning applicants in a regression discontinuity design (RDD). We fail to find any statistically significant effect on research productivity and quality, which suggests that receiving an ERC grant does not make a difference in terms of scientific impact for researchers with a ranking position close to the threshold. Since RDDs help identify a local effect, we also conduct a difference-in-differences (DID) analysis using the time series of bibliometric indicators available, which allows us to estimate the effect on a wider population of winning and non-winning applicants. By contrast with the RDD results, DID estimates show that obtaining an ERC grant leads to positive long-term effects on scientific productivity, impact and the capacity to attract other EU funds in the fields of Chemistry, Universe and Earth Sciences, Institutions and Behaviours, Human Mind Studies and Medicine. Further analysis of heterogeneous effects leads us conclude that the positive results obtained with DID seem to be driven by the top-ranked applicants in these fields.

Suggested Citation

  • Corinna Ghirelli & Enkelejda Havari & Elena Meroni & Stefano Verzillo, 2023. "The long-term causal effects of winning an ERC grant," Working Papers 2313, Banco de España.
    • Handle: RePEc:bde:wpaper:2313
    DOI: https://doi.org/10.53479/30089
    as

    Download full text from publisher

    File URL: https://www.bde.es/f/webbde/SES/Secciones/Publicaciones/PublicacionesSeriadas/DocumentosTrabajo/23/Files/dt2313e.pdf
    File Function: First version, May 2023
    Download Restriction: no
    File URL: https://libkey.io/https://doi.org/10.53479/30089?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Ina Ganguli, 2017. "Saving Soviet Science: The Impact of Grants When Government R&D Funding Disappears," American Economic Journal: Applied Economics, American Economic Association, vol. 9(2), pages 165-201, April.
    2. Benavente, José Miguel & Crespi, Gustavo & Figal Garone, Lucas & Maffioli, Alessandro, 2012. "The impact of national research funds: A regression discontinuity approach to the Chilean FONDECYT," Research Policy, Elsevier, vol. 41(8), pages 1461-1475.
    3. Rachel Heyard & Hanna Hottenrott, 2020. "The Impact of Research Funding on Knowledge Creation and Dissemination: A study of SNSF Research Grants," Papers 2011.11274, arXiv.org, revised Aug 2021.
    4. Raminta Pranckutė, 2021. "Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World," Publications, MDPI, vol. 9(1), pages 1-59, March.
    5. Sebastian Calonico & Matias D. Cattaneo & Rocio Titiunik, 2014. "Robust Nonparametric Confidence Intervals for Regression‐Discontinuity Designs," Econometrica, Econometric Society, vol. 82, pages 2295-2326, November.
    6. Katrin Hussinger & João N. Carvalho, 2022. "The long-term effect of research grants on the scientific output of university professors," Industry and Innovation, Taylor & Francis Journals, vol. 29(4), pages 463-487, April.
    7. Joshua L Rosenbloom & Donna K Ginther & Ted Juhl & Joseph A Heppert, 2015. "The Effects of Research & Development Funding on Scientific Productivity: Academic Chemistry, 1990-2009," PLOS ONE, Public Library of Science, vol. 10(9), pages 1-23, September.
    8. Weishu Liu, 2020. "Accuracy of funding information in Scopus: a comparative case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(1), pages 803-811, July.
    9. David Popp, 2016. "Economic analysis of scientific publications and implications for energy research and development," Nature Energy, Nature, vol. 1(4), pages 1-8, April.
    10. Jacob, Brian A. & Lefgren, Lars, 2011. "The impact of research grant funding on scientific productivity," Journal of Public Economics, Elsevier, vol. 95(9), pages 1168-1177.
    11. Charles Ayoubi & Michele Pezzoni & Fabiana Visentin, 2021. "Does It Pay to Do Novel Science? The Selectivity Patterns in Science Funding," Science and Public Policy, Oxford University Press, vol. 48(5), pages 635-648.
    12. Sant’Anna, Pedro H.C. & Zhao, Jun, 2020. "Doubly robust difference-in-differences estimators," Journal of Econometrics, Elsevier, vol. 219(1), pages 101-122.
    13. Sebastian Calonico & Matias D Cattaneo & Max H Farrell, 2020. "Optimal bandwidth choice for robust bias-corrected inference in regression discontinuity designs," The Econometrics Journal, Royal Economic Society, vol. 23(2), pages 192-210.
    14. Ashish Arora & Alfonso Gambardella, 2010. "The Impact of NSF Support for Basic Research in Economics," NBER Chapters, in: Contributions in Memory of Zvi Griliches, pages 91-115, National Bureau of Economic Research, Inc.
    15. Liv Langfeldt & Carter Walter Bloch & Gunnar Sivertsen, 2015. "Options and limitations in measuring the impact of research grants—evidence from Denmark and Norway," Research Evaluation, Oxford University Press, vol. 24(3), pages 256-270.
    16. Dmitry Arkhangelsky & Guido W Imbens, 2022. "Doubly robust identification for causal panel data models [Sufficient statistics for unobserved heterogeneity in structural dynamic logit models]," The Econometrics Journal, Royal Economic Society, vol. 25(3), pages 649-674.
    17. Pierre Azoulay & Joshua S. Graff Zivin & Gustavo Manso, 2011. "Incentives and creativity: evidence from the academic life sciences," RAND Journal of Economics, RAND Corporation, vol. 42(3), pages 527-554, September.
    18. Callaway, Brantly & Sant’Anna, Pedro H.C., 2021. "Difference-in-Differences with multiple time periods," Journal of Econometrics, Elsevier, vol. 225(2), pages 200-230.
    19. Matias D. Cattaneo & Michael Jansson & Xinwei Ma, 2018. "Manipulation testing based on density discontinuity," Stata Journal, StataCorp LP, vol. 18(1), pages 234-261, March.
    20. Dmitry Arkhangelsky & Guido W. Imbens, 2019. "Doubly Robust Identification for Causal Panel Data Models," Papers 1909.09412, arXiv.org, revised Feb 2022.
    21. Margherita Fort & Andrea Ichino & Enrico Rettore & Giulio Zanella, 2022. "Multicutoff RD designs with observations located at each cutoff: problems and solutions," FBK-IRVAPP Working Papers 2022-01, Research Institute for the Evaluation of Public Policies (IRVAPP), Bruno Kessler Foundation.
    22. Daniel Chudnovsky & Andrés López & Martín A. Rossi & Diego Ubfal, 2008. "Money for Science? The Impact of Research Grants on Academic Output," Fiscal Studies, Institute for Fiscal Studies, vol. 29(1), pages 75-87, March.
    23. Reinhilde Veugelers & Jian Wang & Paula Stephan, 2022. "Do Funding Agencies Select and Enable Risky Research: Evidence from ERC Using Novelty as a Proxy of Risk Taking," NBER Working Papers 30320, National Bureau of Economic Research, Inc.
    24. Sun, Liyang & Abraham, Sarah, 2021. "Estimating dynamic treatment effects in event studies with heterogeneous treatment effects," Journal of Econometrics, Elsevier, vol. 225(2), pages 175-199.
    25. Matias D. Cattaneo & Nicolas Idrobo & Rocio Titiunik, 2019. "A Practical Introduction to Regression Discontinuity Designs: Foundations," Papers 1911.09511, arXiv.org.
    26. Yang Wang & Benjamin F. Jones & Dashun Wang, 2019. "Early-career setback and future career impact," Nature Communications, Nature, vol. 10(1), pages 1-10, December.
    27. repec:adr:anecst:y:2005:i:79-80:p:04 is not listed on IDEAS
    28. Alexander Whalley & Justin Hicks, 2014. "Spending Wisely? How Resources Affect Knowledge Production In Universities," Economic Inquiry, Western Economic Association International, vol. 52(1), pages 35-55, January.
    29. Rachel Heyard & Hanna Hottenrott, 2021. "The value of research funding for knowledge creation and dissemination: A study of SNSF Research Grants," Palgrave Communications, Palgrave Macmillan, vol. 8(1), pages 1-16, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Clemens Fuest & Daniel Gros & Philipp-Leo Mengel & Giorgio Presidente & Jean Jean Tirole, 2024. "EU Innovation Policy: How to Escape the Middle Technology Trap," EconPol Policy Reports Report, ifo Institute - Leibniz Institute for Economic Research at the University of Munich.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marco Cozzi, 2020. "Public Funding of Research and Grant Proposals in the Social Sciences: Empirical Evidence from Canada," Department Discussion Papers 1809, Department of Economics, University of Victoria.
    2. Katrin Hussinger & João N. Carvalho, 2022. "The long-term effect of research grants on the scientific output of university professors," Industry and Innovation, Taylor & Francis Journals, vol. 29(4), pages 463-487, April.
    3. Lawson, Cornelia & Geuna, Aldo & Finardi, Ugo, 2021. "The funding-productivity-gender nexus in science, a multistage analysis," Research Policy, Elsevier, vol. 50(3).
    4. Dmitry Arkhangelsky & Guido Imbens, 2023. "Causal Models for Longitudinal and Panel Data: A Survey," Papers 2311.15458, arXiv.org, revised Jun 2024.
    5. ONISHI Koichiro & OWAN Hideo, 2020. "Heterogenous Impacts of National Research Grants on Academic Productivity," Discussion papers 20052, Research Institute of Economy, Trade and Industry (RIETI).
    6. Zhang, Wanshu & Wang, Xuefeng & Chen, Hongshu & Liu, Jia, 2024. "The impact of early debut on scientists: Evidence from the Young Scientists Fund of the NSFC," Research Policy, Elsevier, vol. 53(2).
    7. Alberto Corsini & Michele Pezzoni, 2022. "Does grant funding foster research impact? Evidence from France," SciencePo Working papers Main hal-03912647, HAL.
    8. Ejermo, Olof & Sofer, Yotam, 2024. "When colleges graduate: Micro-level effects on publications and scientific organization," Research Policy, Elsevier, vol. 53(6).
    9. Adriana Bin & Sergio Salles-Filho & Ana Carolina Spatti & Jesús Pascual Mena-Chalco & Fernando Antonio Basile Colugnati, 2022. "How much does a Ph.D. scholarship program impact an emerging economy research performance?," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 6935-6960, December.
    10. Mohamed Abouaziza, 2022. "Farmer constraints and relational contracts: evidence from agricultural value chains in East Africa," Economics PhD Theses 0122, Department of Economics, University of Sussex Business School.
    11. Alberto Corsini & Michele Pezzoni, 2022. "Does grant funding foster research impact? Evidence from France," Working Papers hal-03912647, HAL.
    12. Corsini, Alberto & Pezzoni, Michele, 2023. "Does grant funding foster research impact? Evidence from France," Journal of Informetrics, Elsevier, vol. 17(4).
    13. Graddy-Reed, Alexandra & Lanahan, Lauren & D'Agostino, Jesse, 2021. "Training across the academy: The impact of R&D funding on graduate students," Research Policy, Elsevier, vol. 50(5).
    14. Mari, Gabriele, 2023. "Less for more? Cuts to child benefits, family adjustments, and long-run child outcomes in larger families," SocArXiv e3n82, Center for Open Science.
    15. Mauricio Villamizar‐Villegas & Freddy A. Pinzon‐Puerto & Maria Alejandra Ruiz‐Sanchez, 2022. "A comprehensive history of regression discontinuity designs: An empirical survey of the last 60 years," Journal of Economic Surveys, Wiley Blackwell, vol. 36(4), pages 1130-1178, September.
    16. Morten Henningsen & Torbjørn Hægeland & Jarle Møen, 2015. "Estimating the additionality of R&D subsidies using proposal evaluation data to control for research intentions," The Journal of Technology Transfer, Springer, vol. 40(2), pages 227-251, April.
    17. Park, Hyunwoo & Lee, Jeongsik (Jay) & Kim, Byung-Cheol, 2015. "Project selection in NIH: A natural experiment from ARRA," Research Policy, Elsevier, vol. 44(6), pages 1145-1159.
    18. Pinotti, Paolo & Bhalotra, Sonia & Britto, Diogo & Sampaio, Breno, 2021. "Job Displacement, Unemployment Benefits and Domestic Violence," CEPR Discussion Papers 16350, C.E.P.R. Discussion Papers.
    19. Hottenrott, Hanna & Lawson, Cornelia, 2013. "Fishing for Complementarities: Competitive Research Funding and Research Productivity," Department of Economics and Statistics Cognetti de Martiis LEI & BRICK - Laboratory of Economics of Innovation "Franco Momigliano", Bureau of Research in Innovation, Complexity and Knowledge, Collegio 201318, University of Turin.
    20. Wilmar Cabrera & Santiago Gamba & Camilo Gómez & Mauricio Villamizar-Villegas, 2022. "Examining Macroprudential Policy through a Microprudential Lens," Borradores de Economia 1212, Banco de la Republica de Colombia.

    More about this item

    Keywords

    research grants; ERC; regression discontinuity design; difference-in-differences; EU funds; policy evaluation;
    All these keywords.

    JEL classification:

    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions
    • D04 - Microeconomics - - General - - - Microeconomic Policy: Formulation; Implementation; Evaluation
    • O31 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Innovation and Invention: Processes and Incentives

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bde:wpaper:2313. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Ángel Rodríguez. Electronic Dissemination of Information Unit. Research Department. Banco de España (email available below). General contact details of provider: https://edirc.repec.org/data/bdegves.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.