IDEAS home Printed from https://ideas.repec.org/p/zbw/sfb649/sfb649dp2017-028.html
   My bibliography  Save this paper

Is scientific performance a function of funds?

Author

Listed:
  • Zharova, Alona
  • Härdle, Wolfgang Karl
  • Lessmann, Stefan

Abstract

The management of universities demands data on teaching and research performance. While teaching parameters can be measured via student performance and teacher evaluation programs, the connection of research outputs and their grant antecedents is much harder to check, test and understand. This paper elicits the interdependence structure between third-party expenses (TPE), publications, citations and academic age. To describe the relationship, we analyze individual level data from a sample of professorships from a leading research university and a Scopus database for the period 2001 to 2015. Using estimates from a PVARX model, impulse response functions and a forecast error variance decomposition, we show that analyzing on the high aggregation level of universities does not reflect the behavior of its faculties. We explain the differences in relationship structure between indicators for social sciences and humanities, life sciences and mathematical and natural sciences. For instance, for mathematics and some fields of social sciences and humanities the relationship between the TPE and the number of publications is insignificant, however, the influence of the TPE on the number of citation is significant and positive that indicates the difference between quality and quantity of research outputs. The paper also proposes a visualization of the cooperation between faculties and research interdisciplinarity via the co-authorship structure among publications. We discuss the implications for policy and decision making and suggest recommendations for research management of universities.

Suggested Citation

  • Zharova, Alona & Härdle, Wolfgang Karl & Lessmann, Stefan, 2017. "Is scientific performance a function of funds?," SFB 649 Discussion Papers 2017-028, Humboldt University Berlin, Collaborative Research Center 649: Economic Risk.
    • Handle: RePEc:zbw:sfb649:sfb649dp2017-028
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/191792/1/SFB649DP2017-028.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. José Manuel Pastor & Lorenzo Serrano & Irene Zaera, 2015. "The research output of European higher education institutions," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(3), pages 1867-1893, March.
    2. Payne A. Abigail & Siow Aloysius, 2003. "Does Federal Research Funding Increase University Research Output?," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 3(1), pages 1-24, May.
    3. Stefan Hornbostel, 2001. "Third party funding of German universities. An indicator of research activity?," Scientometrics, Springer;Akadémiai Kiadó, vol. 50(3), pages 523-537, March.
    4. Canova, Fabio & Ciccarelli, Matteo, 2013. "Panel Vector Autoregressive Models: A Survey," CEPR Discussion Papers 9380, C.E.P.R. Discussion Papers.
    5. Arturas Juodis, 2013. "First Difference Transformation in Panel VAR models: Robustness, Estimation and Inference," UvA-Econometrics Working Papers 13-06, Universiteit van Amsterdam, Dept. of Econometrics.
    6. Holtz-Eakin, Douglas & Newey, Whitney & Rosen, Harvey S, 1988. "Estimating Vector Autoregressions with Panel Data," Econometrica, Econometric Society, vol. 56(6), pages 1371-1395, November.
    7. Joshua L Rosenbloom & Donna K Ginther & Ted Juhl & Joseph A Heppert, 2015. "The Effects of Research & Development Funding on Scientific Productivity: Academic Chemistry, 1990-2009," PLOS ONE, Public Library of Science, vol. 10(9), pages 1-23, September.
    8. Koop, Gary & Korobilis, Dimitris, 2010. "Bayesian Multivariate Time Series Methods for Empirical Macroeconomics," Foundations and Trends(R) in Econometrics, now publishers, vol. 3(4), pages 267-358, July.
    9. Thomas Fomby & Yuki Ikeda & Norman V. Loayza, 2013. "The Growth Aftermath Of Natural Disasters," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(3), pages 412-434, April.
    10. Michael R. M. Abrigo & Inessa Love, 2016. "Estimation of panel vector autoregression in Stata," Stata Journal, StataCorp LP, vol. 16(3), pages 778-804, September.
    11. Carayol, Nicolas & Matt, Mireille, 2004. "Does research organization influence academic production?: Laboratory level evidence from a large European university," Research Policy, Elsevier, vol. 33(8), pages 1081-1102, October.
    12. Borke, Lukas & Härdle, Wolfgang Karl, 2017. "GitHub API based QuantNet Mining infrastructure in R," SFB 649 Discussion Papers 2017-008, Humboldt University Berlin, Collaborative Research Center 649: Economic Risk.
    13. Jacob, Brian A. & Lefgren, Lars, 2011. "The impact of research grant funding on scientific productivity," Journal of Public Economics, Elsevier, vol. 95(9), pages 1168-1177.
    14. Giovanni Abramo & Ciriaco Andrea D’Angelo, 2011. "National-scale research performance assessment at the individual level," Scientometrics, Springer;Akadémiai Kiadó, vol. 86(2), pages 347-364, February.
    15. Rodrigo Costas & Thed N. van Leeuwen & María Bordons, 2010. "A bibliometric classificatory approach for the study and assessment of research performance at the individual level: The effects of age on productivity and impact," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 61(8), pages 1564-1581, August.
    16. Giovanni Abramo & Ciriaco Andrea D’Angelo & Gianluca Murgia, 2016. "The combined effects of age and seniority on research performance of full professors," Science and Public Policy, Oxford University Press, vol. 43(3), pages 301-319.
    17. Sharmistha Nag & Hui Yang & Steven Buccola & David Ervin, 2013. "Productivity and financial support in academic bioscience," Applied Economics, Taylor & Francis Journals, vol. 45(19), pages 2817-2826, July.
    18. Pfaff, Bernhard, 2008. "VAR, SVAR and SVEC Models: Implementation Within R Package vars," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 27(i04).
    19. Tomaz Bartol & Gordana Budimir & Doris Dekleva-Smrekar & Miro Pusnik & Primoz Juznic, 2014. "Assessment of research fields in Scopus and Web of Science in the view of national research evaluation in Slovenia," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(2), pages 1491-1504, February.
    20. James H. Stock & Mark W. Watson, 2001. "Vector Autoregressions," Journal of Economic Perspectives, American Economic Association, vol. 15(4), pages 101-115, Fall.
    21. Grit Laudel, 2005. "Is external research funding a valid indicator for research performance?," Research Evaluation, Oxford University Press, vol. 14(1), pages 27-34, April.
    22. Jian Wang, 2013. "Citation time window choice for research impact evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(3), pages 851-872, March.
    23. Abramo, Giovanni & Cicero, Tindaro & D’Angelo, Ciriaco Andrea, 2013. "Individual research performance: A proposal for comparing apples to oranges," Journal of Informetrics, Elsevier, vol. 7(2), pages 528-539.
    24. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    25. Ashkan Ebadi & Andrea Schiffauerova, 2013. "Impact of Funding on Scientific Output and Collaboration: A Survey of Literature," Journal of Information & Knowledge Management (JIKM), World Scientific Publishing Co. Pte. Ltd., vol. 12(04), pages 1-16.
    26. Rodrigo Costas & Thed N. van Leeuwen & María Bordons, 2010. "A bibliometric classificatory approach for the study and assessment of research performance at the individual level: The effects of age on productivity and impact," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 61(8), pages 1564-1581, August.
    27. Beaudry, Catherine & Allaoui, Sedki, 2012. "Impact of public and private research funding on scientific production: The case of nanotechnology," Research Policy, Elsevier, vol. 41(9), pages 1589-1606.
    28. Levin, Sharon G & Stephan, Paula E, 1991. "Research Productivity over the Life Cycle: Evidence for Academic Scientists," American Economic Review, American Economic Association, vol. 81(1), pages 114-132, March.
    29. Ashkan Ebadi & Andrea Schiffauerova, 2016. "How to boost scientific production? A statistical analysis of research funding and other influencing factors," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(3), pages 1093-1116, March.
    30. DJIGBENOU-KRE, Marie-Louise & Park, Hail, 2016. "The effects of global liquidity on global imbalances," International Review of Economics & Finance, Elsevier, vol. 42(C), pages 1-12.
    31. Sims, Christopher A, 1980. "Macroeconomics and Reality," Econometrica, Econometric Society, vol. 48(1), pages 1-48, January.
    32. Lütkepohl, Helmut, 1999. "Vector autoregressive analysis," SFB 373 Discussion Papers 1999,31, Humboldt University of Berlin, Interdisciplinary Research Project 373: Quantification and Simulation of Economic Processes.
    33. Moed, Henk F. & de Moya-Anegón, Félix & López-Illescas, Carmen & Visser, Martijn, 2011. "Is concentration of university research associated with better research performance?," Journal of Informetrics, Elsevier, vol. 5(4), pages 649-658.
    34. Anthony F. J. Raan & Thed N. Leeuwen & Martijn S. Visser, 2011. "Severe language effect in university rankings: particularly Germany and France are wronged in citation-based rankings," Scientometrics, Springer;Akadémiai Kiadó, vol. 88(2), pages 495-498, August.
    35. Bolli, Thomas & Somogyi, Frank, 2011. "Do competitively acquired funds induce universities to increase productivity?," Research Policy, Elsevier, vol. 40(1), pages 136-147, February.
    36. Wolfgang Glänzel & András Schubert, 2003. "A new classification scheme of science fields and subfields designed for scientometric evaluation purposes," Scientometrics, Springer;Akadémiai Kiadó, vol. 56(3), pages 357-367, March.
    37. Mingers, John & Leydesdorff, Loet, 2015. "A review of theory and practice in scientometrics," European Journal of Operational Research, Elsevier, vol. 246(1), pages 1-19.
    38. Thed N. Van Leeuwen & Henk F. Moed & Robert J. W. Tijssen & Martijn S. Visser & Anthony F. J. Van Raan, 2001. "Language biases in the coverage of the Science Citation Index and its consequencesfor international comparisons of national research performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 51(1), pages 335-346, April.
    39. Michael R.M. Abrigo & Inessa Love, 2016. "Estimation of Panel Vector Autoregression in Stata: a Package of Programs," Working Papers 201602, University of Hawaii at Manoa, Department of Economics.
    40. Nicolas Carayol & Mireille Matt, 2004. "Does research organization influence academic production ?," Post-Print hal-00279014, HAL.
    41. Andrea Bonaccorsi & Cinzia Daraio, 2003. "Age effects in scientific productivity," Scientometrics, Springer;Akadémiai Kiadó, vol. 58(1), pages 49-90, September.
    42. Andrea Diem & Stefan C. Wolter, 2011. "The Use of Bibliometrics to Measure Research Performance in Education Sciences," Economics of Education Working Paper Series 0066, University of Zurich, Department of Business Administration (IBW), revised May 2013.
    43. Diana Hicks & Paul Wouters & Ludo Waltman & Sarah de Rijcke & Ismael Rafols, 2015. "Bibliometrics: The Leiden Manifesto for research metrics," Nature, Nature, vol. 520(7548), pages 429-431, April.
    44. Waltman, Ludo & van Eck, Nees Jan, 2015. "Field-normalized citation impact indicators and the choice of an appropriate counting method," Journal of Informetrics, Elsevier, vol. 9(4), pages 872-894.
    45. Lilia Cavallari & Stefano D’Addona, 2014. "Trade Margins And Exchange Rate Regimes: New Evidence From A Panel Varx Model," Working Papers 0514, CREI Università degli Studi Roma Tre, revised 2014.
    46. Vincent Larivière & Benoit Macaluso & Éric Archambault & Yves Gingras, 2010. "Which scientific elites? On the concentration of research funds, publications and citations," Research Evaluation, Oxford University Press, vol. 19(1), pages 45-53, March.
    47. Abramo, Giovanni & Cicero, Tindaro & D’Angelo, Ciriaco Andrea, 2011. "Assessing the varying level of impact measurement accuracy as a function of the citation window length," Journal of Informetrics, Elsevier, vol. 5(4), pages 659-667.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Alona Zharova & Janine Tellinger-Rice & Wolfgang Karl Härdle, 2018. "How to measure the performance of a Collaborative Research Center," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(2), pages 1023-1040, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alona Zharova & Wolfgang K. Härdle & Stefan Lessmann, 2017. "Is Scientific Performance a Function of Funds?," SFB 649 Discussion Papers SFB649DP2017-028, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
    2. Zharova, Alona & Härdle, Wolfgang Karl & Lessmann, Stefan, 2023. "Data-driven support for policy and decision-making in university research management: A case study from Germany," European Journal of Operational Research, Elsevier, vol. 308(1), pages 353-368.
    3. Andrea Bonaccorsi & Brigida Blasi & Carmela Anna Nappi & Sandra Romagnosi, 2022. "Quality of research as source and signal: revisiting the valorization process beyond substitution vs complementarity," The Journal of Technology Transfer, Springer, vol. 47(2), pages 407-434, April.
    4. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    5. Alona Zharova & Janine Tellinger-Rice & Wolfgang Karl Härdle, 2018. "How to measure the performance of a Collaborative Research Center," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(2), pages 1023-1040, November.
    6. repec:hum:wpaper:sfb649dp2018-001 is not listed on IDEAS
    7. Leila Tahmooresnejad & Catherine Beaudry & Andrea Schiffauerova, 2015. "The role of public funding in nanotechnology scientific production: Where Canada stands in comparison to the United States," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(1), pages 753-787, January.
    8. Mehdi Rhaiem & Nabil Amara, 2020. "Determinants of research efficiency in Canadian business schools: evidence from scholar-level data," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 53-99, October.
    9. Kazuki Nakajima & Kazuyuki Shudo & Naoki Masuda, 2023. "Higher-order rich-club phenomenon in collaborative research grant networks," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(4), pages 2429-2446, April.
    10. Lutz Bornmann & Klaus Wohlrabe, 2019. "Normalisation of citation impact in economics," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(2), pages 841-884, August.
    11. Nicolas Carayol, 2006. "La production de brevets par les chercheurs et enseignants-chercheurs.. Le cas de l'université Louis Pasteur," Economie & Prévision, La Documentation Française, vol. 0(4), pages 117-134.
    12. Zouaoui, Haykel & Zoghlami, Feten, 2020. "On the income diversification and bank market power nexus in the MENA countries: Evidence from a GMM panel-VAR approach," Research in International Business and Finance, Elsevier, vol. 52(C).
    13. Margaret E. Blume-Kohout, 2023. "The case of the interrupting funder: dynamic effects of R&D funding and patenting in U.S. universities," The Journal of Technology Transfer, Springer, vol. 48(4), pages 1221-1242, August.
    14. Sigmund, Michael & Ferstl, Robert, 2021. "Panel vector autoregression in R with the package panelvar," The Quarterly Review of Economics and Finance, Elsevier, vol. 80(C), pages 693-720.
    15. Massimiliano Serati & Fausto Pacicco, 2018. "A proposal for a micro-territorial well-being index: the WIT," RIEDS - Rivista Italiana di Economia, Demografia e Statistica - The Italian Journal of Economic, Demographic and Statistical Studies, SIEDS Societa' Italiana di Economia Demografia e Statistica, vol. 72(3), pages 77-99, July-Sept.
    16. de la Horra, Luis P. & Perote, Javier & de la Fuente, Gabriel, 2021. "Monetary policy and corporate investment: A panel-data analysis of transmission mechanisms in contexts of high uncertainty," International Review of Economics & Finance, Elsevier, vol. 75(C), pages 609-624.
    17. Thi Bich Ngoc Tran & Hoang Cam Huong Pham, 2020. "The Spillover Effects of the US Unconventional Monetary Policy: New Evidence from Asian Developing Countries," JRFM, MDPI, vol. 13(8), pages 1-26, July.
    18. Rachel Heyard & Hanna Hottenrott, 2021. "The value of research funding for knowledge creation and dissemination: A study of SNSF Research Grants," Palgrave Communications, Palgrave Macmillan, vol. 8(1), pages 1-16, December.
    19. Hertweck, Matthias & Brey, Bjoern, 2017. "The Persistent Effects of Monsoon Rainfall Shocks in India: A Nonlinear VAR Approach," VfS Annual Conference 2017 (Vienna): Alternative Structures for Money and Banking 168256, Verein für Socialpolitik / German Economic Association.
    20. Edwin Horlings & Thomas Gurney, 2013. "Search strategies along the academic lifecycle," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(3), pages 1137-1160, March.
    21. Kyoungmi Lee & Sunglok Choi & Jae-Suk Yang, 2021. "Can expensive research equipment boost research and development performances?," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 7715-7742, September.

    More about this item

    Keywords

    research performance; decision making; third-party funds; publications; citations; PVARX model;
    All these keywords.

    JEL classification:

    • M10 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Business Administration - - - General
    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C55 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Large Data Sets: Modeling and Analysis

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:sfb649:sfb649dp2017-028. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/sohubde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.