IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v81y2009i1d10.1007_s11192-009-2127-y.html
   My bibliography  Save this article

Sustainability of incentives for excellent research — The German case

Author

Listed:
  • Ulrich Schmoch

    (Fraunhofer Institut for Systems and Innovation Research)

  • Torben Schubert

    (Fraunhofer Institut for Systems and Innovation Research
    University of Karlsruhe and Karlsruhe Institute of Technology (KIT))

Abstract

The state authorities in Germany used to fund public sector research without controlling the performance of the research units. This has changed during past decade, where the dominant mechanism by which formerly unconditional state funds are allocated nowadays is indicator-based performance measurement. The indicator sets used to measure the research-related performance in the German public science sector are usually very narrow, often consisting exclusively of finished doctoral theses and third-party funds. Using a unique dataset of 473 German research units from astrophysics, nanotechnology, economics and biotechnology, this paper outlines principles for the construction of sensible indicator sets for the performance measurement of scientific research groups. It is argued that scientific production is multidimensional. Thus one-sided indicator sets that fail to cover the relevant output dimensions give rise to incentives that will ultimately lower the performance of the science sector in total. Indicator sets should strive for sustainable incentives, which can be guaranteed if the sets are broad enough. As a starting point it is shown that the very common performance indicator ‘acquired third-party funds’ may affect research efficiency negatively, especially if the level of third-party funds is already very high. Therefore, we conclude that third-party funds should be used with great care, if at all.

Suggested Citation

  • Ulrich Schmoch & Torben Schubert, 2009. "Sustainability of incentives for excellent research — The German case," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(1), pages 195-218, October.
    • Handle: RePEc:spr:scient:v:81:y:2009:i:1:d:10.1007_s11192-009-2127-y
    DOI: 10.1007/s11192-009-2127-y
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-009-2127-y
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-009-2127-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Stefan Hornbostel, 2001. "Third party funding of German universities. An indicator of research activity?," Scientometrics, Springer;Akadémiai Kiadó, vol. 50(3), pages 523-537, March.
    2. Aldo Geuna, 1999. "The Economics of Knowledge Production," Books, Edward Elgar Publishing, number 1689.
    3. DEPRINS, Dominique & SIMAR, Léopold, 1983. "On Farrell measures of technical efficiency," LIDAM Reprints CORE 589, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    4. Johnes, Jill, 2006. "Data envelopment analysis and its application to the measurement of efficiency in higher education," Economics of Education Review, Elsevier, vol. 25(3), pages 273-288, June.
    5. Grit Laudel, 2005. "Is external research funding a valid indicator for research performance?," Research Evaluation, Oxford University Press, vol. 14(1), pages 27-34, April.
    6. Ulrich Schmoch & Torben Schubert, 2008. "Are international co-publications an indicator for quality of scientific research?," Scientometrics, Springer;Akadémiai Kiadó, vol. 74(3), pages 361-377, March.
    7. Susanne Warning, 2004. "Performance Differences in German Higher Education: Empirical Analysis of Strategic Groups," Review of Industrial Organization, Springer;The Industrial Organization Society, vol. 24(4), pages 393-408, June.
    8. Aldo Geuna, 1997. "Allocation of Funds and Research Output : the Case of UK Universities," Revue d'Économie Industrielle, Programme National Persée, vol. 79(1), pages 143-162.
    9. Laursen, Keld & Salter, Ammon, 2004. "Searching high and low: what types of firms use universities as a source of innovation?," Research Policy, Elsevier, vol. 33(8), pages 1201-1215, October.
    10. Peter Weingart, 2005. "Impact of bibliometrics upon the science system: Inadvertent consequences?," Scientometrics, Springer;Akadémiai Kiadó, vol. 62(1), pages 117-131, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Grimpe, Christoph, 2012. "Extramural research grants and scientists’ funding strategies: Beggars cannot be choosers?," Research Policy, Elsevier, vol. 41(8), pages 1448-1460.
    2. María-Jesús Luengo-Valderrey & Julián Pando-García & Iñaki Periáñez-Cañadillas & Amparo Cervera-Taulet, 2020. "Analysis of the Impact of the Triple Helix on Sustainable Innovation Targets in Spanish Technology Companies," Sustainability, MDPI, vol. 12(8), pages 1-20, April.
    3. Schubert, Torben & Kroll, Henning & Chavez, Cecilia Garcia, 2023. "The effects of sustainability orientation on research and teaching efficiency in German universities," Socio-Economic Planning Sciences, Elsevier, vol. 88(C).
    4. Torben Schubert, 2014. "Are there scale economies in scientific production? On the topic of locally increasing returns to scale," Scientometrics, Springer;Akadémiai Kiadó, vol. 99(2), pages 393-408, May.
    5. Alona Zharova & Janine Tellinger-Rice & Wolfgang Karl Härdle, 2018. "How to measure the performance of a Collaborative Research Center," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(2), pages 1023-1040, November.
    6. Ana Rute Cardoso & Paulo Guimarães & Klaus F. Zimmermann, 2010. "Comparing the early research performance of PhD graduates in labor economics in Europe and the USA," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(3), pages 621-637, September.
    7. Wörter, Martin & Spescha, Andrin & Rammer, Christian, 2024. "Monitoring des Wissens- und Technologietransfers in der Schweiz: Abschlussbericht," ZEW Expertises, ZEW - Leibniz Centre for European Economic Research, number 300895, March.
    8. Brandt, Tasso & Schubert, Torben, 2012. "Is the University Model an Organizational Necessity? Scale and Agglomeration Effects in Science," Papers in Innovation Studies 2012/1, Lund University, CIRCLE - Centre for Innovation Research.
    9. Chiang Kao & Shiang-Tai Liu & Hwei-Lan Pao, 2012. "Assessing improvement in management research in Taiwan," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(1), pages 75-87, July.
    10. Robin, Stéphane & Schubert, Torben, 2013. "Cooperation with public research institutions and success in innovation: Evidence from France and Germany," Research Policy, Elsevier, vol. 42(1), pages 149-166.
    11. Schubert, Torben & Kroll, Henning & Karaulova, Maria & Blind, Knut, 2024. "Does new public management repel talent? Findings from a choice experiment among German researchers," Discussion Papers "Innovation Systems and Policy Analysis" 84, Fraunhofer Institute for Systems and Innovation Research (ISI).
    12. Tasso Brandt & Torben Schubert, 2013. "Is the university model an organizational necessity? Scale and agglomeration effects in science," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(2), pages 541-565, February.
    13. repec:hum:wpaper:sfb649dp2018-001 is not listed on IDEAS
    14. Bolli, Thomas & Somogyi, Frank, 2011. "Do competitively acquired funds induce universities to increase productivity?," Research Policy, Elsevier, vol. 40(1), pages 136-147, February.
    15. Yang, Guo-liang & Fukuyama, Hirofumi & Song, Yao-yao, 2018. "Measuring the inefficiency of Chinese research universities based on a two-stage network DEA model," Journal of Informetrics, Elsevier, vol. 12(1), pages 10-30.
    16. Fernando Jiménez-Sáez & Jon Mikel Zabala-Iturriagagoitia & Jose Luis Zofío, 2013. "Who leads research productivity growth? Guidelines for R&D policy-makers," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(1), pages 273-303, January.
    17. repec:mag:wpaper:130014 is not listed on IDEAS

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Schubert, Torben, 2009. "Empirical observations on New Public Management to increase efficiency in public research--Boon or bane?," Research Policy, Elsevier, vol. 38(8), pages 1225-1234, October.
    2. Mehdi Rhaiem & Nabil Amara, 2020. "Determinants of research efficiency in Canadian business schools: evidence from scholar-level data," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 53-99, October.
    3. Amara, Nabil & Rhaiem, Mehdi & Halilem, Norrin, 2020. "Assessing the research efficiency of Canadian scholars in the management field: Evidence from the DEA and fsQCA," Journal of Business Research, Elsevier, vol. 115(C), pages 296-306.
    4. Andrea Bonaccorsi & Brigida Blasi & Carmela Anna Nappi & Sandra Romagnosi, 2022. "Quality of research as source and signal: revisiting the valorization process beyond substitution vs complementarity," The Journal of Technology Transfer, Springer, vol. 47(2), pages 407-434, April.
    5. Aldo Geuna & Alessandro Muscio, 2008. "The governance of University knowledge transfer," SPRU Working Paper Series 173, SPRU - Science Policy Research Unit, University of Sussex Business School.
    6. Alka Obadić & Aleksander Aristovnik, 2011. "Relative efficiency of higher education in Croatia and Slovenia: an international comparison," The AMFITEATRU ECONOMIC journal, Academy of Economic Studies - Bucharest, Romania, vol. 13(30), pages 362-376, June.
    7. Auranen, Otto & Nieminen, Mika, 2010. "University research funding and publication performance--An international comparison," Research Policy, Elsevier, vol. 39(6), pages 822-834, July.
    8. Banal-Estañol, Albert & Jofre-Bonet, Mireia & Lawson, Cornelia, 2015. "The double-edged sword of industry collaboration: Evidence from engineering academics in the UK," Research Policy, Elsevier, vol. 44(6), pages 1160-1175.
    9. Aurora Teixeira & Joana Costa, 2006. "What Type of Firm Forges Closer Innovation Linkages with Portuguese Universities?," Notas Económicas, Faculty of Economics, University of Coimbra, issue 24, pages 22-47, December.
    10. Alona Zharova & Wolfgang K. Härdle & Stefan Lessmann, 2017. "Is Scientific Performance a Function of Funds?," SFB 649 Discussion Papers SFB649DP2017-028, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
    11. Erik E. Lehmann & Michele Meoli & Stefano Paleari & Sarah A. E. Stockinger, 2018. "Approaching effects of the economic crisis on university efficiency: a comparative study of Germany and Italy," Eurasian Business Review, Springer;Eurasia Business and Economics Society, vol. 8(1), pages 37-54, March.
    12. Yolanda Fernández-Santos & Almudena Martínez-Campillo & José Miguel Fernández-Fernández, 2015. "Determinantes de la eficiencia en las universidades públicas españolas: un análisis DEA en dos etapas," Investigaciones de Economía de la Educación volume 10, in: Marta Rahona López & Jennifer Graves (ed.), Investigaciones de Economía de la Educación 10, edition 1, volume 10, chapter 25, pages 491-508, Asociación de Economía de la Educación.
    13. Yolanda Fernández Santos & Almudena Martínez Campillo & José Miguel Fernández Fernández, 2013. "Evaluación de la eficiencia y el cambio de productividad en el sistema universitario público español tras la implantación de la LOU," Hacienda Pública Española / Review of Public Economics, IEF, vol. 205(2), pages 71-98, June.
    14. Zuzana Kučerová, 2012. "Measuring of Efficiency in the Public and Private Sector - Current Research Approaches [Měření efektivity ve veřejném a soukromém sektoru - rešerše dosavadních přístupů]," Český finanční a účetní časopis, Prague University of Economics and Business, vol. 2012(2), pages 110-125.
    15. Abankina, Irina & Aleskerov, Fuad & Belousova, Veronika & Gokhberg, Leonid & Kiselgof, Sofya & Petrushchenko, Vsevolod & Shvydun, Sergey & Zinkovsky, Kirill, 2016. "From equality to diversity: Classifying Russian universities in a performance oriented system," Technological Forecasting and Social Change, Elsevier, vol. 103(C), pages 228-239.
    16. Daraio, Cinzia & Simar, Léopold & Wilson, Paul W., 2021. "Quality as a latent heterogeneity factor in the efficiency of universities," Economic Modelling, Elsevier, vol. 99(C).
    17. Lars Herberholz & Berthold U. Wigger, 2020. "Efficiency of European Universities: A Comparison of Peers," CESifo Working Paper Series 8044, CESifo.
    18. Renato A. Villano & Carolyn‐Dung T. T. Tran, 2021. "Survey on technical efficiency in higher education: A meta‐fractional regression analysis," Pacific Economic Review, Wiley Blackwell, vol. 26(1), pages 110-135, February.
    19. Gulbrandsen, Magnus & Smeby, Jens-Christian, 2005. "Industry funding and university professors' research performance," Research Policy, Elsevier, vol. 34(6), pages 932-950, August.
    20. Tommaso Agasisti, 2016. "Cost structure, productivity and efficiency of the Italian public higher education industry 2001--2011," International Review of Applied Economics, Taylor & Francis Journals, vol. 30(1), pages 48-68, January.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:81:y:2009:i:1:d:10.1007_s11192-009-2127-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.