IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v81y2009i1d10.1007_s11192-009-2127-y.html
   My bibliography  Save this article

Sustainability of incentives for excellent research — The German case

Author

Listed:
  • Ulrich Schmoch

    (Fraunhofer Institut for Systems and Innovation Research)

  • Torben Schubert

    (Fraunhofer Institut for Systems and Innovation Research
    University of Karlsruhe and Karlsruhe Institute of Technology (KIT))

Abstract

The state authorities in Germany used to fund public sector research without controlling the performance of the research units. This has changed during past decade, where the dominant mechanism by which formerly unconditional state funds are allocated nowadays is indicator-based performance measurement. The indicator sets used to measure the research-related performance in the German public science sector are usually very narrow, often consisting exclusively of finished doctoral theses and third-party funds. Using a unique dataset of 473 German research units from astrophysics, nanotechnology, economics and biotechnology, this paper outlines principles for the construction of sensible indicator sets for the performance measurement of scientific research groups. It is argued that scientific production is multidimensional. Thus one-sided indicator sets that fail to cover the relevant output dimensions give rise to incentives that will ultimately lower the performance of the science sector in total. Indicator sets should strive for sustainable incentives, which can be guaranteed if the sets are broad enough. As a starting point it is shown that the very common performance indicator ‘acquired third-party funds’ may affect research efficiency negatively, especially if the level of third-party funds is already very high. Therefore, we conclude that third-party funds should be used with great care, if at all.

Suggested Citation

  • Ulrich Schmoch & Torben Schubert, 2009. "Sustainability of incentives for excellent research — The German case," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(1), pages 195-218, October.
    • Handle: RePEc:spr:scient:v:81:y:2009:i:1:d:10.1007_s11192-009-2127-y
    DOI: 10.1007/s11192-009-2127-y
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-009-2127-y
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-009-2127-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Stefan Hornbostel, 2001. "Third party funding of German universities. An indicator of research activity?," Scientometrics, Springer;Akadémiai Kiadó, vol. 50(3), pages 523-537, March.
    2. Aldo Geuna, 1997. "Allocation of Funds and Research Output : the Case of UK Universities," Revue d'Économie Industrielle, Programme National Persée, vol. 79(1), pages 143-162.
    3. Johnes, Jill, 2006. "Data envelopment analysis and its application to the measurement of efficiency in higher education," Economics of Education Review, Elsevier, vol. 25(3), pages 273-288, June.
    4. Aldo Geuna, 1999. "The Economics of Knowledge Production," Books, Edward Elgar Publishing, number 1689.
    5. DEPRINS, Dominique & SIMAR, Léopold, 1983. "On Farrell measures of technical efficiency," LIDAM Reprints CORE 589, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    6. Laursen, Keld & Salter, Ammon, 2004. "Searching high and low: what types of firms use universities as a source of innovation?," Research Policy, Elsevier, vol. 33(8), pages 1201-1215, October.
    7. Grit Laudel, 2005. "Is external research funding a valid indicator for research performance?," Research Evaluation, Oxford University Press, vol. 14(1), pages 27-34, April.
    8. Ulrich Schmoch & Torben Schubert, 2008. "Are international co-publications an indicator for quality of scientific research?," Scientometrics, Springer;Akadémiai Kiadó, vol. 74(3), pages 361-377, March.
    9. Susanne Warning, 2004. "Performance Differences in German Higher Education: Empirical Analysis of Strategic Groups," Review of Industrial Organization, Springer;The Industrial Organization Society, vol. 24(4), pages 393-408, June.
    10. Peter Weingart, 2005. "Impact of bibliometrics upon the science system: Inadvertent consequences?," Scientometrics, Springer;Akadémiai Kiadó, vol. 62(1), pages 117-131, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Alona Zharova & Janine Tellinger-Rice & Wolfgang Karl Härdle, 2018. "How to measure the performance of a Collaborative Research Center," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(2), pages 1023-1040, November.
    2. Grimpe, Christoph, 2012. "Extramural research grants and scientists’ funding strategies: Beggars cannot be choosers?," Research Policy, Elsevier, vol. 41(8), pages 1448-1460.
    3. Ana Rute Cardoso & Paulo Guimarães & Klaus F. Zimmermann, 2010. "Comparing the early research performance of PhD graduates in labor economics in Europe and the USA," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(3), pages 621-637, September.
    4. Robin, Stéphane & Schubert, Torben, 2013. "Cooperation with public research institutions and success in innovation: Evidence from France and Germany," Research Policy, Elsevier, vol. 42(1), pages 149-166.
    5. María-Jesús Luengo-Valderrey & Julián Pando-García & Iñaki Periáñez-Cañadillas & Amparo Cervera-Taulet, 2020. "Analysis of the Impact of the Triple Helix on Sustainable Innovation Targets in Spanish Technology Companies," Sustainability, MDPI, vol. 12(8), pages 1-20, April.
    6. Tasso Brandt & Torben Schubert, 2013. "Is the university model an organizational necessity? Scale and agglomeration effects in science," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(2), pages 541-565, February.
    7. repec:hum:wpaper:sfb649dp2018-001 is not listed on IDEAS
    8. Schubert, Torben & Kroll, Henning & Chavez, Cecilia Garcia, 2023. "The effects of sustainability orientation on research and teaching efficiency in German universities," Socio-Economic Planning Sciences, Elsevier, vol. 88(C).
    9. Torben Schubert, 2014. "Are there scale economies in scientific production? On the topic of locally increasing returns to scale," Scientometrics, Springer;Akadémiai Kiadó, vol. 99(2), pages 393-408, May.
    10. Bolli, Thomas & Somogyi, Frank, 2011. "Do competitively acquired funds induce universities to increase productivity?," Research Policy, Elsevier, vol. 40(1), pages 136-147, February.
    11. Yang, Guo-liang & Fukuyama, Hirofumi & Song, Yao-yao, 2018. "Measuring the inefficiency of Chinese research universities based on a two-stage network DEA model," Journal of Informetrics, Elsevier, vol. 12(1), pages 10-30.
    12. Fernando Jiménez-Sáez & Jon Mikel Zabala-Iturriagagoitia & Jose Luis Zofío, 2013. "Who leads research productivity growth? Guidelines for R&D policy-makers," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(1), pages 273-303, January.
    13. Wörter, Martin & Spescha, Andrin & Rammer, Christian, 2024. "Monitoring des Wissens- und Technologietransfers in der Schweiz: Abschlussbericht," ZEW Expertises, ZEW - Leibniz Centre for European Economic Research, number 300895.
    14. repec:mag:wpaper:130014 is not listed on IDEAS
    15. Brandt, Tasso & Schubert, Torben, 2012. "Is the University Model an Organizational Necessity? Scale and Agglomeration Effects in Science," Papers in Innovation Studies 2012/1, Lund University, CIRCLE - Centre for Innovation Research.
    16. Chiang Kao & Shiang-Tai Liu & Hwei-Lan Pao, 2012. "Assessing improvement in management research in Taiwan," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(1), pages 75-87, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Schubert, Torben, 2009. "Empirical observations on New Public Management to increase efficiency in public research--Boon or bane?," Research Policy, Elsevier, vol. 38(8), pages 1225-1234, October.
    2. Mehdi Rhaiem & Nabil Amara, 2020. "Determinants of research efficiency in Canadian business schools: evidence from scholar-level data," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 53-99, October.
    3. Amara, Nabil & Rhaiem, Mehdi & Halilem, Norrin, 2020. "Assessing the research efficiency of Canadian scholars in the management field: Evidence from the DEA and fsQCA," Journal of Business Research, Elsevier, vol. 115(C), pages 296-306.
    4. Andrea Bonaccorsi & Brigida Blasi & Carmela Anna Nappi & Sandra Romagnosi, 2022. "Quality of research as source and signal: revisiting the valorization process beyond substitution vs complementarity," The Journal of Technology Transfer, Springer, vol. 47(2), pages 407-434, April.
    5. Aldo Geuna & Alessandro Muscio, 2008. "The governance of University knowledge transfer," SPRU Working Paper Series 173, SPRU - Science Policy Research Unit, University of Sussex Business School.
    6. Alka Obadić & Aleksander Aristovnik, 2011. "Relative efficiency of higher education in Croatia and Slovenia: an international comparison," The AMFITEATRU ECONOMIC journal, Academy of Economic Studies - Bucharest, Romania, vol. 13(30), pages 362-376, June.
    7. Auranen, Otto & Nieminen, Mika, 2010. "University research funding and publication performance--An international comparison," Research Policy, Elsevier, vol. 39(6), pages 822-834, July.
    8. Joanna Wolszczak-Derlacz & Aleksandra Parteka, 2011. "Efficiency of European public higher education institutions: a two-stage multicountry approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 89(3), pages 887-917, December.
    9. Gawellek, Bastian & Sunder, Marco, 2016. "The German excellence initiative and efficiency change among universities, 2001-2011," Working Papers 142, University of Leipzig, Faculty of Economics and Management Science.
    10. Aurora Teixeira & Joana Costa, 2006. "What Type of Firm Forges Closer Innovation Linkages with Portuguese Universities?," Notas Económicas, Faculty of Economics, University of Coimbra, issue 24, pages 22-47, December.
    11. Matthias Menter & Erik E. Lehmann & Torben Klarl, 2018. "In search of excellence: a case study of the first excellence initiative of Germany," Journal of Business Economics, Springer, vol. 88(9), pages 1105-1132, December.
    12. Isabel Maria Bodas Freitas & Aldo Geuna & Federica Rossi, 2011. "University–Industry Interactions: The Unresolved Puzzle," Chapters, in: Cristiano Antonelli (ed.), Handbook on the Economic Complexity of Technological Change, chapter 11, Edward Elgar Publishing.
    13. Y. c{C}inar, 2016. "Research and Teaching Efficiencies of Turkish Universities with Heterogeneity Considerations: Application of Multi-Activity DEA and DEA by Sequential Exclusion of Alternatives Methods," Papers 1701.07318, arXiv.org.
    14. Banal-Estañol, Albert & Jofre-Bonet, Mireia & Lawson, Cornelia, 2015. "The double-edged sword of industry collaboration: Evidence from engineering academics in the UK," Research Policy, Elsevier, vol. 44(6), pages 1160-1175.
    15. Zharova, Alona & Härdle, Wolfgang Karl & Lessmann, Stefan, 2017. "Is scientific performance a function of funds?," SFB 649 Discussion Papers 2017-028, Humboldt University Berlin, Collaborative Research Center 649: Economic Risk.
    16. Alona Zharova & Wolfgang K. Härdle & Stefan Lessmann, 2017. "Is Scientific Performance a Function of Funds?," SFB 649 Discussion Papers SFB649DP2017-028, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
    17. Daniel Ljungberg & Mattias Johansson & Maureen McKelvey, 2009. "Polarization of the Swedish University Sector: Structural Characteristics and Positioning," Chapters, in: Maureen McKelvey & Magnus Holmén (ed.), Learning to Compete in European Universities, chapter 6, Edward Elgar Publishing.
    18. Erik E. Lehmann & Michele Meoli & Stefano Paleari & Sarah A. E. Stockinger, 2018. "Approaching effects of the economic crisis on university efficiency: a comparative study of Germany and Italy," Eurasian Business Review, Springer;Eurasia Business and Economics Society, vol. 8(1), pages 37-54, March.
    19. Schubert , Torben, 2013. "Are there Scale Economies in Scientific Production? On the Topic of Locally Increasing Returns to Scale," Papers in Innovation Studies 2013/43, Lund University, CIRCLE - Centre for Innovation Research.
    20. Yolanda Fernández-Santos & Almudena Martínez-Campillo & José Miguel Fernández-Fernández, 2015. "Determinantes de la eficiencia en las universidades públicas españolas: un análisis DEA en dos etapas," Investigaciones de Economía de la Educación volume 10, in: Marta Rahona López & Jennifer Graves (ed.), Investigaciones de Economía de la Educación 10, edition 1, volume 10, chapter 25, pages 491-508, Asociación de Economía de la Educación.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:81:y:2009:i:1:d:10.1007_s11192-009-2127-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.