IDEAS home Printed from https://ideas.repec.org/p/ipt/iptwpa/jrc101043.html
   My bibliography  Save this paper

Research Performance Based Funding Systems: a Comparative Assessment

Author

Abstract

Performance based funding is used by most EU Member States to increase the performance of their public research system. This report analyses the different nature of systems in EU Member States, selected associated and third countries. It aims to inform Member States which are in a process of mutual learning to improve the design of their allocation systems. • Research Performance based funding systems provide incentives to increase scientific performance and concentrates resources in well performing organisations • The nature of systems in place differs widely • The specific features of RPBF assessment designs can generate unintended consequences • The assessment suggests RPBF as a potential avenue for several Member States • The choice for specific designs, taking into accounts costs and potential benefits, should take into account the national context

Suggested Citation

  • Koen Jonkers & Thomas Zacharewicz, 2016. "Research Performance Based Funding Systems: a Comparative Assessment," JRC Research Reports JRC101043, Joint Research Centre.
    • Handle: RePEc:ipt:iptwpa:jrc101043
    as

    Download full text from publisher

    File URL: https://publications.jrc.ec.europa.eu/repository/handle/JRC101043
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Angelina Todorova, 2015. "Stairway to Excellence. Country Report: Bulgaria," JRC Research Reports JRC97336, Joint Research Centre.
    2. Aldo Geuna, 2001. "The Changing Rationale for European University Research Funding: Are There Negative Unintended Consequences?," Journal of Economic Issues, Taylor & Francis Journals, vol. 35(3), pages 607-632, September.
    3. Abramo, Giovanni & Cicero, Tindaro & D’Angelo, Ciriaco Andrea, 2012. "The dispersion of research performance within and between universities as a potential indicator of the competitive intensity in higher education systems," Journal of Informetrics, Elsevier, vol. 6(2), pages 155-168.
    4. Philippe Aghion & Mathias Dewatripont & Caroline Hoxby & Andreu Mas-Colell & André Sapir, 2010. "The governance and performance of universities: evidence from Europe and the US [Distance to frontier, selection, and economic growth]," Economic Policy, CEPR, CESifo, Sciences Po;CES;MSH, vol. 25(61), pages 7-59.
    5. Gemma E. Derrick & Vincenzo Pavone, 2013. "Democratising research evaluation: Achieving greater public engagement with bibliometrics-informed peer review," Science and Public Policy, Oxford University Press, vol. 40(5), pages 563-575, April.
    6. Dietmar Braun, 2003. "Lasting tensions in research policy-making — a delegation problem," Science and Public Policy, Oxford University Press, vol. 30(5), pages 309-321, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Abramo, Giovanni & D’Angelo, Ciriaco Andrea & Di Costa, Flavia, 2019. "When research assessment exercises leave room for opportunistic behavior by the subjects under evaluation," Journal of Informetrics, Elsevier, vol. 13(3), pages 830-840.
    2. Yaşar Tonta & Müge Akbulut, 2020. "Does monetary support increase citation impact of scholarly papers?," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1617-1641, November.
    3. Corsini, Alberto & Pezzoni, Michele, 2023. "Does grant funding foster research impact? Evidence from France," Journal of Informetrics, Elsevier, vol. 17(4).
    4. Francesco Giovanni Avallone & Alberto Quagli & Paola Ramassa, 2022. "Interdisciplinary research by accounting scholars: An exploratory study," FINANCIAL REPORTING, FrancoAngeli Editore, vol. 2022(2), pages 5-34.
    5. Daniella Bayle Deutz & Thea Marie Drachen & Dorte Drongstrup & Niels Opstrup & Charlotte Wien, 2021. "Quantitative quality: a study on how performance-based measures may change the publication patterns of Danish researchers," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 3303-3320, April.
    6. Rachel Heyard & Hanna Hottenrott, 2021. "The value of research funding for knowledge creation and dissemination: A study of SNSF Research Grants," Palgrave Communications, Palgrave Macmillan, vol. 8(1), pages 1-16, December.
    7. Marchiori, Carmen & Minelli, Enrico, 2023. "Talent, basic research and growth," Journal of Economic Theory, Elsevier, vol. 213(C).
    8. Dzieżyc, Maciej & Kazienko, Przemysław, 2022. "Effectiveness of research grants funded by European Research Council and Polish National Science Centre," Journal of Informetrics, Elsevier, vol. 16(1).
    9. Aridi, Anwar & Querejazu, Daniel & Zuniga, Pluvia, 2021. "Knowledge transfer activities and conditions for impact in Bulgarian public research institutions: A survey-based diagnostic," MERIT Working Papers 2021-026, United Nations University - Maastricht Economic and Social Research Institute on Innovation and Technology (MERIT).
    10. Tanel Hirv, 2022. "The interplay of the size of the research system, ways of collaboration, level, and method of funding in determining bibliometric outputs," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(3), pages 1295-1316, March.
    11. Mehmet Pinar & Timothy J Horne, 2022. "Assessing research excellence: Evaluating the Research Excellence Framework," Research Evaluation, Oxford University Press, vol. 31(2), pages 173-187.
    12. Kulczycki, Emanuel & Korzeń, Marcin & Korytkowski, Przemysław, 2017. "Toward an excellence-based research funding system: Evidence from Poland," Journal of Informetrics, Elsevier, vol. 11(1), pages 282-298.
    13. Linda Sīle & Raf Vanderstraeten, 2019. "Measuring changes in publication patterns in a context of performance-based research funding systems: the case of educational research in the University of Gothenburg (2005–2014)," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(1), pages 71-91, January.
    14. Emanuela Reale, 2017. "Analysis of National Public Research Funding (PREF) - Final Report," JRC Research Reports JRC107599, Joint Research Centre.
    15. Shannon Mason & Lenandlar Singh, 2022. "When a journal is both at the ‘top’ and the ‘bottom’: the illogicality of conflating citation-based metrics with quality," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3683-3694, June.
    16. Jean Luc De Meulemeester, 2020. "De quelques préconditions à la liberté académique," Working Papers CEB 20-013, ULB -- Universite Libre de Bruxelles.
    17. Muhammad Dimyati & Adhi Indra Hermanu, 2023. "Evaluating Research Efficiency in Indonesian Higher Education Institution," Evaluation Review, , vol. 47(2), pages 155-181, April.
    18. Laura Himanen & Hanna-Mari Puuska, 2022. "Does monitoring performance act as an incentive for improving research performance? National and organizational level analysis of Finnish universities," Research Evaluation, Oxford University Press, vol. 31(2), pages 236-248.
    19. Calabrese, Armando & Capece, Guendalina & Costa, Roberta & Di Pillo, Francesca & Giuffrida, Stefania, 2018. "A ‘power law’ based method to reduce size-related bias in indicators of knowledge performance: An application to university research assessment," Journal of Informetrics, Elsevier, vol. 12(4), pages 1263-1281.
    20. Cristian Barra & Ornella Wanda Maietta & Roberto Zotti, 2021. "The effects of university academic research on firm’s propensity to innovate at local level: evidence from Europe," The Journal of Technology Transfer, Springer, vol. 46(2), pages 483-530, April.
    21. Dian-Fu Chang & Angel Chang, 2024. "Analysis of the Influence of Fund Allocation and Sustainable Academic Efficiency Based on a Transformation of Public Goods in Higher Education," Sustainability, MDPI, vol. 16(5), pages 1-21, February.
    22. Alis Oancea, 2019. "Research governance and the future(s) of research assessment," Palgrave Communications, Palgrave Macmillan, vol. 5(1), pages 1-12, December.
    23. Banal-Estañol, Albert & Jofre-Bonet, Mireia & Iori, Giulia & Maynou, Laia & Tumminello, Michele & Vassallo, Pietro, 2023. "Performance-based research funding: Evidence from the largest natural experiment worldwide," Research Policy, Elsevier, vol. 52(6).
    24. Štěpán Jurajda & Stanislav Kozubek & Daniel Münich & Samuel Škoda, 2017. "Scientific publication performance in post-communist countries: still lagging far behind," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(1), pages 315-328, July.
    25. Robert A. Buckle & John Creedy, 2022. "Methods to evaluate institutional responses to performance‐based research funding systems," Australian Economic Papers, Wiley Blackwell, vol. 61(3), pages 615-634, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Koen Jonkers & Thomas Zacharewicz, 2015. "Performance based funding: a comparative assessment of their use and nature in EU Member States – a working paper," JRC Research Reports JRC97684, Joint Research Centre.
    2. Laura De Dominicis & Susana Elena Pérez & Ana Fernández Zubieta, 2011. "European university funding and financial autonomy. A study on the degree of diversification of university budget and the share of competitive funding," JRC Research Reports JRC63682, Joint Research Centre, revised Mar 2011.
    3. Andrea Bonaccorsi & Luca Secondi & Enza Setteducati & Alessio Ancaiani, 2014. "Participation and commitment in third-party research funding: evidence from Italian Universities," The Journal of Technology Transfer, Springer, vol. 39(2), pages 169-198, April.
    4. Benedetto, Lepori & Geuna, Aldo & Veglio, Valerio, 2017. "A Typology of European Universities. Differentiation and resource distribution," Department of Economics and Statistics Cognetti de Martiis. Working Papers 201705, University of Turin.
    5. Lepori, Benedetto, 2011. "Coordination modes in public funding systems," Research Policy, Elsevier, vol. 40(3), pages 355-367, April.
    6. Thomas Zacharewicz & Benedetto Lepori & Emanuela Reale & Koen Jonkers, 2019. "Performance-based research funding in EU Member States—a comparative assessment," Science and Public Policy, Oxford University Press, vol. 46(1), pages 105-115.
    7. Sandström, Ulf & Van den Besselaar, Peter, 2018. "Funding, evaluation, and the performance of national research systems," Journal of Informetrics, Elsevier, vol. 12(1), pages 365-384.
    8. Bonaccorsi, Andrea & Haddawy, Peter & Cicero, Tindaro & Hassan, Saeed-Ul, 2017. "The solitude of stars. An analysis of the distributed excellence model of European universities," Journal of Informetrics, Elsevier, vol. 11(2), pages 435-454.
    9. Benedetto Lepori & Aldo Geuna & Valerio Veglio, 2017. "A Typology of European Research Universities. Differentiation, Layering and Resource Distribution," SPRU Working Paper Series 2017-01, SPRU - Science Policy Research Unit, University of Sussex Business School.
    10. Thomas Zacharewicz & Noemi Pulido Pavón & Luis Antonio & Benedetto Lepori, 2023. "Do funding modes matter? A multilevel analysis of funding allocation mechanisms on university research performance," Research Evaluation, Oxford University Press, vol. 32(3), pages 545-556.
    11. Ana Fernández-Zubieta & Inés Andújar-Nagore & Sandro Giachi & Manuel Fernández-Esquinas, 2016. "New Organizational Arrangements for Public-Private Research Collaboration," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 7(1), pages 80-103, March.
    12. Marco Cavallaro & Benedetto Lepori, 2021. "Institutional barriers to participation in EU framework programs: contrasting the Swiss and UK cases," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 1311-1328, February.
    13. Ramón A. Feenstra & Emilio Delgado López-Cózar, 2022. "Philosophers’ appraisals of bibliometric indicators and their use in evaluation: from recognition to knee-jerk rejection," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(4), pages 2085-2103, April.
    14. Jürgen Janger & Nicole Schmidt & Anna Strauss, 2019. "International Differences in Basic Research Grant Funding. A Systematic Comparison," WIFO Studies, WIFO, number 61664.
    15. Mario BENASSI & Matteo LANDONI & Francesco RENTOCCHINI, 2017. "University Management Practices and Academic Spin-offs," Departmental Working Papers 2017-11, Department of Economics, Management and Quantitative Methods at Università degli Studi di Milano.
    16. Geuna, Aldo & Nesta, Lionel J.J., 2006. "University patenting and its effects on academic research: The emerging European evidence," Research Policy, Elsevier, vol. 35(6), pages 790-807, July.
    17. Daraio, Cinzia & Bonaccorsi, Andrea & Geuna, Aldo & Lepori, Benedetto & Bach, Laurent & Bogetoft, Peter & F. Cardoso, Margarida & Castro-Martinez, Elena & Crespi, Gustavo & de Lucio, Ignacio Fernandez, 2011. "The European university landscape: A micro characterization based on evidence from the Aquameth project," Research Policy, Elsevier, vol. 40(1), pages 148-164, February.
    18. Joanna Wolszczak-Derlacz, 2015. "Analysis of efficiency of European and American higher education institutions - nonparametric approach," Ekonomia journal, Faculty of Economic Sciences, University of Warsaw, vol. 40.
    19. Eric A. Hanushek & Ludger Woessmann, 2011. "How much do educational outcomes matter in OECD countries? [‘Accountability and flexibility in public schools: Evidence from Boston’s charters and pilots’]," Economic Policy, CEPR, CESifo, Sciences Po;CES;MSH, vol. 26(67), pages 427-491.
    20. Leporia, Benedetto & Geuna, Aldo & Mira, Antonietta, 2018. "Scientific Output of US and European Universities Scales Super-linearly with Resources," Department of Economics and Statistics Cognetti de Martiis LEI & BRICK - Laboratory of Economics of Innovation "Franco Momigliano", Bureau of Research in Innovation, Complexity and Knowledge, Collegio 201806, University of Turin.

    More about this item

    Keywords

    research funding; funding allocation; mutual learning; performance based funding; science policy;
    All these keywords.

    JEL classification:

    • C68 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computable General Equilibrium Models
    • C82 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Macroeconomic Data; Data Access
    • E16 - Macroeconomics and Monetary Economics - - General Aggregative Models - - - Social Accounting Matrix

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ipt:iptwpa:jrc101043. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Publication Officer (email available below). General contact details of provider: https://edirc.repec.org/data/ipjrces.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.