Funding, evaluation, and the performance of national research systems
Author
Abstract
Suggested Citation
DOI: 10.1016/j.joi.2018.01.007
Download full text from publisher
As the access to this document is restricted, you may want to search for a different version of it.
References listed on IDEAS
- Terttu Luukkonen, 2012. "Conservatism and risk-taking in peer review: Emerging ERC practices," Research Evaluation, Oxford University Press, vol. 21(1), pages 48-60, February.
- Auranen, Otto & Nieminen, Mika, 2010. "University research funding and publication performance--An international comparison," Research Policy, Elsevier, vol. 39(6), pages 822-834, July.
- Grit Laudel, 2006. "The art of getting funded: How scientists adapt to their funding conditions," Science and Public Policy, Oxford University Press, vol. 33(7), pages 489-504, August.
- H F Moed & Th N van Leeuwen & M S Visser, 1999. "Trends in publication output and impact of universities in the Netherlands," Research Evaluation, Oxford University Press, vol. 8(1), pages 60-67, April.
- Schubert, Torben, 2009. "Empirical observations on New Public Management to increase efficiency in public research--Boon or bane?," Research Policy, Elsevier, vol. 38(8), pages 1225-1234, October.
- Christine Wennerås & Agnes Wold, 1997. "Nepotism and sexism in peer-review," Nature, Nature, vol. 387(6631), pages 341-343, May.
- Pleun van Arensbergen & Inge van der Weijden & Peter van den Besselaar, 2014. "Different views on scholarly talent: What are the talents we are looking for in science?," Research Evaluation, Oxford University Press, vol. 23(4), pages 273-284.
- van den Besselaar, Peter & Sandström, Ulf, 2015. "Early career grants, performance, and careers: A study on predictive validity of grant decisions," Journal of Informetrics, Elsevier, vol. 9(4), pages 826-838.
- Duncan Thomas & Maria Nedeva, 2012. "Characterizing researchers to study research funding agency impacts: The case of the European Research Council's Starting Grants," Research Evaluation, Oxford University Press, vol. 21(4), pages 257-269, September.
- Jan van Steen, 2012. "Modes of Public Funding of Research and Development: Towards Internationally Comparable Indicators," OECD Science, Technology and Industry Working Papers 2012/4, OECD Publishing.
- Cimini, Giulio & Zaccaria, Andrea & Gabrielli, Andrea, 2016. "Investigating the interplay between fundamentals of national research systems: Performance, investments and international collaborations," Journal of Informetrics, Elsevier, vol. 10(1), pages 200-211.
- Dalpe, Robert & Anderson, Frances, 1995. "National priorities in academic research-strategic research and contracts in renewable energies," Research Policy, Elsevier, vol. 24(4), pages 563-581, July.
- Stefan Hornbostel & Susan Böhmer & Bernd Klingsporn & Jörg Neufeld & Markus Ins, 2009. "Funding of young scientist and scientific excellence," Scientometrics, Springer;Akadémiai Kiadó, vol. 79(1), pages 171-190, April.
- Peter van den Besselaar & Loet Leydesdorff, 2009. "Past performance, peer review and project selection: a case study in the social and behavioral sciences," Research Evaluation, Oxford University Press, vol. 18(4), pages 273-288, October.
- Abramo, Giovanni & Cicero, Tindaro & D’Angelo, Ciriaco Andrea, 2012. "The dispersion of research performance within and between universities as a potential indicator of the competitive intensity in higher education systems," Journal of Informetrics, Elsevier, vol. 6(2), pages 155-168.
- Clara Eugenia Garcia & Luis Sanz-Menéndez, 2005. "Competition for funding as an indicator of research competitiveness," Scientometrics, Springer;Akadémiai Kiadó, vol. 64(3), pages 271-300, August.
- Philippe Aghion & Mathias Dewatripont & Caroline Hoxby & Andreu Mas-Colell & André Sapir, 2010.
"The governance and performance of universities: evidence from Europe and the US [Distance to frontier, selection, and economic growth],"
Economic Policy, CEPR, CESifo, Sciences Po;CES;MSH, vol. 25(61), pages 7-59.
- Philippe Aghion & Mathias Dewatripont & Caroline Hoxby & Andreu Mas-Colell & André Sapir, 2010. "The governance and performance of universities: Evidence from Europe and the US," ULB Institutional Repository 2013/167268, ULB -- Universite Libre de Bruxelles.
- Aghion, Philippe & Dewatripont, Mathias & Hoxby, Caroline & Mas-Colell, Andreu & Sapir, Andreu, 2010. "The governance and performance of universities: evidence from Europe and the US," Scholarly Articles 12502061, Harvard University Department of Economics.
- Ludo Waltman & Michael Schreiber, 2013. "On the calculation of percentile-based bibliometric indicators," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(2), pages 372-379, February.
- Partha, Dasgupta & David, Paul A., 1994. "Toward a new economics of science," Research Policy, Elsevier, vol. 23(5), pages 487-521, September.
- Andrea Bonaccorsi, 2007. "Explaining poor performance of European science: Institutions versus policies," Science and Public Policy, Oxford University Press, vol. 34(5), pages 303-316, June.
- Thomas Heinze, 2008. "How to sponsor ground-breaking research: A comparison of funding schemes," Science and Public Policy, Oxford University Press, vol. 35(5), pages 302-318, June.
- Crespi, Gustavo A. & Geuna, Aldo, 2008. "An empirical study of scientific production: A cross country analysis, 1981-2002," Research Policy, Elsevier, vol. 37(4), pages 565-579, May.
- Robert J. W. Tijssen & Martijn S. Visser & Thed N. van Leeuwen, 2002. "Benchmarking international scientific excellence: Are highly cited research papers an appropriate frame of reference?," Scientometrics, Springer;Akadémiai Kiadó, vol. 54(3), pages 381-397, July.
- Catherine Paradeise & Jean-Claude Thoenig, 2013. "Academic Institutions in Search of Quality: Local Orders and Global Standards," Post-Print halshs-00871625, HAL.
- Koen Jonkers & Thomas Zacharewicz, 2015. "Performance based funding: a comparative assessment of their use and nature in EU Member States – a working paper," JRC Research Reports JRC97684, Joint Research Centre.
- Musselin, Christine, 2013. "How peer review empowers the academic profession and university managers: Changes in relationships between the state, universities and the professoriate," Research Policy, Elsevier, vol. 42(5), pages 1165-1173.
- Abramo, Giovanni & D’Angelo, Andrea Ciriaco & Murgia, Gianluca, 2017. "The relationship among research productivity, research collaboration, and their determinants," Journal of Informetrics, Elsevier, vol. 11(4), pages 1016-1030.
- Inge van der Weijden & Maaike Verbree & Peter van den Besselaar, 2012. "From bench to bedside: The societal orientation of research leaders: The case of biomedical and health research in the Netherlands," Science and Public Policy, Oxford University Press, vol. 39(3), pages 285-303, May.
- Chapman, I. D. & Farina, C., 1983. "Peer review and national need," Research Policy, Elsevier, vol. 12(6), pages 317-327, December.
- repec:dau:papers:123456789/12525 is not listed on IDEAS
- Anders Granberg & Staffan Jacobsson, 2006. "Myths or reality - a scrutiny of dominant beliefs in the Swedish science policy debate," Science and Public Policy, Oxford University Press, vol. 33(5), pages 321-340, June.
- Jacobsson, Staffan & Rickne, Annika, 2004. "How large is the Swedish 'academic' sector really?: A critical analysis of the use of science and technology indicators," Research Policy, Elsevier, vol. 33(9), pages 1355-1372, November.
- Jamil Salmi, 2009. "The Challenge of Establishing World-Class Universities," World Bank Publications - Books, The World Bank Group, number 2600.
- Ludo Waltman & Clara Calero-Medina & Joost Kosten & Ed C.M. Noyons & Robert J.W. Tijssen & Nees Jan Eck & Thed N. Leeuwen & Anthony F.J. Raan & Martijn S. Visser & Paul Wouters, 2012. "The Leiden ranking 2011/2012: Data collection, indicators, and interpretation," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(12), pages 2419-2432, December.
- Hicks, Diana, 2012. "Performance-based university research funding systems," Research Policy, Elsevier, vol. 41(2), pages 251-261.
- Jan van Steen & Marcel Eijffinger, 1998. "Evaluation practices of scientific research in the Netherlands," Research Evaluation, Oxford University Press, vol. 7(2), pages 113-122, August.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
Cited by:
- Győrffy, Balázs & Herman, Péter & Szabó, István, 2020. "Research funding: past performance is a stronger predictor of future scientific output than reviewer scores," Journal of Informetrics, Elsevier, vol. 14(3).
- Li, Heyang & Wu, Meijun & Wang, Yougui & Zeng, An, 2022. "Bibliographic coupling networks reveal the advantage of diversification in scientific projects," Journal of Informetrics, Elsevier, vol. 16(3).
- Young-Hwan Lee, 2021. "Determinants of research productivity in Korean Universities: the role of research funding," The Journal of Technology Transfer, Springer, vol. 46(5), pages 1462-1486, October.
- Tanel Hirv, 2022. "The interplay of the size of the research system, ways of collaboration, level, and method of funding in determining bibliometric outputs," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(3), pages 1295-1316, March.
- Stefan Thurner & Wenyuan Liu & Peter Klimek & Siew Ann Cheong, 2020. "The role of mainstreamness and interdisciplinarity for the relevance of scientific papers," PLOS ONE, Public Library of Science, vol. 15(4), pages 1-14, April.
- Fernandez Martinez, Roberto & Lostado Lorza, Ruben & Santos Delgado, Ana Alexandra & Piedra, Nelson, 2021. "Use of classification trees and rule-based models to optimize the funding assignment to research projects: A case study of UTPL," Journal of Informetrics, Elsevier, vol. 15(1).
- Muhammad Dimyati & Adhi Indra Hermanu, 2023. "Evaluating Research Efficiency in Indonesian Higher Education Institution," Evaluation Review, , vol. 47(2), pages 155-181, April.
- Ping Zhou & Xiaojing Cai & Xiaozan Lyu, 2020. "An in-depth analysis of government funding and international collaboration in scientific research," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1331-1347, November.
- Gerald Schweiger & Adrian Barnett & Peter van den Besselaar & Lutz Bornmann & Andreas De Block & John P. A. Ioannidis & Ulf Sandstrom & Stijn Conix, 2024. "The Costs of Competition in Distributing Scarce Research Funds," Papers 2403.16934, arXiv.org.
- Janne Pölönen & Otto Auranen, 2022. "Research performance and scholarly communication profile of competitive research funding: the case of Academy of Finland," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 7415-7433, December.
- Benito, M. & Gil, P. & Romera, R., 2020. "Evaluating the influence of country characteristics on the Higher Education System Rankings’ progress," Journal of Informetrics, Elsevier, vol. 14(3).
- Tóth, Tamás & Demeter, Márton & Csuhai, Sándor & Major, Zsolt Balázs, 2024. "When career-boosting is on the line: Equity and inequality in grant evaluation, productivity, and the educational backgrounds of Marie Skłodowska-Curie Actions individual fellows in social sciences an," Journal of Informetrics, Elsevier, vol. 18(2).
- Yin, Xingbo & Zong, Xiaohua, 2022. "International student mobility spurs scientific research on foreign countries: Evidence from international students studying in China," Journal of Informetrics, Elsevier, vol. 16(1).
- Claudiu Vasile Kifor & Ana Maria Benedek & Ioan Sîrbu & Roxana Florența Săvescu, 2023. "Institutional drivers of research productivity: a canonical multivariate analysis of Romanian public universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(4), pages 2233-2258, April.
- Gabriel-Alexandru Vîiu & Mihai Păunescu, 2021. "The citation impact of articles from which authors gained monetary rewards based on journal metrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(6), pages 4941-4974, June.
- Alonso Rodríguez-Navarro & Ricardo Brito, 2022. "The link between countries’ economic and scientific wealth has a complex dependence on technological activity and research policy," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(5), pages 2871-2896, May.
- Pastoriza, David & Alegre, Inés & Canela, Miguel A., 2021. "Conditioning the effect of prize on tournament self-selection," Journal of Economic Psychology, Elsevier, vol. 86(C).
- Saarela, Mirka & Kärkkäinen, Tommi, 2020. "Can we automate expert-based journal rankings? Analysis of the Finnish publication indicator," Journal of Informetrics, Elsevier, vol. 14(2).
- Abramo, Giovanni & D'Angelo, Ciriaco Andrea & Di Costa, Flavia, 2022. "Revealing the scientific comparative advantage of nations: Common and distinctive features," Journal of Informetrics, Elsevier, vol. 16(1).
- Abramo, Giovanni & D’Angelo, Ciriaco Andrea, 2020. "A novel methodology to assess the scientific standing of nations at field level," Journal of Informetrics, Elsevier, vol. 14(1).
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Bonaccorsi, Andrea & Haddawy, Peter & Cicero, Tindaro & Hassan, Saeed-Ul, 2017. "The solitude of stars. An analysis of the distributed excellence model of European universities," Journal of Informetrics, Elsevier, vol. 11(2), pages 435-454.
- Tanel Hirv, 2022. "The interplay of the size of the research system, ways of collaboration, level, and method of funding in determining bibliometric outputs," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(3), pages 1295-1316, March.
- Tóth, Tamás & Demeter, Márton & Csuhai, Sándor & Major, Zsolt Balázs, 2024. "When career-boosting is on the line: Equity and inequality in grant evaluation, productivity, and the educational backgrounds of Marie Skłodowska-Curie Actions individual fellows in social sciences an," Journal of Informetrics, Elsevier, vol. 18(2).
- Rodríguez-Navarro, Alonso & Brito, Ricardo, 2018. "Technological research in the EU is less efficient than the world average. EU research policy risks Europeans’ future," Journal of Informetrics, Elsevier, vol. 12(3), pages 718-731.
- Leporia, Benedetto & Geuna, Aldo & Mira, Antonietta, 2018.
"Scientific Output of US and European Universities Scales Super-linearly with Resources,"
Department of Economics and Statistics Cognetti de Martiis LEI & BRICK - Laboratory of Economics of Innovation "Franco Momigliano", Bureau of Research in Innovation, Complexity and Knowledge, Collegio
201806, University of Turin.
- Leporia, Benedetto & Geuna, Aldo & Mira, Antonietta, 2018. "Scientific Output of US and European Universities Scales Super-linearly with Resources," Department of Economics and Statistics Cognetti de Martiis. Working Papers 201818, University of Turin.
- Benedetto Lepori & Aldo Geuna & Antonietta Mira, 2018. "Scientific Output of US and European Universities Scales Super-Linearly with Resources," SPRU Working Paper Series 2018-22, SPRU - Science Policy Research Unit, University of Sussex Business School.
- Banal-Estañol, Albert & Macho-Stadler, Inés & Pérez-Castrillo, David, 2019.
"Evaluation in research funding agencies: Are structurally diverse teams biased against?,"
Research Policy, Elsevier, vol. 48(7), pages 1823-1840.
- Albert Banal-Estañol & Inés Macho-Stadler & David Pérez-Castrillo, 2016. "Evaluation in Research Funding Agencies: Are Structurally Diverse Teams Biased Against?," Working Papers 890, Barcelona School of Economics.
- Benedetto, Lepori & Geuna, Aldo & Veglio, Valerio, 2017.
"A Typology of European Universities. Differentiation and resource distribution,"
Department of Economics and Statistics Cognetti de Martiis. Working Papers
201705, University of Turin.
- Benedetto, Lepori & Geuna, Aldo & Veglio, Valerio, 2017. "A Typology of European Universities. Differentiation and resource distribution," Department of Economics and Statistics Cognetti de Martiis LEI & BRICK - Laboratory of Economics of Innovation "Franco Momigliano", Bureau of Research in Innovation, Complexity and Knowledge, Collegio 201702, University of Turin.
- Andrea Bonaccorsi & Tindaro Cicero & Peter Haddawy & Saeed-UL Hassan, 2017. "Explaining the transatlantic gap in research excellence," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(1), pages 217-241, January.
- Leila Jabrane, 2022. "Individual excellence funding: effects on research autonomy and the creation of protected spaces," Palgrave Communications, Palgrave Macmillan, vol. 9(1), pages 1-9, December.
- Domingo Docampo & Lawrence Cram, 2017. "Academic performance and institutional resources: a cross-country analysis of research universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 739-764, February.
- Janger, Jürgen & Nowotny, Klaus, 2016. "Job choice in academia," Research Policy, Elsevier, vol. 45(8), pages 1672-1683.
- Peter van den Besselaar & Ulf Sandström, 2016. "Gender differences in research performance and its impact on careers: a longitudinal case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(1), pages 143-162, January.
- Sabrina Petersohn & Thomas Heinze, 2018. "Professionalization of bibliometric research assessment. Insights from the history of the Leiden Centre for Science and Technology Studies (CWTS)," Science and Public Policy, Oxford University Press, vol. 45(4), pages 565-578.
- Benedetto Lepori & Aldo Geuna & Valerio Veglio, 2017. "A Typology of European Research Universities. Differentiation, Layering and Resource Distribution," SPRU Working Paper Series 2017-01, SPRU - Science Policy Research Unit, University of Sussex Business School.
- Carmen Osuna & Laura Cruz Castro & Luis Sanz Menéndez, 2010. "Knocking down some Assumptions about the Effects of Evaluation Systems on Publications," Working Papers 1010, Instituto de Políticas y Bienes Públicos (IPP), CSIC.
- Чернова Е. Г. & Ахобадзе Т. Д. & Малова А. С. & Салтан А. А., 2017. "Модели Финансирования Высшего Образования И Эффективность Деятельности Университетов Эмпирическое Исследование Европейского Опыта И Отечественная Практика," Вопросы образования // Educational Studies Moscow, National Research University Higher School of Economics, issue 3, pages 37-82.
- Abramo, Giovanni & D’Angelo, Ciriaco Andrea, 2015. "Evaluating university research: Same performance indicator, different rankings," Journal of Informetrics, Elsevier, vol. 9(3), pages 514-525.
- Loet Leydesdorff & Lutz Bornmann & Jonathan Adams, 2019. "The integrated impact indicator revisited (I3*): a non-parametric alternative to the journal impact factor," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(3), pages 1669-1694, June.
- van den Besselaar, Peter & Heyman, Ulf & Sandström, Ulf, 2017. "Perverse effects of output-based research funding? Butler’s Australian case revisited," Journal of Informetrics, Elsevier, vol. 11(3), pages 905-918.
- Maaike Verbree & Edwin Horlings & Peter Groenewegen & Inge Weijden & Peter Besselaar, 2015. "Organizational factors influencing scholarly performance: a multivariate study of biomedical research groups," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(1), pages 25-49, January.
More about this item
Keywords
Research policy; Input-output studies; Performance-based funding; Research efficiency; Bibliometrics; Citations;All these keywords.
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:infome:v:12:y:2018:i:1:p:365-384. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/joi .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.