Overturning some assumptions about the effects of evaluation systems on publication performance
Author
Abstract
Suggested Citation
DOI: 10.1007/s11192-010-0312-7
Download full text from publisher
As the access to this document is restricted, you may want to search for a different version of it.
References listed on IDEAS
- Robert D. Shelton, 2008. "Relations between national research investment and publication output: Application to an American Paradox," Scientometrics, Springer;Akadémiai Kiadó, vol. 74(2), pages 191-205, February.
- Peter Ingwersen & Daisy Jacobs, 2004. "South African research in selected scientific areas: Status 1981–2000," Scientometrics, Springer;Akadémiai Kiadó, vol. 59(3), pages 405-423, March.
- Mohr, L. B., 2000. "Regression artifacts and other customs of dubious desert," Evaluation and Program Planning, Elsevier, vol. 23(4), pages 397-409, November.
- Gomez, I. & Fernandez, M. T. & Zulueta, M. A. & Cami, J., 1995. "Analysis of biomedical research in Spain," Research Policy, Elsevier, vol. 24(3), pages 459-471, May.
- Çetin Önder & Mehmet Sevkli & Taner Altinok & Cengiz Tavukçuoǧlu, 2008. "Institutional change and scientific research: A preliminary bibliometric analysis of institutional influences on Turkey’s recent social science publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 76(3), pages 543-560, September.
- Anthony F J van Raan, 1997. "Science as an international enterprise," Science and Public Policy, Oxford University Press, vol. 24(5), pages 290-300, October.
- Henk F. Moed, 2008. "UK Research Assessment Exercises: Informed judgments on research quality or quantity?," Scientometrics, Springer;Akadémiai Kiadó, vol. 74(1), pages 153-161, January.
- F. Moya-Anegón & V. Herrero-Solana, 1999. "Science in america latina: A comparison of bibliometric and scientific-technical indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 46(2), pages 299-320, October.
- H F Moed & Th N van Leeuwen & M S Visser, 1999. "Trends in publication output and impact of universities in the Netherlands," Research Evaluation, Oxford University Press, vol. 8(1), pages 60-67, April.
- Butler, Linda, 2003. "Explaining Australia's increased share of ISI publications--the effects of a funding formula based on publication counts," Research Policy, Elsevier, vol. 32(1), pages 143-155, January.
- Linda Butler, 2003. "Modifying publication practices in response to funding formulas," Research Evaluation, Oxford University Press, vol. 12(1), pages 39-46, April.
- Whitley, Richard, 2003. "Competition and pluralism in the public sciences: the impact of institutional frameworks on the organisation of academic science," Research Policy, Elsevier, vol. 32(6), pages 1015-1029, June.
- Crespi, Gustavo A. & Geuna, Aldo, 2008. "An empirical study of scientific production: A cross country analysis, 1981-2002," Research Policy, Elsevier, vol. 37(4), pages 565-579, May.
- Olle Persson & Wolfgang Glänzel & Rickard Danell, 2004. "Inflationary bibliometric values: The role of scientific collaboration and the need for relative indicators in evaluative studies," Scientometrics, Springer;Akadémiai Kiadó, vol. 60(3), pages 421-432, August.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
Cited by:
- Selcuk Besir Demir, 2018. "Pros and cons of the new financial support policy for Turkish researchers," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 2053-2068, September.
- Yaşar Tonta & Müge Akbulut, 2020. "Does monetary support increase citation impact of scholarly papers?," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1617-1641, November.
- Irene López-Navarro & Ana I. Moreno & Miguel Ángel Quintanilla & Jesús Rey-Rocha, 2015. "Why do I publish research articles in English instead of my own language? Differences in Spanish researchers’ motivations across scientific domains," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(3), pages 939-976, June.
- M. Teresa Antonio-García & Irene López-Navarro & Jesús Rey-Rocha, 2014. "Determinants of success for biomedical researchers: a perception-based study in a health science research environment," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(3), pages 1747-1779, December.
- Christian Schneijderberg & Nicolai Götze & Lars Müller, 2022. "A study of 25 years of publication outputs in the German academic profession," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(1), pages 1-28, January.
- Antonio Fernández-Cano & Manuel Torralbo & Mónica Vallejo, 2012. "Time series of scientific growth in Spanish doctoral theses (1848–2009)," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(1), pages 15-36, April.
- Gabriel-Alexandru Vîiu & Mihai Păunescu, 2021. "The citation impact of articles from which authors gained monetary rewards based on journal metrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(6), pages 4941-4974, June.
- Alonso Rodríguez-Navarro & Ricardo Brito, 2022. "The link between countries’ economic and scientific wealth has a complex dependence on technological activity and research policy," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(5), pages 2871-2896, May.
- Daniele Fanelli, 2012. "Negative results are disappearing from most disciplines and countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 90(3), pages 891-904, March.
- van den Besselaar, Peter & Heyman, Ulf & Sandström, Ulf, 2017. "Perverse effects of output-based research funding? Butler’s Australian case revisited," Journal of Informetrics, Elsevier, vol. 11(3), pages 905-918.
- Artés, Joaquín & Pedraja-Chaparro, Francisco & Salinas-JiméneZ, Mª del Mar, 2017. "Research performance and teaching quality in the Spanish higher education system: Evidence from a medium-sized university," Research Policy, Elsevier, vol. 46(1), pages 19-29.
- Luis Sanz-Menéndez & Laura Cruz-Castro & Kenedy Alva, 2013. "Time to Tenure in Spanish Universities: An Event History Analysis," PLOS ONE, Public Library of Science, vol. 8(10), pages 1-1, October.
- Pin-Hua Lin & Jong-Rong Chen & Chih-Hai Yang, 2014. "Academic research resources and academic quality: a cross-country analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(1), pages 109-123, October.
- Ramón A. Feenstra & Emilio Delgado López-Cózar, 2022. "Philosophers’ appraisals of bibliometric indicators and their use in evaluation: from recognition to knee-jerk rejection," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(4), pages 2085-2103, April.
- Linda Sīle & Raf Vanderstraeten, 2019. "Measuring changes in publication patterns in a context of performance-based research funding systems: the case of educational research in the University of Gothenburg (2005–2014)," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(1), pages 71-91, January.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Carmen Osuna & Laura Cruz Castro & Luis Sanz Menéndez, 2010. "Knocking down some Assumptions about the Effects of Evaluation Systems on Publications," Working Papers 1010, Instituto de Políticas y Bienes Públicos (IPP), CSIC.
- Christian Schneijderberg & Nicolai Götze & Lars Müller, 2022. "A study of 25 years of publication outputs in the German academic profession," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(1), pages 1-28, January.
- Alonso Rodríguez-Navarro & Francis Narin, 2018. "European Paradox or Delusion—Are European Science and Economy Outdated?," Science and Public Policy, Oxford University Press, vol. 45(1), pages 14-23.
- Marianne Gauffriau & Peder Olesen Larsen & Isabelle Maye & Anne Roulin-Perriard & Markus Ins, 2007. "Publication, cooperation and productivity measures in scientific research," Scientometrics, Springer;Akadémiai Kiadó, vol. 73(2), pages 175-214, November.
- Mehdi Rhaiem & Nabil Amara, 2020. "Determinants of research efficiency in Canadian business schools: evidence from scholar-level data," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 53-99, October.
- Fabian Scheidegger & Andre Briviba & Bruno S. Frey, 2023. "Behind the curtains of academic publishing: strategic responses of economists and business scholars," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(8), pages 4765-4790, August.
- Soo Jeung Lee & Christian Schneijderberg & Yangson Kim & Isabel Steinhardt, 2021. "Have Academics’ Citation Patterns Changed in Response to the Rise of World University Rankings? A Test Using First-Citation Speeds," Sustainability, MDPI, vol. 13(17), pages 1-19, August.
- Hanna-Mari Puuska & Reetta Muhonen & Yrjö Leino, 2014. "International and domestic co-publishing and their citation impact in different disciplines," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(2), pages 823-839, February.
- Abramo, Giovanni & D'Angelo, Ciriaco Andrea & Grilli, Leonardo, 2021.
"The effects of citation-based research evaluation schemes on self-citation behavior,"
Journal of Informetrics, Elsevier, vol. 15(4).
- Giovanni Abramo & Ciriaco Andrea D'Angelo & Leonardo Grilli, 2021. "The effects of citation-based research evaluation schemes on self-citation behavior," Papers 2102.05358, arXiv.org.
- Xin Gu & Karen Blackmore, 2017. "Quantitative study on Australian academic science," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(2), pages 1009-1035, November.
- Isabel Iribarren-Maestro & María Luisa Lascurain-Sánchez & Elías Sanz-Casado, 2009. "Are multi-authorship and visibility related? Study of ten research areas at Carlos III University of Madrid," Scientometrics, Springer;Akadémiai Kiadó, vol. 79(1), pages 191-200, April.
- Auranen, Otto & Nieminen, Mika, 2010. "University research funding and publication performance--An international comparison," Research Policy, Elsevier, vol. 39(6), pages 822-834, July.
- Giovanni Abramo & Ciriaco Andrea D’Angelo, 2016. "Refrain from adopting the combination of citation and journal metrics to grade publications, as used in the Italian national research assessment exercise (VQR 2011–2014)," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 2053-2065, December.
- Giovanni Abramo & Ciriaco Andrea D’Angelo & Flavia Di Costa, 2011. "A national-scale cross-time analysis of university research performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 87(2), pages 399-413, May.
- van den Besselaar, Peter & Heyman, Ulf & Sandström, Ulf, 2017. "Perverse effects of output-based research funding? Butler’s Australian case revisited," Journal of Informetrics, Elsevier, vol. 11(3), pages 905-918.
- Jiri Vanecek, 2014. "The effect of performance-based research funding on output of R&D results in the Czech Republic," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(1), pages 657-681, January.
- Linda Sīle & Raf Vanderstraeten, 2019. "Measuring changes in publication patterns in a context of performance-based research funding systems: the case of educational research in the University of Gothenburg (2005–2014)," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(1), pages 71-91, January.
- Giovanni Abramo & Ciriaco Andrea D’Angelo & Myroslava Hladchenko, 2023. "Assessing the effects of publication requirements for professorship on research performance and publishing behaviour of Ukrainian academics," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(8), pages 4589-4609, August.
- Çetin Önder & Mehmet Sevkli & Taner Altinok & Cengiz Tavukçuoǧlu, 2008. "Institutional change and scientific research: A preliminary bibliometric analysis of institutional influences on Turkey’s recent social science publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 76(3), pages 543-560, September.
- Yuret, Tolga, 2017. "Do researchers pay attention to publication subsidies?," Journal of Informetrics, Elsevier, vol. 11(2), pages 423-434.
More about this item
Keywords
Research evaluation systems; Scientific production; Effects of evaluations; Quasi-experimental design; Spain; CNEAI;All these keywords.
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:86:y:2011:i:3:d:10.1007_s11192-010-0312-7. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.