Do they agree? Bibliometric evaluation versus informed peer review in the Italian research assessment exercise
Author
Abstract
Suggested Citation
DOI: 10.1007/s11192-016-1929-y
Download full text from publisher
As the access to this document is restricted, you may want to search for a different version of it.
References listed on IDEAS
- Bertocchi, Graziella & Gambardella, Alfonso & Jappelli, Tullio & Nappi, Carmela A. & Peracchi, Franco, 2015.
"Bibliometric evaluation vs. informed peer review: Evidence from Italy,"
Research Policy, Elsevier, vol. 44(2), pages 451-466.
- Graziella Bertocchi & Alfonso Gambardella & Tullio Jappelli & Carmela A. Nappi & Franco Peracchi, 2013. "Bibliometric Evaluation vs. Informed Peer Review: Evidence from Italy," Department of Economics (DEMB) 0020, University of Modena and Reggio Emilia, Department of Economics "Marco Biagi".
- Bertocchi, Graziella & Gambardella, Alfonso & Jappelli, Tullio & Nappi, Carmela A. & Peracchi, Franco, 2013. "Bibliometric Evaluation vs. Informed Peer Review: Evidence from Italy," IZA Discussion Papers 7739, Institute of Labor Economics (IZA).
- Graziella Bertocchi & Alfonso Gambardella & Tullio Jappelli & Carmela A. Nappi & Franco Peracchi, 2013. "Bibliometric Evaluation vs. Informed Peer Review: Evidence from Italy," CSEF Working Papers 344, Centre for Studies in Economics and Finance (CSEF), University of Naples, Italy.
- Graziella Bertocchi & Alfonso Gambardella & Tullio Jappelli & Carmela A. Nappi & Franco Peracchi, 2013. "Bibliometric Evaluation vs. Informed Peer Review: Evidence from Italy," Center for Economic Research (RECent) 093, University of Modena and Reggio E., Dept. of Economics "Marco Biagi".
- Jappelli, Tullio & Peracchi, Franco & Bertocchi, Graziella & Gambardella, Alfonso & Nappi, Carmela A, 2013. "Bibliometric Evaluation vs. Informed Peer Review: Evidence from Italy," CEPR Discussion Papers 9724, C.E.P.R. Discussion Papers.
- Frederic S. Lee, 2007. "The Research Assessment Exercise, the state and the dominance of mainstream economics in British universities," Cambridge Journal of Economics, Cambridge Political Economy Society, vol. 31(2), pages 309-325, March.
- Alessio Ancaiani & Alberto F. Anfossi & Anna Barbara & Sergio Benedetto & Brigida Blasi & Valentina Carletti & Tindaro Cicero & Alberto Ciolfi & Filippo Costa & Giovanna Colizza & Marco Costantini & F, 2015. "Evaluating scientific research in Italy: The 2004–10 research evaluation exercise," Research Evaluation, Oxford University Press, vol. 24(3), pages 242-255.
- O. Mryglod & R. Kenna & Yu. Holovatch & B. Berche, 2015. "Predicting results of the research excellence framework using departmental h-index: revisited," Scientometrics, Springer;Akadémiai Kiadó, vol. 104(3), pages 1013-1017, September.
- O. Mryglod & R. Kenna & Yu. Holovatch & B. Berche, 2015. "Predicting results of the Research Excellence Framework using departmental h-index," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(3), pages 2165-2180, March.
- Michael E. D. Koenig, 1983. "Bibliometric indicators versus expert opinion in assessing research performance," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 34(2), pages 136-145, March.
- Rinia, E. J. & van Leeuwen, Th. N. & van Vuren, H. G. & van Raan, A. F. J., 1998. "Comparative analysis of a set of bibliometric indicators and central peer review criteria: Evaluation of condensed matter physics in the Netherlands," Research Policy, Elsevier, vol. 27(1), pages 95-107, May.
- Giovanni Abramo & Ciriaco Andrea D'Angelo, 2015. "The VQR, Italy's second national research assessment: Methodological failures and ranking distortions," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(11), pages 2202-2214, November.
- Anthony F. J. Raan, 2006. "Comparison of the Hirsch-index with standard bibliometric indicators and with peer judgment for 147 chemistry research groups," Scientometrics, Springer;Akadémiai Kiadó, vol. 67(3), pages 491-502, June.
- repec:mod:depeco:0020 is not listed on IDEAS
- Dag W Aksnes & Randi Elisabeth Taxt, 2004. "Peer reviews and bibliometric indicators: a comparative study at a Norwegian university," Research Evaluation, Oxford University Press, vol. 13(1), pages 33-41, April.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Giovanni Abramo & Ciriaco Andrea D’Angelo & Emanuela Reale, 2019. "Peer review versus bibliometrics: Which method better predicts the scholarly impact of publications?," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 537-554, October.
- Kayvan Kousha & Mike Thelwall, 2024. "Factors associating with or predicting more cited or higher quality journal articles: An Annual Review of Information Science and Technology (ARIST) paper," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 75(3), pages 215-244, March.
- Dag W. Aksnes & Liv Langfeldt & Paul Wouters, 2019. "Citations, Citation Indicators, and Research Quality: An Overview of Basic Concepts and Theories," SAGE Open, , vol. 9(1), pages 21582440198, February.
- Thelwall, Mike & Kousha, Kayvan & Stuart, Emma & Makita, Meiko & Abdoli, Mahshid & Wilson, Paul & Levitt, Jonathan, 2023. "Do bibliometrics introduce gender, institutional or interdisciplinary biases into research evaluations?," Research Policy, Elsevier, vol. 52(8).
- Abramo, Giovanni, 2018. "Revisiting the scientometric conceptualization of impact and its measurement," Journal of Informetrics, Elsevier, vol. 12(3), pages 590-597.
- Daniele Checchi & Alberto Ciolfi & Gianni De Fraja & Irene Mazzotta & Stefano Verzillo, 2021.
"Have you Read This? An Empirical Comparison of the British REF Peer Review and the Italian VQR Bibliometric Algorithm,"
Economica, London School of Economics and Political Science, vol. 88(352), pages 1107-1129, October.
- Checchi, Daniele & Ciolfi, Alberto & De Fraja, Gianni & Mazzotta, Irene & Verzillo, Stefano, 2019. "Have You Read This? An Empirical Comparison of the British REF Peer Review and the Italian VQR Bibliometric Algorithm," IZA Discussion Papers 12155, Institute of Labor Economics (IZA).
- De Fraja, Gianni & Ciolfi, Alberto & Checchi, Daniele & Mazzotta, Irene & Verzillo, Stefano, 2019. "Have you read this? An empirical comparison of the British REF peer review and the Italian VQR bibliometric algorithm," CEPR Discussion Papers 13521, C.E.P.R. Discussion Papers.
- Primož Južnič & Stojan Pečlin & Matjaž Žaucer & Tilen Mandelj & Miro Pušnik & Franci Demšar, 2010. "Scientometric indicators: peer-review, bibliometric methods and conflict of interests," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(2), pages 429-441, November.
- Giovanni Abramo & Tindaro Cicero & Ciriaco Andrea D’Angelo, 2013. "National peer-review research assessment exercises for the hard sciences can be a complete waste of money: the Italian case," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(1), pages 311-324, April.
- Franceschet, Massimo & Costantini, Antonio, 2011. "The first Italian research assessment exercise: A bibliometric perspective," Journal of Informetrics, Elsevier, vol. 5(2), pages 275-291.
- Vieira, Elizabeth S. & Cabral, José A.S. & Gomes, José A.N.F., 2014. "How good is a model based on bibliometric indicators in predicting the final decisions made by peers?," Journal of Informetrics, Elsevier, vol. 8(2), pages 390-405.
- Li, Jiang & Sanderson, Mark & Willett, Peter & Norris, Michael & Oppenheim, Charles, 2010. "Ranking of library and information science researchers: Comparison of data sources for correlating citation data, and expert judgments," Journal of Informetrics, Elsevier, vol. 4(4), pages 554-563.
- Giovanni Abramo & Ciriaco Andrea D'Angelo, 2015. "The VQR, Italy's second national research assessment: Methodological failures and ranking distortions," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(11), pages 2202-2214, November.
- Morgan-Thomas, Anna & Tsoukas, Serafeim & Dudau, Adina & Gąska, Paweł, 2024. "Beyond declarations: Metrics, rankings and responsible assessment," Research Policy, Elsevier, vol. 53(10).
- Jacques Wainer & Paula Vieira, 2013. "Correlations between bibliometrics and peer evaluation for all disciplines: the evaluation of Brazilian scientists," Scientometrics, Springer;Akadémiai Kiadó, vol. 96(2), pages 395-410, August.
- Basso, Antonella & di Tollo, Giacomo, 2022. "Prediction of UK research excellence framework assessment by the departmental h-index," European Journal of Operational Research, Elsevier, vol. 296(3), pages 1036-1049.
- Fedderke, J.W. & Goldschmidt, M., 2015.
"Does massive funding support of researchers work?: Evaluating the impact of the South African research chair funding initiative,"
Research Policy, Elsevier, vol. 44(2), pages 467-482.
- Johannes W. Fedderke & M. Velez, 2014. "Does Massive Funding Support of Researchers Work?: Evaluating the Impact of the South African Research Chair Funding Initiative," Working Papers 389, Economic Research Southern Africa.
- Takanori Ida & Naomi Fukuzawa, 2013.
"Effects of large-scale research funding programs: a Japanese case study,"
Scientometrics, Springer;Akadémiai Kiadó, vol. 94(3), pages 1253-1273, March.
- Takanori Ida & Naomi Fukuzawa, 2012. "Effects of Large-Scale Research Funding Programs:A Japanese Case Study," Discussion papers e-11-012, Graduate School of Economics Project Center, Kyoto University.
- Hui-Zhen Fu & Yuh-Shan Ho, 2013. "Comparison of independent research of China’s top universities using bibliometric indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 96(1), pages 259-276, July.
- Shahd Al-Janabi & Lee Wei Lim & Luca Aquili, 2021. "Development of a tool to accurately predict UK REF funding allocation," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 8049-8062, September.
- Mike Thelwall, 2017. "Are Mendeley reader counts useful impact indicators in all fields?," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(3), pages 1721-1731, December.
More about this item
Keywords
Informed peer review; Research assessment; Meta-analysis; Bibliometric evaluation; Italian VQR; Peer review; Cohen’s kappa;All these keywords.
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:108:y:2016:i:3:d:10.1007_s11192-016-1929-y. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.