IDEAS home Printed from https://ideas.repec.org/a/eee/infome/v15y2021i2s1751157720306465.html
   My bibliography  Save this article

The research productivity of universities. A multilevel and multidisciplinary analysis on European institutions

Author

Listed:
  • Bonaccorsi, Andrea
  • Belingheri, Paola
  • Secondi, Luca

Abstract

The paper makes use of a novel dataset at European level which includes data on academic staff and students of universities from official National Statistical Authorities, bibliometric indicators on publications, and socio-economic indicators at regional level. The dataset covers all European countries. The unit of analysis is a combination between teaching activities at the level of Field of Education and publications classified by Field of Science, resulting in five major integrated areas of STEM (Science; Engineering; Computer Science; Agriculture; Medicine). Using a multilevel modeling framework and comparing results across disciplinary areas the paper finds strong support for peer effects at institutional level and for the positive effect of international collaborations and attraction of foreign PhD students. It does not find support for economies of scale in research, institutional age, specialization effects and private vs private governance. The external regional environment has an impact on research productivity only in applied disciplines.

Suggested Citation

  • Bonaccorsi, Andrea & Belingheri, Paola & Secondi, Luca, 2021. "The research productivity of universities. A multilevel and multidisciplinary analysis on European institutions," Journal of Informetrics, Elsevier, vol. 15(2).
    • Handle: RePEc:eee:infome:v:15:y:2021:i:2:s1751157720306465
    DOI: 10.1016/j.joi.2020.101129
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1751157720306465
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.joi.2020.101129?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kellie L. Maske & Garey C. Durden & Patricia E. Gaynor, 2003. "Determinants of Scholarly Productivity among Male and Female Economists," Economic Inquiry, Western Economic Association International, vol. 41(4), pages 555-564, October.
    2. Cimenler, Oguz & Reeves, Kingsley A. & Skvoretz, John, 2015. "An evaluation of collaborative research in a college of engineering," Journal of Informetrics, Elsevier, vol. 9(3), pages 577-590.
    3. Laurens Cherchye & Bram De Rock & Frederic Vermeulen, 2008. "Analyzing Cost-Efficient Production Behavior Under Economies of Scope: A Nonparametric Methodology," Operations Research, INFORMS, vol. 56(1), pages 204-221, February.
    4. Worthington, Andrew C. & Higgs, Helen, 2014. "Economies of scale and scope in Australian urban water utilities," Utilities Policy, Elsevier, vol. 31(C), pages 52-62.
    5. Roman Abramov & Ivan Gruzdev & Evgeniy Terentev, 2017. "Working Time and Role Strains of Research and Teaching Staff in a Modern Russian University," Voprosy obrazovaniya / Educational Studies Moscow, National Research University Higher School of Economics, issue 1, pages 88-111.
    6. De Witte, Kristof & Rogge, Nicky & Cherchye, Laurens & Van Puyenbroeck, Tom, 2013. "Economies of scope in research and teaching: A non-parametric investigation," Omega, Elsevier, vol. 41(2), pages 305-314.
    7. Matthias Krapf, 2015. "Age and complementarity in scientific collaboration," Empirical Economics, Springer, vol. 49(2), pages 751-781, September.
    8. Geuna, Aldo (ed.), 2015. "Global Mobility of Research Scientists," Elsevier Monographs, Elsevier, edition 1, number 9780128013960.
    9. Koshal, Rajindar K. & Koshal, Manjulika, 1999. "Economies of scale and scope in higher education: a case of comprehensive universities," Economics of Education Review, Elsevier, vol. 18(2), pages 269-277, April.
    10. Andrea Bonaccorsi & Cinzia Daraio, 2005. "Exploring size and agglomeration effects on public research productivity," Scientometrics, Springer;Akadémiai Kiadó, vol. 63(1), pages 87-120, March.
    11. Frenken, Koen & Heimeriks, Gaston J. & Hoekman, Jarno, 2017. "What drives university research performance? An analysis using the CWTS Leiden Ranking data," Journal of Informetrics, Elsevier, vol. 11(3), pages 859-872.
    12. repec:bla:germec:v:9:y:2008:i::p:506-531 is not listed on IDEAS
    13. Moed, Henk F., 2010. "Measuring contextual citation impact of scientific journals," Journal of Informetrics, Elsevier, vol. 4(3), pages 265-277.
    14. Fredrik Niclas Piro & Dag W. Aksnes & Kristoffer Rørstad, 2013. "A macro analysis of productivity differences across fields: Challenges in the measurement of scientific publishing," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(2), pages 307-320, February.
    15. Susan Washburn Taylor & Blakely Fox Fender & Kimberly Gladden Burke, 2006. "Unraveling the Academic Productivity of Economists: The Opportunity Costs of Teaching and Service," Southern Economic Journal, John Wiley & Sons, vol. 72(4), pages 846-859, April.
    16. Néstor Duch-Brown & Martí Parellada-Sabata & Jose Polo-Otero, 2010. "Economies of scale and scope of university research and technology transfer: a flexible multi-product approach," Working Papers 2010/51, Institut d'Economia de Barcelona (IEB).
    17. Besancenot, Damien & Faria, Joao Ricardo & Vranceanu, Radu, 2009. "Why business schools do so much research: A signaling explanation," Research Policy, Elsevier, vol. 38(7), pages 1093-1101, September.
    18. Carayol, Nicolas & Matt, Mireille, 2006. "Individual and collective determinants of academic scientists' productivity," Information Economics and Policy, Elsevier, vol. 18(1), pages 55-72, March.
    19. Fabel Oliver & Hein Miriam & Hofmeister Robert, 2008. "Research Productivity in Business Economics: An Investigation of Austrian, German and Swiss Universities," German Economic Review, De Gruyter, vol. 9(4), pages 506-531, December.
    20. Haddawy, Peter & Hassan, Saeed-Ul & Abbey, Craig W. & Lee, Inn Beng, 2017. "Uncovering fine-grained research excellence: The global research benchmarking system," Journal of Informetrics, Elsevier, vol. 11(2), pages 389-406.
    21. Koen Jonkers & Frédérique Sachwald, 2018. "The dual impact of ‘excellent’ research on science and innovation: the case of Europe," Science and Public Policy, Oxford University Press, vol. 45(2), pages 159-174.
    22. Besancenot, Damien & Huynh, Kim & Serranito, Francisco, 2017. "Co-authorship and research productivity in economics: Assessing the assortative matching hypothesis," Economic Modelling, Elsevier, vol. 66(C), pages 61-80.
    23. repec:adr:anecst:y:1998:i:49-50:p:05 is not listed on IDEAS
    24. Gonzalez-Brambila, Claudia & Veloso, Francisco M., 2007. "The determinants of research output and impact: A study of Mexican researchers," Research Policy, Elsevier, vol. 36(7), pages 1035-1051, September.
    25. Raúl Ramos & Vicente Royuela & Jordi Suriñach, 2007. "An analysis of the determinants in Economics and Business publications by Spanish universities between 1994 and 2004," Scientometrics, Springer;Akadémiai Kiadó, vol. 71(1), pages 117-144, April.
    26. Charles S. White & Karen James & Lisa A. Burke & Richard S. Allen, 2012. "What makes a “research star”? Factors influencing the research productivity of business faculty," International Journal of Productivity and Performance Management, Emerald Group Publishing Limited, vol. 61(6), pages 584-602, July.
    27. Nederhof, A. J. & van Raan, A. F. J., 1993. "A bibliometric analysis of six economics research groups: A comparison with peer review," Research Policy, Elsevier, vol. 22(4), pages 353-368, August.
    28. Joanna Wolszczak-Derlacz & Aleksandra Parteka, 2011. "Efficiency of European public higher education institutions: a two-stage multicountry approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 89(3), pages 887-917, December.
    29. James D. Adams & Zvi Griliches, 1998. "Research Productivity in a System of Universities," Annals of Economics and Statistics, GENES, issue 49-50, pages 127-162.
    30. de Groot, Hans & McMahon, Walter W & Volkwein, J Fredericks, 1991. "The Cost Structure of American Research Universities," The Review of Economics and Statistics, MIT Press, vol. 73(3), pages 424-431, August.
    31. Pedro Teixeira & Vera Rocha & Ricardo Biscaia & Margarida F. Cardoso, 2014. "Public and private higher education in Europe: competition, complementarity or worlds apart?," Chapters, in: Andrea Bonaccorsi (ed.), Knowledge, Diversity and Performance in European Higher Education, chapter 3, pages iii-iii, Edward Elgar Publishing.
    32. David N. Laband & Bernard F. Lentz, 2003. "New Estimates of Economies of Scale and Scope in Higher Education," Southern Economic Journal, John Wiley & Sons, vol. 70(1), pages 172-183, July.
    33. Geraint Johnes & Manuel Salas-Velasco, 2007. "The Determinants Of Costs And Efficiencies Where Producers Are Heterogeneous: The Case Of Spanish Universities," Economics Bulletin, AccessEcon, vol. 4(15), pages 1-9.
    34. Johnes, Jill, 2006. "Data envelopment analysis and its application to the measurement of efficiency in higher education," Economics of Education Review, Elsevier, vol. 25(3), pages 273-288, June.
    35. Golden, John & Carstensen, Fred V., 1992. "Academic research productivity, department size and organization: Further results, comment," Economics of Education Review, Elsevier, vol. 11(2), pages 153-160, June.
    36. repec:ebl:ecbull:v:4:y:2007:i:15:p:1-9 is not listed on IDEAS
    37. Hollis, Aidan, 2001. "Co-authorship and the output of academic economists," Labour Economics, Elsevier, vol. 8(4), pages 503-530, September.
    38. Jeremy M. Berg, 2012. "Well-funded investigators should receive extra scrutiny," Nature, Nature, vol. 489(7415), pages 203-203, September.
    39. Anthony F J van Raan, 2013. "Universities Scale Like Cities," PLOS ONE, Public Library of Science, vol. 8(3), pages 1-14, March.
    40. Johnes, Jill, 2006. "Measuring teaching efficiency in higher education: An application of data envelopment analysis to economics graduates from UK Universities 1993," European Journal of Operational Research, Elsevier, vol. 174(1), pages 443-456, October.
    41. repec:bla:ecorec:v:75:y:1999:i:230:p:256-67 is not listed on IDEAS
    42. Andrea Bonaccorsi & Luca Secondi, 2017. "The determinants of research performance in European universities: a large scale multilevel analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(3), pages 1147-1178, September.
    43. Golden, John & Carstensen, Fred V., 1992. "Academic research productivity, department size and organization: Further results, rejoinder," Economics of Education Review, Elsevier, vol. 11(2), pages 169-171, June.
    44. Katz, J. Sylvan & Martin, Ben R., 1997. "What is research collaboration?," Research Policy, Elsevier, vol. 26(1), pages 1-18, March.
    45. E Thanassoulis & M Kortelainen & G Johnes & J Johnes, 2011. "Costs and efficiency of higher education institutions in England: a DEA analysis," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(7), pages 1282-1297, July.
    46. Jung Cheol Shin & William K. Cummings, 2010. "Multilevel analysis of academic publishing across disciplines: research preference, collaboration, and time on research," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(2), pages 581-594, November.
    47. Bonaccorsi, Andrea & Haddawy, Peter & Cicero, Tindaro & Hassan, Saeed-Ul, 2017. "The solitude of stars. An analysis of the distributed excellence model of European universities," Journal of Informetrics, Elsevier, vol. 11(2), pages 435-454.
    48. Dundar, Halil & Lewis, Darrell R., 1995. "Departmental productivity in American universities: Economies of scale and scope," Economics of Education Review, Elsevier, vol. 14(2), pages 119-144, June.
    49. Mabel Sanchez-Barrioluengo & Sara Flisi, 2017. "Student Mobility in Tertiary Education: institutional factors and regional attractiveness," JRC Research Reports JRC108895, Joint Research Centre.
    50. Fredrik Niclas Piro & Dag W. Aksnes & Kristoffer Rørstad, 2013. "A macro analysis of productivity differences across fields: Challenges in the measurement of scientific publishing," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 64(2), pages 307-320, February.
    51. Amanda H. Goodall & Agnes Bäker, 2015. "A Theory Exploring How Expert Leaders Influence Performance in Knowledge-Intensive Organizations," Springer Books, in: Isabell M. Welpe & Jutta Wollersheim & Stefanie Ringelhan & Margit Osterloh (ed.), Incentives and Performance, edition 127, pages 49-67, Springer.
    52. Jia Zhu & Saeed-Ul Hassan & Hamid Turab Mirza & Qing Xie, 2014. "Measuring recent research performance for Chinese universities using bibliometric methods," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(1), pages 429-443, October.
    53. Lepori, B. & Seeber, M. & Bonaccorsi, A., 2015. "Competition for talent. Country and organizational-level effects in the internationalization of European higher education institutions," Research Policy, Elsevier, vol. 44(3), pages 789-802.
    54. Kevin J. Fox & Ross Milbourne, 1999. "What Determines Research Output of Academic Economists?," The Economic Record, The Economic Society of Australia, vol. 75(3), pages 256-267, September.
    55. Néstor Duch-Brown & Martí Parellada-Sabata & Jose Polo-Otero, 2010. "Economies of scale and scope of university research and technology transfer: a flexible multi-product approach," Working Papers 2010/51, Institut d'Economia de Barcelona (IEB).
    56. Zucker, Lynne G & Darby, Michael R & Brewer, Marilynn B, 1998. "Intellectual Human Capital and the Birth of U.S. Biotechnology Enterprises," American Economic Review, American Economic Association, vol. 88(1), pages 290-306, March.
    57. Tasso Brandt & Torben Schubert, 2013. "Is the university model an organizational necessity? Scale and agglomeration effects in science," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(2), pages 541-565, February.
    58. Lorenzo Ductor, 2015. "Does Co-authorship Lead to Higher Academic Productivity?," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 77(3), pages 385-407, June.
    59. Sarrico, Cláudia S. & Teixeira, Pedro N. & Rosa, Maria J. & Cardoso, Margarida F., 2009. "Subject mix and productivity in Portuguese universities," European Journal of Operational Research, Elsevier, vol. 197(1), pages 287-295, August.
    60. Ynalvez, Marcus Antonius & Shrum, Wesley M., 2011. "Professional networks, scientific collaboration, and publication productivity in resource-constrained research institutions in a developing country," Research Policy, Elsevier, vol. 40(2), pages 204-216, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zharova, Alona & Härdle, Wolfgang Karl & Lessmann, Stefan, 2023. "Data-driven support for policy and decision-making in university research management: A case study from Germany," European Journal of Operational Research, Elsevier, vol. 308(1), pages 353-368.
    2. Amir Brudner & Arieh Gavious, 2024. "A dynamic model of investment in research and teaching facilities in academic institutions," Annals of Operations Research, Springer, vol. 343(1), pages 67-85, December.
    3. Claudiu Vasile Kifor & Ana Maria Benedek & Ioan Sîrbu & Roxana Florența Săvescu, 2023. "Institutional drivers of research productivity: a canonical multivariate analysis of Romanian public universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(4), pages 2233-2258, April.
    4. Andrea Bonaccorsi & Nicola Melluso & Francesco Alessandro Massucci, 2022. "Exploring the antecedents of interdisciplinarity at the European Research Council: a topic modeling approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 6961-6991, December.
    5. Kuan, Chung-Huei & Chen, Dar-Zen & Huang, Mu-Hsuan, 2024. "Dubious cross-national affiliations obscure the assessment of international research collaboration," Journal of Informetrics, Elsevier, vol. 18(2).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andrea Bonaccorsi & Luca Secondi, 2017. "The determinants of research performance in European universities: a large scale multilevel analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(3), pages 1147-1178, September.
    2. Mehdi Rhaiem, 2017. "Measurement and determinants of academic research efficiency: a systematic review of the evidence," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 581-615, February.
    3. Daraio, Cinzia & Bonaccorsi, Andrea & Simar, Léopold, 2015. "Efficiency and economies of scale and specialization in European universities: A directional distance approach," Journal of Informetrics, Elsevier, vol. 9(3), pages 430-448.
    4. Torben Schubert, 2014. "Are there scale economies in scientific production? On the topic of locally increasing returns to scale," Scientometrics, Springer;Akadémiai Kiadó, vol. 99(2), pages 393-408, May.
    5. Shamohammadi, Mehdi & Oh, Dong-hyun, 2019. "Measuring the efficiency changes of private universities of Korea: A two-stage network data envelopment analysis," Technological Forecasting and Social Change, Elsevier, vol. 148(C).
    6. Lars Herberholz & Berthold U. Wigger, 2020. "Efficiency of European Universities: A Comparison of Peers," CESifo Working Paper Series 8044, CESifo.
    7. Camil Demetrescu & Andrea Ribichini & Marco Schaerf, 2020. "Are Italian research assessment exercises size-biased?," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 533-549, October.
    8. Liang-Cheng Zhang & Andrew C. Worthington, 2018. "Explaining Estimated Economies of Scale and Scope in Higher Education: A Meta-Regression Analysis," Research in Higher Education, Springer;Association for Institutional Research, vol. 59(2), pages 156-173, March.
    9. Önder, Ali Sina & Schweitzer, Sascha & Yilmazkuday, Hakan, 2021. "Specialization, field distance, and quality in economists’ collaborations," Journal of Informetrics, Elsevier, vol. 15(4).
    10. Mehdi Rhaiem & Nabil Amara, 2020. "Determinants of research efficiency in Canadian business schools: evidence from scholar-level data," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 53-99, October.
    11. Bäker, Agnes, 2015. "Non-tenured post-doctoral researchers’ job mobility and research output: An analysis of the role of research discipline, department size, and coauthors," Research Policy, Elsevier, vol. 44(3), pages 634-650.
    12. Maaike Verbree & Edwin Horlings & Peter Groenewegen & Inge Weijden & Peter Besselaar, 2015. "Organizational factors influencing scholarly performance: a multivariate study of biomedical research groups," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(1), pages 25-49, January.
    13. Andrea Bonaccorsi & Cinzia Daraio & Leopold Simar, 2014. "Efficiency and economies of scale and scope in European universities. A directional distance approach," DIAG Technical Reports 2014-08, Department of Computer, Control and Management Engineering, Universita' degli Studi di Roma "La Sapienza".
    14. Maria Rosaria Carillo & Erasmo Papagni & Alessandro Sapio, 2012. "Do collaborations enhance the high-quality output of scientific institutions? Evidence from the Italian Research Assessment Exercise (2001-2003)," Discussion Papers 4_2012, CRISEI, University of Naples "Parthenope", Italy.
    15. Kristof De Witte & Laura López-Torres, 2017. "Efficiency in education: a review of literature and a way forward," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 339-363, April.
    16. Schubert , Torben, 2013. "Are there Scale Economies in Scientific Production? On the Topic of Locally Increasing Returns to Scale," Papers in Innovation Studies 2013/43, Lund University, CIRCLE - Centre for Innovation Research.
    17. Marcel Clermont & Alexander Dirksen & Harald Dyckhoff, 2015. "Returns to scale of Business Administration research in Germany," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(2), pages 583-614, May.
    18. Herberholz, Lars & Wigger, Berthold U., 2021. "Efficiency of European universities: A comparison of peers," Research Policy, Elsevier, vol. 50(9).
    19. Carillo, Maria Rosaria & Papagni, Erasmo & Sapio, Alessandro, 2013. "Do collaborations enhance the high-quality output of scientific institutions? Evidence from the Italian Research Assessment Exercise," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 47(C), pages 25-36.
    20. John Rigby, 2009. "Comparing the scientific quality achieved by funding instruments for single grant holders and for collaborative networks within a research system: Some observations," Scientometrics, Springer;Akadémiai Kiadó, vol. 78(1), pages 145-164, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:infome:v:15:y:2021:i:2:s1751157720306465. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/joi .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.