IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v88y2011i2d10.1007_s11192-011-0398-6.html
   My bibliography  Save this article

A ranking of universities should account for differences in their disciplinary specialization

Author

Listed:
  • Carmen López-Illescas

    (SCImago Unit, IPP, CCHS, CSIC, Spanish National Research Council)

  • Félix Moya-Anegón

    (SCImago Unit, IPP, CCHS, CSIC, Spanish National Research Council)

  • Henk F. Moed

    (Elsevier)

Abstract

A bibliometric analysis of the 50 most frequently publishing Spanish universities shows large differences in the publication activity and citation impact among research disciplines within an institution. Gini Index is a useful measure of an institution’s disciplinary specialization and can roughly categorize universities in terms of general versus specialized. A study of the Spanish academic system reveals that assessment of a university’s research performance must take into account the disciplinary breadth of its publication activity and citation impact. It proposes the use of graphs showing not only a university’s article production and citation impact, but also its disciplinary specialization. Such graphs constitute both a warning and a remedy against one-dimensional approaches to the assessment of institutional research performance.

Suggested Citation

  • Carmen López-Illescas & Félix Moya-Anegón & Henk F. Moed, 2011. "A ranking of universities should account for differences in their disciplinary specialization," Scientometrics, Springer;Akadémiai Kiadó, vol. 88(2), pages 563-574, August.
    • Handle: RePEc:spr:scient:v:88:y:2011:i:2:d:10.1007_s11192-011-0398-6
    DOI: 10.1007/s11192-011-0398-6
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-011-0398-6
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-011-0398-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jamil Salmi, 2009. "The Challenge of Establishing World-Class Universities," World Bank Publications - Books, The World Bank Group, number 2600.
    2. H F Moed & Th N van Leeuwen & M S Visser, 1999. "Trends in publication output and impact of universities in the Netherlands," Research Evaluation, Oxford University Press, vol. 8(1), pages 60-67, April.
    3. Clara Calero-Medina & Carmen López-Illescas & Martijn S Visser & Henk F Moed, 2008. "Important factors when interpreting bibliometric rankings of world universities: an example from oncology," Research Evaluation, Oxford University Press, vol. 17(1), pages 71-81, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Daraio, Cinzia & Bonaccorsi, Andrea & Simar, Léopold, 2015. "Efficiency and economies of scale and specialization in European universities: A directional distance approach," Journal of Informetrics, Elsevier, vol. 9(3), pages 430-448.
    2. Renato Bruni & Giuseppe Catalano & Cinzia Daraio & Martina Gregori & Henk F. Moed, 2019. "Studying the Heterogeneity of European Higher Education Institutions," DIAG Technical Reports 2019-12, Department of Computer, Control and Management Engineering, Universita' degli Studi di Roma "La Sapienza".
    3. Ludo Waltman & Clara Calero-Medina & Joost Kosten & Ed C.M. Noyons & Robert J.W. Tijssen & Nees Jan Eck & Thed N. Leeuwen & Anthony F.J. Raan & Martijn S. Visser & Paul Wouters, 2012. "The Leiden ranking 2011/2012: Data collection, indicators, and interpretation," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(12), pages 2419-2432, December.
    4. Guo Chen & Lu Xiao & Chang-ping Hu & Xue-qin Zhao, 2015. "Identifying the research focus of Library and Information Science institutions in China with institution-specific keywords," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(2), pages 707-724, May.
    5. Chi, Pei-Shan, 2016. "Differing disciplinary citation concentration patterns of book and journal literature?," Journal of Informetrics, Elsevier, vol. 10(3), pages 814-829.
    6. Hiran H. Lathabai & Abhirup Nandy & Vivek Kumar Singh, 2021. "x-index: Identifying core competency and thematic research strengths of institutions using an NLP and network based ranking framework," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(12), pages 9557-9583, December.
    7. Andrea Bonaccorsi & Luca Secondi, 2017. "The determinants of research performance in European universities: a large scale multilevel analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(3), pages 1147-1178, September.
    8. J. A. García & Rosa Rodriguez-Sánchez & J. Fdez-Valdivia & Daniel Torres-Salinas & Francisco Herrera, 2012. "Ranking of research output of universities on the basis of the multidimensional prestige of influential fields: Spanish universities as a case of study," Scientometrics, Springer;Akadémiai Kiadó, vol. 93(3), pages 1081-1099, December.
    9. Félix Moya-Anegón & Carmen López-Illescas & Henk F. Moed, 2014. "How to interpret the position of private sector institutions in bibliometric rankings of research institutions," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(1), pages 283-298, January.
    10. Nicolás Robinson-García & Clara Calero-Medina, 2014. "What do university rankings by fields rank? Exploring discrepancies between the organizational structure of universities and bibliometric classifications," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(3), pages 1955-1970, March.
    11. Chen, Guo & Xiao, Lu, 2016. "Selecting publication keywords for domain analysis in bibliometrics: A comparison of three methods," Journal of Informetrics, Elsevier, vol. 10(1), pages 212-223.
    12. Tolga Yuret, 2015. "Interfield comparison of academic output by using department level data," Scientometrics, Springer;Akadémiai Kiadó, vol. 105(3), pages 1653-1664, December.
    13. Calabrese, Armando & Capece, Guendalina & Costa, Roberta & Di Pillo, Francesca & Giuffrida, Stefania, 2018. "A ‘power law’ based method to reduce size-related bias in indicators of knowledge performance: An application to university research assessment," Journal of Informetrics, Elsevier, vol. 12(4), pages 1263-1281.
    14. Maria Cláudia Cabrini Grácio & Ely Francina Tannuri Oliveira & Zaida Chinchilla-Rodríguez & Henk F. Moed, 2020. "Does corresponding authorship influence scientific impact in collaboration: Brazilian institutions as a case of study," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1349-1369, November.
    15. Moed, Henk F. & de Moya-Anegón, Félix & López-Illescas, Carmen & Visser, Martijn, 2011. "Is concentration of university research associated with better research performance?," Journal of Informetrics, Elsevier, vol. 5(4), pages 649-658.
    16. Renato Bruni & Giuseppe Catalano & Cinzia Daraio & Martina Gregori & Henk F. Moed, 2020. "Studying the heterogeneity of European higher education institutions," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1117-1144, November.
    17. Mauro G. Carta & Matthias C. Angermeyer & Silvano Tagliagambe, 2021. "The Trend of Scientific Productivity of Chinese, European Union, and United States Universities and Private Companies: Does the Future Belong to E-Technology Companies?," Publications, MDPI, vol. 9(2), pages 1-14, April.
    18. Yong Yi & Wei Qi & Dandan Wu, 2013. "Are CIVETS the next BRICs? A comparative analysis from scientometrics perspective," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(2), pages 615-628, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Moed, Henk F. & de Moya-Anegón, Félix & López-Illescas, Carmen & Visser, Martijn, 2011. "Is concentration of university research associated with better research performance?," Journal of Informetrics, Elsevier, vol. 5(4), pages 649-658.
    2. Sandström, Ulf & Van den Besselaar, Peter, 2018. "Funding, evaluation, and the performance of national research systems," Journal of Informetrics, Elsevier, vol. 12(1), pages 365-384.
    3. Henk F. Moed, 2017. "A critical comparative analysis of five world university rankings," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 967-990, February.
    4. Bjørn Stensaker, 2018. "University Alliances: Enhancing Control, Capacity, and Creativity in Dynamic Environments," Voprosy obrazovaniya / Educational Studies Moscow, National Research University Higher School of Economics, issue 1, pages 132-153.
    5. Feng Li & Yong Yi & Xiaolong Guo & Wei Qi, 2012. "Performance evaluation of research universities in Mainland China, Hong Kong and Taiwan: based on a two-dimensional approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 90(2), pages 531-542, February.
    6. Arega Yirdaw, 2016. "Quality of Education in Private Higher Institutions in Ethiopia," SAGE Open, , vol. 6(1), pages 21582440156, January.
    7. Adam, Edmund, 2020. "‘Governments base performance-based funding on global rankings indicators’: A global trend in higher education finance or a global rankings literature fiction? A comparative analysis of four performan," International Journal of Educational Development, Elsevier, vol. 76(C).
    8. Bonaccorsi, Andrea & Haddawy, Peter & Cicero, Tindaro & Hassan, Saeed-Ul, 2017. "The solitude of stars. An analysis of the distributed excellence model of European universities," Journal of Informetrics, Elsevier, vol. 11(2), pages 435-454.
    9. Daraio, Cinzia & Bonaccorsi, Andrea & Simar, Léopold, 2015. "Rankings and university performance: A conditional multidimensional approach," European Journal of Operational Research, Elsevier, vol. 244(3), pages 918-930.
    10. M. V. Puchkov, 2022. "University Campus: Interrelations of Educational Technologies and Models of Architectural Space Formation," University Management: Practice and Analysis, Federal State Autonomous Educational Institution of Higher Education «Ural Federal University named after the first President of Russia B.N.Yeltsin»; Non-Commercial Partnership “University Management: Practice and, vol. 25(4).
    11. Saisana, Michaela & d'Hombres, Béatrice & Saltelli, Andrea, 2011. "Rickety numbers: Volatility of university rankings and policy implications," Research Policy, Elsevier, vol. 40(1), pages 165-177, February.
    12. D. Docampo & D. Egret & L. Cram, 2015. "The effect of university mergers on the Shanghai ranking," Scientometrics, Springer;Akadémiai Kiadó, vol. 104(1), pages 175-191, July.
    13. Chirikov, Igor, 2016. "HOW GLOBAL COMPETITION IS CHANGING UNIVERSITIES: Three Theoretical Perspectives," University of California at Berkeley, Center for Studies in Higher Education qt50g3t797, Center for Studies in Higher Education, UC Berkeley.
    14. Shahid Yusuf & Kaoru Nabeshima, 2009. "Growth through Innovation : An Industrial Strategy for Shanghai," World Bank Publications - Reports 18613, The World Bank Group.
    15. Carmen Osuna & Laura Cruz Castro & Luis Sanz Menéndez, 2010. "Knocking down some Assumptions about the Effects of Evaluation Systems on Publications," Working Papers 1010, Instituto de Políticas y Bienes Públicos (IPP), CSIC.
    16. Sacha Lussier & Jean-François Chanlat, 2015. "L’évaluation des établissements d’enseignement et le rôle des enseignants-chercheurs en gestion : l’intériorisation institutionnelle de l’internationalisation," Post-Print hal-01655876, HAL.
    17. Chaocheng He & Jiang Wu & Qingpeng Zhang, 2021. "Characterizing research leadership on geographically weighted collaboration network," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(5), pages 4005-4037, May.
    18. Brigida Blasi & Sandra Romagnosi & Andrea Bonaccorsi, 2018. "Universities as celebrities? How the media select information from a large research assessment exercise," Science and Public Policy, Oxford University Press, vol. 45(4), pages 503-514.
    19. Чернова Е. Г. & Ахобадзе Т. Д. & Малова А. С. & Салтан А. А., 2017. "Модели Финансирования Высшего Образования И Эффективность Деятельности Университетов Эмпирическое Исследование Европейского Опыта И Отечественная Практика," Вопросы образования // Educational Studies Moscow, National Research University Higher School of Economics, issue 3, pages 37-82.
    20. Bennell, Paul, 2021. "The political economy of attaining Universal Primary Education in sub-Saharan Africa: The politics of UPE implementation," International Journal of Educational Development, Elsevier, vol. 80(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:88:y:2011:i:2:d:10.1007_s11192-011-0398-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.