IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v108y2016i3d10.1007_s11192-016-2037-8.html
   My bibliography  Save this article

Constructing a synthetic indicator of research activity

Author

Listed:
  • Teodoro Luque-Martínez

    (University of Granada)

  • Salvador Barrio-García

    (University of Granada)

Abstract

There are increasing demands on universities to operate transparently with regard how resources are being used and targets met, putting them under growing pressure to clarify their position relative to other universities at national and international level. But there are several challenges associated with establishing their relative positioning. The first issue is concerned with measurement or how to capture data that are relevant, pertinent and fit-for-purpose. Second, universities must obtain an overall indicator or a means of ordering that helps synthesize the different indicators; and, third, they must decide how to weight them. Those university rankings that attempt to address these questions are met with a degree of criticism for being subjective or inconsistent in their quantification of the indicators. The aim of the present work is to develop a procedure for synthesizing all of the indicators relating to the objective measurement of university R&D and innovation into a single or summary concept. In other words, to establish a procedure that does not require subjective criteria and that can be applied for both absolute and relativized indicators. This approach makes a dual contribution. First, a specific application, in this particular case for the case of the Spanish university system, will be created, to obtain a synthetic indicator for research activity. This will enable us to achieve an R&D and innovation ranking for Spanish universities. Second, the work makes a methodological contribution by using a new technique for synthesizing this type of indicator, namely Partial Least Squares (PLS).

Suggested Citation

  • Teodoro Luque-Martínez & Salvador Barrio-García, 2016. "Constructing a synthetic indicator of research activity," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(3), pages 1049-1064, September.
  • Handle: RePEc:spr:scient:v:108:y:2016:i:3:d:10.1007_s11192-016-2037-8
    DOI: 10.1007/s11192-016-2037-8
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-016-2037-8
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11192-016-2037-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Elias Carayannis & David Campbell, 2011. "Open Innovation Diplomacy and a 21st Century Fractal Research, Education and Innovation (FREIE) Ecosystem: Building on the Quadruple and Quintuple Helix Innovation Concepts and the “Mode 3” Knowledge ," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 2(3), pages 327-372, September.
    2. Philippe Aghion & Mathias Dewatripont & Caroline Hoxby & Andreu Mas-Colell & André Sapir, 2010. "The governance and performance of universities: evidence from Europe and the US [Distance to frontier, selection, and economic growth]," Economic Policy, CEPR, CESifo, Sciences Po;CES;MSH, vol. 25(61), pages 7-59.
    3. Domingo Docampo, 2011. "On using the Shanghai ranking to assess the research performance of university systems," Scientometrics, Springer;Akadémiai Kiadó, vol. 86(1), pages 77-92, January.
    4. Feng Li & Yong Yi & Xiaolong Guo & Wei Qi, 2012. "Performance evaluation of research universities in Mainland China, Hong Kong and Taiwan: based on a two-dimensional approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 90(2), pages 531-542, February.
    5. Domingo Docampo, 2012. "Adjusted sum of institutional scores as an indicator of the presence of university systems in the ARWU ranking," Scientometrics, Springer;Akadémiai Kiadó, vol. 90(2), pages 701-713, February.
    6. Ludo Waltman & Clara Calero-Medina & Joost Kosten & Ed C.M. Noyons & Robert J.W. Tijssen & Nees Jan Eck & Thed N. Leeuwen & Anthony F.J. Raan & Martijn S. Visser & Paul Wouters, 2012. "The Leiden ranking 2011/2012: Data collection, indicators, and interpretation," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(12), pages 2419-2432, December.
    7. Jia Zhu & Saeed-Ul Hassan & Hamid Turab Mirza & Qing Xie, 2014. "Measuring recent research performance for Chinese universities using bibliometric methods," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(1), pages 429-443, October.
    8. Domingo Docampo, 2011. "Erratum to: On using the Shanghai ranking to assess the research performance of university systems," Scientometrics, Springer;Akadémiai Kiadó, vol. 86(1), pages 237-237, January.
    9. J.A. García & Rosa Rodríguez-Sánchez & J. Fdez-Valdivia & N. Robinson-García & D. Torres-Salinas, 2012. "Mapping academic institutions according to their journal publication profile: Spanish universities as a case study," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(11), pages 2328-2340, November.
    10. Kuang-hua Chen & Pei-yu Liao, 2012. "A comparative study on world university rankings: a bibliometric survey," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(1), pages 89-103, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nicolás Robinson-García & Daniel Torres-Salinas & Emilio Delgado López-Cózar & Francisco Herrera, 2014. "An insight into the importance of national university rankings in an international context: the case of the I-UGR rankings of Spanish universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(2), pages 1309-1324, November.
    2. Domingo Docampo & Lawrence Cram, 2014. "On the internal dynamics of the Shanghai ranking," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(2), pages 1347-1366, February.
    3. Gul, Muhammet & Yucesan, Melih, 2022. "Performance evaluation of Turkish Universities by an integrated Bayesian BWM-TOPSIS model," Socio-Economic Planning Sciences, Elsevier, vol. 80(C).
    4. Massucci, Francesco Alessandro & Docampo, Domingo, 2019. "Measuring the academic reputation through citation networks via PageRank," Journal of Informetrics, Elsevier, vol. 13(1), pages 185-201.
    5. Olcay, Gokcen Arkali & Bulu, Melih, 2017. "Is measuring the knowledge creation of universities possible?: A review of university rankings," Technological Forecasting and Social Change, Elsevier, vol. 123(C), pages 153-160.
    6. Milica Jovanovic & Veljko Jeremic & Gordana Savic & Milica Bulajic & Milan Martic, 2012. "How does the normalization of data affect the ARWU ranking?," Scientometrics, Springer;Akadémiai Kiadó, vol. 93(2), pages 319-327, November.
    7. Domingo Docampo & Lawrence Cram, 2017. "Academic performance and institutional resources: a cross-country analysis of research universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 739-764, February.
    8. Vicente Safón, 2013. "What do global university rankings really measure? The search for the X factor and the X entity," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(2), pages 223-244, November.
    9. Pin-Hua Lin & Jong-Rong Chen & Chih-Hai Yang, 2014. "Academic research resources and academic quality: a cross-country analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(1), pages 109-123, October.
    10. Mehdi Rhaiem & Nabil Amara, 2020. "Determinants of research efficiency in Canadian business schools: evidence from scholar-level data," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 53-99, October.
    11. Leporia, Benedetto & Geuna, Aldo & Mira, Antonietta, 2018. "Scientific Output of US and European Universities Scales Super-linearly with Resources," Department of Economics and Statistics Cognetti de Martiis LEI & BRICK - Laboratory of Economics of Innovation "Franco Momigliano", Bureau of Research in Innovation, Complexity and Knowledge, Collegio 201806, University of Turin.
    12. Gnewuch, Matthias & Wohlrabe, Klaus, 2018. "Super-efficiency of education institutions: an application to economics departments," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 26, pages 610-623.
    13. Avenali, Alessandro & Daraio, Cinzia & Di Leo, Simone & Wolszczak-Derlacz, Joanna, 2024. "Heterogeneity of national accounting systems, world-class universities and financial resources: What are the links?," Journal of Informetrics, Elsevier, vol. 18(2).
    14. Seiler, Christian & Wohlrabe, Klaus, 2013. "Archetypal scientists," Journal of Informetrics, Elsevier, vol. 7(2), pages 345-356.
    15. Yi Zhang & Mingting Kou & Kaihua Chen & Jiancheng Guan & Yuchen Li, 2016. "Modelling the Basic Research Competitiveness Index (BR-CI) with an application to the biomass energy field," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(3), pages 1221-1241, September.
    16. Veljko Jeremic & Milica Bulajic & Milan Martic & Zoran Radojicic, 2011. "A fresh approach to evaluating the academic ranking of world universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 87(3), pages 587-596, June.
    17. Benedetto, Lepori & Geuna, Aldo & Veglio, Valerio, 2017. "A Typology of European Universities. Differentiation and resource distribution," Department of Economics and Statistics Cognetti de Martiis. Working Papers 201705, University of Turin.
    18. Frode Eika Sandnes, 2021. "Everyone onboard? Participation ratios as a metric for research activity assessments within young universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 6105-6113, July.
    19. Maryam Moshtagh & Tahereh Jowkar & Maryam Yaghtin & Hajar Sotudeh, 2023. "The moderating effect of altmetrics on the correlations between single and multi-faceted university ranking systems: the case of THE and QS vs. Nature Index and Leiden," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(1), pages 761-781, January.
    20. Seiler, Christian & Wohlrabe, Klaus, 2012. "Ranking economists on the basis of many indicators: An alternative approach using RePEc data," Journal of Informetrics, Elsevier, vol. 6(3), pages 389-402.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:108:y:2016:i:3:d:10.1007_s11192-016-2037-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.