IDEAS home Printed from https://ideas.repec.org/a/sae/sagope/v14y2024i2p21582440241257753.html
   My bibliography  Save this article

Research performance of higher education in OECD countries: A hybrid multi-criteria decision-making approach

Author

Listed:
  • Muammer Maral

Abstract

This study aims to analyze the research performance of 38 OECD countries in the last 10 years. For this purpose, the research performance of these countries was analyzed using multi-criteria decision-making (MCDM) methods with the productivity and publication impact data of 38 countries. The analyses were conducted both normal data and also with adjusted data based on the population and income level of the countries. Firstly, the importance level of research performance criteria was determined by three different MCDM methods. Using the weight values obtained from these methods, countries were ranked by three different MCDM methods used for ranking purposes. According to the results of the study, the publications in the highest cited 1% were determined as the most important and distinctive criterion. Secondly, the criterion expressing the relative impact of publications on the world was determined as the second most important criterion. In the analyses conducted without normalizing the data, USA showed the highest research performance. In the analyses conducted by considering the population of the countries, Switzerland showed the highest research performance. In the analyses conducted by taking into account the income level of the countries, Estonia has the highest research performance. As R&D expenditures, development level of countries and international collaboration increased, research performance of countries increased. However, with the increase in domestic collaboration, there has been a decrease in research performance. In addition, this research has shown how to use MCDM in the measurement of research performance by using objective methods with different backgrounds.

Suggested Citation

  • Muammer Maral, 2024. "Research performance of higher education in OECD countries: A hybrid multi-criteria decision-making approach," SAGE Open, , vol. 14(2), pages 21582440241, June.
  • Handle: RePEc:sae:sagope:v:14:y:2024:i:2:p:21582440241257753
    DOI: 10.1177/21582440241257753
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/21582440241257753
    Download Restriction: no

    File URL: https://libkey.io/10.1177/21582440241257753?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Abbas Mardani & Ahmad Jusoh & Khalil MD Nor & Zainab Khalifah & Norhayati Zakwan & Alireza Valipour, 2015. "Multiple criteria decision-making techniques and their applications – a review of the literature from 2000 to 2014," Economic Research-Ekonomska Istraživanja, Taylor & Francis Journals, vol. 28(1), pages 516-571, January.
    2. Harvey Goldstein, 2011. "Estimating research performance by using research grant award gradings," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 174(1), pages 83-93, January.
    3. Mutz, Rüdiger & Bornmann, Lutz & Daniel, Hans-Dieter, 2017. "Are there any frontiers of research performance? Efficiency measurement of funded research projects with the Bayesian stochastic frontier analysis for count data," Journal of Informetrics, Elsevier, vol. 11(3), pages 613-628.
    4. Johnes, Jill & Yu, Li, 2008. "Measuring the research performance of Chinese higher education institutions using data envelopment analysis," China Economic Review, Elsevier, vol. 19(4), pages 679-696, December.
    5. Ann Martin-Sardesai & Helen Irvine & Stuart Tooley & James Guthrie, 2017. "Accounting for Research: Academic Responses to Research Performance Demands in an Australian University," Australian Accounting Review, CPA Australia, vol. 27(3), pages 329-343, September.
    6. Michael Dummett, 1998. "The Borda count and agenda manipulation," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 15(2), pages 289-296.
    7. Giovanni Abramo & Ciriaco Andrea D’Angelo & Fabio Pugini, 2008. "The measurement of Italian universities’ research productivity by a non parametric-bibliometric methodology," Scientometrics, Springer;Akadémiai Kiadó, vol. 76(2), pages 225-244, August.
    8. Michael Fritsch & Viktor Slavtchev, 2007. "Universities and Innovation in Space," Industry and Innovation, Taylor & Francis Journals, vol. 14(2), pages 201-218.
    9. Domingo Docampo & Jean-Jacques Bessoule, 2019. "A new approach to the analysis and evaluation of the research output of countries and institutions," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 1207-1225, May.
    10. Chiang Kao & Hwei-Lan Pao, 2009. "An evaluation of research performance in management of 168 Taiwan universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 78(2), pages 261-277, February.
    11. Ho, William, 2008. "Integrated analytic hierarchy process and its applications - A literature review," European Journal of Operational Research, Elsevier, vol. 186(1), pages 211-228, April.
    12. Alireza Alinezhad & Javad Khalili, 2019. "New Methods and Applications in Multiple Attribute Decision Making (MADM)," International Series in Operations Research and Management Science, Springer, number 978-3-030-15009-9, April.
    13. Jyrki Wallenius & James S. Dyer & Peter C. Fishburn & Ralph E. Steuer & Stanley Zionts & Kalyanmoy Deb, 2008. "Multiple Criteria Decision Making, Multiattribute Utility Theory: Recent Accomplishments and What Lies Ahead," Management Science, INFORMS, vol. 54(7), pages 1336-1349, July.
    14. Bárbara S. Lancho Barrantes & Vicente P. Guerrero Bote & Zaida Chinchilla Rodríguez & Félix de Moya Anegón, 2012. "Citation flows in the zones of influence of scientific collaborations," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 63(3), pages 481-489, March.
    15. Gulbrandsen, Magnus & Smeby, Jens-Christian, 2005. "Industry funding and university professors' research performance," Research Policy, Elsevier, vol. 34(6), pages 932-950, August.
    16. Jingda Ding & Chao Liu & Goodluck Asobenie Kandonga, 2020. "Exploring the limitations of the h-index and h-type indexes in measuring the research performance of authors," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(3), pages 1303-1322, March.
    17. Young-Hwan Lee, 2021. "Determinants of research productivity in Korean Universities: the role of research funding," The Journal of Technology Transfer, Springer, vol. 46(5), pages 1462-1486, October.
    18. Christoph Emanuel Mueller, 2016. "Accurate forecast of countries’ research output by macro-level indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(2), pages 1307-1328, November.
    19. Lucília Cardoso & Rui Silva & Giovana Goretti Feijó de Almeida & Luís Lima Santos, 2020. "A Bibliometric Model to Analyze Country Research Performance: SciVal Topic Prominence Approach in Tourism, Leisure and Hospitality," Sustainability, MDPI, vol. 12(23), pages 1-26, November.
    20. Wagner, Caroline S. & Whetsell, Travis A. & Mukherjee, Satyam, 2019. "International research collaboration: Novelty, conventionality, and atypicality in knowledge recombination," Research Policy, Elsevier, vol. 48(5), pages 1260-1270.
    21. Yu-Wei Chang & Dar-Zen Chen & Mu-Hsuan Huang, 2020. "Discovering types of research performance of scientists with significant contributions," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(2), pages 1529-1552, August.
    22. Katerina Anne Lai & Gaurav Saxena & Peter J. Allen, 2022. "Research performance of academic psychologists in the United Kingdom," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(7), pages 4139-4166, July.
    23. Jiancheng Guan & Nan Ma, 2004. "A comparative study of research performance in computer science," Scientometrics, Springer;Akadémiai Kiadó, vol. 61(3), pages 339-359, November.
    24. Anh Nguyen Quoc & Minh Thang Le & Hiep-Hung Pham, 2021. "The Impact of the Third Mission on Teaching and Research Performance: Evidence From Academic Scholars in an Emerging Country," SAGE Open, , vol. 11(4), pages 21582440211, October.
    25. Ghassan Abdul-Majeed & Wissam Mahmood & Nasri S. M. Namer, 2021. "Measuring research performance of Iraqi universities using Scopus data," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(3), pages 2349-2363, March.
    26. Abbas Valadkhani & Simon Ville, 2010. "Ranking and clustering of the faculties of commerce research performance in Australia," Applied Economics, Taylor & Francis Journals, vol. 42(22), pages 2881-2895.
    27. Luigi Aldieri & Maxim N. Kotsemir & Concetto Paolo Vinci, 2020. "The Effects of Collaboration on Research Performance of Universities: an Analysis by Federal District and Scientific Fields in Russia," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 11(2), pages 766-787, June.
    28. Shaun Goldfinch & Tony Dale & Karl DeRouen, 2003. "Science from the periphery: Collaboration, networks and 'Periphery Effects' in the citation of New Zealand Crown Research Institutes articles, 1995-2000," Scientometrics, Springer;Akadémiai Kiadó, vol. 57(3), pages 321-337, July.
    29. Dag W Aksnes, 2003. "Characteristics of highly cited papers," Research Evaluation, Oxford University Press, vol. 12(3), pages 159-170, December.
    30. Sakiru Adebola Solarin & Yuen Yee Yen, 2016. "A global analysis of the impact of research output on economic growth," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(2), pages 855-874, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Muammer Maral, 2024. "Research performance of higher education institutions in Türkiye: 1980–2022," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(8), pages 4771-4793, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Muammer Maral, 2024. "Research performance of higher education institutions in Türkiye: 1980–2022," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(8), pages 4771-4793, August.
    2. Dongqing Lyu & Kaile Gong & Xuanmin Ruan & Ying Cheng & Jiang Li, 2021. "Does research collaboration influence the “disruption” of articles? Evidence from neurosciences," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(1), pages 287-303, January.
    3. Iman Tahamtan & Askar Safipour Afshar & Khadijeh Ahamdzadeh, 2016. "Factors affecting number of citations: a comprehensive review of the literature," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(3), pages 1195-1225, June.
    4. Barbara S. Lancho-Barrantes & Hector G. Ceballos-Cancino & Francisco J. Cantu-Ortiz, 2021. "Comparing the efficiency of countries to assimilate and apply research investment," Quality & Quantity: International Journal of Methodology, Springer, vol. 55(4), pages 1347-1369, August.
    5. Tamara Krajna & Jelka Petrak, 2019. "Croatian Highly Cited Papers," Interdisciplinary Description of Complex Systems - scientific journal, Croatian Interdisciplinary Society Provider Homepage: http://indecs.eu, vol. 17(3-B), pages 684-696.
    6. Ana María Gómez-Aguayo & Joaquín M. Azagra-Caro & Carlos Benito-Amat, 2024. "The steady effect of knowledge co-creation with universities on business scientific impact throughout the economic cycle," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(5), pages 2771-2799, May.
    7. Waleed M. Sweileh & Sa’ed H. Zyoud & Suleiman Al-Khalil & Samah W. Al-Jabi & Ansam F. Sawalha, 2014. "Assessing the Scientific Research Productivity of the Palestinian Higher Education Institutions," SAGE Open, , vol. 4(3), pages 21582440145, July.
    8. Lei Ye & Gang Zeng & Xianzhong Cao, 2020. "Open innovation and innovative performance of universities: Evidence from China," Growth and Change, Wiley Blackwell, vol. 51(3), pages 1142-1157, September.
    9. Tanel Hirv, 2022. "The interplay of the size of the research system, ways of collaboration, level, and method of funding in determining bibliometric outputs," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(3), pages 1295-1316, March.
    10. Didegah, Fereshteh & Thelwall, Mike, 2013. "Which factors help authors produce the highest impact research? Collaboration, journal and document properties," Journal of Informetrics, Elsevier, vol. 7(4), pages 861-873.
    11. Mehmet Pinar, 2023. "Do research performances of universities and disciplines in England converge or diverge? An assessment of the progress between research excellence frameworks in 2014 and 2021," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(10), pages 5731-5766, October.
    12. Jielan Ding & Zhesi Shen & Per Ahlgren & Tobias Jeppsson & David Minguillo & Johan Lyhagen, 2021. "The link between ethnic diversity and scientific impact: the mediating effect of novelty and audience diversity," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 7759-7810, September.
    13. Kayvan Kousha & Mike Thelwall, 2024. "Factors associating with or predicting more cited or higher quality journal articles: An Annual Review of Information Science and Technology (ARIST) paper," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 75(3), pages 215-244, March.
    14. Jose Martino Neto & Valerio Antonio Pamplona Salomon & Miguel Angel Ortiz-Barrios & Antonella Petrillo, 2023. "Compatibility and correlation of multi-attribute decision making: a case of industrial relocation," Annals of Operations Research, Springer, vol. 326(2), pages 831-852, July.
    15. Mehmet Ali Koseoglu, 2016. "Mapping the institutional collaboration network of strategic management research: 1980–2014," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(1), pages 203-226, October.
    16. Ziyan Zhang & Junyan Zhang & Pushi Wang, 2024. "Measurement of disruptive innovation and its validity based on improved disruption index," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(11), pages 6477-6531, November.
    17. Chiang Kao & Shiang-Tai Liu & Hwei-Lan Pao, 2012. "Assessing improvement in management research in Taiwan," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(1), pages 75-87, July.
    18. Davide Vurchio & Anna Giunta, 2021. "The impact of the Italian Space Agency on scientific knowledge: Evidence from academic publications," Annals of Public and Cooperative Economics, Wiley Blackwell, vol. 92(3), pages 511-529, September.
    19. David Ruiz Bargueño & Valerio Antonio Pamplona Salomon & Fernando Augusto Silva Marins & Pedro Palominos & Luis Armando Marrone, 2021. "State of the Art Review on the Analytic Hierarchy Process and Urban Mobility," Mathematics, MDPI, vol. 9(24), pages 1-13, December.
    20. Bárbara S. Lancho-Barrantes & Vicente P. Guerrero-Bote & Félix Moya-Anegón, 2013. "Citation increments between collaborating countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(3), pages 817-831, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:sagope:v:14:y:2024:i:2:p:21582440241257753. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.