IDEAS home Printed from https://ideas.repec.org/a/sae/sagope/v14y2024i2p21582440241257753.html
   My bibliography  Save this article

Research performance of higher education in OECD countries: A hybrid multi-criteria decision-making approach

Author

Listed:
  • Muammer Maral

Abstract

This study aims to analyze the research performance of 38 OECD countries in the last 10 years. For this purpose, the research performance of these countries was analyzed using multi-criteria decision-making (MCDM) methods with the productivity and publication impact data of 38 countries. The analyses were conducted both normal data and also with adjusted data based on the population and income level of the countries. Firstly, the importance level of research performance criteria was determined by three different MCDM methods. Using the weight values obtained from these methods, countries were ranked by three different MCDM methods used for ranking purposes. According to the results of the study, the publications in the highest cited 1% were determined as the most important and distinctive criterion. Secondly, the criterion expressing the relative impact of publications on the world was determined as the second most important criterion. In the analyses conducted without normalizing the data, USA showed the highest research performance. In the analyses conducted by considering the population of the countries, Switzerland showed the highest research performance. In the analyses conducted by taking into account the income level of the countries, Estonia has the highest research performance. As R&D expenditures, development level of countries and international collaboration increased, research performance of countries increased. However, with the increase in domestic collaboration, there has been a decrease in research performance. In addition, this research has shown how to use MCDM in the measurement of research performance by using objective methods with different backgrounds.

Suggested Citation

  • Muammer Maral, 2024. "Research performance of higher education in OECD countries: A hybrid multi-criteria decision-making approach," SAGE Open, , vol. 14(2), pages 21582440241, June.
  • Handle: RePEc:sae:sagope:v:14:y:2024:i:2:p:21582440241257753
    DOI: 10.1177/21582440241257753
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/21582440241257753
    Download Restriction: no

    File URL: https://libkey.io/10.1177/21582440241257753?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Bárbara S. Lancho Barrantes & Vicente P. Guerrero Bote & Zaida Chinchilla Rodríguez & Félix de Moya Anegón, 2012. "Citation flows in the zones of influence of scientific collaborations," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 63(3), pages 481-489, March.
    2. Johnes, Jill & Yu, Li, 2008. "Measuring the research performance of Chinese higher education institutions using data envelopment analysis," China Economic Review, Elsevier, vol. 19(4), pages 679-696, December.
    3. Gulbrandsen, Magnus & Smeby, Jens-Christian, 2005. "Industry funding and university professors' research performance," Research Policy, Elsevier, vol. 34(6), pages 932-950, August.
    4. Jingda Ding & Chao Liu & Goodluck Asobenie Kandonga, 2020. "Exploring the limitations of the h-index and h-type indexes in measuring the research performance of authors," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(3), pages 1303-1322, March.
    5. Abbas Mardani & Ahmad Jusoh & Khalil MD Nor & Zainab Khalifah & Norhayati Zakwan & Alireza Valipour, 2015. "Multiple criteria decision-making techniques and their applications – a review of the literature from 2000 to 2014," Economic Research-Ekonomska Istraživanja, Taylor & Francis Journals, vol. 28(1), pages 516-571, January.
    6. Young-Hwan Lee, 2021. "Determinants of research productivity in Korean Universities: the role of research funding," The Journal of Technology Transfer, Springer, vol. 46(5), pages 1462-1486, October.
    7. Christoph Emanuel Mueller, 2016. "Accurate forecast of countries’ research output by macro-level indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(2), pages 1307-1328, November.
    8. Harvey Goldstein, 2011. "Estimating research performance by using research grant award gradings," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 174(1), pages 83-93, January.
    9. Lucília Cardoso & Rui Silva & Giovana Goretti Feijó de Almeida & Luís Lima Santos, 2020. "A Bibliometric Model to Analyze Country Research Performance: SciVal Topic Prominence Approach in Tourism, Leisure and Hospitality," Sustainability, MDPI, vol. 12(23), pages 1-26, November.
    10. Mutz, Rüdiger & Bornmann, Lutz & Daniel, Hans-Dieter, 2017. "Are there any frontiers of research performance? Efficiency measurement of funded research projects with the Bayesian stochastic frontier analysis for count data," Journal of Informetrics, Elsevier, vol. 11(3), pages 613-628.
    11. Michael Fritsch & Viktor Slavtchev, 2007. "Universities and Innovation in Space," Industry and Innovation, Taylor & Francis Journals, vol. 14(2), pages 201-218.
    12. Wagner, Caroline S. & Whetsell, Travis A. & Mukherjee, Satyam, 2019. "International research collaboration: Novelty, conventionality, and atypicality in knowledge recombination," Research Policy, Elsevier, vol. 48(5), pages 1260-1270.
    13. Yu-Wei Chang & Dar-Zen Chen & Mu-Hsuan Huang, 2020. "Discovering types of research performance of scientists with significant contributions," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(2), pages 1529-1552, August.
    14. Ann Martin-Sardesai & Helen Irvine & Stuart Tooley & James Guthrie, 2017. "Accounting for Research: Academic Responses to Research Performance Demands in an Australian University," Australian Accounting Review, CPA Australia, vol. 27(3), pages 329-343, September.
    15. Katerina Anne Lai & Gaurav Saxena & Peter J. Allen, 2022. "Research performance of academic psychologists in the United Kingdom," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(7), pages 4139-4166, July.
    16. Michael Dummett, 1998. "The Borda count and agenda manipulation," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 15(2), pages 289-296.
    17. Jiancheng Guan & Nan Ma, 2004. "A comparative study of research performance in computer science," Scientometrics, Springer;Akadémiai Kiadó, vol. 61(3), pages 339-359, November.
    18. Giovanni Abramo & Ciriaco Andrea D’Angelo & Fabio Pugini, 2008. "The measurement of Italian universities’ research productivity by a non parametric-bibliometric methodology," Scientometrics, Springer;Akadémiai Kiadó, vol. 76(2), pages 225-244, August.
    19. Anh Nguyen Quoc & Minh Thang Le & Hiep-Hung Pham, 2021. "The Impact of the Third Mission on Teaching and Research Performance: Evidence From Academic Scholars in an Emerging Country," SAGE Open, , vol. 11(4), pages 21582440211, October.
    20. Ghassan Abdul-Majeed & Wissam Mahmood & Nasri S. M. Namer, 2021. "Measuring research performance of Iraqi universities using Scopus data," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(3), pages 2349-2363, March.
    21. Domingo Docampo & Jean-Jacques Bessoule, 2019. "A new approach to the analysis and evaluation of the research output of countries and institutions," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 1207-1225, May.
    22. Chiang Kao & Hwei-Lan Pao, 2009. "An evaluation of research performance in management of 168 Taiwan universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 78(2), pages 261-277, February.
    23. Abbas Valadkhani & Simon Ville, 2010. "Ranking and clustering of the faculties of commerce research performance in Australia," Applied Economics, Taylor & Francis Journals, vol. 42(22), pages 2881-2895.
    24. Luigi Aldieri & Maxim N. Kotsemir & Concetto Paolo Vinci, 2020. "The Effects of Collaboration on Research Performance of Universities: an Analysis by Federal District and Scientific Fields in Russia," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 11(2), pages 766-787, June.
    25. Ho, William, 2008. "Integrated analytic hierarchy process and its applications - A literature review," European Journal of Operational Research, Elsevier, vol. 186(1), pages 211-228, April.
    26. Alireza Alinezhad & Javad Khalili, 2019. "New Methods and Applications in Multiple Attribute Decision Making (MADM)," International Series in Operations Research and Management Science, Springer, number 978-3-030-15009-9, July-Dece.
    27. Shaun Goldfinch & Tony Dale & Karl DeRouen, 2003. "Science from the periphery: Collaboration, networks and 'Periphery Effects' in the citation of New Zealand Crown Research Institutes articles, 1995-2000," Scientometrics, Springer;Akadémiai Kiadó, vol. 57(3), pages 321-337, July.
    28. Jyrki Wallenius & James S. Dyer & Peter C. Fishburn & Ralph E. Steuer & Stanley Zionts & Kalyanmoy Deb, 2008. "Multiple Criteria Decision Making, Multiattribute Utility Theory: Recent Accomplishments and What Lies Ahead," Management Science, INFORMS, vol. 54(7), pages 1336-1349, July.
    29. Dag W Aksnes, 2003. "Characteristics of highly cited papers," Research Evaluation, Oxford University Press, vol. 12(3), pages 159-170, December.
    30. Sakiru Adebola Solarin & Yuen Yee Yen, 2016. "A global analysis of the impact of research output on economic growth," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(2), pages 855-874, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Muammer Maral, 2024. "Research performance of higher education institutions in Türkiye: 1980–2022," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(8), pages 4771-4793, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Muammer Maral, 2024. "Research performance of higher education institutions in Türkiye: 1980–2022," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(8), pages 4771-4793, August.
    2. Dongqing Lyu & Kaile Gong & Xuanmin Ruan & Ying Cheng & Jiang Li, 2021. "Does research collaboration influence the “disruption” of articles? Evidence from neurosciences," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(1), pages 287-303, January.
    3. Iman Tahamtan & Askar Safipour Afshar & Khadijeh Ahamdzadeh, 2016. "Factors affecting number of citations: a comprehensive review of the literature," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(3), pages 1195-1225, June.
    4. Barbara S. Lancho-Barrantes & Hector G. Ceballos-Cancino & Francisco J. Cantu-Ortiz, 2021. "Comparing the efficiency of countries to assimilate and apply research investment," Quality & Quantity: International Journal of Methodology, Springer, vol. 55(4), pages 1347-1369, August.
    5. Ana María Gómez-Aguayo & Joaquín M. Azagra-Caro & Carlos Benito-Amat, 2024. "The steady effect of knowledge co-creation with universities on business scientific impact throughout the economic cycle," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(5), pages 2771-2799, May.
    6. Waleed M. Sweileh & Sa’ed H. Zyoud & Suleiman Al-Khalil & Samah W. Al-Jabi & Ansam F. Sawalha, 2014. "Assessing the Scientific Research Productivity of the Palestinian Higher Education Institutions," SAGE Open, , vol. 4(3), pages 21582440145, July.
    7. Lei Ye & Gang Zeng & Xianzhong Cao, 2020. "Open innovation and innovative performance of universities: Evidence from China," Growth and Change, Wiley Blackwell, vol. 51(3), pages 1142-1157, September.
    8. Didegah, Fereshteh & Thelwall, Mike, 2013. "Which factors help authors produce the highest impact research? Collaboration, journal and document properties," Journal of Informetrics, Elsevier, vol. 7(4), pages 861-873.
    9. Mehmet Ali Koseoglu, 2016. "Mapping the institutional collaboration network of strategic management research: 1980–2014," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(1), pages 203-226, October.
    10. Ziyan Zhang & Junyan Zhang & Pushi Wang, 2024. "Measurement of disruptive innovation and its validity based on improved disruption index," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(11), pages 6477-6531, November.
    11. Chiang Kao & Shiang-Tai Liu & Hwei-Lan Pao, 2012. "Assessing improvement in management research in Taiwan," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(1), pages 75-87, July.
    12. David Ruiz Bargueño & Valerio Antonio Pamplona Salomon & Fernando Augusto Silva Marins & Pedro Palominos & Luis Armando Marrone, 2021. "State of the Art Review on the Analytic Hierarchy Process and Urban Mobility," Mathematics, MDPI, vol. 9(24), pages 1-13, December.
    13. Bárbara S. Lancho-Barrantes & Vicente P. Guerrero-Bote & Félix Moya-Anegón, 2013. "Citation increments between collaborating countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(3), pages 817-831, March.
    14. Maite Barrios & Angel Borrego & Andreu Vilaginés & Candela Ollé & Marta Somoza, 2008. "A bibliometric study of psychological research on tourism," Scientometrics, Springer;Akadémiai Kiadó, vol. 77(3), pages 453-467, December.
    15. Kilian Buehling & Matthias Geissler & Dorothea Strecker, 2022. "Free access to scientific literature and its influence on the publishing activity in developing countries: The effect of Sci‐Hub in the field of mathematics," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 73(9), pages 1336-1355, September.
    16. Mike Thelwall & Kayvan Kousha & Mahshid Abdoli & Emma Stuart & Meiko Makita & Paul Wilson & Jonathan Levitt, 2023. "Why are coauthored academic articles more cited: Higher quality or larger audience?," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 74(7), pages 791-810, July.
    17. Lars Herberholz & Berthold U. Wigger, 2020. "Efficiency of European Universities: A Comparison of Peers," CESifo Working Paper Series 8044, CESifo.
    18. Hongquan Shen & Juan Xie & Jiang Li & Ying Cheng, 2021. "The correlation between scientific collaboration and citation count at the paper level: a meta-analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 3443-3470, April.
    19. Xu, Xu & Reed, Markum, 2021. "The impact of internet access on research output - a cross-country study," Information Economics and Policy, Elsevier, vol. 56(C).
    20. Giannis Karagiannis & Georgia Paschalidou, 2017. "Assessing research effectiveness: a comparison of alternative nonparametric models," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 456-468, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:sagope:v:14:y:2024:i:2:p:21582440241257753. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.