IDEAS home Printed from https://ideas.repec.org/a/spr/qualqt/v58y2024i6d10.1007_s11135-024-01904-y.html
   My bibliography  Save this article

Development of university ranking scale for higher education institutions

Author

Listed:
  • Tayyaba Rafique

    (University of the Punjab)

  • Muhammad Usman Awan

    (University of the Punjab)

  • Muhammad Shafiq

    (University of the Punjab
    University of the Punjab)

  • Khalid Mahmood

    (University of the Punjab)

Abstract

This empirical investigation was aimed at conceptualizing, developing and validating a scale for the measurement of university performance. Following the 3-step scale development process and utilizing the mix method, items were identified from the literature in the first step. Theoretical analysis was performed in the second step to check the content validity using focus groups, semi-structured interviews, and expert opinions. In the third step, the scale was empirically tested by collecting data from 317 respondents (QEC members, faculty of universities, and postgraduate students). Exploratory and confirmatory factor analyses psychometrically checked the convergent and discriminant validity of the items, and seven criteria and 30 indicators scale consist of quality of education, research, alumni satisfaction, student satisfaction, social interaction, governance, and digital presence. Psychometrically, the scale demonstrates internal consistency and passes reliability and validity tests (construct, convergent, and discriminant). The study provides a theoretical foundation for university ranking criteria and indicators, which will help academicians, administrators, and regulators to design a process-oriented system to evaluate performance in higher education institutions (HEI) and eventually by adopting, Pakistan’s HEI will improve their ranking in other ranking systems as well.

Suggested Citation

  • Tayyaba Rafique & Muhammad Usman Awan & Muhammad Shafiq & Khalid Mahmood, 2024. "Development of university ranking scale for higher education institutions," Quality & Quantity: International Journal of Methodology, Springer, vol. 58(6), pages 5715-5735, December.
    • Handle: RePEc:spr:qualqt:v:58:y:2024:i:6:d:10.1007_s11135-024-01904-y
    DOI: 10.1007/s11135-024-01904-y
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11135-024-01904-y
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11135-024-01904-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Perianes-Rodriguez, Antonio & Ruiz-Castillo, Javier, 2015. "Multiplicative versus fractional counting methods for co-authored publications. The case of the 500 universities in the Leiden Ranking," Journal of Informetrics, Elsevier, vol. 9(4), pages 974-989.
    2. Murat Perit Çakır & Cengiz Acartürk & Oğuzhan Alaşehir & Canan Çilingir, 2015. "A comparative analysis of global and national university ranking systems," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(3), pages 813-848, June.
    3. Sakchai Jarernsiripornkul & I.M. Pandey, 2018. "Governance of autonomous universities: case of Thailand," Journal of Advances in Management Research, Emerald Group Publishing Limited, vol. 15(3), pages 288-305, May.
    4. Murat Tezer & Ezgi Pelin Yildiz & Hüseyin Uzunboylu, 2018. "Online authentic learning self-efficacy: a scale development," Quality & Quantity: International Journal of Methodology, Springer, vol. 52(1), pages 639-649, December.
    5. Vishal Singh Patyal & Maddulety Koilakuntla, 2015. "Infrastructure and core quality practices in Indian manufacturing organizations," Journal of Advances in Management Research, Emerald Group Publishing Limited, vol. 12(2), pages 141-175, August.
    6. Tanveer, Muhammad & Mahmood, Haider & Haq, Ikram Ul & Rather, Raouf Ahmad & Ali, Haider, 2021. "Higher Education Quality Assurance Framework Pathway for Transformation in Pakistan: Managerial and Economic Perspectives," MPRA Paper 109253, University Library of Munich, Germany.
    7. Fredrik Niclas Piro & Gunnar Sivertsen, 2016. "How can differences in international university rankings be explained?," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 2263-2278, December.
    8. Fazeelat Noreen & Bashir Hussain, 2019. "HEC Ranking Criteria in the Perspective of Global University Ranking Systems," Global Social Sciences Review, Humanity Only, vol. 4(2), pages 59-70, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Vicente Safón, 2019. "Inter-ranking reputational effects: an analysis of the Academic Ranking of World Universities (ARWU) and the Times Higher Education World University Rankings (THE) reputational relationship," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(2), pages 897-915, November.
    2. Antonio Fernández-Cano & Elvira Curiel-Marin & Manuel Torralbo-Rodríguez & Mónica Vallejo-Ruiz, 2018. "Questioning the Shanghai Ranking methodology as a tool for the evaluation of universities: an integrative review," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 2069-2083, September.
    3. Wu, Jiang & Ou, Guiyan & Liu, Xiaohui & Dong, Ke, 2022. "How does academic education background affect top researchers’ performance? Evidence from the field of artificial intelligence," Journal of Informetrics, Elsevier, vol. 16(2).
    4. Mehdi Rhaiem & Nabil Amara, 2020. "Determinants of research efficiency in Canadian business schools: evidence from scholar-level data," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 53-99, October.
    5. Zsolt Kohus & Márton Demeter & László Kun & Eszter Lukács & Katalin Czakó & Gyula Péter Szigeti, 2022. "A Study of the Relation between Byline Positions of Affiliated/Non-Affiliated Authors and the Scientific Impact of European Universities in Times Higher Education World University Rankings," Sustainability, MDPI, vol. 14(20), pages 1-14, October.
    6. Yan, Weiwei & Zhang, Yin, 2018. "Research universities on the ResearchGate social networking site: An examination of institutional differences, research activity level, and social networks formed," Journal of Informetrics, Elsevier, vol. 12(1), pages 385-400.
    7. Dmitry Kochetkov, 2023. "Review of the Russian-language academic literature on university rankings and a global perspective," Palgrave Communications, Palgrave Macmillan, vol. 10(1), pages 1-11, December.
    8. Ruiz-Castillo, Javier & Costas, Rodrigo, 2018. "Individual and field citation distributions in 29 broad scientific fields," Journal of Informetrics, Elsevier, vol. 12(3), pages 868-892.
    9. Zorica Lazić & Aleksandar Đorđević & Albina Gazizulina, 2021. "Improvement of Quality of Higher Education Institutions as a Basis for Improvement of Quality of Life," Sustainability, MDPI, vol. 13(8), pages 1-27, April.
    10. Ertugrul Ayyildiz & Mirac Murat & Gul Imamoglu & Yildiz Kose, 2023. "A novel hybrid MCDM approach to evaluate universities based on student perspective," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(1), pages 55-86, January.
    11. Pei Chen & Shan Gao & Fan Jiang & Yifang Ma, 2024. "Measuring the labor market outcomes of universities: evidence from China’s listed company executives," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(9), pages 5715-5730, September.
    12. Gerhard Reichmann & Christian Schlögl, 2022. "On the possibilities of presenting the research performance of an institute over a long period of time: the case of the Institute of Information Science at the University of Graz in Austria," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3193-3223, June.
    13. Neszveda, Gábor & Horváth, Zsófia, 2024. "Új szempont a magyar felsőoktatási intézmények teljesítményének mérésében - az egyetemek online láthatósága [Online visibility - A new aspect of measuring the performance of Hungarian higher educat," Közgazdasági Szemle (Economic Review - monthly of the Hungarian Academy of Sciences), Közgazdasági Szemle Alapítvány (Economic Review Foundation), vol. 0(7), pages 755-790.
    14. Yang Zhang & Yu Xiao & Jun Wu & Xin Lu, 2021. "Comprehensive world university ranking based on ranking aggregation," Computational Statistics, Springer, vol. 36(2), pages 1139-1152, June.
    15. McAleer, M.J. & Nakamura, T. & Watkins, C., 2018. "Size, Internationalization and University Rankings: Evaluating Times Higher Education (THE) Data for Japan," Econometric Institute Research Papers EI2018-43, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    16. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    17. Dag W. Aksnes & Liv Langfeldt & Paul Wouters, 2019. "Citations, Citation Indicators, and Research Quality: An Overview of Basic Concepts and Theories," SAGE Open, , vol. 9(1), pages 21582440198, February.
    18. Angel Meseguer-Martinez & Alejandro Ros-Galvez & Alfonso Rosa-Garcia & Jose Antonio Catalan-Alarcon, 2019. "Online video impact of world class universities," Electronic Markets, Springer;IIM University of St. Gallen, vol. 29(3), pages 519-532, September.
    19. Zsolt Tibor Kosztyán & Beáta Fehérvölgyi & Tibor Csizmadia & Kinga Kerekes, 2021. "Investigating collaborative and mobility networks: reflections on the core missions of universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 3551-3564, April.
    20. Vicente Safón & Domingo Docampo, 2020. "Analyzing the impact of reputational bias on global university rankings based on objective research performance data: the case of the Shanghai Ranking (ARWU)," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2199-2227, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:qualqt:v:58:y:2024:i:6:d:10.1007_s11135-024-01904-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.