IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v89y2021ics0149718921000793.html
   My bibliography  Save this article

A proposed multistage evaluation approach for Higher Education Institutions based on network Data envelopment analysis: A Brazilian experience

Author

Listed:
  • Tavares, Rafael Santos
  • Angulo-Meza, Lidia
  • Sant'Anna, Annibal Parracho

Abstract

The evaluation of Higher Education Institutions (HEIs) is a challenging task, due to the complexity inherent in the context in which they are inserted, the different institutional profiles, the variety of resources used and the results offered in the performance of their mission. In this way, the present study proposes an evaluative approach that aims to measure efficiency taking into account the diverse activities characteristic of university institutions. To this end, a data envelopment analysis (DEA) approach, known as Network DEA, is used, which encompasses the different processes and subprocesses that take place within these institutions. In all, the evaluation considers eleven variables organized in three distinct stages, which reflect the performance of the HEIs in different perspectives: financial, undergraduate level and graduate level (student training and scientific production and innovation). Finally, the model was applied at 45 Brazilian federal universities. This case study allows a comprehensive efficiency analysis to be carried out for the set of institutions considered, from each perspective taken into account in the approach.

Suggested Citation

  • Tavares, Rafael Santos & Angulo-Meza, Lidia & Sant'Anna, Annibal Parracho, 2021. "A proposed multistage evaluation approach for Higher Education Institutions based on network Data envelopment analysis: A Brazilian experience," Evaluation and Program Planning, Elsevier, vol. 89(C).
    • Handle: RePEc:eee:epplan:v:89:y:2021:i:c:s0149718921000793
    DOI: 10.1016/j.evalprogplan.2021.101984
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718921000793
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.evalprogplan.2021.101984?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Johnes, Jill & Yu, Li, 2008. "Measuring the research performance of Chinese higher education institutions using data envelopment analysis," China Economic Review, Elsevier, vol. 19(4), pages 679-696, December.
    2. Tyagi, Preeti & Yadav, Shiv Prasad & Singh, S.P., 2009. "Relative performance of academic departments using DEA with sensitivity analysis," Evaluation and Program Planning, Elsevier, vol. 32(2), pages 168-177, May.
    3. Thanassoulis, E. & Sotiros, D. & Koronakos, G. & Despotis, D., 2018. "Assessing the cost-effectiveness of university academic recruitment and promotion policies," European Journal of Operational Research, Elsevier, vol. 264(2), pages 742-755.
    4. Rolf Färe & Shawna Grosskopf & Gerald Whittaker, 2014. "Network DEA II," International Series in Operations Research & Management Science, in: Wade D. Cook & Joe Zhu (ed.), Data Envelopment Analysis, edition 127, chapter 0, pages 307-327, Springer.
    5. Guironnet, Jean-Pascal & Peypoch, Nicolas, 2018. "The geographical efficiency of education and research: The ranking of U.S. universities," Socio-Economic Planning Sciences, Elsevier, vol. 62(C), pages 44-55.
    6. Amara, Nabil & Rhaiem, Mehdi & Halilem, Norrin, 2020. "Assessing the research efficiency of Canadian scholars in the management field: Evidence from the DEA and fsQCA," Journal of Business Research, Elsevier, vol. 115(C), pages 296-306.
    7. Tommaso Agasisti & Joanna Wolszczak-Derlacz, 2016. "Exploring efficiency differentials between Italian and Polish universities, 2001–11," Science and Public Policy, Oxford University Press, vol. 43(1), pages 128-142.
    8. Zhang, Ganggang & Wu, Jie & Zhu, Qingyuan, 2020. "Performance evaluation and enrollment quota allocation for higher education institutions in China," Evaluation and Program Planning, Elsevier, vol. 81(C).
    9. Chiang Kao, 2017. "Network Data Envelopment Analysis," International Series in Operations Research and Management Science, Springer, number 978-3-319-31718-2, December.
    10. Carolyn–Dung T. T. Tran & Renato A. Villano, 2017. "Input Rigidities and Performance of Vietnamese Universities," Asian Economic Journal, East Asian Economic Association, vol. 31(3), pages 253-273, September.
    11. Weishu Liu, 2020. "Accuracy of funding information in Scopus: a comparative case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(1), pages 803-811, July.
    12. Wade Cook & Moez Hababou & Hans Tuenter, 2000. "Multicomponent Efficiency Measurement and Shared Inputs in Data Envelopment Analysis: An Application to Sales and Service Performance in Bank Branches," Journal of Productivity Analysis, Springer, vol. 14(3), pages 209-224, November.
    13. Sonia Aviles-Sacoto & Wade D Cook & Raha Imanirad & Joe Zhu, 2015. "Two-stage network DEA: when intermediate measures can be treated as outputs from the second stage," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 66(11), pages 1868-1877, November.
    14. R. D. Banker & A. Charnes & W. W. Cooper, 1984. "Some Models for Estimating Technical and Scale Inefficiencies in Data Envelopment Analysis," Management Science, INFORMS, vol. 30(9), pages 1078-1092, September.
    15. Eva M. de la Torre & Tommaso Agasisti & Carmen Perez-Esparrells, 2017. "The relevance of knowledge transfer for universities’ efficiency scores: an empirical approximation on the Spanish public higher education system," Research Evaluation, Oxford University Press, vol. 26(3), pages 211-229.
    16. Kao, Chiang & Hung, Hsi-Tai, 2008. "Efficiency analysis of university departments: An empirical study," Omega, Elsevier, vol. 36(4), pages 653-664, August.
    17. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    18. Yang, Guo-liang & Fukuyama, Hirofumi & Song, Yao-yao, 2018. "Measuring the inefficiency of Chinese research universities based on a two-stage network DEA model," Journal of Informetrics, Elsevier, vol. 12(1), pages 10-30.
    19. Manuel Salas-Velasco, 2020. "Measuring and explaining the production efficiency of Spanish universities using a non-parametric approach and a bootstrapped-truncated regression," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(2), pages 825-846, February.
    20. Kao, Chiang & Hwang, Shiuh-Nan, 2008. "Efficiency decomposition in two-stage data envelopment analysis: An application to non-life insurance companies in Taiwan," European Journal of Operational Research, Elsevier, vol. 185(1), pages 418-429, February.
    21. Lee, Boon L. & Worthington, Andrew C., 2016. "A network DEA quantity and quality-orientated production model: An application to Australian university research services," Omega, Elsevier, vol. 60(C), pages 26-33.
    22. Berbegal-Mirabent, Jasmina & Lafuente, Esteban & Solé, Francesc, 2013. "The pursuit of knowledge transfer activities: An efficiency analysis of Spanish universities," Journal of Business Research, Elsevier, vol. 66(10), pages 2051-2059.
    23. Ruiz, José L. & Segura, José V. & Sirvent, Inmaculada, 2015. "Benchmarking and target setting with expert preferences: An application to the evaluation of educational performance of Spanish universities," European Journal of Operational Research, Elsevier, vol. 242(2), pages 594-605.
    24. William W. Cooper & Lawrence M. Seiford & Kaoru Tone, 2007. "Data Envelopment Analysis," Springer Books, Springer, edition 0, number 978-0-387-45283-8, December.
    25. Facundo Quiroga-Martínez & Esteban Fernández-Vázquez & Catalina Lucía Alberto, 2018. "Efficiency in public higher education on Argentina 2004–2013: institutional decisions and university-specific effects," Latin American Economic Review, Springer;Centro de Investigaciòn y Docencia Económica (CIDE), vol. 27(1), pages 1-18, December.
    26. Minh‐Anh Thi Nguyen & Ming‐Miin Yu, 2020. "Decomposing the operational efficiency of major cruise lines: A network data envelopment analysis approach in the presence of shared input and quasi‐fixed input," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 41(8), pages 1501-1516, December.
    27. Marie-Laure Bougnol & José Dulá, 2006. "Validating DEA as a ranking tool: An application of DEA to assess performance in higher education," Annals of Operations Research, Springer, vol. 145(1), pages 339-365, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mergoni, Anna & Soncin, Mara & Agasisti, Tommaso, 2023. "The effect of ICT on schools’ efficiency: Empirical evidence on 23 European countries," Omega, Elsevier, vol. 119(C).
    2. Svetlana V. Ratner & Artem M. Shaposhnikov & Andrey V. Lychev, 2023. "Network DEA and Its Applications (2017–2022): A Systematic Literature Review," Mathematics, MDPI, vol. 11(9), pages 1-24, May.
    3. Zihong Liu & Haitao Xiong & Ying Sun, 2023. "Will Online MOOCs Improve the Efficiency of Chinese Higher Education Institutions? An Empirical Study Based on DEA," Sustainability, MDPI, vol. 15(7), pages 1-21, March.
    4. Rella, Angela & Rubino, Michele & Raimo, Nicola & Vitolla, Filippo, 2024. "Does the digitalization of municipalities affect the efficiency of universities? An Italian case study using DEA and Malmquist index approaches," Technology in Society, Elsevier, vol. 77(C).
    5. Zhe Cheng & Tong Xiao & Chen Chen & Xiong Xiong, 2022. "Evaluation of Scientific Research in Universities Based on the Idea of Education for Sustainable Development," Sustainability, MDPI, vol. 14(4), pages 1-18, February.
    6. Biao Chen & Yan Chen & Xianghua Qu & Wanyu Huang & Panyu Wang, 2023. "Do Financial Investment, Disciplinary Differences, and Level of Development Impact on the Efficiency of Resource Allocation in Higher Education: Evidence from China," Sustainability, MDPI, vol. 15(9), pages 1-23, April.
    7. Yang, Min & Zhang, Maolin & Yin, Pengzhen & Liang, Liang, 2023. "Performance evaluation of scientific research system in Chinese universities: A view of goal congruence," Socio-Economic Planning Sciences, Elsevier, vol. 87(PA).
    8. Xi Xiong & Guo-liang Yang & Kai-di Liu & De-qun Zhou, 2022. "A proposed fixed-sum carryovers reallocation DEA approach for social scientific resources of Chinese public universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(7), pages 4097-4121, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ding, Tao & Zhang, Yun & Zhang, Danlu & Li, Feng, 2023. "Performance evaluation of Chinese research universities: A parallel interactive network DEA approach with shared and fixed sum inputs," Socio-Economic Planning Sciences, Elsevier, vol. 87(PA).
    2. Shih-Pin Chen & Chung-Wei Chang, 2021. "Measuring the efficiency of university departments: an empirical study using data envelopment analysis and cluster analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(6), pages 5263-5284, June.
    3. Manuel Salas-Velasco, 2020. "Measuring and explaining the production efficiency of Spanish universities using a non-parametric approach and a bootstrapped-truncated regression," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(2), pages 825-846, February.
    4. Sanjeet Singh & Prabhat Ranjan, 2018. "Efficiency analysis of non-homogeneous parallel sub-unit systems for the performance measurement of higher education," Annals of Operations Research, Springer, vol. 269(1), pages 641-666, October.
    5. Yang, Guo-liang & Fukuyama, Hirofumi & Song, Yao-yao, 2018. "Measuring the inefficiency of Chinese research universities based on a two-stage network DEA model," Journal of Informetrics, Elsevier, vol. 12(1), pages 10-30.
    6. Mishra, Neelesh Kumar & Chakraborty, Abhishek & Singh, Sanjeet & Ranjan, Prabhat, 2023. "Efficiency analysis of engineering colleges in India: Decomposition into parallel sub-processes systems," Socio-Economic Planning Sciences, Elsevier, vol. 89(C).
    7. Manuel Salas-Velasco, 2024. "Nonparametric efficiency measurement of undergraduate teaching by university size," Operational Research, Springer, vol. 24(1), pages 1-29, March.
    8. Contreras, I. & Lozano, S., 2020. "Allocating additional resources to public universities. A DEA bargaining approach," Socio-Economic Planning Sciences, Elsevier, vol. 71(C).
    9. Liu, Xing & Wu, Xianhua & Zhang, Weipan, 2024. "A new DEA model and its application in performance evaluation of scientific research activities in the universities of China's double first-class initiative," Socio-Economic Planning Sciences, Elsevier, vol. 92(C).
    10. Chen, Xiaolei & Guan, Zhongcheng & Yang, Guoliang & Pan, Hao & Xiong, Xi, 2024. "Evaluation of technology transfer performance for Chinese universities based on a dual-game cross-efficiency model," Socio-Economic Planning Sciences, Elsevier, vol. 94(C).
    11. Mergoni, Anna & Soncin, Mara & Agasisti, Tommaso, 2023. "The effect of ICT on schools’ efficiency: Empirical evidence on 23 European countries," Omega, Elsevier, vol. 119(C).
    12. Sunil Kumar Jauhar & Millie Pant & Richa Dutt, 2018. "Performance measurement of an Indian higher education institute: a sustainable educational supply chain management perspective," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 9(1), pages 180-193, February.
    13. Samira El Gibari & Trinidad Gómez & Francisco Ruiz, 2022. "Combining reference point based composite indicators with data envelopment analysis: application to the assessment of universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(8), pages 4363-4395, August.
    14. Yang, Guo-liang & Fukuyama, Hirofumi & Chen, Kun, 2019. "Investigating the regional sustainable performance of the Chinese real estate industry: A slack-based DEA approach," Omega, Elsevier, vol. 84(C), pages 141-159.
    15. Mehdi Rhaiem & Nabil Amara, 2020. "Determinants of research efficiency in Canadian business schools: evidence from scholar-level data," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 53-99, October.
    16. Xianmei Wang & Hanhui Hu, 2017. "Sustainability in Chinese Higher Educational Institutions’ Social Science Research: A Performance Interface toward Efficiency," Sustainability, MDPI, vol. 9(11), pages 1-18, October.
    17. Kao, Chiang, 2018. "Multiplicative aggregation of division efficiencies in network data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 270(1), pages 328-336.
    18. Liu, John S. & Lu, Louis Y.Y. & Lu, Wen-Min & Lin, Bruce J.Y., 2013. "A survey of DEA applications," Omega, Elsevier, vol. 41(5), pages 893-902.
    19. Zhang, Ganggang & Wu, Jie & Zhu, Qingyuan, 2020. "Performance evaluation and enrollment quota allocation for higher education institutions in China," Evaluation and Program Planning, Elsevier, vol. 81(C).
    20. Kao, Chiang, 2022. "A maximum slacks-based measure of efficiency for closed series production systems," Omega, Elsevier, vol. 106(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:89:y:2021:i:c:s0149718921000793. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.