IDEAS home Printed from https://ideas.repec.org/p/lan/wpaper/577428.html
   My bibliography  Save this paper

Measuring the research performance of Chinese higher education institutions using data envelopment analysis

Author

Listed:
  • J Johnes
  • L Yu

Abstract

This study uses data envelopment analysis (DEA) to examine the relative efficiency of over 100 selected Chinese regular universities. Various models are developed to measure the research efficiency of these higher education institutions (HEIs) using data for 2003 and 2004. The findings show that the level of efficiency depends on whether or not a subjective measure of research output (based on experts’ opinions of the HEIs) is included as an output in the model. Mean efficiency is higher when the reputation variable is included (around 90%) than when it is not (mean efficiency is around 55% in this case). However, the rankings of the universities are remarkably insensitive to whether or not this variable is included. Bootstrapping procedures are used to find the 95% confidence intervals for the efficiencies, and indicate that the best and worst performing institutions are significantly different from each other; only the middle-performing 30% of HEIs cannot be distinguished from each other in terms of their performance. Further investigation suggests that regional location, source of funding and whether the university is comprehensive or specialist may all contribute to the observed differences in performance. The regional differences are consistent but not significant at conventional levels of significance; the efficiencies differ significantly by administrative type when the subjective measure of research output is excluded from the analysis; comprehensive universities consistently and significantly outperform specialist institutions. The possibility of regional differences in performance is particularly worrying since the already economically disadvantaged Western region may suffer a continued lag in development if its HEIs are less efficient than those in the better developed Central and coastal regions.

Suggested Citation

  • J Johnes & L Yu, 2006. "Measuring the research performance of Chinese higher education institutions using data envelopment analysis," Working Papers 577428, Lancaster University Management School, Economics Department.
  • Handle: RePEc:lan:wpaper:577428
    as

    Download full text from publisher

    File URL: http://www.lancaster.ac.uk/media/lancaster-university/content-assets/documents/lums/economics/working-papers/MeasuringResearchPerformance.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Johnes, Geraint & Johnes, Jill, 1993. "Measuring the Research Performance of UK Economics Departments: An Application of Data Envelopment Analysis," Oxford Economic Papers, Oxford University Press, vol. 45(2), pages 332-347, April.
    2. Antreas Athanassopoulos & Estelle Shale, 1997. "Assessing the Comparative Efficiency of Higher Education Institutions in the UK by the Means of Data Envelopment Analysis," Education Economics, Taylor & Francis Journals, vol. 5(2), pages 117-134.
    3. Léopold Simar & Paul W. Wilson, 2011. "Performance of the Bootstrap for DEA Estimators and Iterating the Principle," International Series in Operations Research & Management Science, in: William W. Cooper & Lawrence M. Seiford & Joe Zhu (ed.), Handbook on Data Envelopment Analysis, chapter 0, pages 241-271, Springer.
    4. Haksever Cengiz & Muragishi Yuki, 1998. "Measuring Value in MBA Programmes," Education Economics, Taylor & Francis Journals, vol. 6(1), pages 11-25.
    5. Worthington, Andrew C. & Lee, Boon L., 2008. "Efficiency, technology and productivity change in Australian universities, 1998-2003," Economics of Education Review, Elsevier, vol. 27(3), pages 285-298, June.
    6. A. Varga, 2006. "Spatial Knowledge Spillovers and University Research: Evidence from Austria," Springer Books, in: Innovation, Networks, and Knowledge Spillovers, chapter 10, pages 211-232, Springer.
    7. Avkiran, Necmi K., 2001. "Investigating technical and scale efficiencies of Australian Universities through data envelopment analysis," Socio-Economic Planning Sciences, Elsevier, vol. 35(1), pages 57-80, March.
    8. John Robst, 2000. "Do state appropriations influence cost efficiency in public higher education?," Applied Economics Letters, Taylor & Francis Journals, vol. 7(11), pages 715-719.
    9. Luc Anselin & Attila Varga & Zoltan Acs, 2008. "Local Geographic Spillovers Between University Research and High Technology Innovations," Chapters, in: Entrepreneurship, Growth and Public Policy, chapter 9, pages 95-121, Edward Elgar Publishing.
    10. Kocher, Martin G. & Luptacik, Mikulas & Sutter, Matthias, 2006. "Measuring productivity of research in economics: A cross-country study using DEA," Socio-Economic Planning Sciences, Elsevier, vol. 40(4), pages 314-332, December.
    11. Beasley, J. E., 1990. "Comparing university departments," Omega, Elsevier, vol. 18(2), pages 171-183.
    12. Audretsch, David B. & Lehmann, Erik E. & Warning, Susanne, 2005. "University spillovers and new firm location," Research Policy, Elsevier, vol. 34(7), pages 1113-1122, September.
    13. Friedman, Lea & Sinuany-Stern, Zilla, 1997. "Scaling units via the canonical correlation analysis in the DEA context," European Journal of Operational Research, Elsevier, vol. 100(3), pages 629-637, August.
    14. Gary Madden & Scott Savage & Steven Kemp, 1997. "Measuring Public Sector Efficiency: A Study of Economics Departments at Australian Universities," Education Economics, Taylor & Francis Journals, vol. 5(2), pages 153-168.
    15. Luc Anselin & Attila Varga & Zoltan Acs, 2008. "Geographical Spillovers and University Research: A Spatial Econometric Perspective," Chapters, in: Entrepreneurship, Growth and Public Policy, chapter 10, pages 122-134, Edward Elgar Publishing.
    16. Johnes, Jill, 2006. "Data envelopment analysis and its application to the measurement of efficiency in higher education," Economics of Education Review, Elsevier, vol. 25(3), pages 273-288, June.
    17. El-Mahgary, Sami & Lahdelma, Risto, 1995. "Data envelopment analysis: Visualizing the results," European Journal of Operational Research, Elsevier, vol. 83(3), pages 700-710, June.
    18. Geraint Johnes & Jill Johnes (ed.), 2004. "International Handbook on the Economics of Education," Books, Edward Elgar Publishing, number 2847.
    19. Ying Chu Ng & Sung Ko Li, 2000. "Measuring the Research Performance of Chinese Higher Education Institutions: An Application of Data Envelopment Analysis," Education Economics, Taylor & Francis Journals, vol. 8(2), pages 139-156.
    20. Korhonen, Pekka & Tainio, Risto & Wallenius, Jyrki, 2001. "Value efficiency analysis of academic research," European Journal of Operational Research, Elsevier, vol. 130(1), pages 121-132, April.
    21. Abbott, M. & Doucouliagos, C., 2003. "The efficiency of Australian universities: a data envelopment analysis," Economics of Education Review, Elsevier, vol. 22(1), pages 89-97, February.
    22. Breu, Theodore M. & Raab, Raymond L., 1994. "Efficiency and perceived quality of the nation's "top 25" National Universities and National Liberal Arts Colleges: An application of data envelopment analysis to higher education," Socio-Economic Planning Sciences, Elsevier, vol. 28(1), pages 33-45.
    23. Johnes, Jill, 2006. "Measuring teaching efficiency in higher education: An application of data envelopment analysis to economics graduates from UK Universities 1993," European Journal of Operational Research, Elsevier, vol. 174(1), pages 443-456, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kristof De Witte & Laura López-Torres, 2017. "Efficiency in education: a review of literature and a way forward," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 339-363, April.
    2. Martín Rivero, Raquel, 2007. "La eficiencia productiva en el ámbito universitario: aspectos claves para su evaluación/The Productive Efficiency in the University: Key Aspects for its Evaluation," Estudios de Economia Aplicada, Estudios de Economia Aplicada, vol. 25, pages 793-812, Diciembre.
    3. Mehdi Rhaiem, 2017. "Measurement and determinants of academic research efficiency: a systematic review of the evidence," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 581-615, February.
    4. Sanjeet Singh & Prabhat Ranjan, 2018. "Efficiency analysis of non-homogeneous parallel sub-unit systems for the performance measurement of higher education," Annals of Operations Research, Springer, vol. 269(1), pages 641-666, October.
    5. Renato A. Villano & Carolyn‐Dung T. T. Tran, 2021. "Survey on technical efficiency in higher education: A meta‐fractional regression analysis," Pacific Economic Review, Wiley Blackwell, vol. 26(1), pages 110-135, February.
    6. Mad Ithnin Salleh & Nurul Fadly Habidin & Abdul Halim Masnan & Nordin Mamat, 2017. "Estimating Technical Efficiency and Bootstrapping Malmquist Indices: Analysis of Malaysian Preschool Sector," International Journal of Academic Research in Business and Social Sciences, Human Resource Management Academic Research Society, International Journal of Academic Research in Business and Social Sciences, vol. 7(3), pages 440-457, March.
    7. Agasisti, Tommaso & Barra, Cristian & Zotti, Roberto, 2016. "Evaluating the efficiency of Italian public universities (2008–2011) in presence of (unobserved) heterogeneity," Socio-Economic Planning Sciences, Elsevier, vol. 55(C), pages 47-58.
    8. Tzeremes, Nickolaos & Halkos, George, 2010. "A DEA approach for measuring university departments’ efficiency," MPRA Paper 24029, University Library of Munich, Germany.
    9. Turgay Türker & Murat Etöz & Yasemin Altun Türker, 2016. "Determination of Effective Critical Factors in Successful Efficiency Measurement of University Departments by Using Fuzzy DEMATEL Method," Alphanumeric Journal, Bahadir Fatih Yildirim, vol. 4(1), pages 57-72, June.
    10. Amir Arjomandi & Mad Ithnin Salleh & Abbas Mohammadzadeh, 2015. "Measuring productivity change in higher education: an application of Hicks–Moorsteen total factor productivity index to Malaysian public universities," Journal of the Asia Pacific Economy, Taylor & Francis Journals, vol. 20(4), pages 630-643, October.
    11. Jill Johnes, 2006. "Measuring Efficiency: A Comparison of Multilevel Modelling and Data Envelopment Analysis in the Context of Higher Education," Bulletin of Economic Research, Wiley Blackwell, vol. 58(2), pages 75-104, April.
    12. Barra, Cristian & Lagravinese, Raffaele & Zotti, Roberto, 2018. "Does econometric methodology matter to rank universities? An analysis of Italian higher education system," Socio-Economic Planning Sciences, Elsevier, vol. 62(C), pages 104-120.
    13. Johnes, Jill, 2006. "Data envelopment analysis and its application to the measurement of efficiency in higher education," Economics of Education Review, Elsevier, vol. 25(3), pages 273-288, June.
    14. Laureti, Tiziana & Secondi, Luca & Biggeri, Luigi, 2014. "Measuring the efficiency of teaching activities in Italian universities: An information theoretic approach," Economics of Education Review, Elsevier, vol. 42(C), pages 147-164.
    15. Erik E. Lehmann & Michele Meoli & Stefano Paleari & Sarah A. E. Stockinger, 2018. "Approaching effects of the economic crisis on university efficiency: a comparative study of Germany and Italy," Eurasian Business Review, Springer;Eurasia Business and Economics Society, vol. 8(1), pages 37-54, March.
    16. Marcel Clermont & Alexander Dirksen & Harald Dyckhoff, 2015. "Returns to scale of Business Administration research in Germany," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(2), pages 583-614, May.
    17. Guironnet, Jean-Pascal & Peypoch, Nicolas, 2018. "The geographical efficiency of education and research: The ranking of U.S. universities," Socio-Economic Planning Sciences, Elsevier, vol. 62(C), pages 44-55.
    18. Mishra, Neelesh Kumar & Chakraborty, Abhishek & Singh, Sanjeet & Ranjan, Prabhat, 2023. "Efficiency analysis of engineering colleges in India: Decomposition into parallel sub-processes systems," Socio-Economic Planning Sciences, Elsevier, vol. 89(C).
    19. Lu, Wen-Min, 2012. "Intellectual capital and university performance in Taiwan," Economic Modelling, Elsevier, vol. 29(4), pages 1081-1089.
    20. Mad Ithnin Salleh & Shariffah Nur Illiana Syed Ismail & Nurul Fadly Habidin & Nor Azrin Md Latip, 2016. "Efficiency and Productivity Changes of the Malaysian Community Colleges," International Journal of Academic Research in Business and Social Sciences, Human Resource Management Academic Research Society, International Journal of Academic Research in Business and Social Sciences, vol. 6(12), pages 407-424, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:lan:wpaper:577428. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Giorgio Motta (email available below). General contact details of provider: https://edirc.repec.org/data/delanuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.