IDEAS home Printed from https://ideas.repec.org/a/eee/soceps/v92y2024ics0038012124000387.html
   My bibliography  Save this article

A new DEA model and its application in performance evaluation of scientific research activities in the universities of China's double first-class initiative

Author

Listed:
  • Liu, Xing
  • Wu, Xianhua
  • Zhang, Weipan

Abstract

How to reasonably evaluate the performance of scientific research activities in universities has attracted people's extensive attention. This study identifies the scientific research activity of Chinese universities as a two-process system with three sub-stages, including technical accumulation and research commercialization processes. Where, the process of technical accumulation includes the production of scientific research and patenting stage, while the process of research commercialization is a separate stage. First, this study proposes a network DEA model with two processes and three sub-stages to evaluate and decompose the performance of scientific research activities in universities. Secondly, taking 61 Chinese universities in the “Double First-Class” initiative (DFIU) as examples, this study evaluates the overall efficiency, stage efficiency and coordination efficiency of scientific research activities in Chinese universities. The final main conclusions are as follows: (1) The average score associated with the transformation efficiency of scientific research achievements based on the internal structures is only 0.2406, lower than the CCR efficiency and merger efficiency, indicating that most universities are still facing problems such as low resource utilization efficiency or unsatisfactory results. (2) The universities in the “First-class Discipline” construction plan (UFDCP) have outstanding performance in the technical accumulation process and the production of scientific research stage. Professional characteristics universities are generally much less efficient than polytechnic universities and comprehensive universities. (3) The universities in the “First-class Discipline” construction plan (UFDCP) are better than the universities in the “First-class Universities” construction plan (UFUCP) in terms of average efficiency values and polytechnic universities are better than other types of universities in terms of average efficiency values. We can find part of the reason for this difference in average efficiency from the evaluation of coordination efficiency.

Suggested Citation

  • Liu, Xing & Wu, Xianhua & Zhang, Weipan, 2024. "A new DEA model and its application in performance evaluation of scientific research activities in the universities of China's double first-class initiative," Socio-Economic Planning Sciences, Elsevier, vol. 92(C).
    • Handle: RePEc:eee:soceps:v:92:y:2024:i:c:s0038012124000387
    DOI: 10.1016/j.seps.2024.101839
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0038012124000387
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.seps.2024.101839?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kao, Chiang, 2009. "Efficiency decomposition in network data envelopment analysis: A relational model," European Journal of Operational Research, Elsevier, vol. 192(3), pages 949-962, February.
    2. A. Charnes & W. W. Cooper, 1963. "Programming with linear fractional functionals," Naval Research Logistics Quarterly, John Wiley & Sons, vol. 10(1), pages 273-274, March.
    3. Auerswald, Philip E & Branscomb, Lewis M, 2003. "Valleys of Death and Darwinian Seas: Financing the Invention to Innovation Transition in the United States," The Journal of Technology Transfer, Springer, vol. 28(3-4), pages 227-239, August.
    4. Siegel, Donald S. & Waldman, David & Link, Albert, 2003. "Assessing the impact of organizational practices on the relative productivity of university technology transfer offices: an exploratory study," Research Policy, Elsevier, vol. 32(1), pages 27-48, January.
    5. Federica Rossi, 2018. "The drivers of efficient knowledge transfer performance: evidence from British universities [Benchmarking universities’ efficiency indicators in the presence of internal heterogeneity]," Cambridge Journal of Economics, Cambridge Political Economy Society, vol. 42(3), pages 729-755.
    6. Claudia Curi & Cinzia Daraio & Patrick Llerena, 2012. "University technology transfer: how (in)efficient are French universities?," Cambridge Journal of Economics, Cambridge Political Economy Society, vol. 36(3), pages 629-654.
    7. Johnes, Jill & Yu, Li, 2008. "Measuring the research performance of Chinese higher education institutions using data envelopment analysis," China Economic Review, Elsevier, vol. 19(4), pages 679-696, December.
    8. Kao, Chiang, 2016. "Efficiency decomposition and aggregation in network data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 255(3), pages 778-786.
    9. Chapple, Wendy & Lockett, Andy & Siegel, Donald & Wright, Mike, 2005. "Assessing the relative performance of U.K. university technology transfer offices: parametric and non-parametric evidence," Research Policy, Elsevier, vol. 34(3), pages 369-384, April.
    10. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    11. Fabrizio Cesaroni & Andrea Piccaluga, 2016. "The activities of university knowledge transfer offices: towards the third mission in Italy," The Journal of Technology Transfer, Springer, vol. 41(4), pages 753-777, August.
    12. Yang, Guo-liang & Fukuyama, Hirofumi & Song, Yao-yao, 2018. "Measuring the inefficiency of Chinese research universities based on a two-stage network DEA model," Journal of Informetrics, Elsevier, vol. 12(1), pages 10-30.
    13. Kao, Chiang & Hwang, Shiuh-Nan, 2008. "Efficiency decomposition in two-stage data envelopment analysis: An application to non-life insurance companies in Taiwan," European Journal of Operational Research, Elsevier, vol. 185(1), pages 418-429, February.
    14. Thursby, Jerry G. & Kemp, Sukanya, 2002. "Growth and productive efficiency of university intellectual property licensing," Research Policy, Elsevier, vol. 31(1), pages 109-124, January.
    15. Lee, Boon L. & Worthington, Andrew C., 2016. "A network DEA quantity and quality-orientated production model: An application to Australian university research services," Omega, Elsevier, vol. 60(C), pages 26-33.
    16. Koronakos, Gregory & Sotiros, Dimitris & Despotis, Dimitris K. & Kritikos, Manolis N., 2022. "Fair efficiency decomposition in network DEA: A compromise programming approach," Socio-Economic Planning Sciences, Elsevier, vol. 79(C).
    17. Ruiz, José L. & Segura, José V. & Sirvent, Inmaculada, 2015. "Benchmarking and target setting with expert preferences: An application to the evaluation of educational performance of Spanish universities," European Journal of Operational Research, Elsevier, vol. 242(2), pages 594-605.
    18. Henry Sauermann & Paula Stephan, 2013. "Conflicting Logics? A Multidimensional View of Industrial and Academic Science," Organization Science, INFORMS, vol. 24(3), pages 889-909, June.
    19. Yu, Ming-Miin, 2010. "Assessment of airport performance using the SBM-NDEA model," Omega, Elsevier, vol. 38(6), pages 440-452, December.
    20. Larsen, Maria Theresa, 2011. "The implications of academic enterprise for public science: An overview of the empirical evidence," Research Policy, Elsevier, vol. 40(1), pages 6-19, February.
    21. Auranen, Otto & Nieminen, Mika, 2010. "University research funding and publication performance--An international comparison," Research Policy, Elsevier, vol. 39(6), pages 822-834, July.
    22. Zhou, Xiaoyang & Xu, Zhongwen & Chai, Jian & Yao, Liming & Wang, Shouyang & Lev, Benjamin, 2019. "Efficiency evaluation for banking systems under uncertainty: A multi-period three-stage DEA model," Omega, Elsevier, vol. 85(C), pages 68-82.
    23. Lin, Shoufu & Lin, Ruoyun & Sun, Ji & Wang, Fei & Wu, Weixiang, 2021. "Dynamically evaluating technological innovation efficiency of high-tech industry in China: Provincial, regional and industrial perspective," Socio-Economic Planning Sciences, Elsevier, vol. 74(C).
    24. Tommaso Agasisti & Guo-liang Yang & Yao-yao Song & Carolyn-Thi Thanh Dung Tran, 2021. "Evaluating the higher education productivity of Chinese and European “elite” universities using a meta-frontier approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 5819-5853, July.
    25. Chen, Yao & Cook, Wade D. & Li, Ning & Zhu, Joe, 2009. "Additive efficiency decomposition in two-stage DEA," European Journal of Operational Research, Elsevier, vol. 196(3), pages 1170-1176, August.
    26. Xiong, Xi & Yang, Guo-liang & Guan, Zhong-cheng, 2018. "Assessing R&D efficiency using a two-stage dynamic DEA model: A case study of research institutes in the Chinese Academy of Sciences," Journal of Informetrics, Elsevier, vol. 12(3), pages 784-805.
    27. Xia Fan & Xiaowan Yang & Zhou Yu, 2021. "Effect of basic research and applied research on the universities’ innovation capabilities: the moderating role of private research funding," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 5387-5411, July.
    28. Fiona Murray & Scott Stern, 2005. "Do Formal Intellectual Property Rights Hinder the Free Flow of Scientific Knowledge? An Empirical Test of the Anti-Commons Hypothesis," NBER Working Papers 11465, National Bureau of Economic Research, Inc.
    29. Romer, Paul M, 1990. "Endogenous Technological Change," Journal of Political Economy, University of Chicago Press, vol. 98(5), pages 71-102, October.
    30. Dongfu (Franco) Li & Xiaoqing (Maggie) Fu, 2021. "The Efficiency of University Technology Transfer in China," Asian Economic Papers, MIT Press, vol. 20(3), pages 114-137, Fall.
    31. T Randolph Beard & George S Ford & Thomas M Koutsky & Lawrence J Spiwak, 2009. "A Valley of Death in the innovation sequence: an economic investigation," Research Evaluation, Oxford University Press, vol. 18(5), pages 343-356, December.
    32. Qingxian An & Fanyong Meng & Beibei Xiong & Zongrun Wang & Xiaohong Chen, 2020. "Assessing the relative efficiency of Chinese high-tech industries: a dynamic network data envelopment analysis approach," Annals of Operations Research, Springer, vol. 290(1), pages 707-729, July.
    33. Yukun Shi & Duchun Wang & Zimeng Zhang, 2022. "Categorical Evaluation of Scientific Research Efficiency in Chinese Universities: Basic and Applied Research," Sustainability, MDPI, vol. 14(8), pages 1-16, April.
    34. Jerry G. Thursby & Marie C. Thursby, 2002. "Who Is Selling the Ivory Tower? Sources of Growth in University Licensing," Management Science, INFORMS, vol. 48(1), pages 90-104, January.
    35. Ma, Ding & Cai, Zhishan & Zhu, Chengkai, 2022. "Technology transfer efficiency of universities in China: A three-stage framework based on the dynamic network slacks-based measurement model," Technology in Society, Elsevier, vol. 70(C).
    36. Caldera, Aida & Debande, Olivier, 2010. "Performance of Spanish universities in technology transfer: An empirical analysis," Research Policy, Elsevier, vol. 39(9), pages 1160-1173, November.
    37. Wang, Derek D., 2019. "Performance-based resource allocation for higher education institutions in China," Socio-Economic Planning Sciences, Elsevier, vol. 65(C), pages 66-75.
    38. Liang Liang & Wade D. Cook & Joe Zhu, 2008. "DEA models for two‐stage processes: Game approach and efficiency decomposition," Naval Research Logistics (NRL), John Wiley & Sons, vol. 55(7), pages 643-653, October.
    39. Berbegal-Mirabent, Jasmina & Lafuente, Esteban & Solé, Francesc, 2013. "The pursuit of knowledge transfer activities: An efficiency analysis of Spanish universities," Journal of Business Research, Elsevier, vol. 66(10), pages 2051-2059.
    40. BERBEGAL MIRABENT, Jasmina & SOLÉ PARELLADA, Francesc, 2012. "What Are We Measuring When Evaluating Universities’ Efficiency?," Regional and Sectoral Economic Studies, Euro-American Association of Economic Development, vol. 12(3).
    41. Mei Ho & John Liu & Wen-Min Lu & Chien-Cheng Huang, 2014. "A new perspective to explore the technology transfer efficiencies in US universities," The Journal of Technology Transfer, Springer, vol. 39(2), pages 247-275, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chen, Xiaolei & Guan, Zhongcheng & Yang, Guoliang & Pan, Hao & Xiong, Xi, 2024. "Evaluation of technology transfer performance for Chinese universities based on a dual-game cross-efficiency model," Socio-Economic Planning Sciences, Elsevier, vol. 94(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ma, Ding & Cai, Zhishan & Zhu, Chengkai, 2022. "Technology transfer efficiency of universities in China: A three-stage framework based on the dynamic network slacks-based measurement model," Technology in Society, Elsevier, vol. 70(C).
    2. Lim, Dong-Joon & Kim, Moon-Su, 2022. "Measuring dynamic efficiency with variable time lag effects," Omega, Elsevier, vol. 108(C).
    3. Mei Ho & John Liu & Wen-Min Lu & Chien-Cheng Huang, 2014. "A new perspective to explore the technology transfer efficiencies in US universities," The Journal of Technology Transfer, Springer, vol. 39(2), pages 247-275, April.
    4. Contreras, I. & Lozano, S., 2020. "Allocating additional resources to public universities. A DEA bargaining approach," Socio-Economic Planning Sciences, Elsevier, vol. 71(C).
    5. Ding, Tao & Zhang, Yun & Zhang, Danlu & Li, Feng, 2023. "Performance evaluation of Chinese research universities: A parallel interactive network DEA approach with shared and fixed sum inputs," Socio-Economic Planning Sciences, Elsevier, vol. 87(PA).
    6. Chen, Kun & Wupur, Abduhalik & Abudouguli, Ailifeire & Yang, Guo-liang, 2023. "Measuring the knowledge transfer efficiency of social science in Chinese universities from a think tank perspective," Socio-Economic Planning Sciences, Elsevier, vol. 90(C).
    7. Tavares, Rafael Santos & Angulo-Meza, Lidia & Sant'Anna, Annibal Parracho, 2021. "A proposed multistage evaluation approach for Higher Education Institutions based on network Data envelopment analysis: A Brazilian experience," Evaluation and Program Planning, Elsevier, vol. 89(C).
    8. See, Kok Fong & Ma, Zhanxin & Tian, Yuzhen, 2023. "Examining the efficiency of regional university technology transfer in China: A mixed-integer generalized data envelopment analysis framework," Technological Forecasting and Social Change, Elsevier, vol. 197(C).
    9. Mishra, Neelesh Kumar & Chakraborty, Abhishek & Singh, Sanjeet & Ranjan, Prabhat, 2023. "Efficiency analysis of engineering colleges in India: Decomposition into parallel sub-processes systems," Socio-Economic Planning Sciences, Elsevier, vol. 89(C).
    10. Koronakos, Gregory & Sotiros, Dimitris & Despotis, Dimitris K. & Kritikos, Manolis N., 2022. "Fair efficiency decomposition in network DEA: A compromise programming approach," Socio-Economic Planning Sciences, Elsevier, vol. 79(C).
    11. Zhang, Linyan & Chen, Kun, 2019. "Hierarchical network systems: An application to high-technology industry in China," Omega, Elsevier, vol. 82(C), pages 118-131.
    12. Hsu, David W.L. & Shen, Yung-Chi & Yuan, Benjamin J.C. & Chou, Chiyan James, 2015. "Toward successful commercialization of university technology: Performance drivers of university technology transfer in Taiwan," Technological Forecasting and Social Change, Elsevier, vol. 92(C), pages 25-39.
    13. Shui‐ying Jin & Xiao‐lin Zhou & Yung‐ho Chiu, 2021. "The parent–subsidiary knowledge transfer efficiency of Chinese–African multinational enterprises based on a metafrontier epsilon‐based measure model," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 42(2), pages 479-492, March.
    14. Claudia Curi & Cinzia Daraio & Patrick Llerena, 2015. "The productivity of French technology transfer offices after government reforms," Applied Economics, Taylor & Francis Journals, vol. 47(28), pages 3008-3019, June.
    15. Tatiana Bencova & Andrea Bohacikova, 2022. "DEA in Performance Measurement of Two-Stage Processes: Comparative Overview of the Literature," Economic Studies journal, Bulgarian Academy of Sciences - Economic Research Institute, issue 5, pages 111-129.
    16. Yang, Guo-liang & Fukuyama, Hirofumi & Song, Yao-yao, 2018. "Measuring the inefficiency of Chinese research universities based on a two-stage network DEA model," Journal of Informetrics, Elsevier, vol. 12(1), pages 10-30.
    17. Soares, Thiago J. & Torkomian, Ana L.V., 2021. "TTO's staff and technology transfer: Examining the effect of employees' individual capabilities," Technovation, Elsevier, vol. 102(C).
    18. Lee, Kyootai & Jung, Hyun Ju, 2021. "Does TTO capability matter in commercializing university technology? Evidence from longitudinal data in South Korea," Research Policy, Elsevier, vol. 50(1).
    19. Sanjeet Singh & Prabhat Ranjan, 2018. "Efficiency analysis of non-homogeneous parallel sub-unit systems for the performance measurement of higher education," Annals of Operations Research, Springer, vol. 269(1), pages 641-666, October.
    20. Annelore Huyghe & Mirjam Knockaert & Evila Piva & Mike Wright, 2016. "Are researchers deliberately bypassing the technology transfer office? An analysis of TTO awareness," Small Business Economics, Springer, vol. 47(3), pages 589-607, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:soceps:v:92:y:2024:i:c:s0038012124000387. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/seps .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.