IDEAS home Printed from https://ideas.repec.org/a/pal/jorsoc/v68y2017i4d10.1057_s41274-016-0165-4.html
   My bibliography  Save this article

Evaluating higher education teaching performance using combined analytic hierarchy process and data envelopment analysis

Author

Listed:
  • Emmanuel Thanassoulis

    (Aston University)

  • Prasanta Kumar Dey

    (Aston University)

  • Konstantinos Petridis

    (Aston University)

  • Ioannis Goniadis

    (University of Macedonia)

  • Andreas C. Georgiou

    (University of Macedonia)

Abstract

Evaluating higher education teaching performance is complex as it involves consideration of both objective and subjective criteria. The student evaluation of teaching (SET) is used to improve higher education quality. However, the traditional approaches to considering students’ responses to SET questionnaires for improving teaching quality have several shortcomings. This study proposes an integrated approach to higher education teaching evaluation that combines the analytical hierarchy process (AHP) and data envelopment analysis (DEA). The AHP allows consideration of the varying importance of each criterion of teaching performance, while DEA enables the comparison of tutors on teaching as perceived by students with a view to identifying the scope for improvement by each tutor. The proposed teaching evaluation method is illustrated using data from a higher education institution in Greece.

Suggested Citation

  • Emmanuel Thanassoulis & Prasanta Kumar Dey & Konstantinos Petridis & Ioannis Goniadis & Andreas C. Georgiou, 2017. "Evaluating higher education teaching performance using combined analytic hierarchy process and data envelopment analysis," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 431-445, April.
    • Handle: RePEc:pal:jorsoc:v:68:y:2017:i:4:d:10.1057_s41274-016-0165-4
    DOI: 10.1057/s41274-016-0165-4
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1057/s41274-016-0165-4
    File Function: Abstract
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1057/s41274-016-0165-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Yang, Taho & Kuo, Chunwei, 2003. "A hierarchical AHP/DEA methodology for the facilities layout design problem," European Journal of Operational Research, Elsevier, vol. 147(1), pages 128-136, May.
    2. De Witte, Kristof & Rogge, Nicky, 2011. "Accounting for exogenous influences in performance evaluations of teachers," Economics of Education Review, Elsevier, vol. 30(4), pages 641-653, August.
    3. Sueyoshi, Toshiyuki & Shang, Jennifer & Chiang, Wen-Chyuan, 2009. "A decision support framework for internal audit prioritization in a rental car company: A combined use between DEA and AHP," European Journal of Operational Research, Elsevier, vol. 199(1), pages 219-231, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Oleg Badunenko & Daniel J. Henderson, 2024. "Production analysis with asymmetric noise," Journal of Productivity Analysis, Springer, vol. 61(1), pages 1-18, February.
    2. Dima Alina Mihaela & Argatu Ruxandra & Rădoi Mireille, 2024. "Performance Evaluation in Higher Education – A Comparative Approach," Proceedings of the International Conference on Business Excellence, Sciendo, vol. 18(1), pages 2453-2471.
    3. Prasanta Kumar Dey & Guo-liang Yang & Chrysovalantis Malesios & Debashree De & Konstantinos Evangelinos, 2021. "Performance Management of Supply Chain Sustainability in Small and Medium-Sized Enterprises Using a Combined Structural Equation Modelling and Data Envelopment Analysis," Computational Economics, Springer;Society for Computational Economics, vol. 58(3), pages 573-613, October.
    4. Xianmei Wang & Hanhui Hu, 2017. "Sustainability in Chinese Higher Educational Institutions’ Social Science Research: A Performance Interface toward Efficiency," Sustainability, MDPI, vol. 9(11), pages 1-18, October.
    5. Wanjing Cheng & Dongxu Mo & Yajun Tian & Wenqiang Xu & Kechang Xie, 2018. "Research on the Composite Index of the Modern Chinese Energy System," Sustainability, MDPI, vol. 11(1), pages 1-17, December.
    6. Solmaz Ghaffarian Asl & Necdet Osam, 2021. "A Study of Teacher Performance in English for Academic Purposes Course: Evaluating Efficiency," SAGE Open, , vol. 11(4), pages 21582440211, October.
    7. Cong Cao & Tianlan Wei & Shengyuan Xu & Fan Su & Haiquan Fang, 2023. "Comprehensive evaluation of higher education systems using indicators: PCA and EWM methods," Palgrave Communications, Palgrave Macmillan, vol. 10(1), pages 1-12, December.
    8. Nelson Amowine & Zhiqiang Ma & Mingxing Li & Zhixiang Zhou & Benjamin Azembila Asunka & James Amowine, 2019. "Energy Efficiency Improvement Assessment in Africa: An Integrated Dynamic DEA Approach," Energies, MDPI, vol. 12(20), pages 1-17, October.
    9. Petridis, Konstantinos & Tampakoudis, Ioannis & Drogalas, George & Kiosses, Nikolaos, 2022. "A Support Vector Machine model for classification of efficiency: An application to M&A," Research in International Business and Finance, Elsevier, vol. 61(C).
    10. Lihui Xiong & Ximiao Dong & Jiaqi Fang, 2023. "Interdisciplinary Teaching Reform of Financial Engineering Majors Based on the Analytic Hierarchy Process in the Post-Pandemic Era," Sustainability, MDPI, vol. 15(11), pages 1-17, May.
    11. Wen Li & Yicheng Ye & Nanyan Hu & Xianhua Wang & Qihu Wang, 2019. "Real-Time Warning and Risk Assessment of Tailings Dam Disaster Status Based on Dynamic Hierarchy-Grey Relation Analysis," Complexity, Hindawi, vol. 2019, pages 1-14, April.
    12. Zhang, Ganggang & Wu, Jie & Zhu, Qingyuan, 2020. "Performance evaluation and enrollment quota allocation for higher education institutions in China," Evaluation and Program Planning, Elsevier, vol. 81(C).
    13. Georgios Tsaples & Jason Papathanasiou & Andreas C. Georgiou, 2022. "An Exploratory DEA and Machine Learning Framework for the Evaluation and Analysis of Sustainability Composite Indicators in the EU," Mathematics, MDPI, vol. 10(13), pages 1-27, June.
    14. Tao Ding & Zhixiang Zhou & Qianzhi Dai & Liang Liang, 2020. "Analysis of China’s Regional Economic Environmental Performance: A Non-radial Multi-objective DEA Approach," Computational Economics, Springer;Society for Computational Economics, vol. 55(4), pages 1209-1231, April.
    15. Badiee, Aghdas & Moshtari, Mohammad & Berenguer, Gemma, 2024. "A systematic review of operations research and management science modeling techniques in the study of higher education institutions," Socio-Economic Planning Sciences, Elsevier, vol. 93(C).
    16. Lena Malesevic Perovic & Maja Mihaljevic Kosor, 2020. "The Efficiency of Universities in Achieving Sustainable Development Goals," The AMFITEATRU ECONOMIC journal, Academy of Economic Studies - Bucharest, Romania, vol. 22(54), pages 516-516, April.
    17. David Katende, 2024. "Students’ Evaluation of Learning Outcomes for Quality Assurance in the Teaching Process at Mountains of the Moon University, Fort Portal, Uganda in East Africa," International Journal of Research and Innovation in Social Science, International Journal of Research and Innovation in Social Science (IJRISS), vol. 8(3s), pages 1764-1784, March.
    18. Qi-Zhen Zhang & Shan Jiang & Ran Liu & Hu-Chen Liu, 2020. "An Integrated Decision-Making Model for Analyzing Key Performance Indicators in University Performance Management," Mathematics, MDPI, vol. 8(10), pages 1-16, October.
    19. Ma, Zhanxin & See, Kok Fong & Yu, Ming-Miin & Zhao, Chunying, 2021. "Research efficiency analysis of China's university faculty members: A modified meta-frontier DEA approach," Socio-Economic Planning Sciences, Elsevier, vol. 76(C).
    20. Xi Xiong & Guo-liang Yang & Kai-di Liu & De-qun Zhou, 2022. "A proposed fixed-sum carryovers reallocation DEA approach for social scientific resources of Chinese public universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(7), pages 4097-4121, July.
    21. Qiuhu Shao & Jingfeng Yuan & Jin Lin & Wei Huang & Junwei Ma & Hongxing Ding, 2021. "A SBM-DEA based performance evaluation and optimization for social organizations participating in community and home-based elderly care services," PLOS ONE, Public Library of Science, vol. 16(3), pages 1-25, March.
    22. Ao Yu & Zhuoqiang Jia & Weike Zhang & Ke Deng & Francisco Herrera, 2020. "A Dynamic Credit Index System for TSMEs in China Using the Delphi and Analytic Hierarchy Process (AHP) Methods," Sustainability, MDPI, vol. 12(5), pages 1-21, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dyckhoff, Harald & Souren, Rainer, 2022. "Integrating multiple criteria decision analysis and production theory for performance evaluation: Framework and review," European Journal of Operational Research, Elsevier, vol. 297(3), pages 795-816.
    2. Wen-Min Lu & Qian Long Kweh & Chung-Wei Wang, 2021. "Integration and application of rough sets and data envelopment analysis for assessments of the investment trusts industry," Annals of Operations Research, Springer, vol. 296(1), pages 163-194, January.
    3. Yande Gong & Joe Zhu & Ya Chen & Wade D. Cook, 2018. "DEA as a tool for auditing: application to Chinese manufacturing industry with parallel network structures," Annals of Operations Research, Springer, vol. 263(1), pages 247-269, April.
    4. Meng, Fanyong & Xiong, Beibei, 2021. "Logical efficiency decomposition for general two-stage systems in view of cross efficiency," European Journal of Operational Research, Elsevier, vol. 294(2), pages 622-632.
    5. Ho, William, 2008. "Integrated analytic hierarchy process and its applications - A literature review," European Journal of Operational Research, Elsevier, vol. 186(1), pages 211-228, April.
    6. Amy H. I. Lee & Chun Yu Lin & He-Yau Kang & Wen Hsin Lee, 2012. "An Integrated Performance Evaluation Model for the Photovoltaics Industry," Energies, MDPI, vol. 5(4), pages 1-21, April.
    7. Freixas, Josep & Kurz, Sascha, 2013. "The golden number and Fibonacci sequences in the design of voting structures," European Journal of Operational Research, Elsevier, vol. 226(2), pages 246-257.
    8. Jorge David Quinteo Otero & William Orlando Prieto Bustos & Fernando Barrios Aguirre & Laura Elena Leviller Guardo, 2008. "Determinantes de la eficiencia técnica en las empresas colombianas, 2001-2004," Revista Semestre Económico, Universidad de Medellín, November.
    9. Ormerod, Richard J. & Ulrich, Werner, 2013. "Operational research and ethics: A literature review," European Journal of Operational Research, Elsevier, vol. 228(2), pages 291-307.
    10. De Witte, Kristof & Rogge, Nicky & Cherchye, Laurens & Van Puyenbroeck, Tom, 2013. "Economies of scope in research and teaching: A non-parametric investigation," Omega, Elsevier, vol. 41(2), pages 305-314.
    11. H Seol & H Lee & S Kim & Y Park, 2008. "The impact of information technology on organizational efficiency in public services: a DEA-based DT approach," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(2), pages 231-238, February.
    12. Karagiannis, Roxani & Karagiannis, Giannis, 2018. "Intra- and inter-group composite indicators using the BoD model," Socio-Economic Planning Sciences, Elsevier, vol. 61(C), pages 44-51.
    13. Tseng, Fang-Mei & Chiu, Yu-Jing & Chen, Ja-Shen, 2009. "Measuring business performance in the high-tech manufacturing industry: A case study of Taiwan's large-sized TFT-LCD panel companies," Omega, Elsevier, vol. 37(3), pages 686-697, June.
    14. Chia-Nan Wang & Van Thanh Nguyen & Hoang Tuyet Nhi Thai & Duy Hung Duong, 2018. "Multi-Criteria Decision Making (MCDM) Approaches for Solar Power Plant Location Selection in Viet Nam," Energies, MDPI, vol. 11(6), pages 1-27, June.
    15. K. Madan Shankar & P. Udhaya Kumar & Devika Kannan, 2016. "Analyzing the Drivers of Advanced Sustainable Manufacturing System Using AHP Approach," Sustainability, MDPI, vol. 8(8), pages 1-10, August.
    16. repec:spo:wpmain:info:hdl:2441/1seuirq4ak9b9bouu1j29ebui7 is not listed on IDEAS
    17. Anne Boring, 2015. "Gender Biases in Student Evaluations of Teachers," SciencePo Working papers Main hal-03470161, HAL.
    18. Ravi Kumar Jain & Ramachandran Natarajan & Amlan Ghosh, 2016. "Decision Tree Analysis for Selection of Factors in DEA: An Application to Banks in India," Global Business Review, International Management Institute, vol. 17(5), pages 1162-1178, October.
    19. Giménez, Víctor & Thieme, Claudio & Prior, Diego & Tortosa-Ausina, Emili, 2022. "Evaluation and determinants of preschool effectiveness in Chile," Socio-Economic Planning Sciences, Elsevier, vol. 81(C).
    20. Pongou, Roland & Tchantcho, Bertrand & Tedjeugang, Narcisse, 2014. "Power theories for multi-choice organizations and political rules: Rank-order equivalence," Operations Research Perspectives, Elsevier, vol. 1(1), pages 42-49.
    21. Gulati, Rachita & Kattumuri, Ruth & Kumar, Sunil, 2020. "A non-parametric index of corporate governance in the banking industry: An application to Indian data," Socio-Economic Planning Sciences, Elsevier, vol. 70(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pal:jorsoc:v:68:y:2017:i:4:d:10.1057_s41274-016-0165-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.palgrave-journals.com/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.