IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v14y2022i20p13446-d946101.html
   My bibliography  Save this article

Interpretable Success Prediction in Higher Education Institutions Using Pedagogical Surveys

Author

Listed:
  • Fátima Leal

    (Science and Technology Department, University Portucalense, 4200-072 Porto, Portugal
    REMIT—Research on Economics, Management and Information Technologies, 4200-072 Porto, Portugal)

  • Bruno Veloso

    (Science and Technology Department, University Portucalense, 4200-072 Porto, Portugal
    INESC TEC—Instituto de Engenharia de Sistemas e Computadores, Tecnologia e Ciência, 4200-465 Porto, Portugal)

  • Carla Santos Pereira

    (Science and Technology Department, University Portucalense, 4200-072 Porto, Portugal
    REMIT—Research on Economics, Management and Information Technologies, 4200-072 Porto, Portugal
    IJP—Instituto Jurídico Portucalense, 4200-072 Porto, Portugal)

  • Fernando Moreira

    (Science and Technology Department, University Portucalense, 4200-072 Porto, Portugal
    REMIT—Research on Economics, Management and Information Technologies, 4200-072 Porto, Portugal
    IJP—Instituto Jurídico Portucalense, 4200-072 Porto, Portugal
    IE et A—Institute of Electronics and Informatics Engineering, University of Aveiro, 3810-193 Aveiro, Portugal)

  • Natércia Durão

    (Science and Technology Department, University Portucalense, 4200-072 Porto, Portugal
    REMIT—Research on Economics, Management and Information Technologies, 4200-072 Porto, Portugal
    IJP—Instituto Jurídico Portucalense, 4200-072 Porto, Portugal)

  • Natacha Jesus Silva

    (Science and Technology Department, University Portucalense, 4200-072 Porto, Portugal
    IJP—Instituto Jurídico Portucalense, 4200-072 Porto, Portugal)

Abstract

The indicators of student success at higher education institutions are continuously analysed to increase the students’ enrolment in multiple scientific areas. Every semester, the students respond to a pedagogical survey that aims to collect the student opinion of curricular units in terms of content and teaching methodologies. Using this information, we intend to anticipate the success in higher-level courses and prevent dropouts. Specifically, this paper contributes with an interpretable student classification method. The proposed solution relies on (i) a pedagogical survey to collect student’s opinions; (ii) a statistical data analysis to validate the reliability of the survey; and (iii) machine learning algorithms to classify the success of a student. In addition, the proposed method includes an explainable mechanism to interpret the classifications and their main factors. This transparent pipeline was designed to have implications in both digital and sustainable education, impacting the three pillars of sustainability, i.e.,economic, social, and environmental, where transparency is a cornerstone. The work was assessed with a dataset from a Portuguese higher-level institution, contemplating multiple courses from different departments. The most promising results were achieved with Random Forest presenting 98% in accuracy and F -measure.

Suggested Citation

  • Fátima Leal & Bruno Veloso & Carla Santos Pereira & Fernando Moreira & Natércia Durão & Natacha Jesus Silva, 2022. "Interpretable Success Prediction in Higher Education Institutions Using Pedagogical Surveys," Sustainability, MDPI, vol. 14(20), pages 1-18, October.
    • Handle: RePEc:gam:jsusta:v:14:y:2022:i:20:p:13446-:d:946101
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/14/20/13446/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2071-1050/14/20/13446/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. María del Carmen Olmos-Gómez & Mónica Luque Suárez & Concetta Ferrara & Eva María Olmedo-Moreno, 2020. "Quality of Higher Education through the Pursuit of Satisfaction with a Focus on Sustainability," Sustainability, MDPI, vol. 12(6), pages 1-20, March.
    2. Mahdi M. Alamri & Mohammed Amin Almaiah & Waleed Mugahed Al-Rahmi, 2020. "Social Media Applications Affecting Students’ Academic Performance: A Model Developed for Sustainability in Higher Education," Sustainability, MDPI, vol. 12(16), pages 1-14, August.
    3. Rosa María Brito & Columba Rodríguez & José Luis Aparicio, 2018. "Sustainability in Teaching: An Evaluation of University Teachers and Students," Sustainability, MDPI, vol. 10(2), pages 1-16, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mohammed Abdullatif Almulla & Mahdi Mohammed Alamri, 2021. "Using Conceptual Mapping for Learning to Affect Students’ Motivation and Academic Achievement," Sustainability, MDPI, vol. 13(7), pages 1-17, April.
    2. Sung-Shun Weng & Yang Liu & Yen-Ching Chuang, 2019. "Reform of Chinese Universities in the Context of Sustainable Development: Teacher Evaluation and Improvement Based on Hybrid Multiple Criteria Decision-Making Model," Sustainability, MDPI, vol. 11(19), pages 1-23, October.
    3. Ali Mugahed Al-Rahmi & Alina Shamsuddin & Uthman Alturki & Ahmed Aldraiweesh & Farahwahida Mohd Yusof & Waleed Mugahed Al-Rahmi & Abdulmajeed A. Aljeraiwi, 2021. "The Influence of Information System Success and Technology Acceptance Model on Social Media Factors in Education," Sustainability, MDPI, vol. 13(14), pages 1-23, July.
    4. Yi-Chen Lai & Li-Hsun Peng, 2019. "Effective Teaching and Activities of Excellent Teachers for the Sustainable Development of Higher Design Education," Sustainability, MDPI, vol. 12(1), pages 1-27, December.
    5. Anirban Chakraborty & Sumit Kumar & L. S. Shashidhara & Anjali Taneja, 2021. "Building Sustainable Societies through Purpose-Driven Universities: A Case Study from Ashoka University (India)," Sustainability, MDPI, vol. 13(13), pages 1-20, July.
    6. María del Carmen Olmos-Gómez & Mónica Luque-Suárez & Concetta Ferrara & Jesús Manuel Cuevas-Rincón, 2020. "Analysis of Psychometric Properties of the Quality and Satisfaction Questionnaire Focused on Sustainability in Higher Education," Sustainability, MDPI, vol. 12(19), pages 1-16, October.
    7. Gracia González-Gijón & Nazaret Martínez-Heredia & Francisco Javier Jiménez Ríos & Andrés Soriano Díaz, 2021. "Analysis of Ecological Values in Future Education Professionals in Andalusia (Spain)," Sustainability, MDPI, vol. 13(14), pages 1-12, July.
    8. Quetzalcoatl Hernandez-Escobedo & Alida Ramirez-Jimenez & Jesús Manuel Dorador-Gonzalez & Miguel-Angel Perea-Moreno & Alberto-Jesus Perea-Moreno, 2020. "Sustainable Solar Energy in Mexican Universities. Case Study: The National School of Higher Studies Juriquilla (UNAM)," Sustainability, MDPI, vol. 12(8), pages 1-22, April.
    9. Monika Sady & Agnieszka Żak & Karolina Rzepka, 2019. "The Role of Universities in Sustainability-Oriented Competencies Development: Insights from an Empirical Study on Polish Universities," Administrative Sciences, MDPI, vol. 9(3), pages 1-20, August.
    10. Ahmad Althunibat & Muhammad Binsawad & Mohammed Amin Almaiah & Omar Almomani & Adeeb Alsaaidah & Waleed Al-Rahmi & Mohamed Elhassan Seliaman, 2021. "Sustainable Applications of Smart-Government Services: A Model to Understand Smart-Government Adoption," Sustainability, MDPI, vol. 13(6), pages 1-28, March.
    11. Alexander K. Killion & Jessica Ostrow Michel & Jason K. Hawes, 2022. "Toward Identifying Sustainability Leadership Competencies: Insights from Mapping a Graduate Sustainability Education Curriculum," Sustainability, MDPI, vol. 14(10), pages 1-18, May.
    12. Bao, Tiantian & Liu, Yifan & Yang, Zhongzhen & Wu, Shanhua & Yan, Zhenli, 2024. "Evaluating sustainable service quality in higher education from a multi-stakeholder perspective: An integrated fuzzy group decision-making method," Socio-Economic Planning Sciences, Elsevier, vol. 92(C).
    13. María del Carmen Olmos-Gómez & Mónica Luque-Suárez & Diego Becerril-Ruiz & Jesús Manuel Cuevas-Rincón, 2021. "Gender and Socioeconomic Status as Factors of Individual Differences in Pre-University Students’ Decision-Making for Careers, with a Focus on Family Influence and Psychosocial Factors," IJERPH, MDPI, vol. 18(3), pages 1-12, February.
    14. Ling Wang & Gongliang Hu & Tiehua Zhou, 2018. "Semantic Analysis of Learners’ Emotional Tendencies on Online MOOC Education," Sustainability, MDPI, vol. 10(6), pages 1-19, June.
    15. Cristina Dimulescu, 2023. "E-Learning Platform Usage and Acceptance of Technology after the COVID-19 Pandemic: The Case of Transilvania University," Sustainability, MDPI, vol. 15(22), pages 1-26, November.
    16. Uthman Alturki & Ahmed Aldraiweesh, 2021. "Application of Learning Management System (LMS) during the COVID-19 Pandemic: A Sustainable Acceptance Model of the Expansion Technology Approach," Sustainability, MDPI, vol. 13(19), pages 1-16, October.
    17. Tajammal Hussain & Jacob Eskildsen & Rick Edgeman & Muhammad Ismail & Alaa Mohamd Shoukry & Showkat Gani, 2019. "Imperatives of Sustainable University Excellence: A Conceptual Framework," Sustainability, MDPI, vol. 11(19), pages 1-21, September.
    18. María del Carmen Olmos-Gómez, 2020. "Sex and Careers of University Students in Educational Practices as Factors of Individual Differences in Learning Environment and Psychological Factors during COVID-19," IJERPH, MDPI, vol. 17(14), pages 1-19, July.
    19. Joanna Sadłowska-Wrzesińska & Kamila Piosik & Żaneta Nejman, 2022. "Psychosocial Context of OSH-Remote Work of Academic Teachers in the Perspective of Sustainable Development," IJERPH, MDPI, vol. 19(22), pages 1-16, November.
    20. Ibrahim Youssef Alyoussef, 2021. "Massive Open Online Course (MOOCs) Acceptance: The Role of Task-Technology Fit (TTF) for Higher Education Sustainability," Sustainability, MDPI, vol. 13(13), pages 1-14, July.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:14:y:2022:i:20:p:13446-:d:946101. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.