IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v9y2021i3p287-d490890.html
   My bibliography  Save this article

Computer Vision and Human Behaviour, Emotion and Cognition Detection: A Use Case on Student Engagement

Author

Listed:
  • Pieter Vanneste

    (KU Leuven, Faculty of Psychology and Educational Sciences, 3000 Leuven, Belgium
    KU Leuven, Imec Research Group Itec, 8500 Kortrijk, Belgium)

  • José Oramas

    (University of Antwerp, Department of Computer Science, Internet Data Lab (IDLab), 2000 Antwerpen, Belgium)

  • Thomas Verelst

    (KU Leuven, Department of Electrical Engineering, research group on Processing Speech and Images (PSI), 3000 Leuven, Belgium)

  • Tinne Tuytelaars

    (KU Leuven, Department of Electrical Engineering, research group on Processing Speech and Images (PSI), 3000 Leuven, Belgium)

  • Annelies Raes

    (KU Leuven, Faculty of Psychology and Educational Sciences, 3000 Leuven, Belgium
    KU Leuven, Imec Research Group Itec, 8500 Kortrijk, Belgium
    CIREL—Centre Interuniversitaire de Recherche en Education de Lille (ULR 4354), 59650 Villeneuve-d’Ascq, France)

  • Fien Depaepe

    (KU Leuven, Faculty of Psychology and Educational Sciences, 3000 Leuven, Belgium
    KU Leuven, Imec Research Group Itec, 8500 Kortrijk, Belgium)

  • Wim Van den Noortgate

    (KU Leuven, Faculty of Psychology and Educational Sciences, 3000 Leuven, Belgium
    KU Leuven, Imec Research Group Itec, 8500 Kortrijk, Belgium)

Abstract

Computer vision has shown great accomplishments in a wide variety of classification, segmentation and object recognition tasks, but tends to encounter more difficulties when tasks require more contextual assessment. Measuring the engagement of students is an example of such a complex task, as it requires a strong interpretative component. This research describes a methodology to measure students’ engagement, taking both an individual (student-level) and a collective (classroom) approach. Results show that students’ individual behaviour, such as note-taking or hand-raising, is challenging to recognise, and does not correlate with students’ self-reported engagement. Interestingly, students’ collective behaviour can be quantified in a more generic way using measures for students’ symmetry, reaction times and eye-gaze intersections. Nonetheless, the evidence for a connection between these collective measures and engagement is rather weak. Although this study does not succeed in providing a proxy of students’ self-reported engagement, our approach sheds light on the needs for future research. More concretely, we suggest that not only the behavioural, but also the emotional and cognitive component of engagement should be captured.

Suggested Citation

  • Pieter Vanneste & José Oramas & Thomas Verelst & Tinne Tuytelaars & Annelies Raes & Fien Depaepe & Wim Van den Noortgate, 2021. "Computer Vision and Human Behaviour, Emotion and Cognition Detection: A Use Case on Student Engagement," Mathematics, MDPI, vol. 9(3), pages 1-20, February.
  • Handle: RePEc:gam:jmathe:v:9:y:2021:i:3:p:287-:d:490890
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/9/3/287/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/9/3/287/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Macey, William H. & Schneider, Benjamin, 2008. "The Meaning of Employee Engagement," Industrial and Organizational Psychology, Cambridge University Press, vol. 1(1), pages 3-30, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yujie Li & Longzhao Huang & Jiahui Chen & Xiwen Wang & Benying Tan, 2023. "Appearance-Based Gaze Estimation Method Using Static Transformer Temporal Differential Network," Mathematics, MDPI, vol. 11(3), pages 1-18, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Farndale, Elaine & Scullion, Hugh & Sparrow, Paul, 2010. "The role of the corporate HR function in global talent management," Journal of World Business, Elsevier, vol. 45(2), pages 161-168, April.
    2. Muhammad Junaid Ahsan & Muhammad Ishtiaq Ishaq & Ali Raza & Qurat‐ul‐ain Talpur, 2024. "Let leaders permit nature! Role of employee engagement, environmental values, and sustainable behavioral intentions," Business Strategy and the Environment, Wiley Blackwell, vol. 33(8), pages 7905-7921, December.
    3. Mohammed Kamruzzaman & Sunan Islam, 2021. "Correlating the diversity awareness within the organizations of Bangladesh in the era of industry 4.0-Human resource perspective," International Journal of Research and Innovation in Social Science, International Journal of Research and Innovation in Social Science (IJRISS), vol. 5(09), pages 83-97, September.
    4. Francoise Contreras & Juan C. Espinosa & Gustavo A. Esguerra, 2020. "Could Personal Resources Influence Work Engagement and Burnout? A Study in a Group of Nursing Staff," SAGE Open, , vol. 10(1), pages 21582440199, January.
    5. Dharmendra MEHTA & Naveen K. MEHTA, 2013. "Employee Engagement: A Literature Review," Economia. Seria Management, Faculty of Management, Academy of Economic Studies, Bucharest, Romania, vol. 16(2), pages 208-215, December.
    6. Nina Pološki Vokić & Tomislav Hernaus, 2015. "The triad of job satisfaction, work engagement and employee loyalty – The interplay among the concepts," EFZG Working Papers Series 1507, Faculty of Economics and Business, University of Zagreb.
    7. Jonathan Chih Win Zaw Tun & Papitchaya Wisankosol, 2021. "The Impact of an ODI on the Development of Leadership, Employee Motivation and Employee Engagement towards Better Performance of Employees: A Case Study," International Journal of Economics & Business Administration (IJEBA), International Journal of Economics & Business Administration (IJEBA), vol. 0(2), pages 22-43.
    8. Salas-Vallina, Andrés & Simone, Cristina & Fernández-Guerrero, Rafael, 2020. "The human side of leadership: Inspirational leadership effects on follower characteristics and happiness at work (HAW)," Journal of Business Research, Elsevier, vol. 107(C), pages 162-171.
    9. Muhammad Umer Azeem & Inam Ul Haq & Ghulam Murtaza & Hina Jaffery, 2023. "Challenge–Hindrance Stressors, Helping Behavior and Job Performance: Double-Edged Sword of Religiousness," Journal of Business Ethics, Springer, vol. 184(3), pages 687-699, May.
    10. Maria Luisa Giancaspro & Antonino Callea & Amelia Manuti, 2022. "“I Like It like That”: A Study on the Relationship between Psychological Capital, Work Engagement and Extra-Role Behavior," Sustainability, MDPI, vol. 14(4), pages 1-17, February.
    11. Urmila Rani Srivastava & Vandana Maurya, 2017. "Organizational and Individual Level Antecedents of Psychological Capital and its Associated Outcomes: Development of a Conceptual Framework," Management and Labour Studies, XLRI Jamshedpur, School of Business Management & Human Resources, vol. 42(3), pages 205-236, August.
    12. Ana Lisbona & Abel Las-Hayas & Francisco J. Palací & Miguel Bernabé & Francisco J. Morales & Alexander Haslam, 2020. "Team Efficiency in Organizations: A Group Perspective on Initiative," IJERPH, MDPI, vol. 17(6), pages 1-17, March.
    13. Robinson James, 2023. "Fit Perception and Engagement: The Mediating Role of Work Meaningfulness," Vision, , vol. 27(4), pages 474-484, August.
    14. Widdy Muhammad Sabar Wibawa & Yoshi Takahashi, 2021. "The Effect of Ethical Leadership on Work Engagement and Workaholism: Examining Self-Efficacy as a Moderator," Administrative Sciences, MDPI, vol. 11(2), pages 1-12, May.
    15. Tung, Dao Duy, 2020. "An empirical assessment of organizational commitment and job performance vietnam small and medium-sized enterprises," OSF Preprints awuk7, Center for Open Science.
    16. Neha Gupta & Vandna Sharma, 2016. "Exploring Employee Engagement—A Way to Better Business Performance," Global Business Review, International Management Institute, vol. 17(3_suppl), pages 45-63, June.
    17. Nida Kamal & Hina Samdani & Amna Yameen, 2018. "Engaging Employees through Ethical Leadership," Global Social Sciences Review, Humanity Only, vol. 3(3), pages 300-316, September.
    18. Utpal Baruah & T. Bangar Raju & Leena Sachdeva, 2023. "Mapping the Landscape of Employee Engagement Research: A Bibliometric Review and Future Research Directions," South Asian Journal of Business and Management Cases, , vol. 12(3), pages 253-274, December.
    19. Fu Yang & Jun Liu & Zhen Wang & Yucheng Zhang, 2019. "Feeling Energized: A Multilevel Model of Spiritual Leadership, Leader Integrity, Relational Energy, and Job Performance," Journal of Business Ethics, Springer, vol. 158(4), pages 983-997, September.
    20. Rawan Alafeshat & Cem Tanova, 2019. "Servant Leadership Style and High-Performance Work System Practices: Pathway to a Sustainable Jordanian Airline Industry," Sustainability, MDPI, vol. 11(22), pages 1-21, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:9:y:2021:i:3:p:287-:d:490890. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.