A Method for Analyzing Learning Sentiment Based on Classroom Time-Series Images

With the development of smart classrooms, analyzing students’ emotions for classroom learning is an effective means of accurately capturing their learning process. Although facial expression-based emotion analysis methods are effective in analyzing classroom learning emotions, current research focuses on facial expressions and does not consider the fact that expressions in different postures do not represent the same emotions. To provide a continuous and deeper understanding of students’ learning emotions, this study proposes an algorithm to characterize learning emotions based on classroom time-series image data. First, face expression data for classroom scenarios are established to address the lack of expression databases in real teaching environments. Second, to improve the accuracy of facial expression recognition, a residual channel cross transformer masking net expression recognition model is proposed in this paper. Finally, to address the problem that the existing research dimension of learning emotion is too single, this paper uses the facial expression and head posture data obtained from deep learning models for fusion analysis and innovatively proposes a Dempster–Shafer evidence-theoretic fusion model to characterize the learning emotion within the lecture duration of knowledge points. The experiments show that both the proposed expression recognition model and the learning sentiment analysis algorithm have good performance, with the expression recognition model achieving an accuracy of 73.58% on the FER2013 dataset. The proposed learning emotion analysis method provides technical support for holistic analysis of student learning effects and evaluation of students’ level of understanding of the knowledge points.