Automatic Detection of Students' Affective States in Classroom Environment Using Hybrid Convolutional Neural Networks

Autor/inn/en	T. S., Ashwin; Guddeti, Ram Mohana Reddy
Titel	Automatic Detection of Students' Affective States in Classroom Environment Using Hybrid Convolutional Neural Networks
Quelle	In: Education and Information Technologies, 25 (2020) 2, S.1387-1415 (29 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (T. S., Ashwin)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1360-2357
DOI	10.1007/s10639-019-10004-6
Schlagwörter	Identification; Psychological Patterns; Affective Behavior; Classroom Environment; Artificial Intelligence; Models; Nonverbal Communication; Human Posture; Accuracy + Suchen Sie Ihr Suchwort? Identifikation; Identifizierung; Affective disturbance; Active behaviour; Affektive Störung; Klassenklima; Unterrichtsklima; Künstliche Intelligenz; Analogiemodell; Non-verbal communication; Nonverbale Kommunikation; Posture; Körperhaltung
Abstract	Predicting the students' emotional and behavioral engagements using computer vision techniques is a challenging task. Though there are several state-of-the-art techniques for analyzing a student's affective states in an e-learning environment (single person's engagement detection in a single image frame), a very few works are available for analyzing the students' affective states in a classroom environment (multiple people in a single image frame). Hence, in this paper, we propose a novel hybrid convolutional neural network (CNN) architecture for analyzing the students' affective states in a classroom environment. This proposed architecture consists of two models, the first model (CNN-1) is designed to analyze the affective states of a single student in a single image frame and the second model (CNN-2) uses multiple students in a single image frame. Thus, our proposed hybrid architecture predicts the overall affective state of the entire class. The proposed architecture uses the students' facial expressions, hand gestures and body postures for analyzing their affective states. Further, due to unavailability of standard datasets for the students' affective state analysis, we created, annotated and tested on our dataset of over 8000 single face in a single image frame and 12000 multiple faces in a single image frame with three different affective states, namely: engaged, boredom and neutral. The experimental results demonstrate an accuracy of 86% and 70% for posed and spontaneous affective states of classroom data, respectively. (As Provided).
Anmerkungen	Springer. Available from: Springer Nature. 233 Spring Street, New York, NY 10013. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-348-4505; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01