Keep me in the loop. Real-time feedback with multimodal data.

Autor/inn/en	Di Mitri, Daniele; Schneider, Jan; Drachsler, Hendrik
Titel	Keep me in the loop. Real-time feedback with multimodal data.
Quelle	In: International journal of artificial intelligence in education, (2021) 32, S. 1039-1118Infoseite zur Zeitschrift PDF als Volltext kostenfreie Datei Link als defekt meldenVerfügbarkeit
Beigaben	Illustrationen
Sprache	englisch
Dokumenttyp	online; Zeitschriftenaufsatz
ISSN	1560-4306
DOI	10.1007/s40593-021-00281-z
Schlagwörter	Empirische Untersuchung; Fragebogen; Fertigkeit; Psychomotorik; Fehler; Feedback; Lernprozess; Medizin; Datenanalyse; Technologie; Training; Teilnehmer; Effektivität; Simulation; System; Tool; Datenverarbeitung
Abstract	This paper describes the CPR Tutor, a real-time multimodal feedback system for cardiopulmonary resuscitation (CPR) training. The CPR Tutor detects training mistakes using recurrent neural networks. The CPR Tutor automatically recognises and assesses the quality of the chest compressions according to five CPR performance indicators. It detects training mistakes in real-time by analysing a multimodal data stream consisting of kinematic and electromyographic data. Based on this assessment, the CPR Tutor provides audio feedback to correct the most critical mistakes and improve the CPR performance. The mistake detection models of the CPR Tutor were trained using a dataset from 10 experts. Hence, we tested the validity of the CPR Tutor and the impact of its feedback functionality in a user study involving additional 10 participants. The CPR Tutor pushes forward the current state of the art of real-time multimodal tutors by providing: (1) an architecture design, (2) a methodological approach for delivering real-time feedback using multimodal data and (3) a field study on real-time feedback for CPR training. This paper details the results of a field study by quantitatively measuring the impact of the CPR Tutor feedback on the performance indicators and qualitatively analysing the participants' questionnaire answers. (DIPF/Orig.).
Erfasst von	DIPF \| Leibniz-Institut für Bildungsforschung und Bildungsinformation, Frankfurt am Main
Update	2023/1