Applications of Deep Language Models for Reflective Writings

Autor/inn/en	Nehyba, Jan; Štefánik, Michal
Titel	Applications of Deep Language Models for Reflective Writings
Quelle	In: Education and Information Technologies, 28 (2023) 3, S.2961-2999 (39 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Nehyba, Jan) ORCID (Štefánik, Michal)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1360-2357
DOI	10.1007/s10639-022-11254-7
Schlagwörter	Models; Language; Reflection; Writing (Composition); Student Teachers; Artificial Intelligence; Data Collection; Data Analysis; Accuracy; Feedback (Response) + Suchen Sie Ihr Suchwort? Analogiemodell; Languages; Sprache; Schreibübung; Lehramtsstudent; Lehramtsstudentin; Referendar; Referendarin; Künstliche Intelligenz; Data capture; Datensammlung; Auswertung
Abstract	Social sciences expose many cognitively complex, highly qualified, or fuzzy problems, whose resolution relies primarily on expert judgement rather than automated systems. One of such instances that we study in this work is a reflection analysis in the writings of student teachers. We share a hands-on experience on how these challenges can be successfully tackled in data collection for machine learning. Based on the novel deep learning architectures pre-trained for a general language understanding, we can reach an accuracy ranging from 76.56-79.37% on low-confidence samples to 97.56-100% on high confidence cases. We open-source all our resources and models, and use the models to analyse previously ungrounded hypotheses on reflection of university students. Our work provides a toolset for objective measurements of reflection in higher education writings, applicable in more than 100 other languages worldwide with a loss in accuracy measured between 0-4.2% Thanks to the outstanding accuracy of the deep models, the presented toolset allows for previously unavailable applications, such as providing semi-automated student feedback or measuring an effect of systematic changes in the educational process via the students' response. (As Provided).
Anmerkungen	Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01