AI-Assisted Automated Scoring of Picture-Cued Writing Tasks for Language Assessment

Autor/inn/en	Zhao, Ruibin; Zhuang, Yipeng; Zou, Di; Xie, Qin; Yu, Philip L. H.
Titel	AI-Assisted Automated Scoring of Picture-Cued Writing Tasks for Language Assessment
Quelle	In: Education and Information Technologies, 28 (2023) 6, S.7031-7063 (33 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1360-2357
DOI	10.1007/s10639-022-11473-y
Schlagwörter	Artificial Intelligence; Automation; Scoring; Visual Aids; Writing (Composition); Language Tests; Elementary School Students; Secondary School Students + Suchen Sie Ihr Suchwort? Künstliche Intelligenz; Bewertung; Anschauungsmaterial; Schreibübung; Language test; Sprachtest; Sekundarschüler
Abstract	Grading assignments is inherently subjective and time-consuming; automatic scoring tools can greatly reduce teacher workload and shorten the time needed for providing feedback to learners. The purpose of this paper is to propose a novel method for automatically scoring student responses to picture-cued writing tasks. As a popular paradigm for language instruction and assessment, a picture-cued writing task typically requires students to describe a picture or pictures. Correspondingly, the automatic scoring methods must measure the link(s) between visual pictures and their textual descriptions. For this purpose, we first designed a picture-cued writing test and collected nearly 4 k responses from 279 K12 students. Based on these responses, we then developed an AI scoring model by incorporating the emerging cross-modal matching technology and some NLP algorithms. The performance of the model was evaluated carefully with six popular measures and was found to demonstrate accurate scoring results with a small mean absolute error of 0.479 and a high adjacent-agreement rate of 90.64%. We believe this method could reduce the subjective elements inherent in human grading and save teachers' time from the mundane task of grading to other valuable endeavors such as designing teaching plans based on AI-generated diagnosis of student progress. (As Provided).
Anmerkungen	Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01