To Aggregate or Not? Linguistic Features in Automatic Essay Scoring and Feedback Systems

Autor/inn/en	Crossley, Scott A.; Kyle, Kristopher; McNamara, Danielle S.
Titel	To Aggregate or Not? Linguistic Features in Automatic Essay Scoring and Feedback Systems
Quelle	8 (2015) 1, (19 Seiten)Infoseite zur Zeitschrift PDF als Volltext (1); PDF als Volltext kostenfreie Datei (2) Verfügbarkeit
Zusatzinformation	Weitere Informationen
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
Schlagwörter	Essays; Scoring; Feedback (Response); Writing Evaluation; Computer Software; Formative Evaluation; Reliability; Accuracy; Computational Linguistics; Natural Language Processing; Verbs; Semantics + Suchen Sie Ihr Suchwort? Essay; Aufsatzunterricht; Bewertung; Reliabilität; Linguistics; Computerlinguistik; Natürliche Sprache; Semantik
Abstract	This study investigates the relative efficacy of using linguistic micro-features, the aggregation of such features, and a combination of micro-features and aggregated features in developing automatic essay scoring (AES) models. Although the use of aggregated features is widespread in AES systems (e.g., e-rater; Intellimetric), very little published data exists that demonstrates the superiority of using such a method over the use of linguistic micro-features or combination of both micro-features and aggregated features. The results of this study indicate that AES models comprised of micro-features and a combination of micro-features and aggregated features outperform AES models comprised of aggregated features alone. The results also indicate that that AES models based on micro-features and a combination of micro-features and aggregated features provide a greater variety of features with which to provide formative feedback to writers. These results have implications for the development of AES systems and for providing automatic feedback to writers within these systems. (As Provided).
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2022/4/11