Combining Machine Learning and Natural Language Processing to Assess Literary Text Comprehension [Konferenzbericht] Paper presented at the International Conference on Educational Data Mining (10th, 2017).

Autor/inn/en	Balyan, Renu; McCarthy, Kathryn S.; McNamara, Danielle S.
Titel	Combining Machine Learning and Natural Language Processing to Assess Literary Text Comprehension [Konferenzbericht] Paper presented at the International Conference on Educational Data Mining (10th, 2017).
Quelle	(2017), (7 Seiten) PDF als Volltext kostenfreie Datei Verfügbarkeit
Zusatzinformation	Weitere Informationen
Sprache	englisch
Dokumenttyp	gedruckt; online; Monographie
Schlagwörter	Artificial Intelligence; Natural Language Processing; Reading Comprehension; Literature; Comparative Analysis; Accuracy; Classification; Mathematics; Essays; College Students + Suchen Sie Ihr Suchwort? Künstliche Intelligenz; Natürliche Sprache; Leseverstehen; Literatur; Classification system; Klassifikation; Klassifikationssystem; Mathematik; Essay; Aufsatzunterricht; Collegestudent
Abstract	This study examined how machine learning and natural language processing (NLP) techniques can be leveraged to assess the interpretive behavior that is required for successful literary text comprehension. We compared the accuracy of seven different machine learning classification algorithms in predicting human ratings of student essays about literary works. Three types of NLP feature sets: unigrams (single content words), elaborative (new) n-grams, and linguistic features were used to classify idea units (paraphrase, text-based inference, interpretive inference). The most accurate classifications emerged using all three NLP features sets in combination, with accuracy ranging from 0.61 to 0.94 (F = 0.18 to 0.81). Random Forests, which employs multiple decision trees and a bagging approach, was the most accurate classifier for these data. In contrast, the single classifier, Trees, which tends to "overfit" the data during training, was the least accurate. Ensemble classifiers were generally more accurate than single classifiers. However, Support Vector Machines accuracy was comparable to that of the ensemble classifiers. This is likely due to Support Vector Machines' unique ability to support high dimension feature spaces. The findings suggest that combining the power of NLP and machine learning is an effective means of automating literary text comprehension assessment. [This paper was published in: A. Hershkovitz & L. Paquette (Eds.), "Proceedings of the 10th International Conference on Educational Data Mining" (pp. 244-249), Wuhan, China: International Educational Data Mining Society.] (As Provided).
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2020/1/01