Using Machine Learning Sentiment Analysis to Evaluate Learning Impact

Autor/inn/en	Lazrig, Ibrahim; Humpherys, Sean L.
Titel	Using Machine Learning Sentiment Analysis to Evaluate Learning Impact
Quelle	In: Information Systems Education Journal, 20 (2022) 1, S.13-21 (9 Seiten) PDF als Volltext kostenfreie Datei Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1545-679X
Schlagwörter	College Students; Learning Analytics; Educational Research; Learning Experience; Mathematics; Man Machine Systems; Classification; Accuracy; Bayesian Statistics; Student Attitudes; Technology Uses in Education; Information Systems + Suchen Sie Ihr Suchwort? Collegestudent; Bildungsforschung; Pädagogische Forschung; Lernerfahrung; Mathematik; Mensch-Maschine-System; Classification system; Klassifikation; Klassifikationssystem; Schülerverhalten; Technology enhanced learning; Technology aided learning; Technologieunterstütztes Lernen
Abstract	Can sentiment analysis be used in an educational context to help teachers and researchers evaluate students' learning experiences? Are sentiment analyzing algorithms accurate enough to replace multiple human raters in educational research? A dataset of 333 students evaluating a learning experience was acquired with positive, negative, and neutral sentiments. Nine machine learning algorithms were used in five experimental configurations. Two non-learning algorithms were used in two experimental configurations. Each experiment compared the results of the algorithm's classification of sentiment (positive, neutral, or negative) with the judgment of sentiment by three human raters. When excluding neutral sentiment, 98% accuracy was achieved using naive Bayes. We demonstrate that current algorithms do not yet accurately classify neutral sentiments in an educational context. An algorithm using a word-sentiment association strategy was able to achieve 87% accuracy and did not require pretraining the model, which increases generalizability and applicability of the model. More educational datasets with sentiment are needed to improve sentiment analysis algorithms. (As Provided).
Anmerkungen	Information Systems and Computing Academic Professionals. Box 488, Wrightsville Beach, NC 28480. e-mail: publisher@isedj.org; Web site: http://isedj.org
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01