Early Detection of Wheel Spinning: Comparison across Tutors, Models, Features, and Operationalizations [Konferenzbericht] Paper presented at the International Conference on Educational Data Mining (EDM) (12th, Montreal, Canada, Jul 2-5, 2019).

Autor/inn/en	Zhang, Chuankai; Huang, Yanzun; Wang, Jingyu; Lu, Dongyang; Fang, Weiqi; Stamper, John; Fancsali, Stephen; Holstein, Kenneth; Aleven, Vincent
Titel	Early Detection of Wheel Spinning: Comparison across Tutors, Models, Features, and Operationalizations [Konferenzbericht] Paper presented at the International Conference on Educational Data Mining (EDM) (12th, Montreal, Canada, Jul 2-5, 2019).
Quelle	(2019), (6 Seiten) PDF als Volltext kostenfreie Datei Verfügbarkeit
Zusatzinformation	Weitere Informationen
Sprache	englisch
Dokumenttyp	gedruckt; online; Monographie
Schlagwörter	Identification; Intelligent Tutoring Systems; Academic Failure; Criteria; Algebra; Geometry; Mathematics Instruction; Models; Comparative Analysis; Knowledge Level + Suchen Sie Ihr Suchwort? Identifikation; Identifizierung; Intelligentes Tutorsystem; Geometrie; Mathematics lessons; Mathematikunterricht; Analogiemodell; Wissensbasis
Abstract	"Wheel spinning" is the phenomenon in which a student fails to master a Knowledge Component (KC), despite significant practice. Ideally, an intelligent tutoring system would detect this phenomenon early, so that the system or a teacher could try alternative instructional strategies. Prior work has put forward several criteria for wheel spinning and has demonstrated that wheel spinning can be detected reasonably early. Yet the literature lacks systematic comparisons among the multiple wheel spinning criteria, features, and models that have been proposed, across multiple evaluation criteria (e.g., earliness, precision, and generalizability) and datasets. In our experiments, we constructed six wheel spinning detectors and compared their performance under two different wheel spinning criteria with three datasets. The results show that two prominent criteria for wheel spinning diverge substantially, and that a Random Forest model has the most consistent performance in early detection of wheel spinning across datasets and wheel spinning criteria. In addition, we found that a simple model overlooked by previous research (Logistic Regression trained on a single feature) is able to detect wheel spinning at an early stage with decent performance. This work brings us closer to unifying strands of prior work on wheel spinning (e.g., understanding how different criteria compare) and to early detection of wheel spinning in educational practice. [For the corresponding grantee submission, see ED594575. For the full proceedings, see ED599096.] (As Provided).
Anmerkungen	International Educational Data Mining Society. e-mail: admin@educationaldatamining.org; Web site: http://www.educationaldatamining.org
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2020/1/01