Chapter 3: Using Machine Learning to Advance Early Warning Systems--Promise and Pitfalls

Autor/inn/en	Soland, James; Domingue, Benjamin; Lang, David
Titel	Chapter 3: Using Machine Learning to Advance Early Warning Systems--Promise and Pitfalls
Quelle	In: Teachers College Record, 122 (2020) 14, (30 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0161-4681
Schlagwörter	Identification; At Risk Students; Potential Dropouts; High School Students; Artificial Intelligence; Predictor Variables; Accuracy; Information Management + Suchen Sie Ihr Suchwort? Identifikation; Identifizierung; High school; High schools; Student; Students; Oberschule; Schüler; Schülerin; Studentin; Künstliche Intelligenz; Prädiktor; Procurement of information; Informationsbeschaffung
Abstract	Background/Context: Early warning indicators (EWI) are often used by states and districts to identify students who are not on track to finish high school, and provide supports/interventions to increase the odds the student will graduate. While EWI are diverse in terms of the academic behaviors they capture, research suggests that indicators like course failures, chronic absenteeism, and suspensions can help identify students in need of additional supports. In parallel with the expansion of administrative data that have made early versions of EWI possible, new machine learning methods have been developed. These methods are data-driven and often designed to sift through thousands of variables with the purpose of identifying the best predictors of a given outcome. While applications of machine learning techniques to identify students at-risk of high school dropout have obvious appeal, few studies consider the benefits and limitations of applying those models in an EWI context, especially as they relate to questions of fairness and equity. Focus of Study: In this study, we will provide applied examples of how machine learning can be used to support EWI selection. The purpose is to articulate the broad risks and benefits of using machine learning methods to identify students who may be at risk of dropping out. We focus on dropping out given its salience in the EWI literature, but also anticipate generating insights that will be germane to EWI used for a variety of outcomes. Research Design: We explore these issues by using several hypothetical examples of how ML techniques might be used to identify EWI. For example, we show results from decision tree algorithms used to identify predictors of dropout that use simulated data. Conclusions/Recommendations: Generally, we argue that machine learning techniques have several potential benefits in the EWI context. For example, some related methods can help create clear decision rules for which students are a dropout risk, and their predictive accuracy can be higher than for more traditional, regression-based models. At the same time, these methods often require additional statistical and data management expertise to be used appropriately. Further, the black-box nature of machine learning algorithms could invite their users to interpret results through the lens of preexisting biases about students and educational settings. (As Provided).
Anmerkungen	Teachers College, Columbia University. P.O. Box 103, 525 West 120th Street, New York, NY 10027. Tel: 212-678-3774; Fax: 212-678-6619; e-mail: tcr@tc.edu; Web site: http://www.tcrecord.org
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01