Literaturnachweis - Detailanzeige
Autor/inn/en | Gardner, Josh; Brooks, Christopher |
---|---|
Titel | Evaluating Predictive Models of Student Success: Closing the Methodological Gap |
Quelle | In: Journal of Learning Analytics, 5 (2018) 2, S.105-125 (21 Seiten)Infoseite zur Zeitschrift
PDF als Volltext |
Sprache | englisch |
Dokumenttyp | gedruckt; online; Zeitschriftenaufsatz |
ISSN | 1929-7750 |
Schlagwörter | Prediction; Models; Evaluation; Evaluation Methods; Comparative Analysis; Hypothesis Testing; Bayesian Statistics; Data Analysis; Online Courses; Academic Achievement; Case Studies; Mathematics; Computation |
Abstract | Model evaluation -- the process of making inferences about the performance of predictive models -- is a critical component of predictive modelling research in learning analytics. We survey the state of the practice with respect to model evaluation in learning analytics, which overwhelmingly uses only naïve methods for model evaluation or statistical tests that are not appropriate for predictive model evaluation. We conduct a critical comparison of both null hypothesis significance testing (NHST) and a preferred Bayesian method for model evaluation. Finally, we apply three methods -- the naïve average commonly used in learning analytics, NHST, and Bayesian -- to a predictive modelling experiment on a large set of MOOC data. We compare 96 different predictive models, including different feature sets, statistical modelling algorithms, and tuning hyperparameters for each, using this case study to demonstrate the different experimental conclusions these evaluation techniques provide. (As Provided). |
Anmerkungen | Society for Learning Analytics Research. 121 Pointe Marsan, Beaumont, AB T4X 0A2, Canada. Tel: +61-429-920-838; e-mail: info@solaresearch.org; Web site: http://learning-analytics.info/journals/index.php/JLA/ |
Erfasst von | ERIC (Education Resources Information Center), Washington, DC |
Update | 2020/1/01 |