Where's the Reward?: A Review of Reinforcement Learning for Instructional Sequencing

Autor/inn/en	Doroudi, Shayan; Aleven, Vincent; Brunskill, Emma
Titel	Where's the Reward?: A Review of Reinforcement Learning for Instructional Sequencing
Quelle	In: International Journal of Artificial Intelligence in Education, 29 (2019) 4, S.568-620 (53 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Doroudi, Shayan) Weitere Informationen
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1560-4292
DOI	10.1007/s40593-019-00187-x
Schlagwörter	Reinforcement; Learning Processes; Sequential Learning; Decision Making; Cognitive Psychology; Best Practices; Artificial Intelligence; Intelligent Tutoring Systems + Suchen Sie Ihr Suchwort? Positive Verstärkung; Learning process; Lernprozess; Didaktische Sequenzierung; Lernsequenz; Decision-making; Entscheidungsfindung; Kognitive Psychologie; Künstliche Intelligenz; Intelligentes Tutorsystem
Abstract	Since the 1960s, researchers have been trying to optimize the sequencing of instructional activities using the tools of reinforcement learning (RL) and sequential decision making under uncertainty. Many researchers have realized that reinforcement learning provides a natural framework for optimal instructional sequencing given a particular model of student learning, and excitement towards this area of research is as alive now as it was over fifty years ago. But does RL actually help students learn? If so, when and where might we expect it to be most helpful? To help answer these questions, we review the variety of attempts to use RL for instructional sequencing. First, we present a historical narrative of this research area. We identify three waves of research, which gives us a sense of the various communities of researchers that have been interested in this problem and where the field is going. Second, we review all of the empirical research that has compared RL-induced instructional policies to baseline methods of sequencing. We find that over half of the studies found that RL-induced policies significantly outperform baselines. Moreover, we identify five clusters of studies with different characteristics and varying levels of success in using RL to help students learn. We find that reinforcement learning has been most successful in cases where it has been constrained with ideas and theories from cognitive psychology and the learning sciences. However, given that our theories and models are limited, we also find that it has been useful to complement this approach with running more robust offline analyses that do not rely heavily on the assumptions of one particular model. Given that many researchers are turning to deep reinforcement learning and big data to tackle instructional sequencing, we believe keeping these best practices in mind can help guide the way to the reward in using RL for instructional sequencing. (As Provided).
Anmerkungen	Springer. Available from: Springer Nature. 233 Spring Street, New York, NY 10013. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-348-4505; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2020/1/01