Using Sequence Mining Techniques for Understanding Incorrect Behavioral Patterns on Interactive Tasks

Autor/inn/en	Ulitzsch, Esther; He, Qiwei; Pohl, Steffi
Titel	Using Sequence Mining Techniques for Understanding Incorrect Behavioral Patterns on Interactive Tasks
Quelle	In: Journal of Educational and Behavioral Statistics, 47 (2022) 1, S.3-35 (33 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Ulitzsch, Esther)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1076-9986
DOI	10.3102/10769986211010467
Schlagwörter	Behavior Patterns; Problem Solving; Failure; Adults; Responses; Tests; Data Analysis; Time; Differences; Interaction; Program for the International Assessment of Adult Competencies (PIAAC) + Suchen Sie Ihr Suchwort? Problemlösen; Examination; Prüfung; Examen; Auswertung; Zeit; Unterscheiden; Interaktion
Abstract	Interactive tasks designed to elicit real-life problem-solving behavior are rapidly becoming more widely used in educational assessment. Incorrect responses to such tasks can occur for a variety of different reasons such as low proficiency levels, low metacognitive strategies, or motivational issues. We demonstrate how behavioral patterns associated with incorrect responses can, in part, be understood, supporting insights into the different sources of failure on a task. To this end, we make use of sequence mining techniques that leverage the information contained in time-stamped action sequences commonly logged in assessments with interactive tasks for: (1) investigating what distinguishes incorrect behavioral patterns from correct ones; and (2) identifying subgroups of examinees with similar incorrect behavioral patterns. Analyzing a task from the Programme for the International Assessment of Adult Competencies 2012 assessment, we find incorrect behavioral patterns to be more heterogeneous than correct ones. We identify multiple subgroups of incorrect behavioral patterns, which point toward different levels of effort and lack of different subskills needed for solving the task. Albeit focusing on a single task, meaningful patterns of major differences in how examinees approach a given task that generalize across multiple tasks are uncovered. Implications for the construction and analysis of interactive tasks as well as the design of interventions for complex problem-solving skills are derived. (As Provided).
Anmerkungen	SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01