Automated and Interactive Game-Based Assessment of Critical Thinking

Autor/inn/en	Wang, Dang; Liu, Hongyun; Hau, Kit-Tai
Titel	Automated and Interactive Game-Based Assessment of Critical Thinking
Quelle	In: Education and Information Technologies, 27 (2022) 4, S.4553-4575 (23 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Wang, Dang) ORCID (Liu, Hongyun) ORCID (Hau, Kit-Tai)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1360-2357
DOI	10.1007/s10639-021-10777-9
Schlagwörter	Game Based Learning; Evaluation Methods; Critical Thinking; Simulation; Secondary School Students; Foreign Countries; Psychometrics; China + Suchen Sie Ihr Suchwort? Kritisches Denken; Simulation program; Simulationsprogramm; Sekundarschüler; Ausland; Psychometry; Psychometrie
Abstract	Critical thinking is one of the important higher-order skills very much treasured in education, but hard to be measured using paper-pencil tests. In line with recent recommendation to measure high-order thinking skills with interactive tasks (vs. static one set of questions), in this study we developed an interactive and automated game-based assessment of critical thinking, using the Toulmin Model. In two real-life simulation stories, through interactive tasks in progressing scenes in the stories, students chose and rated evidence and conflicting reasons as supportive or non-supportive arguments in making the eventual decision. Critical thinking scores were awarded on choosing the appropriate evidence and reasons. The psychometric quality of the game was evaluated with 185 Chinese senior secondary students. Results showed that (i) reliabilities as measured by Cronbach's a of the whole scale and subdomains were reasonable; (ii) parallel form reliability was high; (iii) its correlation and convergent validity with the popular Halpern Critical Thinking Assessment were comparable to those in other studies; (iv) it was generally not related to academic performance; and (v) the game was interesting and engaging. We also noted that students hesitated to query others and they were weak in applying critical thinking to problem-solving, which were in congruent with previous research showing students rarely used critical thinking to solve complex, real-world problems. In sum, we demonstrated successfully the use of interactive simulation tasks in measuring critical thinking. With the advancement of technology, our study suggested the possibility of assessing hard-to-measure important complex higher-order competence with dynamic games. (As Provided).
Anmerkungen	Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01