'Time to Figure out What to Do': Understanding the Nature of Irish Post-Primary Students' Interactions with Computer-Based Exams (CBEs) That Use Multimedia Stimuli

Autor/inn/en	Lehane, Paula; Scully, Darina; O'Leary, Michael
Titel	'Time to Figure out What to Do': Understanding the Nature of Irish Post-Primary Students' Interactions with Computer-Based Exams (CBEs) That Use Multimedia Stimuli
Quelle	In: Irish Educational Studies, 41 (2022) 1, S.5-25 (21 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Lehane, Paula) ORCID (Scully, Darina) ORCID (O'Leary, Michael)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0332 3315
DOI	10.1080/03323315.2021.2022517
Schlagwörter	Computer Assisted Testing; Secondary School Students; Culture Fair Tests; Test Validity; Test Use; Credibility; Test Construction; Test Items; Multimedia Materials; Cues; Protocol Analysis; Eye Movements; Cognitive Processes; Decision Making; Familiarity; Guidelines; Foreign Countries; International Assessment; Achievement Tests; Scientific Literacy; Rural Schools; Student Attitudes; Ireland; Program for International Student Assessment + Suchen Sie Ihr Suchwort? Sekundarschüler; Testvalidität; Testanwendung; Glaubwürdigkeit; Testaufbau; Test content; Testaufgabe; Stichwort; Augenbewegung; Cognitive process; Kognitiver Prozess; Decision-making; Entscheidungsfindung; Richtlinien; Ausland; Achievement test; Achievement; Testing; Test; Tests; Leistungsbeurteilung; Leistungsüberprüfung; Leistung; Testdurchführung; Testen; Rural area; Rural areas; School; Schools; Ländlicher Raum; Schule; Schulen; Schülerverhalten; Irland
Abstract	In line with the widespread proliferation of digital technology in everyday life, many countries are now beginning to use computer-based exams (CBEs) in their post-primary education systems. To ensure that these CBEs are delivered in a manner that preserves their fairness, validity, utility and credibility, several factors pertaining to their design and development will need to be considered. This research study investigated the extent to which the design of different types of test items (e.g. inclusion of multimedia stimuli) in a CBE can affect test-takers' engagement and behaviour. Qualitative data from a cued-Retrospective Think Aloud (c-RTA) protocol were gathered from 12 participants who had participated in a previous eye-tracking study. Participants watched a replay of their eye movements and were asked to state out loud what they were thinking at different points of the replay. Thematic analysis of the responses from these cognitive interviews captured the nature of students' interactions with online testing environments under three main themes: Familiarisation, Sense-making and Making Decisions. Students also provided their opinions of and recommendations for the future of Irish online assessments. These findings can offer guidelines to all stakeholders considering the use of CBEs in post-primary contexts. (As Provided).
Anmerkungen	Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01