The Continuity of Students' Disengaged Responding in Low-Stakes Assessments: Evidence from Response Times

Autor/in	Bulut, Hatice Cigdem
Titel	The Continuity of Students' Disengaged Responding in Low-Stakes Assessments: Evidence from Response Times
Quelle	In: International Journal of Assessment Tools in Education, 8 (2021) 3, S.527-541 (15 Seiten) PDF als Volltext kostenfreie Datei Verfügbarkeit
Zusatzinformation	ORCID (Bulut, Hatice Cigdem)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	2148-7456
Schlagwörter	Reaction Time; Response Style (Tests); Foreign Countries; International Assessment; Achievement Tests; Secondary School Students; United Arab Emirates; Australia; Austria; Belgium; Bulgaria; Brazil; Canada; Switzerland; Chile; Colombia; Czech Republic; Germany; Lithuania; Luxembourg; Latvia; Macau; Mexico; Montenegro; Malaysia; Netherlands; Norway; New Zealand; Peru; Poland; Portugal; Denmark; Dominican Republic; Spain; Estonia; Finland; France; United Kingdom; Greece; Hong Kong; Croatia; Hungary; Ireland; Iceland; Israel; Italy; Japan; South Korea; Qatar; China; United States; Russia; Singapore; Slovakia; Slovenia; Sweden; Taiwan; Thailand; Tunisia; Turkey; Uruguay; Program for International Student Assessment + Suchen Sie Ihr Suchwort? Reaktionsvermögen; Antwortverhalten; Ausland; Achievement test; Achievement; Testing; Test; Tests; Leistungsbeurteilung; Leistungsüberprüfung; Leistung; Testdurchführung; Testen; Sekundarschüler; Vereinigte Arabische Emirate; Australien; Österreich; Belgien; Bulgarien; Brasilien; Kanada; Schweiz; Kolumbien; Tschechische Republik; Deutschland; Litauen; Lettland; Mexiko; Niederlande; Norwegen; Neuseeland; Polen; Dänemark; Dominikanische Republik; Spanien; Estland; Finnland; Frankreich; Großbritannien; Griechenland; Hongkong; Kroatien; Ungarn; Irland; Island; Italien; Korea; Republik; Katar; USA; Russland; Singapur; Slowakei; Slowenien; Schweden; Tunesien; Türkei
Abstract	Several studies have been published on disengaged test respondents, and others have analyzed disengaged survey respondents separately. For many large-scale assessments, students answer questionnaire and test items in succession. This study examines the percentage of students who continuously engage in disengaged responding behaviors across sections in a low-stakes assessment. The effects on calculated scores of filtering students, based on their responding behaviors, are also analyzed. Data of this study came from the 2015 administration of PISA. For data analysis, frequencies and percentages of engaged students in the sessions were initially calculated using students' response times. To investigate the impact of filtering disengaged respondents on parameter estimation, three groups were created, namely engaged in both measures, engaged only in the test, and engaged only in the questionnaire. Next, several validity checks were performed on each group to verify the accuracy of the classifications and the impact of filtering student groups based on their responding behavior. The results indicate that students who are disengaged in tests tend to continue this behavior when responding to the questionnaire items in PISA. Moreover, the rate of continuity of disengaged responding is non-negligible as can be seen from the effect sizes. On the other hand, removing disengaged students in both measures led to higher or nearly the same performance ratings compared to the other groups. Researchers analyzing the dataset including achievement tests and survey items are recommended to review disengaged responses and filter out students who are continuously showing disengaged responding before performing further statistical analysis. (As Provided).
Anmerkungen	International Journal of Assessment Tools in Education. Pamukkale University, Faculty of Education, Kinikli Campus, Denizli 20070, Turkey. e-mail: ijate.editor@gmail.com; Web site: https://ijate.net/index.php/ijate
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01