Determining the Overall Impact of Interruptions during Online Testing

Autor/inn/en	Sinharay, Sandip; Wan, Ping; Whitaker, Mike; Kim, Dong-In; Zhang, Litong; Choi, Seung W.
Titel	Determining the Overall Impact of Interruptions during Online Testing
Quelle	In: Journal of Educational Measurement, 51 (2014) 4, S.419-440 (22 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0022-0655
DOI	10.1111/jedm.12052
Schlagwörter	Computer Assisted Testing; Testing Problems; Scores; Regression (Statistics); Probability; Item Response Theory; Simulation; Statistical Analysis; Achievement Tests; Indiana Statewide Testing for Educational Progress Plus + Suchen Sie Ihr Suchwort? Regression; Regressionsanalyse; Wahrscheinlichkeitsrechnung; Wahrscheinlichkeitstheorie; Item-Response-Theorie; Simulation program; Simulationsprogramm; Statistische Analyse; Achievement test; Achievement; Testing; Test; Tests; Leistungsbeurteilung; Leistungsüberprüfung; Leistung; Testdurchführung; Testen
Abstract	With an increase in the number of online tests, interruptions during testing due to unexpected technical issues seem unavoidable. For example, interruptions occurred during several recent state tests. When interruptions occur, it is important to determine the extent of their impact on the examinees' scores. There is a lack of research on this topic due to the novelty of the problem. This article is an attempt to fill that void. Several methods, primarily based on propensity score matching, linear regression, and item response theory, were suggested to determine the overall impact of the interruptions on the examinees' scores. A realistic simulation study shows that the suggested methods have satisfactory Type I error rate and power. Then the methods were applied to data from the Indiana Statewide Testing for Educational Progress-Plus (ISTEP+) test that experienced interruptions in 2013. The results indicate that the interruptions did not have a significant overall impact on the student scores for the ISTEP+ test. (As Provided).
Anmerkungen	Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail: cs-journals@wiley.com; Web site: http://www.wiley.com/WileyCDA
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10