A Statistical Test for the Detection of Item Compromise Combining Responses and Response Times

Autor/inn/en	van der Linden, Wim J.; Belov, Dmitry I.
Titel	A Statistical Test for the Detection of Item Compromise Combining Responses and Response Times
Quelle	In: Journal of Educational Measurement, 60 (2023) 2, S.235-254 (20 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0022-0655
DOI	10.1111/jedm.12346
Schlagwörter	Item Response Theory; Reaction Time; Test Items; Item Analysis; Response Style (Tests); Alternative Assessment + Suchen Sie Ihr Suchwort? Item-Response-Theorie; Reaktionsvermögen; Test content; Testaufgabe; Itemanalyse; Antwortverhalten
Abstract	A test of item compromise is presented which combines the test takers' responses and response times (RTs) into a statistic defined as the number of correct responses on the item for test takers with RTs flagged as suspicious. The test has null and alternative distributions belonging to the well-known family of compound binomial distributions, is simple to calculate, and has results that are easy to interpret. It also demonstrated nearly perfect power for the detection of compromise with no more than 10 test takers with preknowledge of the more difficult and discriminating items in a set of empirical examples. For the easier and less discriminating items, the presence of some 20 test takers with preknowledge still sufficed. A test based on the reverse statistic of the total time by test takers with responses flagged as suspicious may seem a natural alternative but misses the property of a monotone likelihood ratio necessary to decide between a test that should be left or right sided. (As Provided).
Anmerkungen	Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01