Reconceptualizing Rapid Responses as a Speededness Indicator in High-Stakes Assessments

Autor/inn/en	Feinberg, Richard; Jurich, Daniel; Wise, Steven L.
Titel	Reconceptualizing Rapid Responses as a Speededness Indicator in High-Stakes Assessments
Quelle	In: Applied Measurement in Education, 34 (2021) 4, S.312-326 (15 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0895-7347
DOI	10.1080/08957347.2021.1987904
Schlagwörter	High Stakes Tests; Reaction Time; Response Style (Tests); Licensing Examinations (Professions); Physicians; United States Medical Licensing Examination + Suchen Sie Ihr Suchwort? Reaktionsvermögen; Antwortverhalten; Physician; Doctor; Arzt
Abstract	Previous research on rapid responding tends to implicitly consider examinees as either engaging in solution behavior or purely guessing. However, particularly in a high-stakes testing context, examinees perceiving that they are running out of time may consider the remaining items for less time than necessary to provide a fully informed response, but longer than a truly rapid guess. This partial consideration results in a response that misrepresents true ability, but with accuracy above the level of pure chance. To address this limitation of existing methodology, we propose an empirical approach that attempts to disentangle fully and partially informed responses to be used as a preliminary measure of the extent to which speededness may be distorting test score validity. We first illustrate and validate the approach using an experimental dataset in which the amount of time per item was manipulated. Next, applications of this approach are demonstrated using observational data in a more realistic context through four operational exams in which speededness is unknown. (As Provided).
Anmerkungen	Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01