An Examination of Individual Ability Estimation and Classification Accuracy under Rapid Guessing Misidentifications

Autor/in	Rios, Joseph
Titel	An Examination of Individual Ability Estimation and Classification Accuracy under Rapid Guessing Misidentifications
Quelle	In: Applied Measurement in Education, 35 (2022) 4, S.300-312 (13 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Rios, Joseph)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0895-7347
DOI	10.1080/08957347.2022.2155653
Schlagwörter	Accuracy; Guessing (Tests); Scoring; Classification; Bias; Ability; Test Items + Suchen Sie Ihr Suchwort? Erraten; Bewertung; Classification system; Klassifikation; Klassifikationssystem; Fähigkeit; Fertigkeit; Test content; Testaufgabe
Abstract	To mitigate the deleterious effects of rapid guessing (RG) on ability estimates, several rescoring procedures have been proposed. Underlying many of these procedures is the assumption that RG is accurately identified. At present, there have been minimal investigations examining the utility of rescoring approaches when RG is misclassified, and individual scores are reported. To address this limitation, the present simulation study investigates the effect of RG misclassifications on individual examinee ability estimate bias and classification accuracy when using effort-moderated (EM) scoring. This objective is accomplished by manipulating simulee ability level, RG rate, as well as misclassification type and percentage. Results showed that EM scoring significantly improved ability inferences for examinees engaging in RG; however, the effectiveness of this approach was largely dependent on misclassification type. Specifically, across ability levels, bias tended to be on average lower when falsely classifying effortful responses as RG. Although EM scoring improved bias, it was susceptible to elevated false-positive classifications of ability under high RG. (As Provided).
Anmerkungen	Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01