Changes in the Speed-Ability Relation through Different Treatments of Rapid Guessing

Autor/inn/en	Deribo, Tobias; Goldhammer, Frank; Kroehne, Ulf
Titel	Changes in the Speed-Ability Relation through Different Treatments of Rapid Guessing
Quelle	In: Educational and Psychological Measurement, 83 (2023) 3, S.473-494 (22 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Deribo, Tobias)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0013-1644
DOI	10.1177/00131644221109490
Schlagwörter	Reaction Time; Guessing (Tests); Behavior Patterns; Bias; Cognitive Ability; Psychometrics; Accuracy; Validity; Reliability; Guidelines; Longitudinal Studies; Foreign Countries; Test Items; Item Analysis; Information Technology; Multiple Choice Tests; College Students; Comparative Analysis; Germany + Suchen Sie Ihr Suchwort? Reaktionsvermögen; Erraten; Denkfähigkeit; Psychometry; Psychometrie; Gültigkeit; Reliabilität; Richtlinien; Longitudinal study; Longitudinal method; Longitudinal methods; Längsschnittuntersuchung; Ausland; Test content; Testaufgabe; Itemanalyse; Informationstechnologie; Multiple choice examinations; Multiple-choice tests, Multiple-choice examinations; Multiple-Choice-Verfahren; Collegestudent; Deutschland
Abstract	As researchers in the social sciences, we are often interested in studying not directly observable constructs through assessments and questionnaires. But even in a well-designed and well-implemented study, rapid-guessing behavior may occur. Under rapid-guessing behavior, a task is skimmed shortly but not read and engaged with in-depth. Hence, a response given under rapid-guessing behavior does bias constructs and relations of interest. Bias also appears reasonable for latent speed estimates obtained under rapid-guessing behavior, as well as the identified relation between speed and ability. This bias seems especially problematic considering that the relation between speed and ability has been shown to be able to improve precision in ability estimation. For this reason, we investigate if and how responses and response times obtained under rapid-guessing behavior affect the identified speed-ability relation and the precision of ability estimates in a joint model of speed and ability. Therefore, the study presents an empirical application that highlights a specific methodological problem resulting from rapid-guessing behavior. Here, we could show that different (non-)treatments of rapid guessing can lead to different conclusions about the underlying speed-ability relation. Furthermore, different rapid-guessing treatments led to wildly different conclusions about gains in precision through joint modeling. The results show the importance of taking rapid guessing into account when the psychometric use of response times is of interest. (As Provided).
Anmerkungen	SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01