Adjusting for Ability Differences of Equating Samples When Randomization Is Suboptimal

Autor/inn/en	Kim, Sooyeon; Walker, Michael E.
Titel	Adjusting for Ability Differences of Equating Samples When Randomization Is Suboptimal
Quelle	In: Educational Measurement: Issues and Practice, 41 (2022) 3, S.26-37 (12 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0731-1745
DOI	10.1111/emip.12506
Schlagwörter	Ability; Tests; Equated Scores; Testing Problems; Sampling; Test Items; Accuracy; Test Bias + Suchen Sie Ihr Suchwort? Fähigkeit; Fertigkeit; Examination; Prüfung; Examen; Test content; Testaufgabe; Testkritik
Abstract	Test equating requires collecting data to link the scores from different forms of a test. Problems arise when equating samples are not equivalent and the test forms to be linked share no common items by which to measure or adjust for the group nonequivalence. Using data from five operational test forms, we created five pairs of research forms for each form, such that the equating relationship between each pair was known. Then we compared five approaches to adjusting for group nonequivalence in a situation where not only was group equivalence questionable, but the number of common items was small. We used a resampling approach to evaluate the linking accuracy of group adjustment using sample weights via minimum discriminant information adjustment (MDIA) using test takers' collateral (demographic) information, a weak anchor of only three items, or a mix of both. Overall, the use of both sample weights via MDIA and a weak anchor produced the most accurate result, while the direct (random groups) linking method assuming group equivalence produced the least accurate result due to nontrivial bias. For all five research forms, using both collateral information and anchor items only marginally improved linking accuracy compared to using the weak anchor alone. (As Provided).
Anmerkungen	Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01