Setting and Validating Multiple Standards on a Multistage-Adaptive Test

Autor/inn/en	Lewis, Jennifer; Lim, Hwanggyu; Padellaro, Frank; Sireci, Stephen G.; Zenisky, April L.
Titel	Setting and Validating Multiple Standards on a Multistage-Adaptive Test
Quelle	In: Educational Measurement: Issues and Practice, 41 (2022) 1, S.80-92 (13 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Lewis, Jennifer)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0731-1745
DOI	10.1111/emip.12434
Schlagwörter	Cutting Scores; Adaptive Testing; Test Items; Item Analysis; Validity; Standard Setting (Scoring); Evaluation Methods + Suchen Sie Ihr Suchwort? Test content; Testaufgabe; Itemanalyse; Gültigkeit; Bewertungsskala
Abstract	Setting cut scores on (MSTs) is difficult, particularly when the test spans several grade levels, and the selection of items from MST panels must reflect the operational test specifications. In this study, we describe, illustrate, and evaluate three methods for mapping panelists' Angoff ratings into cut scores on the scale underlying an MST. The results suggest the test characteristic function and item characteristic curve methods performed similarly, but the method based on dichotomizing panelists' ratings at a response probability of 0.67 was unacceptable. The study featured a rating booklet design that allowed us to systematically evaluate the validity of the Angoff ratings across test levels, which contributed internal validity evidence for the cut scores, which were also evaluated using procedural and external validity evidence. The implications of the results for future standard setting studies and research in this area are discussed. (As Provided).
Anmerkungen	Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01