A Framework for Measuring the Amount of Adaptation of Rasch-Based Computerized Adaptive Tests

Autor/inn/en	Wyse, Adam E.; McBride, James R.
Titel	A Framework for Measuring the Amount of Adaptation of Rasch-Based Computerized Adaptive Tests
Quelle	In: Journal of Educational Measurement, 58 (2021) 1, S.83-103 (21 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Wyse, Adam E.)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0022-0655
DOI	10.1111/jedm.12267
Schlagwörter	Item Response Theory; Computer Assisted Testing; Adaptive Testing; Test Items; Difficulty Level; Simulation; Item Banks + Suchen Sie Ihr Suchwort? Item-Response-Theorie; Test content; Testaufgabe; Schwierigkeitsgrad; Simulation program; Simulationsprogramm
Abstract	A key consideration when giving any computerized adaptive test (CAT) is how much adaptation is present when the test is used in practice. This study introduces a new framework to measure the amount of adaptation of Rasch-based CATs based on looking at the differences between the selected item locations (Rasch item difficulty parameters) of the administered items and target item locations determined from provisional ability estimates at the start of each item. Several new indices based on this framework are introduced and compared to previously suggested measures of adaptation using simulated and real test data. Results from the simulation indicate that some previously suggested indices are not as sensitive to changes in item pool size and the use of constraints as the new indices and may not work as well under different item selection rules. The simulation study and real data example also illustrate the utility of using the new indices to measure adaptation at both a group and individual level. Discussion is provided on how one may use several of the indices to measure adaptation of Rasch-based CATs in practice. (As Provided).
Anmerkungen	Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01