Implementing Three CATs Within Eighteen Months.

Autor/inn/en	Spoden, Christian; Frey, Andreas; Bernhardt, Raphael
Titel	Implementing Three CATs Within Eighteen Months.
Quelle	In: Journal of computerized adaptive testing, 6 (2018) 3, S. 38-55 PDF als Volltext (1); PDF als Volltext (2) Link als defekt meldenVerfügbarkeit
Beigaben	Literaturangaben
Zusatzinformation	Forschungsdaten, Studiendetails und Erhebungsinstrumente
Sprache	deutsch
Dokumenttyp	online; Zeitschriftenaufsatz
ISSN	2165-6592
DOI	10.7333/jcat.v6i3.70
Schlagwörter	Testkonstruktion; Adaptives Testen; Test; Testentwicklung; Bewertung; Lesen; Mathematik; Naturwissenschaften; Simulation; Test; Instrument; Testkonstruktion; Computerunterstütztes Verfahren; Instrumentelle Analytik; Item; Instrumentelle Analytik; Computerauswertung; Simulationsprogramm; Lesen; Mathematik; Computerunterstütztes Verfahren; Naturwissenschaften; Technologische Entwicklung; Bewertung; Instrument; Item; Simulation
Abstract	The development of a computerized adaptive test is considered a labor-intensive and time-consuming endeavor. This paper illustrates that this does not have to be the case - by demonstrating the steps taken, the decisions made, and the empirical results obtained during the development of three computerized adaptive tests (CATs) designed to measure student competencies in reading, mathematics, and science. The three tests had to be developed and piloted within an 18-month period, and they were used directly afterward in six research projects of a large nationwide research initiative. To ensure the sound psychometric quality of the CATs developed, the item calibration (N=1,632) followed several quality control procedures, including item fit analysis, differential item functioning analysis, and preoperational simulation studies. A CAT pilot study (N=1,093) and an additional CAT simulation confirmed the general usefulness of th constructed instruments. It is concluded that the development of CATs-including item calibration, simulations, and piloting within 18 months-is quite possible, even for comparably small development teams. This necessitates an available theoretical framework for the assessment and a sufficient number of items, specific plans for the item calibration, simulations, and a pilot study, as well as an information technology infrastructure for administering the tests. (Orig.).
Erfasst von	DIPF \| Leibniz-Institut für Bildungsforschung und Bildungsinformation, Frankfurt am Main
Update	2021/4