An Automatic Online Calibration Design in Adaptive Testing

Autor/inn/en	Makransky, Guido; Glas, Cees A. W.
Titel	An Automatic Online Calibration Design in Adaptive Testing
Quelle	In: Journal of Applied Testing Technology, 11 (2010) 1, (29 Seiten) PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
Schlagwörter	Foreign Countries; Simulation; Adaptive Testing; Computer Assisted Testing; Internet; Psychometrics; Item Banks; Test Items; Predictor Variables; Occupational Tests; Item Response Theory; Evaluation Research; Test Construction; Denmark + Suchen Sie Ihr Suchwort? Ausland; Simulation program; Simulationsprogramm; Psychometry; Psychometrie; Test content; Testaufgabe; Prädiktor; Berufseignungsprüfung; Item-Response-Theorie; Evaluationsforschung; Testaufbau; Dänemark
Abstract	An accurately calibrated item bank is essential for a valid computerized adaptive test. However, in some settings, such as occupational testing, there is limited access to test takers for calibration. As a result of the limited access to possible test takers, collecting data to accurately calibrate an item bank in an occupational setting is usually difficult. In such a setting, the item bank can be calibrated online in an operational setting. This study explored three possible automatic online calibration strategies, with the intent of calibrating items accurately while estimating ability precisely and fairly. That is, the item bank is calibrated in a situation where test takers are processed and the scores they obtain have consequences. A simulation study was used to identify the optimal calibration strategy. The outcome measure was the mean absolute error of the ability estimates of the test takers participating in the calibration phase. Manipulated variables were the calibration strategy, the size of the calibration sample, the size of the item bank, and the item response model. (Contains 2 figures and 4 tables.) (As Provided).
Anmerkungen	Association of Test Publishers. 601 Pennsylvania Avenue NW, South Building Suite 900, Washington DC 20004. Tel: 866-240-7909; Fax: 717-755-8962; e-mail: wgh.atp@att.net; Web site: http://www.testpublishers.org
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10