Effects of Content Balancing and Item Selection Method on Ability Estimation in Computerized Adaptive Tests

Autor/inn/en	Sahin, Alper; Ozbasi, Durmus
Titel	Effects of Content Balancing and Item Selection Method on Ability Estimation in Computerized Adaptive Tests
Quelle	In: Eurasian Journal of Educational Research, (2017) 69, S.21-36 (16 Seiten) PDF als Volltext kostenfreie Datei Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1302-597X
Schlagwörter	Computer Assisted Testing; Adaptive Testing; Test Items; Test Content; Selection; Computation; Comparative Analysis; Methods; Ability; Monte Carlo Methods + Suchen Sie Ihr Suchwort? Test content; Testaufgabe; Auslese; Method; Methode; Fähigkeit; Fertigkeit; Monte-Carlo-Methode
Abstract	Purpose: This study aims to reveal effects of content balancing and item selection method on ability estimation in computerized adaptive tests by comparing Fisher's maximum information (FMI) and likelihood weighted information (LWI) methods. Research Methods: Four groups of examinees (250, 500, 750, 1000) and a bank of 500 items with 10 different content domains were generated through Monte Carlo simulations. Examinee ability was estimated by fixing all settings except for the item selection methods mentioned. True and estimated ability (?) values were compared by dividing examinees into six subgroups. Moreover, the average number of items used was compared. Findings: The correlations decreased steadily as examinee ? level increased among all examinee groups when LWI was used. FMI had the same trend with the 250 and 500 examinees. Correlations for 750 examinees decreased as ? level increased as well, but they were somewhat steady with FMI. For 1000 examinees, FMI was not successful in estimating examinee ? accurately after ? subgroup 4. Moreover, when FMI was used, ? estimates had less error than LWI. The figures regarding the average items used indicated that LWI used fewer items in subgroups 1, 2, 3 and that FMI used less items in subgroups 4, 5, and 6. Implications for Research and Practice: The findings indicated that when content balancing is put into use, LWI is more suitable to estimate examinee ? for examinees between -3 and 0 and that FMI is more stable when examinee ? is above 0. An item selection algorithm combining these two item selection methods is recommended. (As Provided).
Anmerkungen	ANI Publishing Company. Kizilirmak Sokak 10/A Bakanliklar, Ankara, Turkey 06440. Tel: +90-312-425-8150; Fax: +90-312-425-8111; e-mail: aniyayincilik@aniyayincilik.com.tr; Web site: http://www.ejer.com.tr
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2020/1/01