Item Pool Design for an Operational Variable-Length Computerized Adaptive Test

Autor/inn/en	He, Wei; Reckase, Mark D.
Titel	Item Pool Design for an Operational Variable-Length Computerized Adaptive Test
Quelle	In: Educational and Psychological Measurement, 74 (2014) 3, S.473-494 (22 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0013-1644
DOI	10.1177/0013164413509629
Schlagwörter	Item Banks; Test Length; Computer Assisted Testing; Adaptive Testing; Test Construction; Licensing Examinations (Professions); Item Response Theory; Bayesian Statistics; Computation; Maximum Likelihood Statistics; Ability; Difficulty Level; Test Items; Accuracy; Test Bias + Suchen Sie Ihr Suchwort? Testaufbau; Item-Response-Theorie; Fähigkeit; Fertigkeit; Schwierigkeitsgrad; Test content; Testaufgabe; Testkritik
Abstract	For computerized adaptive tests (CATs) to work well, they must have an item pool with sufficient numbers of good quality items. Many researchers have pointed out that, in developing item pools for CATs, not only is the item pool size important but also the distribution of item parameters and practical considerations such as content distribution and item exposure issues. Yet, there is little research on how to design item pools to have those desirable features. The research reported in this article provided step-by-step hands-on guidance on the item pool design process by applying the bin-and-union method to design item pools for a large-scale licensure CAT employing complex adaptive testing algorithm with variable test length, a decision based on stopping rule, content balancing, and exposure control. The design process involved extensive simulations to identify several alternative item pool designs and evaluate their performance against a series of criteria. The design output included the desired item pool size and item parameter distribution. The results indicate that the mechanism used to identify the desirable item pool features functions well and that two recommended item pool designs would support satisfactory performance of the operational testing program. (As Provided).
Anmerkungen	SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10