Equated Pooled Booklet Method in DIF Testing

Autor/inn/en	Cheng, Ying; Chen, Peihua; Qian, Jiahe; Chang, Hua-Hua
Titel	Equated Pooled Booklet Method in DIF Testing
Quelle	In: Applied Psychological Measurement, 37 (2013) 4, S.276-288 (13 Seiten) PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0146-6216
DOI	10.1177/0146621612471889
Schlagwörter	Test Bias; Equated Scores; Test Items; Effect Size; Difficulty Level; Statistical Analysis + Suchen Sie Ihr Suchwort? Testkritik; Test content; Testaufgabe; Schwierigkeitsgrad; Statistische Analyse
Abstract	Differential item functioning (DIF) analysis is an important step in the data analysis of large-scale testing programs. Nowadays, many such programs endorse matrix sampling designs to reduce the load on examinees, such as the balanced incomplete block (BIB) design. These designs pose challenges to the traditional DIF analysis methods. For example, as difficulty levels often vary across booklets, examinees with same booklet scores may be disparate in ability. Consequently, DIF procedures based on matching total scores at the booklet level may cause misplacement of examinees and inflation in measurement errors. Therefore, modification to traditional DIF procedures to better accommodate the BIB design becomes important. This article introduces modification of current simultaneous item bias test (SIBTEST) procedure for the DIF analysis method when multiple booklets are used. More specifically, examinees will be pooled across booklets, and the matching will be based on transformed booklet scores after common block equating/linking. Simulations are conducted to compare the performance of this new method, the equated "pooled booklet" method against that of the current "pooled booklet" method, in terms of both Type I error control and power. Four factors are considered in the simulation--the DIF effect size, item difficulty, impact, and the length of common block. Results show that the equated "pooled booklet" method in general improves power while keeping Type I error under control. The advantage of the new method is the most pronounced when the traditional method struggles, for example, when the item is difficult or there is impact. (Contains 11 tables.) (As Provided).
Anmerkungen	SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10