Small-Sample DIF Estimation Using SIBTEST, Cochran's Z, and Log-Linear Smoothing

Autor/inn/en	Lei, Pui-Wa; Li, Hongli
Titel	Small-Sample DIF Estimation Using SIBTEST, Cochran's Z, and Log-Linear Smoothing
Quelle	In: Applied Psychological Measurement, 37 (2013) 5, S.397-416 (20 Seiten) PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0146-6216
DOI	10.1177/0146621613478150
Schlagwörter	Sample Size; Test Bias; Computation; Accuracy; Statistical Analysis; Data Analysis + Suchen Sie Ihr Suchwort? Testkritik; Statistische Analyse; Auswertung
Abstract	Minimum sample sizes of about 200 to 250 per group are often recommended for differential item functioning (DIF) analyses. However, there are times when sample sizes for one or both groups of interest are smaller than 200 due to practical constraints. This study attempts to examine the performance of Simultaneous Item Bias Test (SIBTEST), Cochran's Z test, and log-linear smoothing with these methods in DIF detection accuracy at a number of small-sample and ability distribution combinations. Effects of item parameters and DIF magnitudes are also investigated. Results show that when ability distributions between groups are identical, Type I error for these DIF methods can be adequately controlled at all sample sizes, and their power to detect a large amount of unidirectional DIF can be tolerably high (power greater than 0.6) when sample size is not too small (at least 100 per group). When ability distributions are different, Type I inflation is higher for easier items and larger sample sizes, and power depends on DIF direction. Log-linear smoothing with SIBTEST tends to lower both Type I error rate and power. The effect of smoothing with Cochran's Z test is not as consistent. Implications of the findings are discussed. (Contains 6 tables, 2 figures, and 2 notes.) (As Provided).
Anmerkungen	SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10