The Matching Criterion Purification for Differential Item Functioning Analyses in a Large-Scale Assessment

Autor/inn/en	Lee, HyeSun; Geisinger, Kurt F.
Titel	The Matching Criterion Purification for Differential Item Functioning Analyses in a Large-Scale Assessment
Quelle	In: Educational and Psychological Measurement, 76 (2016) 1, S.141-163 (23 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0013-1644
DOI	10.1177/0013164415585166
Schlagwörter	Test Bias; Measurement; Accuracy; Statistical Analysis; Test Length; Test Items; Sample Size; Mathematical Concepts; Differences; Ability + Suchen Sie Ihr Suchwort? Testkritik; Messverfahren; Statistische Analyse; Test content; Testaufgabe; Unterscheiden; Fähigkeit; Fertigkeit
Abstract	The current study investigated the impact of matching criterion purification on the accuracy of differential item functioning (DIF) detection in large-scale assessments. The three matching approaches for DIF analyses (block-level matching, pooled booklet matching, and equated pooled booklet matching) were employed with the Mantel-Haenszel procedure. Five factors--the length of a test, the proportion of items exhibiting DIF, a sample size, a ratio of a reference and focal group, and the existence of an average ability difference between two groups--were manipulated. The three matching approaches were used with and without purification. Also, a systematic test form difference was considered. The results indicated that overall, matching criterion purification in the three approaches contributed to the improvement of power in the detection of DIF. Depending on the psychometric characteristics of items exhibiting DIF and the existence of an average ability difference, the amount of power improvement due to matching criterion purification was different across the three approaches. The purification of a matching criterion contributed to the slight reduction of Type I error rates in the three approaches when no mean ability difference existed between the two groups. Considering power improvement with the control of Type I error rates, the purification of a matching criterion in the pooled booklet matching and the equated pooled booklet matching approaches can be recommended for DIF analyses in large-scale assessments. (As Provided).
Anmerkungen	SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2020/1/01