Sensitivity and Accuracy of the Mantel-Haenszel Method and Standardization Method: Detection of Item Functioning Differential

Autor/inn/en	Rustam, Ahmad; Naga, Dali Santun; Supriyati, Yetti
Titel	Sensitivity and Accuracy of the Mantel-Haenszel Method and Standardization Method: Detection of Item Functioning Differential
Quelle	In: International Journal of Education and Literacy Studies, 7 (2019) 3, S.28-37 (10 Seiten) PDF als Volltext kostenfreie Datei Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	2202-9478
Schlagwörter	Statistical Analysis; Test Bias; Accuracy; Multiple Choice Tests; Foreign Countries; Indonesia + Suchen Sie Ihr Suchwort? Statistische Analyse; Testkritik; Multiple choice examinations; Multiple-choice tests, Multiple-choice examinations; Multiple-Choice-Verfahren; Ausland; Indonesien
Abstract	Detection of differential item functioning (DIF) is needed in the development of tests to obtain useful items. The Mantel-Haenszel method and standardization are tools for DIF detection based on classical theory assumptions. The study was conducted to highlight the sensitivity and accuracy between the Mantel-Haenszel method and the standardization method in DIF detection. Simulation design (a) test participants consisted of 1000 responses in both the reference and focus groups, (b) the size of the proportion of DIF (0.1; 0.25; 0.50; and 0.75), and (c) the length of the multiple choice test with 40 choices the answer. Research shows that the Mantel-Haenszel method has the same sensitivity as the standardization method in DIF proportions of 10% and 25%, however, when the ratio of DIF proportions above 25% the standardization method is less sensitive, and conversely the sensitivity of the Mantel-Haenszel method increases. The standardization method has higher accuracy than the Mantel-Haenszel method in the DIF proportion of 10%, however, when the size of the DIF proportion above 10% the accuracy of the standardization method decreases, the accuracy of the Mantel-Haenszel method is higher than the standardization method. Thus, if the ratio of DIF is detected by the standardization method of (=0.10), then the results of the standardization method are preferred as a reference. Conversely, if the proportion of DIF detected by the standardization method is (=0.10), then the result of the Mantel-Haenszel method is chosen as a reference. (As Provided).
Anmerkungen	Australian International Academic Centre PTY, LTD. 11 Souter Crescent, Footscray VIC 3011, Australia. Tel: +61-3-9028-6880; e-mail: support@aiac.org.au; Web site: http://www.journals.aiac.org.au/index.php/IJELS/index
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2020/1/01