An Item-Level Expected Classification Accuracy and Its Applications in Cognitive Diagnostic Assessment

Autor/inn/en	Wang, Wenyi; Song, Lihong; Chen, Ping; Ding, Shuliang
Titel	An Item-Level Expected Classification Accuracy and Its Applications in Cognitive Diagnostic Assessment
Quelle	In: Journal of Educational Measurement, 56 (2019) 1, S.51-75 (25 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0022-0655
DOI	10.1111/jedm.12200
Schlagwörter	Cognitive Tests; Classification; Accuracy; Diagnostic Tests; Testing; Models; Item Analysis; Test Items; Prediction; Item Response Theory + Suchen Sie Ihr Suchwort? Kognitiver Fähigkeitstest; Classification system; Klassifikation; Klassifikationssystem; Diagnostic test; Diagnostischer Test; Testdurchführung; Testen; Analogiemodell; Itemanalyse; Test content; Testaufgabe; Vorhersage; Item-Response-Theorie
Abstract	Most of the existing classification accuracy indices of attribute patterns lose effectiveness when the response data is absent in diagnostic testing. To handle this issue, this article proposes new indices to predict the correct classification rate of a diagnostic test before administering the test under the deterministic noise input "and" gate (DINA) model. The new indices include an item-level expected classification accuracy (ECA) for attributes and a test-level ECA for attributes and attribute patterns, and both of them are calculated based solely on the known item parameters and Q-matrix. Theoretical analysis showed that the item-level ECA could be regarded as a measure of correct classification rates of attributes contributed by an item. This article also illustrates how to apply the item-level ECA for attributes to estimate the correct classification rate of attributes patterns at the test level. Simulation results showed that two test-level ECA indices, ECA_I_W (an index based on the independence assumption and the weighted sum of the item-level ECAs) and ECA_C_M (an index based on Gaussian Copula function that incorporates the dependence structure of the events of attribute classification and the simple average of the item-level ECAs), could make an accurate prediction for correct classification rates of attribute patterns. (As Provided).
Anmerkungen	Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail: cs-journals@wiley.com; Web site: http://www.wiley.com/WileyCDA
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2020/1/01