Assessing Dimensionality of Noncompensatory Multidimensional Item Response Theory with Complex Structures

Autor/in	Svetina, Dubravka
Titel	Assessing Dimensionality of Noncompensatory Multidimensional Item Response Theory with Complex Structures
Quelle	In: Educational and Psychological Measurement, 73 (2013) 2, S.312-338 (27 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0013-1644
DOI	10.1177/0013164412461353
Schlagwörter	Item Response Theory; Statistical Analysis; Computation; Test Length; Accuracy; Test Items; Sample Size; Correlation; Classification; Data Analysis + Suchen Sie Ihr Suchwort? Item-Response-Theorie; Statistische Analyse; Test content; Testaufgabe; Korrelation; Classification system; Klassifikation; Klassifikationssystem; Auswertung
Abstract	The purpose of this study was to investigate the effect of complex structure on dimensionality assessment in noncompensatory multidimensional item response models using dimensionality assessment procedures based on DETECT (dimensionality evaluation to enumerate contributing traits) and NOHARM (normal ogive harmonic analysis robust method). Five methods were evaluated: two DETECT-based methods--exploratory and cross-validated--and three NOHARM-based methods: root mean square residual (RMSR), chi[superscript 2]G/D2, and approximate likelihood ratio (ALR). The results suggested that the studied methods had varying degree of success in correctly counting the number of dimensions and in meaningfully labeling sets of items as dimension-like. In two-dimensional, shorter tests, chi[superscript 2]G/D2 and ALR largely outperformed RMSR- and DETECT-based methods in conditions with small and medium sample sizes, across all levels of complexity and correlations. Lengthening of the test in two-dimensional conditions led to most notably improved accuracy in determining the correct number of dimensions for NOHARM-based RMSR, whereas for the remaining methods, increase in the number of items had differential effect. DETECT-based methods, on the other hand, had more success in labeling sets of items as dimension-like in conditions with two dimensions, irrespective of the test length, suggesting the items that ought to be together were more often grouped together. Performance of the methods was further evaluated in conditions with larger dimensionality (i.e., 3) and conditions with the increased number of items (i.e., longer tests). (Contains 7 tables and 4 notes.) (As Provided).
Anmerkungen	SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10