Reporting Valid and Reliable Overall Scores and Domain Scores

Autor/in	Yao, Lihua
Titel	Reporting Valid and Reliable Overall Scores and Domain Scores
Quelle	In: Journal of Educational Measurement, 47 (2010) 3, S.339-360 (22 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0022-0655
DOI	10.1111/j.1745-3984.2010.00117.x
Schlagwörter	Educational Assessment; Error of Measurement; Item Response Theory; Scores; Models; Correlation; Measurement Techniques + Suchen Sie Ihr Suchwort? Education; assessment; Bewertungssystem; Messfehler; Item-Response-Theorie; Analogiemodell; Korrelation; Messtechnik
Abstract	In educational assessment, overall scores obtained by simply averaging a number of domain scores are sometimes reported. However, simply averaging the domain scores ignores the fact that different domains have different score points, that scores from those domains are related, and that at different score points the relationship between overall score and domain score may be different. To report reliable and valid overall scores and domain scores, I investigated the performance of four methods using both real and simulation data: (a) the unidimensional IRT model; (b) the higher-order IRT model, which simultaneously estimates the overall ability and domain abilities; (c) the multidimensional IRT (MIRT) model, which estimates domain abilities and uses the maximum information method to obtain the overall ability; and (d) the bifactor general model. My findings suggest that the MIRT model not only provides reliable domain scores, but also produces reliable overall scores. The overall score from the MIRT maximum information method has the smallest standard error of measurement. In addition, unlike the other models, there is no linear relationship assumed between overall score and domain scores. Recommendations for sizes of correlations between domains and the number of items needed for reporting purposes are provided. (As Provided).
Anmerkungen	Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail: cs-journals@wiley.com; Web site: http://www.wiley.com/WileyCDA/
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10