A New Method for Analyzing Content Validity Data Using Multidimensional Scaling

Autor/inn/en	Li, Xueming; Sireci, Stephen G.
Titel	A New Method for Analyzing Content Validity Data Using Multidimensional Scaling
Quelle	In: Educational and Psychological Measurement, 73 (2013) 3, S.365-385 (21 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0013-1644
DOI	10.1177/0013164412473825
Schlagwörter	Content Validity; Multidimensional Scaling; Data Analysis; Educational Testing; Test Content; Alignment (Education); Test Items; Science Tests; National Competency Tests; Science Teachers; Multivariate Analysis; California; Delaware; Florida; Kentucky; Maryland; Ohio; South Carolina; Texas; Virginia; Washington; National Assessment of Educational Progress + Suchen Sie Ihr Suchwort? Mehrdimensionale Analysis; Auswertung; Testaufgabe; Test content; Science; Teacher; Teachers; Science teacher; Wissenschaft; Lehrer; Lehrerin; Lehrende; Multivariate Analyse; Kalifornien
Abstract	Validity evidence based on test content is of essential importance in educational testing. One source for such evidence is an alignment study, which helps evaluate the congruence between tested objectives and those specified in the curriculum. However, the results of an alignment study do not always sufficiently capture the degree to which a test adequately represents the intended content domain. In this study, we present and evaluate a method for analyzing alignment data that uses multidimensional scaling to determine whether the dimensions underlying subject matter experts' (SME) ratings of test items conform to the dimensions delineated in the test specifications. The results suggest this procedure provides an enhanced view of content domain representation by portraying the content similarities among items along continuous, rather than discrete, dimensions. The additional types of information provided by this procedure, in relation to that provided by traditional analysis of SME data, are discussed. (Contains 8 tables, 6 figures, and 2 notes.) (As Provided).
Anmerkungen	SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10