What Are the Conditions Associated with Subscore Added Value Noninvariance? Implications for Improving Subscore Interpretation Fairness

Autor/inn/en	Rios, Joseph A.; Miranda, Alejandra A.
Titel	What Are the Conditions Associated with Subscore Added Value Noninvariance? Implications for Improving Subscore Interpretation Fairness
Quelle	In: Educational Measurement: Issues and Practice, 40 (2021) 1, S.69-78 (10 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Rios, Joseph A.)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0731-1745
DOI	10.1111/emip.12379
Schlagwörter	Scores; Test Length; Ability; Correlation; Differences; Test Interpretation; Groups + Suchen Sie Ihr Suchwort? Fähigkeit; Fertigkeit; Korrelation; Unterscheiden; Test analysis; Testauswertung
Abstract	Subscore added value analyses assume invariance across test taking populations; however, this assumption may be untenable in practice as differential subdomain relationships may be present among subgroups. The purpose of this simulation study was to understand the conditions associated with subscore added value noninvariance when manipulating: (1) subdomain test length; (2) differences in subgroup mean ability; and (3) subgroup differences in intersubdomain correlations. Results demonstrated that subscore added value was noninvariant for 24-100% of replications (depending on subdomain test length) when the subgroup difference in intersubdomain correlation was equal to 0.30. To examine if this condition was met in practice, applied invariance analyses of three operational testing programs were conducted. Across these datasets, noninvariant subscore added value was present for some subdomains across sex and ethnic subgroups. Overall, these results indicate that subscore added value noninvariance is largely driven by differential intersubdomain correlations among subgroups, which may be present in some operational testing programs. (As Provided).
Anmerkungen	Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01