Estimating the Accuracy of Relative Growth Measures Using Empirical Data

Autor/inn/en	Castellano, Katherine E.; McCaffrey, Daniel F.
Titel	Estimating the Accuracy of Relative Growth Measures Using Empirical Data
Quelle	In: Journal of Educational Measurement, 57 (2020) 1, S.92-123 (32 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0022-0655
DOI	10.1111/jedm.12243
Schlagwörter	Accuracy; Student Evaluation; Measurement Techniques; Evaluation Methods; Statistical Analysis; Scores; Computation; Item Response Theory; Statistical Bias; Student Development + Suchen Sie Ihr Suchwort? Schulnote; Studentische Bewertung; Messtechnik; Statistische Analyse; Item-Response-Theorie
Abstract	The residual gain score has been of historical interest, and its percentile rank has been of interest more recently given its close correspondence to the popular Student Growth Percentile. However, these estimators suffer from low accuracy and systematic bias (bias conditional on prior latent achievement). This article explores three alternatives--using the expected a posterior (EAP), conditioning on an additional lagged score, and correcting for measurement error bias from the prior score (Corrected-Observed)--evaluated in terms of their systematic bias, squared correlation with their target (R[superscript 2]), and proportional reduction in mean squared error (PRMSE). Both analytic results (under model assumptions) and empirical results (found using item response data to calculate the growth estimators) reveal that the EAP estimators are the most accurate, whereas the Corrected-Observed removes systematic bias, but reduces overall accuracy. Adding another prior year often decreases accuracy but only slightly reduces systematic bias at realistic test reliabilities. For all estimators, R[superscript 2] and PRMSE are substantially below levels that are considered necessary for reporting educational measurements with moderate to high stakes. For all but the EAP, the raw residual gain estimators have negative PRMSE, indicating that inferences about a student's latent growth would be more accurate if students were assigned the average residual rather than estimating their residual. (As Provided).
Anmerkungen	Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail: cs-journals@wiley.com; Web site: http://www.wiley.com/WileyCDA
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01