Is Teacher Value Added a Matter of Scale? The Practical Consequences of Treating an Ordinal Scale as Interval for Estimation of Teacher Effects

Autor/in	Soland, James
Titel	Is Teacher Value Added a Matter of Scale? The Practical Consequences of Treating an Ordinal Scale as Interval for Estimation of Teacher Effects
Quelle	In: Applied Measurement in Education, 30 (2017) 1, S.52-70 (19 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0895-7347
DOI	10.1080/08957347.2016.1247844
Schlagwörter	Intervals; Value Added Models; Teacher Evaluation; Teacher Effectiveness; Change; Tests; Achievement Tests; Standardized Tests; State Standards; Item Response Theory; Evaluation Methods; Florida; Florida Comprehensive Assessment Test + Suchen Sie Ihr Suchwort? Teacher appraisal; Lehrerbeurteilung; Effectiveness of teaching; Instructional effectiveness; Lehrerleistung; Unterrichtserfolg; Wandel; Examination; Prüfung; Examen; Achievement test; Achievement; Testing; Test; Tests; Leistungsbeurteilung; Leistungsüberprüfung; Leistung; Testdurchführung; Testen; Standadised tests; Standardisierter Test; Item-Response-Theorie
Abstract	Research shows that assuming a test scale is equal-interval can be problematic, especially when the assessment is being used to achieve a policy aim like evaluating growth over time. However, little research considers whether teacher value added is sensitive to the underlying test scale, and in particular whether treating an ordinal scale as interval might lead to erroneous conclusions about teacher quality. This article addresses the issue by estimating teacher value added, then applying extremely mild nonlinear transformations to the original scale and re-estimating the value added. Although by definition at most one of these scales can be equal-interval, all are treated as if interval-scaled when estimating value added. Results show that value added is sensitive to the scale used. While rank orderings of teachers do not change radically by transformation, even mild departures from the original scale can change a teacher's odds of being considered high- or low-performing by a factor of 5. (As Provided).
Anmerkungen	Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site: http://www.tandf.co.uk/journals
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2020/1/01