How Non-Linearity and Grade-Level Differences Complicate the Validation of Observation Protocols

Autor/inn/en	Lazarev, Valeriy; Newman, Denis
Institution	Society for Research on Educational Effectiveness (SREE)
Titel	How Non-Linearity and Grade-Level Differences Complicate the Validation of Observation Protocols
Quelle	(2013), (8 Seiten) PDF als Volltext kostenfreie Datei Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Monographie
Schlagwörter	Teacher Evaluation; Observation; Scores; Value Added Models; Teacher Competencies; Mathematics Teachers; Mathematics Instruction; Instructional Program Divisions; Grade 4; Grade 5; Grade 6; Grade 7; Grade 8; Elementary Schools; Middle Schools; Departments; Correlation; Urban Schools; School Districts; Teacher Effectiveness; Statistical Analysis; Video Technology + Suchen Sie Ihr Suchwort? Teacher appraisal; Lehrerbeurteilung; Beobachtung; Lehrkunst; Mathematics; Teacher; Teachers; Mathematik; Lehrer; Lehrerin; Lehrende; Mathematics lessons; Mathematikunterricht; School year 04; 4. Schuljahr; Schuljahr 04; School year 05; 5. Schuljahr; Schuljahr 05; School year 06; 6. Schuljahr; Schuljahr 06; School year 07; 7. Schuljahr; Schuljahr 07; School year 08; 8. Schuljahr; Schuljahr 08; Elementary school; Grundschule; Volksschule; Middle school; Mittelschule; Mittelstufenschule; Department; Abteilung; Korrelation; Urban area; Urban areas; School; Schools; Stadtregion; Stadt; Schule; School district; Schulbezirk; Effectiveness of teaching; Instructional effectiveness; Lehrerleistung; Unterrichtserfolg; Statistische Analyse
Abstract	Teacher evaluation is currently a major policy issue at all levels of the K-12 system driven in large part by current US Department of Education requirements. The main objective of this study is to explore the patterns of relationship between observational scores and value-added measures of teacher performance in math classrooms and the variation in these relationships across grade levels. While the MET analyses used a single composite score consisting of a simple average of the eight component scores of the protocol, in our work we treated each component separately since each measures a separately definable aspect of classroom practice. Specifically, across all the components, the authors pose the following questions: (1) Do the relationships between observation scores of math teachers and their value-added scores tend to be non-linear?; (2) Is there a difference in the relationships associated with developmental changes as indicated by grade levels (four through eight)?; and (3) To what extent the observed changes are associated with increasing departmentalization (in upper elementary and middle school)? The relationship between classroom observation instruments and teacher effectiveness is often presumed to be a simple linear mapping. The authors find that the relationship is complex: it is typically non-linear and the shape of this relationship appears to evolve with the grade level progression. Careful analysis of such relationships will improve understanding of teacher effectiveness and result in more accurate teacher evaluation systems. Better evaluation systems will in turn generate more useful administrative data for use in effectiveness research. Tables and figures are appended. (ERIC).
Anmerkungen	Society for Research on Educational Effectiveness. 2040 Sheridan Road, Evanston, IL 60208. Tel: 202-495-0920; Fax: 202-640-4401; e-mail: inquiries@sree.org; Web site: http://www.sree.org
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2020/1/01