A Comparison of Teacher Effectiveness Measures Calculated Using Three Multilevel Models for Raters Effects

Autor/inn/en	Murphy, Daniel L.; Beretvas, S. Natasha
Titel	A Comparison of Teacher Effectiveness Measures Calculated Using Three Multilevel Models for Raters Effects
Quelle	In: Applied Measurement in Education, 28 (2015) 3, S.219-236 (18 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0895-7347
DOI	10.1080/08957347.2015.1042158
Schlagwörter	Teacher Effectiveness; Comparative Analysis; Hierarchical Linear Modeling; Test Theory; Item Response Theory; Computation; Scaling; Bias; Measurement; Elementary School Teachers; Middle School Teachers; Grade 4; Grade 5; Grade 6; Grade 7; Grade 8; Markov Processes; Monte Carlo Methods; Colorado; Florida; New York; North Carolina; Tennessee; Texas + Suchen Sie Ihr Suchwort? Effectiveness of teaching; Instructional effectiveness; Lehrerleistung; Unterrichtserfolg; Testtheorie; Item-Response-Theorie; Scale construction; Skalenkonstruktion; Messverfahren; Elementary school; Teacher; Teachers; Grundschule; Volksschule; Lehrer; Lehrerin; Lehrende; Middle school; Middle schools; Mittelschule; Mittelstufenschule; School year 04; 4. Schuljahr; Schuljahr 04; School year 05; 5. Schuljahr; Schuljahr 05; School year 06; 6. Schuljahr; Schuljahr 06; School year 07; 7. Schuljahr; Schuljahr 07; School year 08; 8. Schuljahr; Schuljahr 08; Markowscher Prozess; Monte-Carlo-Methode
Abstract	This study examines the use of cross-classified random effects models (CCrem) and cross-classified multiple membership random effects models (CCMMrem) to model rater bias and estimate teacher effectiveness. Effect estimates are compared using CTT versus item response theory (IRT) scaling methods and three models (i.e., conventional multilevel model, CCrem, CCMMrem). Results indicate that ignoring rater bias can lead to teachers being misclassified within an evaluation system. The best estimates of teacher effectiveness are produced using CCrems regardless of scaling method. Use of CCMMrems to model rater bias cannot be recommended based on the results of this study; combining the use of CCMMrems with an IRT scaling method produced especially unstable results. (As Provided).
Anmerkungen	Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site: http://www.tandf.co.uk/journals
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2020/1/01