Do Student Ratings Provide Reliable and Valid Information about Teaching Quality at the School Level? Evaluating Measures of Science Teaching in PISA 2015

Autor/inn/en	Aditomo, Anindito; Köhler, Carmen
Titel	Do Student Ratings Provide Reliable and Valid Information about Teaching Quality at the School Level? Evaluating Measures of Science Teaching in PISA 2015
Quelle	In: Educational Assessment, Evaluation and Accountability, 32 (2020) 3, S.275-310 (36 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Aditomo, Anindito)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1874-8597
DOI	10.1007/s11092-020-09328-6
Schlagwörter	Teacher Effectiveness; Achievement Tests; Foreign Countries; Secondary School Students; International Assessment; Rating Scales; Test Validity; Test Reliability; Classroom Techniques; Student Evaluation of Teacher Performance; Program for International Student Assessment + Suchen Sie Ihr Suchwort? Effectiveness of teaching; Instructional effectiveness; Lehrerleistung; Unterrichtserfolg; Achievement test; Achievement; Testing; Test; Tests; Leistungsbeurteilung; Leistungsüberprüfung; Leistung; Testdurchführung; Testen; Ausland; Sekundarschüler; Rating-Skala; Testvalidität; Testreliabilität; Klassenführung
Abstract	Large-scale educational surveys, including PISA, often collect student ratings to assess teaching quality. Because of the sampling design in PISA, student ratings must be aggregated at the school level instead of the classroom level. To what extent does school-level aggregation of student ratings yield reliable and valid measures of teaching quality? We investigate this question for six scales measuring classroom management, emotional support, inquiry-based instruction, teacher-directed instruction, adaptive instruction, and feedback provided by PISA 2015. The sample consisted of 503,146 students from 17,678 schools in 69 countries/regions. Multilevel CFA and SEM were conducted for each scale in each country/region to evaluate school-level reliability (intraclass correlations 1 and 2), factorial validity, and predictive validity. In most countries/regions, school-level reliability was found to be adequate for the classroom management scale, but only low to moderate for the other scales. Examination of factorial and predictive validity indicated that the classroom management, emotional support, adaptive instruction, and teacher-directed instruction scales capture meaningful differences in teaching quality between schools. Meanwhile, the inquiry scale exhibited poor validity in almost all countries/regions. These findings suggest the possibility of using student ratings in PISA to investigate some aspects of school-level teaching quality in most countries/regions. (As Provided).
Anmerkungen	Springer. Available from: Springer Nature. 233 Spring Street, New York, NY 10013. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-348-4505; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01