Policies and practices of assessment. A showcase for the use (and misuse) of international large scale assessments in educational effectiveness research.

Autor/in	Klieme, Eckhard
Titel	Policies and practices of assessment. A showcase for the use (and misuse) of international large scale assessments in educational effectiveness research.
Quelle	Aus: Hall, James (Hrsg.); Lindorff, Ariel (Hrsg.); Sammons, Pamela (Hrsg.): International perspectives in educational effectiveness research. Cham: Springer (2020) S. 147-181 PDF als Volltext Link als defekt meldenVerfügbarkeit
Beigaben	Literaturangaben
Sprache	englisch
Dokumenttyp	online; gedruckt; Sammelwerksbeitrag
ISBN	978-3-030-44809-7; 978-3-030-44810-3; 978-3-030-44811-0; 978303044812-7
DOI	10.1007/978-3-030-44810-3_7
Schlagwörter	Bildungsforschung; TIMSS (Third International Mathematics and Science Study); Bildungssystem; Bildungsertrag; Schüler; Lernerfolg; Nationaler Unterschied; Forschungsstand; Internationaler Vergleich; Auswirkung; Bewertung; Forschungsdaten; Konzeptualisierung; Kulturabhängigkeit; Leistungsmessung; Missbrauch; Perspektive; Praxis; Problematisierung; Richtlinien; Wirksamkeit; PISA (Programme for International Student Assessment)
Abstract	International Large Scale Assessments (ILSAs) such as TIMSS and PISA provide comparative indicators and trend information on educational systems. Scholars repeatedly claimed that ILSAs should be based on concepts from Educational Effectiveness Research (EER). At the same time, ILSAs can contribute to the further development of EER by providing data, triggering new research studies, and providing instruments which work across cultures. When using ILSA data, however, researchers need to cope with limitations regarding design, sampling, and measurement. Cross-sectional data from individual ILSAs, with little information on students' learning paths, rarely allow for estimating the effects of policies and practices on student outcomes. Rather, ILSAs inform about the distribution of educational opportunities among students, schools, and regions. Effects of national policies may be identified through country level trend data, if ecological fallacies can be avoided.- In an attempt to illustrate methodological problems and discuss relationships between ILSAs and EER, the present chapter uses a specific showcase: policies and practices of educational assessment. Several related measures were implemented in PISA. Reanalyzing these data, the chapter identifies national patterns of classroom assessment practices, use of assessment, school evaluation and accountability policies. E.g., "soft accountability" (comparing performance with a national standard) is discriminated from "strong accountability" (making test results public); soft accountability was related to country-level growth in achievement. English-speaking countries turned out to show similar patterns, while full invariance with regard to student-perceived assessment and feedback could be established for four (non-American) countries only. (Orig.).
Erfasst von	DIPF \| Leibniz-Institut für Bildungsforschung und Bildungsinformation, Frankfurt am Main
Update	2022/2