Testing teacher judgments comprehensively: Accuracy, halo, frame of reference, strategy, and personality effects in holistic and analytic assessments of student essays.

Autor/inn/en	Lohmann, Julian F.; Lötscher, Flavio; Junge, Fynn; Keller, Stefan; Jansen, Thorben; Fleckenstein, Johanna; Möller, Jens
Titel	Testing teacher judgments comprehensively: Accuracy, halo, frame of reference, strategy, and personality effects in holistic and analytic assessments of student essays. Gefälligkeitsübersetzung: Umfassende Prüfung von Lehrerurteilen: Genauigkeit, Halo, Bezugsrahmen, Strategie und Persönlichkeitseffekte bei ganzheitlichen und analytischen Bewertungen von Schüleraufsätzen.
Quelle	In: The journal of educational psychology, 118 (2026) 6, S. 941-960Infoseite zur Zeitschrift PDF als Volltext Link als defekt meldenVerfügbarkeit
Sprache	englisch
Dokumenttyp	online; Zeitschriftenaufsatz
ISSN	1939-2176
DOI	10.1037/edu0000969
Schlagwörter	Eigenschaft; Halo-Effekt; Kognition; Lehrer; Lehramtsstudium; Referendar; Lehrerpersönlichkeit; Verzerrung; Berufliche Kompetenz; Beurteilung
Abstract	The present study examined teacher judgment accuracy and bias in text assessment. We (a) investigated differences in judgment accuracy depending on multiple text quality criteria, (b) explored teacher characteristics and judgment behavior as potential moderators of judgment accuracy, and (c) juxtaposed accuracy and typical judgment biases, namely reference group and halo effects. A sample of NsubLevel 1 = 6,300 judgments from NsubLevel 2 = 315 German and Swiss preservice English teachers was analyzed using hierarchical linear models. The results predominantly imply a medium to strong relative judgment accuracy (rank component) across analytic and holistic text ratings. Moderation analyses showed that relative judgment accuracy was higher when teachers spent more time and switched more often between essays to achieve consistent judgments but tended to be lower for teachers reporting more text assessment experience. Language quality and content triggered halo effects in judgments of other text quality dimensions. Mean essay quality had a negative effect on teacher judgments, implying a reference-group effect in line with the contrast hypothesis. Although statistically significant, biases were much smaller than coefficients representing accuracy. We discuss the implications of our findings with regard to teacher education. (ZPID).
Erfasst von	Leibniz-Institut für Psychologie, Trier
Update	2026/3