Toward Understanding and Quantifying Halo in Students' Evaluation of Teaching

Autor/in	Michela, John L.
Titel	Toward Understanding and Quantifying Halo in Students' Evaluation of Teaching
Quelle	In: Assessment & Evaluation in Higher Education, 48 (2023) 4, S.438-450 (13 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Michela, John L.)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0260-2938
DOI	10.1080/02602938.2022.2086965
Schlagwörter	Student Evaluation of Teacher Performance; Cognitive Processes; Bias; Psychological Patterns; College Students; Schemata (Cognition); Effect Size; Validity; Factor Analysis; Summative Evaluation; Formative Evaluation + Suchen Sie Ihr Suchwort? Cognitive process; Kognitiver Prozess; Collegestudent; Cognition; Schema; Kognition; Gültigkeit; Faktorenanalyse
Abstract	Despite its name, the halo effect in student evaluation of teaching (SET) response is not mystical. Halo in SET results from psychological processes that undermine SET validity, particularly for summative evaluation (pay decisions, etc.). These processes span psychological concepts of cognition, motivation and affect. This paper demonstrates that halo signals serious trouble for SET data, contrary to the conclusion in Cannon and Cipriani (2022), to which this article replies. Re-analysis of those authors' findings, conducted for the present paper, reveals both more halo and less validity than Cannon and Cipriani reported. For re-analysis of their factor analysis, a practical, generalizable approach to gauging halo in various settings is proposed. This approach revealed consistently high apparent SET halo across various decades and geographical locations of SET use. For re-analysis of their multiple regression, an approach to deciphering individual variables' effect sizes is provided for designs like Cannon and Cipriani's. Implications discussed for summative use of SETs include issues of veracity of SET confidence intervals. In contrast to summative use, formative use (toward performance improvement) suffers less from halo because non-instructional factor influences are somewhat constant for individuals. (As Provided).
Anmerkungen	Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01