A Model-Based Examination of Scale Effects in Student Evaluations of Teaching

Autor/inn/en	Courey, Karyssa A.; Lee, Michael D.
Titel	A Model-Based Examination of Scale Effects in Student Evaluations of Teaching
Quelle	In: AERA Open, 7 (2021) 1, (13 Seiten) PDF als Volltext kostenfreie Datei Verfügbarkeit
Zusatzinformation	ORCID (Courey, Karyssa A.) ORCID (Lee, Michael D.)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	2332-8584
Schlagwörter	Student Evaluation of Teacher Performance; Rating Scales; Response Style (Tests); College Students; Test Format; California (Irvine) + Suchen Sie Ihr Suchwort? Rating-Skala; Antwortverhalten; Collegestudent; Testentwicklung
Abstract	Student evaluations of teaching are widely used to assess instructors and courses. Using a model-based approach and Bayesian methods, we examine how the direction of the scale, labels on scales, and the number of options affect the ratings. We conduct a within-participants experiment in which respondents evaluate instructors and lectures using different scales. We find that people tend to give positive ratings, especially when using letter scales compared with number scales. Furthermore, people tend to use the end-points less often when a scale is presented in reverse. Our model-based analysis allows us to infer how the features of scales shift responses to higher or lower ratings and how they compress scale use to make end-point responses more or less likely. The model also makes predictions about equivalent ratings across scales, which we demonstrate using real-world evaluation data. Our study has implications for the design of scales and for their use in assessment. (As Provided).
Anmerkungen	SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01