Can We Trust Teaching Evaluations When Response Rates Are Not High? Implications from a Monte Carlo Simulation

Autor/inn/en	He, Jun; Freeman, Lee A.
Titel	Can We Trust Teaching Evaluations When Response Rates Are Not High? Implications from a Monte Carlo Simulation
Quelle	In: Studies in Higher Education, 46 (2021) 9, S.1934-1948 (15 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0307-5079
DOI	10.1080/03075079.2019.1711046
Schlagwörter	Student Evaluation of Teacher Performance; College Faculty; College Students; Online Surveys; Response Rates (Questionnaires); Responses; Accuracy; Validity; Monte Carlo Methods; Class Size; Scores; Correlation; Public Colleges + Suchen Sie Ihr Suchwort? Fakultät; Collegestudent; Antwortkontrolle; Gültigkeit; Monte-Carlo-Methode; Klassengröße; Korrelation
Abstract	Online teaching evaluations have replaced in-class teaching evaluations as the new norm for assessing teaching performance. Faculty raise concerns regarding lower response rates compared to traditional in-class evaluations. A low response rate implies an underrepresentation of the target student population and threatens the validity of the evaluation. The literature comparing online with in-class evaluations focuses on the average evaluation ratings and concludes, with few exceptions, that the two methods produce statistically indifferent results. The accuracy of an evaluation, however, is not addressed. This study employs Monte Carlo simulation to investigate the effects of various evaluation conditions, including response rates, class sizes, and observed evaluation scores, on the accuracy of the evaluations. The complex distribution of evaluation ratings are carefully simulated based on a real dataset, and the effects of the investigated factors on evaluation accuracy are calculated and analyzed. Implications for assessing teaching performance are discussed. (As Provided).
Anmerkungen	Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01