On Rater Agreement and Rater Training

Autor/in	Wang, Binhong
Titel	On Rater Agreement and Rater Training
Quelle	In: English Language Teaching, 3 (2010) 1, S.108-112 (5 Seiten) PDF als Volltext kostenfreie Datei Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1916-4742
Schlagwörter	Interrater Reliability; Examiners; Training; Bias; Evaluation Criteria; Error of Measurement; Scores; Personnel Selection; Rating Scales + Suchen Sie Ihr Suchwort? Interrater-Reliabilität; Examiner; Prüfer; Ausbildung; Messfehler; Personalauswahl; Personalentscheidung; Rating-Skala
Abstract	This paper first analyzed two studies on rater factors and rating criteria to raise the problem of rater agreement. After that the author reveals the causes of discrepencies in rating administration by discussing rater variability and rater bias. The author argues that rater bias can not be eliminated completely, we can only reduce the error to a cetain degree by training raters. The study on rater factors can help us better understand rater variability and rater bias, train raters more effectively and find out ways to modify the scores given by raters. The author suggests that rater files which contain rater information including each rater bias tendency should be established and kept so that information can be retrieved about the selection of raters, the interpretation as well as the modification of the scores given by raters. Raters need to receive pre-service training, on-service training and pilot -on-task training. (As Provided).
Anmerkungen	Canadian Center of Science and Education. 1120 Finch Avenue West Suite 701-309, Toronto, OH M3J 3H7, Canada. Tel: 416-642-2606; Fax: 416-642-2608; e-mail: elt@ccsenet.org; Web site: http://www.ccsenet.org/journal/index.php/elt
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2020/1/01