Comparison of Automatic and Expert Teachers' Rating of Computerized English Listening-Speaking Test

Autor/in	Linlin, Cao
Titel	Comparison of Automatic and Expert Teachers' Rating of Computerized English Listening-Speaking Test
Quelle	In: English Language Teaching, 13 (2020) 1, S.18-30 (13 Seiten) PDF als Volltext kostenfreie Datei Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1916-4742
Schlagwörter	Language Tests; Computer Assisted Testing; English (Second Language); Second Language Learning; Speech Communication; Scores; Evaluators; Scoring; Listening Comprehension; Interrater Reliability; College Faculty; High School Teachers; Comparative Analysis; Computer Software; Foreign Countries; Teacher Attitudes; Specialists; Evaluation Methods; China + Suchen Sie Ihr Suchwort? Language test; Sprachtest; English as second language; English; Second Language; Englisch als Zweitsprache; Zweitsprachenerwerb; Bewertung; Hörverständnis; Interrater-Reliabilität; Fakultät; High school; High schools; Teacher; Teachers; Oberschule; Lehrer; Lehrerin; Lehrende; Ausland; Lehrerverhalten
Abstract	Through Many-Facet Rasch analysis, this study explores the rating differences between 1 computer automatic rater and 5 expert teacher raters on scoring 119 students in a computerized English listening-speaking test. Results indicate that both automatic and the teacher raters demonstrate good inter-rater reliability, though the automatic rater indicates less intra-rater reliability than college teacher and high school teacher raters under the stringent infit limits. There's no central tendency and random effect for both automatic and human raters. This research provides evidence for the automatic rating reform of the computerized English listening-speaking test (CELST) in Guangdong NMET and encourages the application of MFRM in actual score monitoring. (As Provided).
Anmerkungen	Canadian Center of Science and Education. 1120 Finch Avenue West Suite 701-309, Toronto, OH M3J 3H7, Canada. Tel: 416-642-2606; Fax: 416-642-2608; e-mail: elt@ccsenet.org; Web site: http://www.ccsenet.org/journal/index.php/elt
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01