The Consistency between Human Raters and an Automated Essay Scoring System in Grading High School Students' English Writing

Autor/in	Tsai, Min-hsiu
Titel	The Consistency between Human Raters and an Automated Essay Scoring System in Grading High School Students' English Writing
Quelle	In: Action in Teacher Education, 34 (2012) 4, S.328-335 (8 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0162-6620
DOI	10.1080/01626620.2012.717033
Schlagwörter	Foreign Countries; High School Students; Writing (Composition); Essays; English (Second Language); Grading; Scoring; Cognitive Processes; Automation; Cybernetics; Artificial Intelligence; Comparative Analysis; High Schools; Grade 11; Grade 12; Interrater Reliability; China; Taiwan + Suchen Sie Ihr Suchwort? Ausland; High school; High schools; Student; Students; Oberschule; Schüler; Schülerin; Studentin; Schreibübung; Essay; Aufsatzunterricht; English as second language; English; Second Language; Englisch als Zweitsprache; Notengebung; Schulnote; Bewertung; Cognitive process; Kognitiver Prozess; Kybernetik; Künstliche Intelligenz; School year 11; 11. Schuljahr; Schuljahr 11; School year 12; 12. Schuljahr; Schuljahr 12; Interrater-Reliabilität
Abstract	This study investigates the consistency between human raters and an automated essay scoring system in grading high school students' English compositions. A total of 923 essays from 23 classes of 12 senior high schools in Taiwan (Republic of China) were obtained and scored manually and electronically. The results show that the consistency between human raters is significantly higher than the consistency between human raters and the automated essay scoring system. To discover whether the students were confident with the automated essay grading system, a questionnaire was also distributed. The results indicate the participants realize their vocabulary level was inadequate, and they wanted to know the scores the automated essay grading system gave them along with the generated comments regarding their compositions. (Contains 6 tables.) (As Provided).
Anmerkungen	Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site: http://www.tandf.co.uk/journals
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10