Do ESL Essay Raters' Evaluation Criteria Change with Experience? A Mixed-Methods, Cross-Sectional Study

Autor/in	Barkaoui, Khaled
Titel	Do ESL Essay Raters' Evaluation Criteria Change with Experience? A Mixed-Methods, Cross-Sectional Study
Quelle	In: TESOL Quarterly: A Journal for Teachers of English to Speakers of Other Languages and of Standard English as a Second Dialect, 44 (2010) 1, S.31-57 (27 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0039-8322
Schlagwörter	Evaluation Criteria; Rating Scales; Essays; English (Second Language); Second Language Learning; Writing Evaluation; Case Studies; Scores; Qualitative Research; Longitudinal Studies; Correlation; Statistical Analysis; Language Proficiency; Comparative Analysis + Suchen Sie Ihr Suchwort? Rating-Skala; Essay; Aufsatzunterricht; English as second language; English; Second Language; Englisch als Zweitsprache; Zweitsprachenerwerb; Case study; Fallstudie; Case Study; Qualitative Forschung; Longitudinal study; Longitudinal method; Longitudinal methods; Längsschnittuntersuchung; Korrelation; Statistische Analyse; Language skill; Language skills; Sprachkompetenz
Abstract	This study adopted a mixed-methods cross-sectional approach to identify similarities and differences in the English as a second language (ESL) essay holistic scores and evaluation criteria of raters with different levels of experience. Each of 31 experienced and 29 novice raters rated a sample of ESL essays holistically and analytically and provided written explanations for each holistic score they assigned. Score and qualitative data analyses were conducted to identify the criteria that the raters employed to rate the essays holistically. The findings indicated that both groups gave more importance to the communicative quality of the essays than to other aspects of writing. However, the novice raters tended to be more lenient and to give more importance to argumentation than the experienced raters did. The experienced raters tended to be more severe, to give more importance to linguistic accuracy, and to refer to evaluation criteria other than those listed in the rating scale more frequently than the novices did. The article concludes with a call for longitudinal research to investigate to what extent, how, and why rater evaluation criteria change over time and across contexts. (Contains 5 tables and 4 footnotes.) (As Provided).
Anmerkungen	Teachers of English to Speakers of Other Languages, Inc. 1925 Ballenger Avenue Suite 550, Alexandria, VA 22314. Tel: 888-547-3369; Tel: 703-836-0774; Fax: 703-836-7864; Fax: 703-836-6447; e-mail: info@tesol.org; Web site: http://www.tesol.org
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10