Establishing an Operational Model of Rating Scale Construction for English Writing Assessment

Autor/in	Wu, Xuefeng
Titel	Establishing an Operational Model of Rating Scale Construction for English Writing Assessment
Quelle	In: English Language Teaching, 15 (2022) 1, S.16-36 (21 Seiten) PDF als Volltext kostenfreie Datei Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1916-4742
Schlagwörter	Writing Evaluation; Rating Scales; Second Language Learning; Second Language Instruction; English (Second Language); Majors (Students); Essays; Language Teachers; Factor Analysis; Foreign Countries; Models; College Faculty; Specialists; Language Tests; Student Attitudes; Teacher Attitudes; Undergraduate Students; Writing Skills; Decision Making; Evaluators; China + Suchen Sie Ihr Suchwort? Rating-Skala; Zweitsprachenerwerb; Fremdsprachenunterricht; English as second language; English; Second Language; Englisch als Zweitsprache; Essay; Aufsatzunterricht; Language teacher; Sprachunterricht; Faktorenanalyse; Ausland; Analogiemodell; Fakultät; Language test; Sprachtest; Schülerverhalten; Lehrerverhalten; Writing skill; Schreibfertigkeit; Decision-making; Entscheidungsfindung
Abstract	Rating scales for writing assessment are critical in that they determine directly the quality and fairness of such performance tests. However, in many EFL contexts, rating scales are made, to certain extent, based on the intuition of teachers who strongly need a feasible and scientific route to guide their construction of rating scales. This study aims to design an operational model of rating scale construction with English summary writing as an example. Altogether 325 university English teachers, 4 experts in language assessment and 60 English majors in China participated in the study. 20 textual attributes were extracted, through text analysis, from China's Standards of English Language Ability (CSE), theoretical construct of summary writing, comments on sample summary writing essays from 8 English teachers and their personal judgement. The textual attributes were then investigated through a large-scale questionnaire survey. Exploratory factor analysis and expert judgement were employed to determine rating scale dimensions. Regression analysis and expert judgement were conducted to determine the weighting distribution across all dimensions. Based on such endeavors, a tentative operational model of rating scale construction was established, which can also be applied and adapted to develop rating scales in other writing assessment. (As Provided).
Anmerkungen	Canadian Center of Science and Education. 1595 Sixteenth Ave Suite 301, Richmond Hill, Ontario, L4B 3N9 Canada. Tel: 416-642-2606; Fax: 416-642-2608; e-mail: elt@ccsenet.org; Web site: http://www.ccsenet.org/journal/index.php/elt
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01