Validity and Fairness Implications of Varying Time Conditions on a Diagnostic Test of Academic English Writing Proficiency

Autor/inn/en	Knoch, Ute; Elder, Catherine
Titel	Validity and Fairness Implications of Varying Time Conditions on a Diagnostic Test of Academic English Writing Proficiency
Quelle	In: System: An International Journal of Educational Technology and Applied Linguistics, 38 (2010) 1, S.63-74 (12 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0346-251X
DOI	10.1016/j.system.2009.12.006
Schlagwörter	Writing Tests; Language Tests; Test Validity; Interrater Reliability; Diagnostic Tests; Discourse Analysis; Measures (Individuals); Writing Skills; Academic Discourse; Time Perspective; Educational Policy; Writing Achievement; Second Language Learning; Second Language Instruction; English for Academic Purposes; Comparative Analysis; Questionnaires; College Instruction; Student Attitudes; Ethics; College Students + Suchen Sie Ihr Suchwort? Writing test; Schreibtest; Language test; Sprachtest; Testvalidität; Interrater-Reliabilität; Diagnostic test; Diagnostischer Test; Diskursanalyse; Messdaten; Writing skill; Schreibfertigkeit; Discourse; Diskurs; Zeitbezug; Politics of education; Bildungspolitik; Zweitsprachenerwerb; Fremdsprachenunterricht; Fragebogen; Hochschullehre; Schülerverhalten; Ethik; Collegestudent
Abstract	A number of scholars have questioned the practice of assessing academic writing in the context of a one-off language test, claiming that the time restrictions imposed in the test environment, when compared to the writing conditions typical at university, may prevent learners from displaying the kinds of writing skills required in academic contexts. Studies which have explored this issue have thus far produced conflicting findings. This paper investigates the impact of an efficiency driven policy decision to reduce the time allowed for performance on a post-entry diagnostic test of academic writing from 55 to 30 min. It does so by comparing the performance of 30 test takers under both old and new time conditions. A fully counter-balanced design was chosen to establish whether the different time limits had an effect on (a) the writing scores, (b) the inter-rater reliability and (c) the quality of the discourse. Test takers' perceptions were also canvassed via a post-task questionnaire. Findings showed that the test takers' scores on the analytic rating criteria were not significantly different under the two time conditions, although high proficiency candidates profited more from the extended time allowance than did the others. Ratings were equally reliable in the "short" and "long" condition. The detailed discourse analysis illustrated that the longer writing condition yielded, as predicted, a better quality performance on a number of variables; however the performance on the majority of the variables was unaffected by the time factor. The questionnaire data nevertheless showed that students in general preferred having more time for planning and revising. The study considers the implications of these findings for the validity and fairness of diagnostic writing tests. (Contains 10 tables.) (As Provided).
Anmerkungen	Elsevier. 6277 Sea Harbor Drive, Orlando, FL 32887-4800. Tel: 877-839-7126; Tel: 407-345-4020; Fax: 407-363-1354; e-mail: usjcs@elsevier.com; Web site: http://www.elsevier.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10