Comparability of Difficulty Levels of Translation Tasks in CET-6 Parallel Test Forms: Evidence from Product and Process-Based Data

Autor/inn/en	Liu, Yanmei; Zheng, Binghan
Titel	Comparability of Difficulty Levels of Translation Tasks in CET-6 Parallel Test Forms: Evidence from Product and Process-Based Data
Quelle	In: Interpreter and Translator Trainer, 16 (2022) 4, S.428-447 (20 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Liu, Yanmei) ORCID (Zheng, Binghan)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1750-399X
DOI	10.1080/1750399X.2022.2036938
Schlagwörter	Language Tests; Translation; Difficulty Level; Language Processing; Second Language Learning; Second Language Instruction; Eye Movements; English (Second Language); Cognitive Ability; Comparative Analysis; Performance Based Assessment; Task Analysis; Student Attitudes; Test Validity; Chinese; Language Proficiency; Foreign Countries; Undergraduate Students; Business Administration Education; Business English; China; Test of English as a Foreign Language + Suchen Sie Ihr Suchwort? Language test; Sprachtest; Schwierigkeitsgrad; Sprachverarbeitung; Zweitsprachenerwerb; Fremdsprachenunterricht; Augenbewegung; English as second language; English; Second Language; Englisch als Zweitsprache; Denkfähigkeit; Leistungsermittlung; Aufgabenanalyse; Schülerverhalten; Testvalidität; China; Chinesen; Language skill; Language skills; Sprachkompetenz; Ausland; Business; English language; Wirtschaft; Englisch; Wirtschaftsenglisch
Abstract	This study investigates the comparability of three parallel translation tasks selected from a College English Test Band-6 (CET-6) and explores the major linguistic features contributing to translation difficulty. Data obtained from the participants' subjective rating, eye-tracking, and performance evaluation were triangulated to measure the comparability of difficulty levels of parallel translation tasks. Data of word translation entropy, translation errors, and participants' retrospective reports were correlated to examine the difficulty triggers. The results show that: (i) the text comparability was evidenced by eye-tracking indicators and performance measurements, but not supported by subjective ratings; (ii) the domain content words (DCWs) were reported by the participants as the major cause of translation difficulties and the unequal number of DCWs among the three tasks led to inconsistent ratings for the task difficulty. Our findings suggest that test-takers' subjective perception and their cognitive skills deserve serious consideration by test designers, as these two factors can better demonstrate difficulty levels among parallel tasks. Our study postulates a new direction to establish a relationship between task characteristics and test validity, and provides suggestions for the CET-6 committee and other examination boards with practical methods to be able to compare the difficulty levels of parallel translation tasks. (As Provided).
Anmerkungen	Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01