Text Authenticity in Listening Assessment: Can Item Writers Be Trained to Produce Authentic-Sounding Texts?

Autor/inn/en	Rossi, Olena; Brunfaut, Tineke
Titel	Text Authenticity in Listening Assessment: Can Item Writers Be Trained to Produce Authentic-Sounding Texts?
Quelle	In: Language Assessment Quarterly, 18 (2021) 4, S.398-418 (21 Seiten) PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Rossi, Olena) ORCID (Brunfaut, Tineke)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1543-4303
DOI	10.1080/15434303.2021.1895162
Schlagwörter	Listening Comprehension Tests; Test Items; Test Construction; Training; Instructional Effectiveness; Oral Language + Suchen Sie Ihr Suchwort? Hörverstehensübung; Test content; Testaufgabe; Testaufbau; Ausbildung; Unterrichtserfolg; Oral interpretation; Mündlicher Sprachgebrauch
Abstract	A long-standing debate in the testing of listening concerns the authenticity of the listening input. On the one hand, listening texts produced by item writers often lack spoken language characteristics. On the other hand, real-life recordings are often too context-specific to stand alone, or not suitable for item generation. In this study, we explored the effectiveness of an existing item-writing training course to produce authentic-sounding listening texts within the constraints of test specifications. Twenty-five trainees took an online item-writing course including training on creating authentic-sounding listening texts. Prior to and after the course, they developed a listening task. The resulting listening texts were judged on authenticity by three professional item reviewers and analysed linguistically by the researchers. Additionally, we interviewed the trainees following each item writing event and analysed their online discussions from during the course. Statistical comparison of the pre-and post-course authenticity scores revealed a positive effect of the training on item-writers' ability to produce authentic-sounding listening texts, while the linguistic analysis demonstrated that the texts produced after the training contained more instances of spoken language. The interviews and discussions revealed that item writers' awareness of spoken language features and their text production techniques influenced their ability to develop authentic-sounding texts. (As Provided).
Anmerkungen	Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01