Extending the Scope of Speaking Assessment Criteria in a Specific-Purpose Language Test: Operationalizing a Health Professional Perspective

Autor/inn/en	O'Hagan, Sally; Pill, John; Zhang, Ying
Titel	Extending the Scope of Speaking Assessment Criteria in a Specific-Purpose Language Test: Operationalizing a Health Professional Perspective
Quelle	In: Language Testing, 33 (2016) 2, S.195-216 (22 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0265-5322
DOI	10.1177/0265532215607920
Schlagwörter	Health Personnel; Language Tests; English for Special Purposes; Criticism; Languages for Special Purposes; English (Second Language); Second Language Learning; Foreign Countries; Foreign Medical Graduates; Oral Language; Evaluation Criteria; Feedback (Response); Physician Patient Relationship; Statistical Analysis; Evaluators; Check Lists; Workshops; Training; Decision Making; Australia + Suchen Sie Ihr Suchwort? Medizinisches Personal; Language test; Sprachtest; Kritik; Sprachhandlungsfähigkeit; English as second language; English; Second Language; Englisch als Zweitsprache; Zweitsprachenerwerb; Ausland; Oral interpretation; Mündlicher Sprachgebrauch; Arzt-Patient-Beziehung; Statistische Analyse; Checkliste; Lernwerkstatt; Schulung; Ausbildung; Decision-making; Entscheidungsfindung; Australien
Abstract	Criticism of specific-purpose language (LSP) tests is often directed at their limited ability to represent fully the demands of the target language use situation. Such criticisms extend to the criteria used to assess test performance, which may fail to capture what matters to participants in the domain of interest. This paper reports on the outcomes of an attempt to expand the construct of a specific-purpose test through the inclusion of two new professionally relevant criteria designed to reflect the values of domain experts. The test in question was the speaking component of the Occupational English Test (OET), designed to assess the language proficiency of overseas-trained health professionals applying to practise their profession in Australia. The criteria were developed from analysis of health professionals' feedback to trainees, a source that reflected what the professionals value, that is, their indigenous assessment criteria. The criteria considered amenable to inclusion in the OET were as follows: (1) Clinician Engagement with the patient, and (2) Management of Interaction in the consultation. Seven OET assessors were trained to apply these professionally relevant criteria at a workshop that introduced a checklist derived from the original data analysis as a tool to aid understanding of the new criteria. Following the workshop, assessors rated a total of 300 pre-recorded OET speaking test performances using both new and existing criteria. Statistical analyses of the ratings indicate the extent to which (a) the judgements of the language-trained assessors using the new criteria were consistent, and (b) the new and existing criteria aligned in terms of the construct(s) they represent. Furthermore, feedback from the assessors in the process shows how comfortable and confident they are to represent a health professional perspective. (As Provided).
Anmerkungen	SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2020/1/01