A Multi-Method Analysis of Evaluation Criteria Used to Assess the Speaking Proficiency of Graduate Student Instructors

Autor/inn/en	Plough, India C.; Briggs, Sarah L.; Van Bonn, Sarah
Titel	A Multi-Method Analysis of Evaluation Criteria Used to Assess the Speaking Proficiency of Graduate Student Instructors
Quelle	In: Language Testing, 27 (2010) 2, S.235-260 (26 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0265-5322
DOI	10.1177/0265532209349469
Schlagwörter	Graduate Students; Listening Comprehension; Evaluators; Performance Tests; Evaluation Criteria; Oral English; English (Second Language); Second Language Learning; Language Proficiency; Language Tests; Teaching Assistants; Pronunciation; Regression (Statistics); Comparative Analysis; Interviews + Suchen Sie Ihr Suchwort? Graduate Study; Student; Students; Aufbaustudium; Graduiertenstudium; Hauptstudium; Studentin; Hörverständnis; Leistungsbeurteilung; Leistungsermittlung; Leistungsmessung; Leistungsüberprüfung; English as second language; English; Second Language; Englisch als Zweitsprache; Zweitsprachenerwerb; Language skill; Language skills; Sprachkompetenz; Language test; Sprachtest; Aussprache; Regression; Regressionsanalyse; Interviewing; Interviewtechnik
Abstract	The study reported here examined the evaluation criteria used to assess the proficiency and effectiveness of the language produced in an oral performance test of English conducted in an American university context. Empirical methods were used to analyze qualitatively and quantitatively transcriptions of the Oral English Tests (OET) of 44 prospective Graduate Student Instructors (GSI). The language required to complete the tasks on the test was conceptualized from the functional perspective of transactional and interactional language use as defined by Brown and Yule (1989). Listening comprehension and pronunciation were also analyzed and scored. Stepwise logistic regression was used to determine the extent to which these linguistic features contributed to final ratings. These quantitative findings were then compared to "real-time" written comments made by evaluators during the tests. Intuitive methods were then used to further explore those features of candidate performance attended to by evaluators: interviews were conducted with experienced evaluators to determine the features they judged necessary for communicating effectively in instructional settings. Results indicate that the three data sources converge on two main features--pronunciation and listening comprehension--that are important in describing and evaluating the proficiency of prospective GSIs. (Contains 13 tables and 8 notes.) (As Provided).
Anmerkungen	SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10