Using Automatic Speech Recognition Technology with Elicited Oral Response Testing

Autor/inn/en	Cox, Troy L.; Davies, Randall S.
Titel	Using Automatic Speech Recognition Technology with Elicited Oral Response Testing
Quelle	In: CALICO Journal, 29 (2012) 4, S.601-618 (18 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0742-7778
Schlagwörter	English Language Learners; Computer Assisted Testing; Computer Software; Computer Software Evaluation; Correlation; Comparative Analysis; Program Effectiveness; Validity; Performance Based Assessment; Language Tests; Placement; Speech Communication; Second Language Learning; Language Proficiency; Oral Language; Gender Issues; Evaluation Methods; Predictive Validity; Adult Students; Foreign Students; English (Second Language); Interviews; Data Analysis; Student Placement; Native Language + Suchen Sie Ihr Suchwort? Softwareanalyse; Korrelation; Gültigkeit; Leistungsermittlung; Language test; Sprachtest; Betriebspraktikum; Praktikum; Zweitsprachenerwerb; Language skill; Language skills; Sprachkompetenz; Oral interpretation; Mündlicher Sprachgebrauch; Geschlechterfrage; Adult; Adults; Student; Students; Erwachsenenalter; Studentin; Schüler; Schülerin; English as second language; English; Second Language; Englisch als Zweitsprache; Interviewing; Interviewtechnik; Auswertung; Schülerpraktikum
Abstract	This study examined the use of automatic speech recognition (ASR) scored elicited oral response (EOR) tests to assess the speaking ability of English language learners. It also examined the relationship between ASR-scored EOR and other language proficiency measures and the ability of the ASR to rate speakers without bias to gender or native language. To that end, 179 subjects were given an ASR-scored EOR test with 60 items, followed by an oral proficiency interview (OPI) type assessment and a battery of other language tests. Findings suggest that ASR-scored EOR results could be used alone to predict speaking ability in specific situations and for limited purposes such as initial placement of students in language training situations. However, if more certainty is required, adding a listening component would improve the assessment. Analysis of the study results also suggests that while there were some differences in amount of variance explained in speaking scores based on gender and native language, there was no significant negative effect that would preclude the use of ASR-scoring. While EOR is not an authentic performance assessment of the speaking ability, it does correlate well with other assessments of this construct and has good content validity. The use of an ASR-scored EOR test seems to provide a practical estimate of speaking proficiency that could be used for initial placement of students in situations where assessments of speaking for the purpose of placement are not currently being used due to the cost of administering OPI type assessments. (Contains 2 figures and 9 tables.) (As Provided).
Anmerkungen	Computer Assisted Language Instruction Consortium. 214 Centennial Hall, 601 University Drive, San Marcos, TX 78666. Tel: 512-245-1417; Fax: 512-245-9089; e-mail: info@calico.org: Web site: http://calico.org
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10