CAF Indices and Human Ratings of Oral Performances in an Opinion-Based Monologue Task

Autor/in	Ogawa, Chie
Titel	CAF Indices and Human Ratings of Oral Performances in an Opinion-Based Monologue Task
Quelle	In: Language Testing in Asia, 12 (2022), Artikel 4 (18 Seiten) PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Ogawa, Chie)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	2229-0443
DOI	10.1186/s40468-022-00154-9
Schlagwörter	Oral Language; Evaluators; Audio Equipment; Accuracy; Language Fluency; Goal Orientation; English (Second Language); Second Language Learning; Second Language Instruction; Foreign Countries; Communicative Competence (Languages); Correlation; Language Tests; Japan + Suchen Sie Ihr Suchwort? Oral interpretation; Mündlicher Sprachgebrauch; Audio-CD; Language skill; Language skills; Sprachkompetenz; Zielorientierung; Zielvorstellung; English as second language; English; Second Language; Englisch als Zweitsprache; Zweitsprachenerwerb; Fremdsprachenunterricht; Ausland; Communicative competence; Languages; Kommunikative Kompetenz; Sprache; Korrelation; Language test; Sprachtest
Abstract	This study explored two assessment approaches to oral performances: analytical complexity, accuracy, and fluency (CAF) indices and human raters' evaluations. CAF indices are frequently used in second-language speaking (L2) research; however, because tasks are communicative and goal-oriented, the degree to which students achieve such communicative goals must also be included. By incorporating human ratings of monologue organization and perceived CAF into speaking assessments, researchers can better understand the relationship between the analytical CAF indices and human ratings of a monologue task. The participants consisted of 48 English as a Foreign Language (EFL) students in a Japanese university. Their oral performances of 2-min opinion-based monologues were audio-recorded and then transcribed and analyzed using CAF measures. In addition, 11 human raters evaluated the same recordings in terms of the following criteria: topic organization, complexity, accuracy, and fluency. These ratings were then analyzed using the many-facet Rasch measurement (MFRM). Multiple linear regression results showed that fluency accounted for a significant amount of the human ratings, but other measures (lexis, complexity, accuracy) explained only a small portion of the variance. This study concluded with implications regarding L2 testing in speaking assessments. (As Provided).
Anmerkungen	Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01