A Conversation Analytic Approach to Oral Placement Test Validation: Attending to Vertical and Horizontal Comparisons

Autor/inn/en	Kimura, Daisuke; Mattson, Nikki; Amory, Michael
Titel	A Conversation Analytic Approach to Oral Placement Test Validation: Attending to Vertical and Horizontal Comparisons
Quelle	In: TESOL Journal, 9 (2018) 3, S.455-480 (26 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1056-7941
DOI	10.1002/tesj.335
Schlagwörter	Oral Language; Language Tests; Student Placement; English (Second Language); Second Language Learning; Second Language Instruction; Test Validity; Discourse Analysis; Instructional Materials; Evaluators; Comparative Analysis; Action Research; Intervention; Video Technology + Suchen Sie Ihr Suchwort? Oral interpretation; Mündlicher Sprachgebrauch; Language test; Sprachtest; Schülerpraktikum; English as second language; English; Second Language; Englisch als Zweitsprache; Zweitsprachenerwerb; Fremdsprachenunterricht; Testvalidität; Diskursanalyse; Lehrmaterial; Lehrmittel; Unterrichtsmedien; Projektforschung
Abstract	Whereas previous research revealed the interactional variability occurring in oral assessments, demonstrating how it could undermine test validity (e.g., A. Brown, 2003), little has been published regarding how language programs can mine and analyze video recordings of in-house oral placement tests for validation purposes. Addressing this need, this article demonstrates how action research supplemented by an interventionist conversation analysis (CA) approach may be implemented as a tool for localized and cyclical test validation. This article reports on the process of how a team of oral placement test interviewers and CA researchers sought to iteratively improve interviewer training materials and testing protocols based on observed talk during placement test interactions. The study revolves around sample analyses of data excerpts to exemplify two data comparison procedures, involving different interviewers within the same iteration (i.e., horizontal comparison) and the same interviewer across different iterations after participation in a training session (i.e., vertical comparison). It showcases the ongoing process of collaboration with the goal of offering transferable insights to those who design, implement, and revise in-house oral placement tests. The authors contend that a holistic and unified approach to test validation, involving continued dialogue between researchers and practitioners, is crucial to in-house oral placement tests (Kunnan, 1998; Messick, 1989). (As Provided).
Anmerkungen	Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail: cs-journals@wiley.com; Web site: http://www.wiley.com/WileyCDA
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2020/1/01