The Differences among Three-, Four-, and Five-Option-Item Formats in the Context of a High-Stakes English-Language Listening Test

Autor/inn/en	Lee, HyeSun; Winke, Paula
Titel	The Differences among Three-, Four-, and Five-Option-Item Formats in the Context of a High-Stakes English-Language Listening Test
Quelle	In: Language Testing, 30 (2013) 1, S.99-123 (25 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0265-5322
DOI	10.1177/0265532212451235
Schlagwörter	Academic Ability; Stakeholders; Reliability; Listening Comprehension Tests; English (Second Language); Scores; High Stakes Tests; Korean; Native Speakers; Second Language Learning; High School Students; Test Format; Correlation; Language Tests; Test Construction; College Entrance Examinations; Foreign Countries; South Korea + Suchen Sie Ihr Suchwort? Reliabilität; Hörverstehensübung; English as second language; English; Second Language; Englisch als Zweitsprache; Koreanisch; Muttersprachler; Zweitsprachenerwerb; High school; High schools; Student; Students; Oberschule; Schüler; Schülerin; Studentin; Testentwicklung; Korrelation; Language test; Sprachtest; Testaufbau; Aufnahmeprüfung; Ausland; Korea; Republik
Abstract	We adapted three practice College Scholastic Ability Tests (CSAT) of English listening, each with five-option items, to create four- and three-option versions by asking 73 Korean speakers or learners of English to eliminate the least plausible options in two rounds. Two hundred and sixty-four Korean high school English-language learners formed three groups. Each took three of the nine tests, one with five-option items, one with four-, and one with three-, with administrations counterbalanced to control for order and practice effects. Mean test scores of the three-option tests were significantly higher than those of four- and five-option tests. While no difference was found in mean item discriminations across the three different test formats, reliability coefficients showed inconsistent patterns depending on the number of options and test versions. One possible interpretation of the low correlations among the scores of three test formats is that items with different numbers of options tap into skills other than listening. The findings suggest that statistically, three options may or may not be optimal depending on the point of view taken--from that of the test score users, or from that of the test stakeholders. Test developers must consider multiple statistical, affective, and contextual factors in determining the optimal number of options. (Contains 5 tables, 2 figures and 2 notes.) (As Provided).
Anmerkungen	SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10