Development and Validation of an Automatic Item Generation System for English Idioms

Autor/inn/en	Rafatbakhsh, Elaheh; Ahmadi, Alireza; Moloodi, Amirsaeid; Mehrpour, Saeed
Titel	Development and Validation of an Automatic Item Generation System for English Idioms
Quelle	In: Educational Measurement: Issues and Practice, 40 (2021) 2, S.49-59 (11 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Ahmadi, Alireza)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0731-1745
DOI	10.1111/emip.12401
Schlagwörter	Test Construction; Test Items; Computer Assisted Testing; Multiple Choice Tests; North American English; Language Patterns; Language Tests; Item Response Theory; Automation; Second Language Learning; English (Second Language) + Suchen Sie Ihr Suchwort? Testaufbau; Test content; Testaufgabe; Multiple choice examinations; Multiple-choice tests, Multiple-choice examinations; Multiple-Choice-Verfahren; Amerikanisches Englisch; Sprachmodell; Sprachstruktur; Language test; Sprachtest; Item-Response-Theorie; Zweitsprachenerwerb; English as second language; English; Second Language; Englisch als Zweitsprache
Abstract	Test development is a crucial, yet difficult and time-consuming part of any educational system, and the task often falls all on teachers. Automatic item generation systems have recently drawn attention as they can reduce this burden and make test development more convenient. Such systems have been developed to generate items for vocabulary, grammar, reading, and writing. However, the literature lacks such a system for idioms. Informed by corpus linguistics, we aimed at developing a system that can generate items on idioms using the Corpus of Contemporary American English. The result was a system capable of generating two types of multiple-choice items, that is, fill-in-the-blank and definition. To validate the system output, we asked ten experts of Teaching English as a Foreign Language to evaluate 400 generated items for content issues. Also, a sample test of 40 items was administered to 110 upper-intermediate and advanced EFL learners, and then validated through the Rasch model. The results manifested that a large number of generated items were acceptable based on both experts' judgments and Rasch analysis. The study is an example of the application of corpus linguistics to language testing and a step toward automatic generation of items for assessment purposes. (As Provided).
Anmerkungen	Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01