A Bayesian Approach to Improving Measurement Precision over Multiple Test Occasions

Autor/inn/en	Van Moere, Alistair; Hanlon, Sean
Titel	A Bayesian Approach to Improving Measurement Precision over Multiple Test Occasions
Quelle	In: Language Testing, 37 (2020) 4, S.482-502 (21 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Van Moere, Alistair)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0265-5322
DOI	10.1177/0265532220934203
Schlagwörter	Bayesian Statistics; Measurement; Accuracy; English (Second Language); Native Speakers; Scores; Repetition; Reading Tests; Multiple Choice Tests; Longitudinal Studies; Foreign Countries; South Korea; United States + Suchen Sie Ihr Suchwort? Messverfahren; English as second language; English; Second Language; Englisch als Zweitsprache; Muttersprachler; Wiederholung; Lesetest; Multiple choice examinations; Multiple-choice tests, Multiple-choice examinations; Multiple-Choice-Verfahren; Longitudinal study; Longitudinal method; Longitudinal methods; Längsschnittuntersuchung; Ausland; Korea; Republik; USA
Abstract	In language assessment and in educational measurement more broadly, there is a tendency to interpret scores from single-administration tests as accurate indicators of a latent trait (e.g., reading ability). Even in contexts where learners receive multiple formative assessments throughout the year, estimates of student ability are determined based on the most recent assessment. This paper demonstrates a technique that incorporates prior test scores with current scores for learners who re-test periodically, in order to arrive at an estimate closer to the learners' true score. Over 21,000 learners from two separate studies (EFL and native speaker) were tested for reading proficiency between three and five times each, over a one- to two-year period, on a multiple-choice reading test which reported reading ability in Lexile® measures. Applying Bayes theorem, prior scores and the most recent test score were combined with uncertainty parameters (i.e., measurement error) to produce new estimates of student ability. This is advantageous as prior administration data is re-used rather than discarded. The approach is recommended in the context of periodic low-stakes tests designed to measure proficiency gains over time, as well as for high-stakes tests as an alternative to allowing candidates to cherry-pick their highest score for university applications. (As Provided).
Anmerkungen	SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2022/1/01