A Bayesian approach to improving measurement precision over multiple test occasions.

Autor/inn/en	Moere, Alistair van; Hanlon, Sean
Titel	A Bayesian approach to improving measurement precision over multiple test occasions.
Quelle	In: Language testing, 37 (2020) 4, S. 482-502Infoseite zur Zeitschrift PDF als Volltext (1); PDF als Volltext (2) Link als defekt meldenVerfügbarkeit
Beigaben	Abbildungen 3; Literaturangaben; Tabellen 4
Sprache	englisch
Dokumenttyp	online; gedruckt; Zeitschriftenaufsatz
ISSN	0265-5322; 1477-0946
Schlagwörter	Empirische Forschung; Test; Testverhalten; Vergleichende Analyse; Fremdsprachenunterricht; Englischunterricht
Abstract	In language assessment and in educational measurement more broadly, there is a tendency to interpret scores from single-administration tests as accurate indicators of a latent trait (e.g., reading ability). Even in contexts where learners receive multiple formative assessments throughout the year, estimates of student ability are determined based on the most recent assessment. This paper demonstrates a technique that incorporates prior test scores with current scores for learners who re-test periodically, in order to arrive at an estimate closer to the learners' true score. Over 21,000 learners from two separate studies (EFL and native speaker) were tested for reading proficiency between three and five times each, over a one- to two-year period, on a multiple-choice reading test which reported reading ability in Lexile® measures. Applying Bayes theorem, prior scores and the most recent test score were combined with uncertainty parameters (i.e., measurement error) to produce new estimates of student ability. This is advantageous as prior administration data is re-used rather than discarded. The approach is recommended in the context of periodic low-stakes tests designed to measure proficiency gains over time, as well as for high-stakes tests as an alternative to allowing candidates to cherry-pick their highest score for university applications. (Verlag).
Erfasst von	Informationszentrum für Fremdsprachenforschung, Marburg
Update	2022/2