Literaturnachweis - Detailanzeige
Autor/inn/en | Eckes, Thomas; Jin, Kuan-Yu |
---|---|
Titel | Examining Severity and Centrality Effects in TestDaF Writing and Speaking Assessments: An Extended Bayesian Many-Facet Rasch Analysis |
Quelle | In: International Journal of Testing, 21 (2021) 3-4, S.131-153 (23 Seiten)Infoseite zur Zeitschrift
PDF als Volltext |
Zusatzinformation | ORCID (Eckes, Thomas) ORCID (Jin, Kuan-Yu) |
Sprache | englisch |
Dokumenttyp | gedruckt; online; Zeitschriftenaufsatz |
ISSN | 1530-5058 |
DOI | 10.1080/15305058.2021.1963260 |
Schlagwörter | Language Tests; German; Second Languages; Writing Tests; Speech Tests; Goodness of Fit; Evaluators; Individual Characteristics; Computer Assisted Testing; Monte Carlo Methods; Markov Processes; Foreign Students; Foreign Countries; Bayesian Statistics; Germany |
Abstract | Severity and centrality are two main kinds of rater effects posing threats to the validity and fairness of performance assessments. Adopting Jin and Wang's (2018) extended facets modeling approach, we separately estimated the magnitude of rater severity and centrality effects in the web-based TestDaF (Test of German as a Foreign Language) writing and speaking assessments using Bayesian MCMC methods. The findings revealed that (a) the extended facets model had a better data-model fit than models that ignored either or both kinds of rater effects, (b) rating scale and partial credit versions of the extended model differed in terms of data-model fit for writing and speaking, (c) rater severity and centrality estimates were not significantly correlated with each other, and (d) centrality effects had a demonstrable impact on examinee rank orderings. The discussion focuses on implications for the analysis and evaluation of rating quality in performance assessments. (As Provided). |
Anmerkungen | Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals |
Erfasst von | ERIC (Education Resources Information Center), Washington, DC |
Update | 2024/1/01 |