Literaturnachweis - Detailanzeige
| Autor/inn/en | Xu, Jing; Jones, Edmund; Laxton, Victoria; Galaczi, Evelina |
|---|---|
| Titel | Assessing L2 English Speaking Using Automated Scoring Technology: Examining Automarker Reliability |
| Quelle | In: Assessment in Education: Principles, Policy & Practice, 28 (2021) 4, S.411-436 (26 Seiten)Infoseite zur Zeitschrift
PDF als Volltext |
| Zusatzinformation | ORCID (Xu, Jing) ORCID (Jones, Edmund) ORCID (Laxton, Victoria) ORCID (Galaczi, Evelina) |
| Sprache | englisch |
| Dokumenttyp | gedruckt; online; Zeitschriftenaufsatz |
| ISSN | 0969-594X |
| DOI | 10.1080/0969594X.2021.1979467 |
| Schlagwörter | Second Language Learning; Second Language Instruction; English (Second Language); Computer Software; Scoring; Computer Assisted Testing; Language Tests; Evaluators; Comparative Analysis; Language Proficiency; Prediction; Audio Equipment; Guidelines; Rating Scales; Foreign Countries; Test Reliability; Europe |
| Abstract | Recent advances in machine learning have made automated scoring of learner speech widespread, and yet validation research that provides support for applying automated scoring technology to assessment is still in its infancy. Both the educational measurement and language assessment communities have called for greater transparency in describing scoring algorithms and research evidence about the reliability of automated scoring. This paper reports on a study that investigated the reliability of an automarker using candidate responses produced in an online oral English test. Based on 'limits of agreement' and multi-faceted Rasch analyses on automarker scores and individual examiner scores, the study found that the automarker, while exhibiting excellent internal consistency, was slightly more lenient than examiner fair average scores, particularly for low-proficiency speakers. Additionally, it was found that an automarker uncertainty measure termed Language Quality, which indicates the confidence of speech recognition, was useful for predicting automarker reliability and flagging abnormal speech. (As Provided). |
| Anmerkungen | Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals |
| Erfasst von | ERIC (Education Resources Information Center), Washington, DC |
| Update | 2024/1/01 |
Literaturbeschaffung und Bestandsnachweise in Bibliotheken prüfen
Permalink als QR-Code
Inhalt auf sozialen Plattformen teilen (nur vorhanden, wenn Javascript eingeschaltet ist)
Teile diese Seite:
