Literaturnachweis - Detailanzeige
Autor/inn/en | Chen, Dandan; Hebert, Michael; Wilson, Joshua |
---|---|
Titel | Examining Human and Automated Ratings of Elementary Students' Writing Quality: A Multivariate Generalizability Theory Application |
Quelle | In: American Educational Research Journal, 59 (2022) 6, S.1122-1156 (35 Seiten)Infoseite zur Zeitschrift
PDF als Volltext |
Zusatzinformation | ORCID (Wilson, Joshua) |
Sprache | englisch |
Dokumenttyp | gedruckt; online; Zeitschriftenaufsatz |
ISSN | 0002-8312 |
DOI | 10.3102/00028312221106773 |
Schlagwörter | Reliability; Scoring; Essays; Automation; Writing Evaluation; Elementary School Students; Grade 3; Grade 4; Grade 5; Evaluation Methods; Natural Language Processing; Computer Assisted Testing; Writing Difficulties |
Abstract | We used multivariate generalizability theory to examine the reliability of hand-scoring and automated essay scoring (AES) and to identify how these scoring methods could be used in conjunction to optimize writing assessment. Students (n = 113) included subsamples of struggling writers and non-struggling writers in Grades 3-5 drawn from a larger study. Students wrote six essays across three genres. All essays were hand-scored by four raters and an AES system called Project Essay Grade (PEG). Both scoring methods were highly reliable, but PEG was more reliable for non-struggling students, while hand-scoring was more reliable for struggling students. We provide recommendations regarding ways of optimizing writing assessment and blending hand-scoring with AES. (As Provided). |
Anmerkungen | SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub.com |
Erfasst von | ERIC (Education Resources Information Center), Washington, DC |
Update | 2024/1/01 |