Literaturnachweis - Detailanzeige
| Autor/inn/en | Yang, Yongwei; Buckendahl, Chad W.; Juszkiewicz, Piotr J.; Bhola, Dennison S. |
|---|---|
| Titel | Evaluating Computer Automated Scoring: Issues, Methods, and an Empirical Illustration |
| Quelle | In: Journal of Applied Testing Technology, 7 (2005) 3, S.1-43 (43 Seiten)
PDF als Volltext |
| Sprache | englisch |
| Dokumenttyp | gedruckt; online; Zeitschriftenaufsatz |
| Schlagwörter | Scoring; Validity; Interrater Reliability; Comparative Analysis; Statistical Analysis; Evaluation Methods; Educational Technology; Measurement Techniques; Evaluation Research; Interviews; Measures (Individuals); Data Analysis; Item Analysis; Performance; Delivery Systems; Computer Assisted Testing; Writing Evaluation; Occupational Tests; Information Technology |
| Abstract | With the continual progress of computer technologies, computer automated scoring (CAS) has become a popular tool for evaluating writing assessments. Research of applications of these methodologies to new types of performance assessments is still emerging. While research has generally shown a high agreement of CAS system generated scores with those produced by human raters, concerns and questions have been raised about appropriate analyses and validity of decisions/interpretations based on those scores. In this paper we expand the emerging discussions on validation strategies on CAS by illustrating several analyses can be accomplished with available data. These analyses compare the degree to which two CAS systems accurately score data from a structured interview using the original scores provided by human raters as the criterion. Results suggest key differences across the two systems as well as differences in the statistical procedures used to evaluate them. The use of several statistical and qualitative analyses is recommended for evaluating contemporary CAS systems. (Contains 10 tables and 2 footnotes.) (Author). |
| Anmerkungen | Association of Test Publishers. 601 Pennsylvania Avenue NW, South Building, Suite 900, Washington, DC 20004. Tel: 866-240-7909; Fax: 717-755-8962; e-mail: atp@att.net; Web site: http://www.testpublishers.org |
| Erfasst von | ERIC (Education Resources Information Center), Washington, DC |
| Update | 2017/4/10 |
Literaturbeschaffung und Bestandsnachweise in Bibliotheken prüfen
Permalink als QR-Code
Inhalt auf sozialen Plattformen teilen (nur vorhanden, wenn Javascript eingeschaltet ist)
Teile diese Seite:
