Literaturnachweis - Detailanzeige
| Autor/inn/en | Burstein, Jill C.; Kaplan, Randy M. |
|---|---|
| Institution | Educational Testing Service, Princeton, NJ. |
| Titel | GE FRST Evaluation Report: How Well Does a Statistically-Based Natural Language Processing System Score Natural Language Constructed-Responses? |
| Quelle | (1995)
PDF als Volltext kostenfreie Datei |
| Sprache | englisch |
| Dokumenttyp | gedruckt; online; Monografie |
| Schlagwörter | Forschungsbericht; Computer Assisted Testing; Constructed Response; Cost Effectiveness; Hypothesis Testing; Natural Language Processing; Performance Based Assessment; Reading Comprehension; Scoring; Standardized Tests; Test Construction; Test Items |
| Abstract | There is a considerable interest at Educational Testing Service (ETS) to include performance-based, natural language constructed-response items on standardized tests. Such items can be developed, but the projected time and costs required to have these items scored by human graders would be prohibitive. In order for ETS to include these types of items on standardized tests, automated scoring systems need to be developed and evaluated. Automated scoring systems could decrease the time and costs required for human graders to score these items. This report details the evaluation of a statistically-based scoring system, the General Electric Free-Response Scoring Tool (GE FRST). GE FRST was designed to score short-answer, constructed-responses of up to 17 words. The report describes how the system performs for responses on three different item types: (1) the formulating-hypotheses item; (2) a paraphrase language proficiency item; and (3) a reading comprehension item. For the sake of efficiency, it is important to evaluate systems on a number of item types to see if the system's scoring method can generalize to a number of item types. An appendix shows learning information abut responses recognized by GE FRST. (Contains 7 figures, 13 tables, and 3 references.) (Author/SLD) |
| Begutachtung | |
| Erfasst von | ERIC (Education Resources Information Center), Washington, DC |
Literaturbeschaffung und Bestandsnachweise in Bibliotheken prüfen
Permalink als QR-Code
Inhalt auf sozialen Plattformen teilen (nur vorhanden, wenn Javascript eingeschaltet ist)
Teile diese Seite:
