Literaturnachweis - Detailanzeige
Autor/in | Barnwell, David |
---|---|
Titel | Who Is To Judge How Well Others Speak? An Experiment with the ACTFL/ETS Oral Proficiency Scale. |
Quelle | (1986), (11 Seiten)
PDF als Volltext |
Sprache | englisch |
Dokumenttyp | gedruckt; online; Monographie |
Schlagwörter | College Faculty; Higher Education; Interrater Reliability; Language Teachers; Language Tests; Rating Scales; Second Language Instruction; Spanish; Test Reliability |
Abstract | A study examined inter-rater reliability on the American Council on the Teaching of Foreign Languages/Educational Testing Service (ACTFL/ETS) oral language proficiency rating scale. Seven raters, all elementary or intermediate college Spanish teachers given only brief formal training in the use of the scale, evaluated recorded interviews with Spanish students at varying proficiency levels. The ratings were paired for comparison and the pairs were categorized as being in perfect agreement, acceptable disagreement (indicating disagreement by one subdivision of the rating scale), or total disagreement. Over 41 percent of the paired ratings were found to be in perfect agreement, almost 45 percent were in acceptable disagreement, and less than 14 percent were in total disagreement. The majority of disagreements were within a particular level rather than across levels. The results suggest a high degree of concordance between raters, with comparatively inexperienced raters reaching acceptable levels of agreement in most cases. The continuing need for native speaker input in the test construction and administration processes is emphasized. (MSE) |
Erfasst von | ERIC (Education Resources Information Center), Washington, DC |