Who is to judge how well others speak? An experiment with the ACTFL/ETS oral proficiency scale.

Autor/in	Barnwell, David
Titel	Who is to judge how well others speak? An experiment with the ACTFL/ETS oral proficiency scale.
Quelle	(1986), 11 S.Verfügbarkeit
Sprache	englisch
Dokumenttyp	Mikroform; Monographie
Schlagwörter	Evaluation; Reliabilität; Test; Testanwendung; College; Lehrer; Experiment; Native Speaker; Sprachkompetenz; Fremdsprachenunterricht; Spanischunterricht; Zweitsprachenerwerb; Forschungsprojekt
Abstract	A study examined inter-rater reliability on the American Council on the Teaching of Foreign Languages/Educational Testing Service (ACTFL/ETS) oral language proficiency rating scale. Seven raters, all elementary or intermediate college Spanish teachers given only brief formal training in the use of the scale, evaluated recorded interviews with Spanish students at varying proficiency levels. The ratings were paired for comparison and the pairs were categorized as being in perfect agreement, acceptable disagreement (indicating disagreement by one subdivision of the rating scale), or total disagreement. Over 41 percent of the paired ratings were found to be in perfect agreement, almost 45 percent were in acceptable disagreement, and less than 14 percent were in total disagreement. The majority of disagreements were within a particular level rather than across levels. The results suggest a high degree of concordance between raters, with comparatively inexperienced raters reaching acceptable levels of agreement in most cases. The continuing need for native speaker input in the test construction and administration processes is emphasized.
Erfasst von	Informationszentrum für Fremdsprachenforschung, Marburg
Update	1996_(CD)