Evaluating the Impact of Rater Effects on Behavior Rating Scale Score Validity and Utility

Autor/inn/en	J. Anthony, Christopher; Styck, Kara M.; Cooke, Erin; Martel, Justin R.; E. Frye, Katherine
Titel	Evaluating the Impact of Rater Effects on Behavior Rating Scale Score Validity and Utility
Quelle	In: School Psychology Review, 51 (2022) 1, S.25-39 (15 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Styck, Kara M.)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0279-6015
DOI	10.1080/2372966X.2020.1827681
Schlagwörter	Behavior Rating Scales; Evaluators; Student Evaluation; Elementary School Students; Grade 4; Grade 5; Predictive Validity; Scores; Achievement Tests; Academic Achievement; Competence; Item Response Theory; Effect Size; Florida; Florida State Student Assessment Test + Suchen Sie Ihr Suchwort? Schulnote; Studentische Bewertung; School year 04; 4. Schuljahr; Schuljahr 04; School year 05; 5. Schuljahr; Schuljahr 05; Achievement test; Achievement; Testing; Test; Tests; Leistungsbeurteilung; Leistungsüberprüfung; Leistung; Testdurchführung; Testen; Schulleistung; Kompetenz; Item-Response-Theorie
Abstract	Behavior rating scales represent one of the most commonly used types of assessments in school psychology. Yet, they suffer from a fundamental limitation: They are an indirect methodology influenced partially by student behavior and partially by rater perspectives. Thus, the current study utilized advanced analytic approaches to evaluate rater effects on the Academic Competence Evaluation Scales-Short Form-Teacher (ACES-SF-T) with a partially crossed sample of 132 fourth- and fifth-grade students rated by seven teachers. Results indicated that rater effects had a minimal impact on the predictive validity of ACES-SF-T scores for state achievement tests, but at the individual level, rater effects could lead to starkly different conclusions about students' academic, social, and behavioral functioning. Implications for research and practice are discussed. (As Provided).
Anmerkungen	Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01