Finding Efficiency in the Design of Large Multisite Evaluations: Estimating Variances for Science Achievement Studies

Autor/in	Westine, Carl D.
Titel	Finding Efficiency in the Design of Large Multisite Evaluations: Estimating Variances for Science Achievement Studies
Quelle	In: American Journal of Evaluation, 37 (2016) 3, S.311-325 (15 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1098-2140
DOI	10.1177/1098214015624014
Schlagwörter	Efficiency; Evaluation Methods; Science Achievement; Correlation; Multivariate Analysis; Randomized Controlled Trials; Science Education; School Districts; Computation; Hierarchical Linear Modeling; Scores; Achievement Tests; Grade 5; Grade 8; Grade 10; Grade 11; Research Design; Texas + Suchen Sie Ihr Suchwort? Effectiveness; Effektivität; Wirkungsgrad; Korrelation; Multivariate Analyse; Naturwissenschaftliche Bildung; School district; Schulbezirk; Achievement test; Achievement; Testing; Test; Tests; Leistungsbeurteilung; Leistungsüberprüfung; Leistung; Testdurchführung; Testen; School year 05; 5. Schuljahr; Schuljahr 05; School year 08; 8. Schuljahr; Schuljahr 08; School year 11; 11. Schuljahr; Schuljahr 11; Forschungsdesign
Abstract	Little is known empirically about intraclass correlations (ICCs) for multisite cluster randomized trial (MSCRT) designs, particularly in science education. In this study, ICCs suitable for science achievement studies using a three-level (students in schools in districts) MSCRT design that block on district are estimated and examined. Estimates of ICCs, by district, are computed for unconditional two-level (students in schools) hierarchical linear models using student-level science achievement raw scores as measured by the Texas Assessment of Knowledge and Skills in 2010-2011 for Grades 5, 8, 10, and 11. The average within-district ICCs for MSCRTs of science achievement range from 0.0781 to 0.0982 across grades. For Grade 5, a significant difference is found in the ICC estimate suitable for MSCRTs with many districts versus only a few districts. Consequently, evaluators of science education interventions should exhibit care when selecting ICC estimates for three-level MSCRT designs that block on district. (As Provided).
Anmerkungen	SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2020/1/01