SAS Code for Calculating Intraclass Correlation Coefficients and Effect Size Benchmarks for Site-Randomized Education Experiments

Autor/inn/en	Brandon, Paul R.; Harrison, George M.; Lawton, Brian E.
Titel	SAS Code for Calculating Intraclass Correlation Coefficients and Effect Size Benchmarks for Site-Randomized Education Experiments
Quelle	In: American Journal of Evaluation, 34 (2013) 1, S.85-90 (6 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1098-2140
DOI	10.1177/1098214012466453
Schlagwörter	Statistical Analysis; Correlation; Effect Size; Benchmarking; Computation; Computer Software; Educational Research; Educational Experiments; Elementary Secondary Education; Achievement Tests; Hawaii + Suchen Sie Ihr Suchwort? Statistische Analyse; Korrelation; Bildungsforschung; Pädagogische Forschung; Schulversuch; Achievement test; Achievement; Testing; Test; Tests; Leistungsbeurteilung; Leistungsüberprüfung; Leistung; Testdurchführung; Testen
Abstract	When evaluators plan site-randomized experiments, they must conduct the appropriate statistical power analyses. These analyses are most likely to be valid when they are based on data from the jurisdictions in which the studies are to be conducted. In this method note, we provide software code, in the form of a SAS macro, for producing statistical power analyses using such data. The macro is designed to estimate statistical parameters for multiple school subjects and multiple grades in a single computer run. Among other convenient features, the macro calculates intraclass correlation coefficient confidence intervals, which are essential for planning studies conservatively. We also provide a SAS macro for calculating benchmarks--again, using locally-based--data for interpreting the feasibility of achieving the minimum detectable effect sizes that are calculated in statistical power analyses. The benchmarks are potentially useful for interpreting the meaning of the effect sizes that are achieved in completed studies, as well. We describe the macros, describe how we verified their accuracy, show how they can be useful to education evaluators, and give examples of their use with statewide educational assessment data. It is our hope that the macros will help evaluators use local data when conducting group-randomized studies. (Contains 3 tables.) (As Provided).
Anmerkungen	SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10