Estimating Reliability of School-Level Scores Using Multilevel and Generalizability Theory Models

Autor/inn/en	Jeon, Min-Jeong; Lee, Guemin; Hwang, Jeong-Won; Kang, Sang-Jin
Titel	Estimating Reliability of School-Level Scores Using Multilevel and Generalizability Theory Models
Quelle	In: Asia Pacific Education Review, 10 (2009) 2, S.149-158 (10 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1598-1037
DOI	10.1007/s12564-009-9014-3
Schlagwörter	Generalizability Theory; Scores; Reliability; Statistical Analysis; Comparative Analysis; Models; Student Evaluation + Suchen Sie Ihr Suchwort? Reliabilität; Statistische Analyse; Analogiemodell; Schulnote; Studentische Bewertung
Abstract	The purpose of this study was to investigate the methods of estimating the reliability of school-level scores using generalizability theory and multilevel models. Two approaches, "student within schools" and "students within schools and subject areas," were conceptualized and implemented in this study. Four methods resulting from the combination of these two approaches with generalizability theory and multilevel models were compared for both balanced and unbalanced data. The generalizability theory and multilevel models for the "students within schools" approach produced the same variance components and reliability estimates for the balanced data, while failing to do so for the unbalanced data. The different results from the two models can be explained by the fact that they administer different procedures in estimating the variance components used, in turn, to estimate reliability. Among the estimation methods investigated in this study, the generalizability theory model with the "students nested within schools crossed with subject areas" design produced the lowest reliability estimates. Fully nested designs such as (students:schools) or (subject areas:students:schools) would not have any significant impact on reliability estimates of school-level scores. Both methods provide very similar reliability estimates of school-level scores. (As Provided).
Anmerkungen	Springer. 233 Spring Street, New York, NY 10013. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-348-4505; e-mail: service-ny@springer.com; Web site: http://www.springerlink.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10