Evaluating Effects of Developmental Education for College Students Using a Regression Discontinuity Design

Autor/inn/en	Moss, Brian G.; Yeaton, William H.
Titel	Evaluating Effects of Developmental Education for College Students Using a Regression Discontinuity Design
Quelle	In: Evaluation Review, 37 (2013) 5, S.370-404 (35 Seiten) PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0193-841X
DOI	10.1177/0193841X14523620
Schlagwörter	Developmental Studies Programs; Community Colleges; Two Year College Students; Program Evaluation; Program Effectiveness; Regression (Statistics); College English; Grades (Scholastic); Nonparametric Statistics; Meta Analysis; Gender Differences; Achievement Gains; Academic Achievement; Racial Differences + Suchen Sie Ihr Suchwort? Developmental studies; Developmental psychology; Study; Studies; Entwicklungspsychologie; Studium; Community college; Community College; Programme evaluation; Programmevaluation; Regression; Regressionsanalyse; Notenspiegel; Meta-analysis; Metaanalyse; Geschlechterkonflikt; Achievement gain; Leistungssteigerung; Schulleistung; Rassenunterschied
Abstract	Background: Annually, American colleges and universities provide developmental education (DE) to millions of underprepared students; however, evaluation estimates of DE benefits have been mixed. Objectives: Using a prototypic exemplar of DE, our primary objective was to investigate the utility of a replicative evaluative framework for assessing program effectiveness. Research design: Within the context of the regression discontinuity (RD) design, this research examined the effectiveness of a DE program for five, sequential cohorts of first-time college students. Discontinuity estimates were generated for individual terms and cumulatively, across terms. Subjects: Participants were 3,589 first-time community college students. Measures: DE program effects were measured by contrasting both college-level English grades and a dichotomous measure of pass/fail, for DE and non-DE students. Results: Parametric and nonparametric estimates of overall effect were positive for continuous and dichotomous measures of achievement (grade and pass/fail). The variability of program effects over time was determined by tracking results within individual terms and cumulatively, across terms. Applying this replication strategy, DE's overall impact was modest (an effect size of approximately .20) but quite consistent, based on parametric and nonparametric estimation approaches. A meta-analysis of five RD results yielded virtually the same estimate as the overall, parametric findings. Subset analysis, though tentative, suggested that males benefited more than females, while academic gains were comparable for different ethnicities. Conclusion: The cumulative, within-study comparison, replication approach offers considerable potential for the evaluation of new and existing policies, particularly when effects are relatively small, as is often the case in applied settings. (As Provided).
Anmerkungen	SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10