Measures of Program Effectiveness Based on Retrospective Pretest Data: Are All Created Equal?

Autor/inn/en	Nimon, Kim; Zigarmi, Drea; Allen, Jeff
Titel	Measures of Program Effectiveness Based on Retrospective Pretest Data: Are All Created Equal?
Quelle	In: American Journal of Evaluation, 32 (2011) 1, S.8-28 (21 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1098-2140
DOI	10.1177/1098214010378354
Schlagwörter	Program Effectiveness; Pretests Posttests; Pretesting; Predictive Validity; Program Evaluation; Time Perspective + Suchen Sie Ihr Suchwort? Vortest; Programme evaluation; Programmevaluation; Zeitbezug
Abstract	This study analyzed data from four evaluation designs incorporating the retrospective pretest (i.e., thentest), analyzing the effects of self-report pretesting and post-program survey format on a set of self-report measures. Validity of self-report data was assessed by comparing the criterion validity of then ratings to established benchmarks and by including a control condition. This study found that designs incorporating separate posttest and thentest surveys yielded the most comparable levels of criterion validity for then ratings and the least biased measures of program effectiveness. Conversely, designs that incorporated a single post-program survey, with adjacent post and then items, yielded the least comparable levels of criterion validity for then ratings and the most biased measures of program effectiveness. This study also found a slight interaction between the effects of self-report pretesting and post-program survey format. Implications for program evaluation are discussed. (Contains 3 figures and 4 tables.) (As Provided).
Anmerkungen	SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10