Secondary Observer Effects: Idiosyncratic Errors in Small-N Secondary Data Analysis

Autor/in	Breznau, Nate
Titel	Secondary Observer Effects: Idiosyncratic Errors in Small-N Secondary Data Analysis
Quelle	In: International Journal of Social Research Methodology, 19 (2016) 3, S.301-318 (18 Seiten) PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1364-5579
DOI	10.1080/13645579.2014.1001221
Schlagwörter	Observation; Error of Measurement; Data Analysis; Comparative Analysis; Bias; Experimenter Characteristics; Replication (Evaluation); Simulation + Suchen Sie Ihr Suchwort? Beobachtung; Messfehler; Auswertung; Simulation program; Simulationsprogramm
Abstract	In this paper, I extend the concept of observer effect into the realm of country-level secondary data analysis. When analyzing what appear to be the same secondary data using the same methods, macro-comparative researchers arrive at different results. I argue that this is a product of idiosyncratic variation directly or indirectly produced by the researchers. Even when this bias produces only small perturbations in results, the consequences may be very large. Using an influential study by Brooks and Manza I analyze this "secondary observer" effect (SOE). Two seemingly identical replications of their data by different researchers produced surprising variations. Reanalysis of these divergent values produces similar but not identical results. A rough calculation of the size of the SOEs suggests that they are about 0.32 standardized standard deviations across variable scores. Simulations of this size of error show that significant changes in findings occur as a result. (As Provided).
Anmerkungen	Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2020/1/01