Researchers' Perceptions of Statistical Significance Contribute to Bias in Health and Exercise Science

Autor/inn/en	Buchanan, Taylor L.; Lohse, Keith R.
Titel	Researchers' Perceptions of Statistical Significance Contribute to Bias in Health and Exercise Science
Quelle	In: Measurement in Physical Education and Exercise Science, 20 (2016) 3, S.131-139 (9 Seiten) PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1091-367X
DOI	10.1080/1091367X.2016.1166112
Schlagwörter	Researchers; Attitudes; Statistical Significance; Bias; Research Methodology; Surveys; Vignettes; Randomized Controlled Trials; Comparative Analysis; Data Processing; Hypothesis Testing; Sampling; Research Universities; Medical Schools; Foreign Countries; College Faculty; Higher Education; Department Heads; Online Surveys; Statistical Inference; Statistics; Statistical Analysis; Exercise Physiology; Health Sciences; Experiments; Simulation; Questionnaires; Error Correction; Canada; United States + Suchen Sie Ihr Suchwort? Researcher; Forscher; Attitude; Einstellung; Verhalten; Research method; Forschungsmethode; Survey; Umfrage; Befragung; Datenverarbeitung; Hypothesenprüfung; Hypothesentest; Forschungseinrichtung; Medizinische Ausbildung; Ausland; Fakultät; Hochschulbildung; Hochschulsystem; Hochschulwesen; Inferential statistics; Schließende Statistik; Statistik; Statistische Analyse; Sportphysiologie; Erprobung; Simulation program; Simulationsprogramm; Fragebogen; Korrektur; Kanada; USA
Abstract	We surveyed researchers in the health and exercise sciences to explore different areas and magnitudes of bias in researchers' decision making. Participants were presented with scenarios (testing a central hypothesis with p = 0.06 or p = 0.04) in a random order and surveyed about what they would do in each scenario. Participants showed significant bias in deciding to randomize additional participants when p = 0.06 (24.5%) compared to when p = 0.04 (6.5%), ?[superscript 2] = 19.86, odds ratio (OR) = 13.5. Based on this bias to randomize additional participants, we present statistical simulations showing the cumulative negative effect this bias has on the false positive rate for a field. While it is important for researchers to have flexibility in their data-processing decisions, there is a cost/benefit trade-off to experimenter degrees of freedom and it is important that these decisions be unbiased. These data highlight the importance of a priori analysis plans in research. (As Provided).
Anmerkungen	Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site: http://www.tandf.co.uk/journals
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2020/1/01