All Evidence Is Equal: The Flaw in Statistical Reasoning

Autor/in	Gorard, Stephen
Titel	All Evidence Is Equal: The Flaw in Statistical Reasoning
Quelle	In: Oxford Review of Education, 36 (2010) 1, S.63-77 (15 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0305-4985
Schlagwörter	Evidence; Research Methodology; Statistical Significance; Thinking Skills; Misconceptions; Social Science Research; Testing; Probability; Epidemiology + Suchen Sie Ihr Suchwort? Evidenz; Research method; Forschungsmethode; Denkfähigkeit; Missverständnis; Social scientific research; Sozialwissenschaftliche Forschung; Testdurchführung; Testen; Wahrscheinlichkeitsrechnung; Wahrscheinlichkeitstheorie; Epidemiologie
Abstract	In the context of existing "quantitative"/"qualitative" schisms, this paper briefly reminds readers of the current practice of testing for statistical significance in social science research. This practice is based on a widespread confusion between two conditional probabilities. A worked example and other elements of logical argument demonstrate the flaw in statistical testing as currently conducted, even when strict protocols are met. Assessment of significance cannot be standardised and requires knowledge of an underlying figure that the analyst does not generally have and cannot usually know. Therefore, even if all assumptions are met, the practice of statistical testing in isolation is futile. The question many people then ask in consequence is--what should we do instead? This is, perhaps, the wrong question. Rather, the question could be--why should we expect to treat randomly sampled figures differently from any other kinds of numbers, or any other forms of evidence? What we could do "instead" is use figures in the same way as we would most other data, with care and judgement. If all such evidence is equal, the implications for research synthesis and the way we generate new knowledge are considerable. (Contains 2 tables and 13 notes.) (As Provided).
Anmerkungen	Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site: http://www.tandf.co.uk/journals
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10