Improving the Validity of Quantitative Measures in Applied Linguistics Research

Autor/inn/en	Purpura, James E.; Brown, James Dean; Schoonen, Rob
Titel	Improving the Validity of Quantitative Measures in Applied Linguistics Research
Quelle	In: Language Learning, 65 (2015), S.37-75 (39 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0023-8333
DOI	10.1111/lang.12112
Schlagwörter	Applied Linguistics; Language Research; Statistical Analysis; Validity; Second Language Learning; Reliability; Scores; Measurement Techniques; Guidelines; Generalization; Check Lists; Research Methodology + Suchen Sie Ihr Suchwort? Linguistics; Linguistik; Angewandte Linguistik; Sprachforschung; Statistische Analyse; Gültigkeit; Zweitsprachenerwerb; Reliabilität; Messtechnik; Richtlinien; Checkliste; Research method; Forschungsmethode
Abstract	In empirical applied linguistics research it is essential that the key variables are operationalized in a valid and reliable way, and that the scores are treated appropriately, allowing for a proper testing of the hypotheses under investigation. The current article addresses several theoretical and practical issues regarding the use of measurement instruments and scores. Starting from an elaborated treatment of validity and validation, it introduces a comprehensive framework for score interpretation and score use. Kane's framework serves as a rich context to raise the right questions about a measurement instruments' validity, and it provides guidance in addressing questions about validity and score use. Application of the framework is illustrated with examples from a recent second language acquisition study about the effects of recasts (Révész, 2012]). The critical generalization inference from the framework, as it applies to measuring productive L2 performance, is then examined in greater detail, discussing the different facets of these kinds of measurements and the way reliability issues are and should be dealt with. The paper concludes with a series of common measurement mistakes in applied linguistics research and recommendations to avoid these. The paper offers a brief checklist for proper quantitative data collection and for adequate data treatment in subsequent analyses. (As Provided).
Anmerkungen	Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail: cs-journals@wiley.com; Web site: http://www.wiley.com/WileyCDA
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2020/1/01