NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1062199
Record Type: Journal
Publication Date: 2015-Jun
Pages: 39
Abstractor: As Provided
Reference Count: N/A
ISSN: ISSN-0023-8333
Improving the Validity of Quantitative Measures in Applied Linguistics Research
Purpura, James E.; Brown, James Dean; Schoonen, Rob
Language Learning, v65 nS1 p37-75 Jun 2015
In empirical applied linguistics research it is essential that the key variables are operationalized in a valid and reliable way, and that the scores are treated appropriately, allowing for a proper testing of the hypotheses under investigation. The current article addresses several theoretical and practical issues regarding the use of measurement instruments and scores. Starting from an elaborated treatment of validity and validation, it introduces a comprehensive framework for score interpretation and score use. Kane's framework serves as a rich context to raise the right questions about a measurement instruments' validity, and it provides guidance in addressing questions about validity and score use. Application of the framework is illustrated with examples from a recent second language acquisition study about the effects of recasts (Révész, 2012]). The critical generalization inference from the framework, as it applies to measuring productive L2 performance, is then examined in greater detail, discussing the different facets of these kinds of measurements and the way reliability issues are and should be dealt with. The paper concludes with a series of common measurement mistakes in applied linguistics research and recommendations to avoid these. The paper offers a brief checklist for proper quantitative data collection and for adequate data treatment in subsequent analyses.
Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail:; Web site:
Publication Type: Journal Articles; Reports - Descriptive
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A