ERIC Number: EJ1083593
Record Type: Journal
Publication Date: 2015-Dec
Abstractor: As Provided
Bootstrapping in Applied Linguistics: Assessing Its Potential Using Shared Data
Plonsky, Luke; Egbert, Jesse; Laflair, Geoffrey T.
Applied Linguistics, v36 n5 p591-610 Dec 2015
Parametric analyses such as t tests and ANOVAs are the norm--if not the default--statistical tests found in quantitative applied linguistics research (Gass 2009). Applied statisticians and one applied linguist (Larson-Hall 2010, 2012; Larson-Hall and Herrington 2010), however, have argued that this approach may not be appropriate for small samples and/or nonnormally distributed data (e.g. Wilcox 2003), both common in second language (L2) research. They recommend instead "robust statistics" such as bootstrapping, a nonparametric procedure that randomly resamples from an observed data set to produce a simulated but more stable and statistically accurate outcome. The present study tests the usefulness of bootstrapping by reanalyzing raw data from 26 studies of applied linguistics research. Our results found no evidence of Type II error (false negative). However, 4 out of 16 statistically significant results were not replicated (i.e. a Type I error "misfit" five times higher than an alpha of 0.05). We discuss empirically justified suggestions for the use of bootstrapping in the context of broader methodological issues and reforms in applied linguistics (see Plonsky 2013, 2014).
Descriptors: Applied Linguistics, Statistical Analysis, Second Language Learning, Language Research, Robustness (Statistics), Error of Measurement, Research Methodology
Oxford University Press. Great Clarendon Street, Oxford, OX2 6DP, UK. Tel: +44-1865-353907; Fax: +44-1865-353485; e-mail: email@example.com; Web site: http://applij.oxfordjournals.org/
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A