NotesFAQContact Us
Collection
Advanced
Search Tips
Peer reviewed Peer reviewed
PDF on ERIC Download full text
ERIC Number: EJ1134820
Record Type: Journal
Publication Date: 2015
Pages: 18
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-2083-5205
EISSN: N/A
Analyzing Randomized Controlled Interventions: Three Notes for Applied Linguists
Vanhove, Jan
Studies in Second Language Learning and Teaching, v5 n1 p135-152 2015
I discuss three common practices that obfuscate or invalidate the statistical analysis of randomized controlled interventions in applied linguistics. These are (a) checking whether randomization produced groups that are balanced on a number of possibly relevant covariates, (b) using repeated measures ANOVA to analyze pretest-posttest designs, and (c) using traditional significance tests to analyze interventions in which whole groups were assigned to the conditions (cluster randomization). The first practice is labeled superfluous, and taking full advantage of important covariates regardless of balance is recommended. The second is needlessly complicated, and analysis of covariance is recommended as a more powerful alternative. The third produces dramatic inferential errors, which are largely, though not entirely, avoided when mixed-effects modeling is used. This discussion is geared towards applied linguists who need to design, analyze, or assess intervention studies or other randomized controlled trials. Statistical formalism is kept to a minimum throughout.
Adam Mickiewicz University Department of English Studies. Faculty of Pedagogy and Fine Arts, Ul. Nowy Swiat 28-30, 62-800 Kailsz, Poland. e-mail: ssllt@amu.edu.pll; Web site: http://ssllt.amu.edu.pl/
Publication Type: Journal Articles; Reports - Evaluative
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A