NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1088718
Record Type: Journal
Publication Date: 2016-Mar
Pages: 22
Abstractor: As Provided
ISSN: ISSN-0039-8322
Instrument Reporting Practices in Second Language Research
Derrick, Deirdre J.
TESOL Quarterly: A Journal for Teachers of English to Speakers of Other Languages and of Standard English as a Second Dialect, v50 n1 p132-153 Mar 2016
Second language (L2) researchers often have to develop or change the instruments they use to measure numerous constructs (Norris & Ortega, 2012). Given the prevalence of researcher-developed and -adapted data collection instruments, and given the profound effect instrumentation can have on results, thorough reporting of instrumentation is important for interpreting study results, conducting replications, forming and modifying L2 theory, and performing meta-analytic research. Transparency in instrument reporting should include information on the origins, development, piloting, and reliability of instruments as well as information about inter-rater reliability. Prior research, however, indicates gaps in L2 research transparency (Cohen & Macaro, 2010; Plonsky & Gass, 2011). The present study examined instrument reporting practices in three L2 journals over a period of 5 years. Origins were reported for 58% of the instruments, descriptions of piloting were provided for 17% of the instruments, reliability coefficients were reported for 28% of the instruments (with Cronbach's alpha being the most frequently used index: 22%), and inter-rater reliability information was provided for 42% of the instruments (with percentage agreement being the most frequently used calculation: 16%). Seventeen percent of the instruments were made available either online or in an appendix. This snapshot of current reporting practices indicates areas where transparency could be improved.
Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail:; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A