ERIC Number: EJ943299
Record Type: Journal
Publication Date: 2011-Oct
Pages: 20
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0265-5322
EISSN: N/A
Predicting Lexical Proficiency in Language Learner Texts Using Computational Indices
Crossley, Scott A.; Salsbury, Tom; McNamara, Danielle S.; Jarvis, Scott
Language Testing, v28 n4 p561-580 Oct 2011
The authors present a model of lexical proficiency based on lexical indices related to vocabulary size, depth of lexical knowledge, and accessibility to core lexical items. The lexical indices used in this study come from the computational tool Coh-Metrix and include word length scores, lexical diversity values, word frequency counts, hypernymy values, polysemy values, semantic co-referentiality, word meaningfulness, word concreteness, word imagability, and word familiarity. Human raters evaluated a corpus of 240 written texts using a standardized rubric of lexical proficiency. To ensure a variety of text levels, the corpus comprised 60 texts each from beginning, intermediate, and advanced second language (L2) adult English learners. The L2 texts were collected longitudinally from 10 English learners. In addition, 60 texts from native English speakers were collected. The holistic scores from the trained human raters were then correlated to a variety of lexical indices. The researchers found that lexical diversity, word hypernymy values and content word frequency explain 44% of the variance of the human evaluations of lexical proficiency in the examined writing samples. The findings represent an important step in the development of a model of lexical proficiency that incorporates both vocabulary size and depth of lexical knowledge features. (Contains 4 tables.)
Descriptors: Semantics, Familiarity, Second Language Learning, Word Frequency, English (Second Language), Verbs, Prediction, Language Proficiency, Computational Linguistics, Vocabulary, Scores, Longitudinal Studies, Correlation, Scoring Rubrics, Writing (Composition), Adult Learning, Writing Evaluation, Language Tests
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Publication Type: Journal Articles; Reports - Research
Education Level: Adult Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Assessments and Surveys: Test of English as a Foreign Language
IES Funded: Yes
Grant or Contract Numbers: R305A080589