NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ849515
Record Type: Journal
Publication Date: 2009-May
Pages: 19
Abstractor: As Provided
Reference Count: 21
ISSN: ISSN-0742-7778
Mastering Overdetection and Underdetection in Learner-Answer Processing: Simple Techniques for Analysis and Diagnosis
Blanchard, Alexia; Kraif, Olivier; Ponton, Claude
CALICO Journal, v26 n3 p592-610 May 2009
This paper presents a "didactic triangulation" strategy to cope with the problem of reliability of NLP applications for computer-assisted language learning (CALL) systems. It is based on the implementation of basic but well mastered NLP techniques and puts the emphasis on an adapted gearing between computable linguistic clues and didactic features of the evaluated activities. We claim that a correct balance between false positives (i.e., false error detection) and false negatives (i.e., undetected errors) is not only an outcome of NLP techniques, but also of an appropriate didactic integration of what NLP can do well--and what it cannot do well. Based on this approach, ExoGen is a prototype for generating activities such as gap-fill exercises. It integrates a module for error detection and description which checks learners' answers against expected ones. Through the analysis of graphic, orthographic, and morphosyntactic differences, it is able to diagnose problems like spelling errors, lexical mix-ups, agreement errors, conjugation errors, and so on. The first evaluation of ExoGen outputs, based on the FRIDA learner corpus, has yielded very promising results, paving the way for the development of an efficient and general model adaptable to a wide variety of activities. (Contains 5 figures, 2 tables and 12 notes.)
Computer Assisted Language Instruction Consortium. 214 Centennial Hall, 601 University Drive, San Marcos, TX 78666. Tel: 512-245-1417; Fax: 512-245-9089; e-mail: Web site:
Publication Type: Journal Articles; Reports - Descriptive
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A