NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ904351
Record Type: Journal
Publication Date: 2011-Feb
Pages: 9
Abstractor: As Provided
Reference Count: 0
ISSN: ISSN-0360-1315
The Automatic Assessment of Free Text Answers Using a Modified BLEU Algorithm
Noorbehbahani, F.; Kardan, A. A.
Computers & Education, v56 n2 p337-345 Feb 2011
e-Learning plays an undoubtedly important role in today's education and assessment is one of the most essential parts of any instruction-based learning process. Assessment is a common way to evaluate a student's knowledge regarding the concepts related to learning objectives. In this paper, a new method for assessing the free text answers of students based on the BLEU algorithm is presented. We modify the BLEU algorithm so that it is suitable for assessing free text answers and call the new algorithm the modified BLEU (M-BLEU). To perform an assessment, it is necessary to establish a repository of reference answers written by course instructors or related experts. Several reference answers are included for each question. The M-BLEU algorithm is used to identify the most similar reference answer to a student answer; a similarity score is calculated and applied to score the answers provided by students. Evaluation results show that the proposed method achieves the highest correlation with human expert scores compared to other assessment methods such as latent semantic analysis (LSA) and n-gram co-occurrence. (Contains 3 tables and 2 figures.)
Elsevier. 6277 Sea Harbor Drive, Orlando, FL 32887-4800. Tel: 877-839-7126; Tel: 407-345-4020; Fax: 407-363-1354; e-mail:; Web site:
Publication Type: Journal Articles; Reports - Descriptive
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A