NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
PDF on ERIC Download full text
ERIC Number: EJ1111657
Record Type: Journal
Publication Date: 2007-Dec
Pages: 29
Abstractor: ERIC
ISSN: EISSN-2330-8516
On-the-Fly Customization of Automated Essay Scoring. Research Report. ETS RR-07-42
Attali, Yigal
ETS Research Report Series, Dec 2007
Because there is no commonly accepted view of what makes for good writing, automated essay scoring (AES) ideally should be able to accommodate different theoretical positions, certainly at the level of state standards but also perhaps among teachers at the classroom level. This paper presents a practical approach and an interactive computer program for judgment-based customization. This approach is based on the AES system, "e-rater"®. Through this new approach, a user can gain easy accessibility to system components, flexibility in adjusting scoring parameters, and procedures for making scoring adjustments that can be based on only a few benchmark essays. The interactive prototype program that implements this approach allows the user to customize "e-rater" and watch the effect on benchmark essay scores as well as on score distributions for a reference testing program of the user's choice. The paper presents results for the use of this approach in customizing "e-rater" to the standards of different assessments.
Educational Testing Service. Rosedale Road, MS19-R Princeton, NJ 08541. Tel: 609-921-9000; Fax: 609-734-5410; e-mail:; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: Elementary Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A