NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
PDF on ERIC Download full text
ERIC Number: EJ895959
Record Type: Journal
Publication Date: 2010-Jul
Pages: 22
Abstractor: As Provided
Reference Count: 13
ISSN: ISSN-1540-2525
The Effectiveness and Efficiency of Distributed Online, Regional Online, and Regional Face-to-Face Training for Writing Assessment Raters
Wolfe, Edward W.; Matthews, Staci; Vickers, Daisy
Journal of Technology, Learning, and Assessment, v10 n1 Jul 2010
This study examined the influence of rater training and scoring context on training time, scoring time, qualifying rate, quality of ratings, and rater perceptions. One hundred twenty raters participated in the study and experienced one of three training contexts: (a) online training in a distributed scoring context, (b) online training in a regional scoring context, and (c) stand-up training in a regional context. After training, raters assigned scores to qualification sets, scored 400 student essays, and responded to a questionnaire that measured their perceptions of the effectiveness of, and satisfaction with, the training and scoring process, materials, and staff. The results suggest that the only clear difference on the outcomes for these three groups of raters concerned training time--online training was considerably faster. There were no clear differences between groups concerning qualification rate, rating quality, or rater perceptions. (Contains 4 tables.)
Technology and Assessment Study Collaborative. 332 Campion Hall, Boston College, Chestnut Hill, MA 02467. Tel: 617-552-4521; Fax: 617-552-8419; e-mail:; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: Adult Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A