ERIC Number: EJ1135553
Record Type: Journal
Publication Date: 2012-Jul
Pages: 13
Abstractor: As Provided
ISBN: N/A
ISSN: EISSN-1931-4744
EISSN: N/A
Efficiency in Assessment: Can Trained Student Interns Rate Essays as Well as Faculty Members?
Cole, Tracy L.; Cochran, Loretta F.; Troboy, L. Kim; Roach, David W.
International Journal for the Scholarship of Teaching and Learning, v6 n2 Article 6 Jul 2012
What are the most efficient and effective methods in measuring outcomes for assurance of learning in higher education? This study examines the merits of outsourcing part of the assessment workload by comparing ratings completed by trained student interns to ratings completed by faculty. Faculty evaluation of students' written work samples provides the most detailed, actionable data useful for improving the curriculum. While this approach may be efficacious, it is also labor-intensive. Both the faculty and student interns were trained to use a scoring rubric developed for this assessment to rate undergraduate student essay responses to an ethical reasoning scenario. The convergent validity, discriminant validity, and source bias showed no significant difference between the values for the student raters versus those for the faculty raters. These findings support the hypothesis that trained student interns can do as well as faculty at evaluating undergraduate student work samples.
Descriptors: Scoring, Interrater Reliability, Essays, Undergraduate Students, Scoring Rubrics, Validity, Outsourcing, Internship Programs, College Faculty, Graduate Students, Bias, Training, Accuracy, Questionnaires
Centers for Teaching & Technology at Georgia Southern University. IJ-SoTL, Georgia Southern University, Henderson Library 1301, Statesboro, GA 30460. e-mail: sotlij@georgiasouthern.edu; Web site: http://digitalcommons.georgiasouthern.edu/ij-sotl/
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A