ERIC Number: EJ780902
Record Type: Journal
Publication Date: 2007-Oct
Reference Count: 9
Language Arts Performance Assignments: Generalizability Studies of Local and Central Ratings
Martinez, Jose Felipe; Goldschmidt, Pete; Niemi, David; Baker, Eva L.; Sylvester, Roxanne M.
Educational Assessment, v12 n3-4 p267-282 Oct 2007
We conducted generalizability studies to examine the extent to which ratings of language arts performance assignments, administered in a large, diverse, urban district to students in second through ninth grades, result in reliable and precise estimates of true student performance. The results highlight three important points when considering the use of performance assessments in large-scale settings: (a) Rater training may significantly impact reliability; (b) simple rater agreement indices do not provide enough information to assess the reliability of inferences about true student achievement; and (c) assessments adequate for relative judgments of student performance do not necessarily provide sufficient precision for absolute criterion-referenced decisions. (Contains 4 figures, 6 tables and 1 footnote.)
Descriptors: Assignments, Language Arts, Academic Achievement, Urban Areas, School Districts, Generalizability Theory, Student Evaluation, Evaluation Methods, Reliability, Interrater Reliability
Lawrence Erlbaum. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site: http://www.tandf.co.uk/journals/default.html
Publication Type: Journal Articles; Reports - Evaluative
Education Level: Elementary Secondary Education
Sponsor: Los Angeles Unified School District, CA.; Institute of Education Sciences (ED), Washington, DC.
Authoring Institution: N/A