ERIC Number: ED492897
Record Type: Non-Journal
Publication Date: 2006-Jan
Reference Count: 20
Using the Instructional Quality Assessment Toolkit to Investigate the Quality of Reading Comprehension Assignments and Student Work. CSE Report 669
Matsumura, Lindsay Clare; Slater, Sharon Cadman; Wolf, Mikyung Kim; Crosson, Amy; Levison, Allison; Peterson, Maureen; Resnick, Lauren; Junker, Brian
National Center for Research on Evaluation, Standards, and Student Testing (CRESST)
This study presents preliminary findings from research developing an instructional quality assessment (IQA) toolkit that could be used to monitor the influence of reform initiatives on students' learning environments and to guide professional development efforts within a school or district. This report focuses specifically on the portion of the IQA used to evaluate the quality of teachers' reading comprehension assignments and student work. Results are limited due to a very small sample of participating teachers (N = 13, 52 assignments), and indicate a poor to moderate level of inter-rater agreement and a good degree of consistency for the dimensions measuring academic rigor, but not the clarity of teachers' expectations. The rigor of the assignments collected from teachers also was associated with the rigor of observed instruction. Collecting four assignments (two challenging and two recent) from teachers did not yield a stable estimate of quality. Additional analyses looking separately at the two different assignment types indicate, however, that focusing on one assignment type would yield a stable estimate of quality. This suggests that the way in which assignments are collected from teachers should be revised. Implications for professional development are also discussed. The 2003 Draft Observation and Assignment Rubrics for Reading Comprehension is appended. (Contains 6 tables, 4 figures, and 4 footnotes.)
Descriptors: Reading Comprehension, Reading Assignments, Reading Instruction, Instructional Effectiveness, Observation, Literature, Scoring Rubrics, Test Validity, Rating Scales, Teacher Effectiveness, Elementary School Teachers, Teacher Expectations of Students, Interrater Reliability, Reading Research, Teaching Methods, Teacher Evaluation, Classroom Observation Techniques, Difficulty Level
National Center for Research on Evaluation, Standards, and Student Testing (CRESST). 300 Charles E Young Drive N, GSE&IS Building 3rd Floor, Mailbox 951522, Los Angeles, CA 90095-1522. Tel: 310-206-1532; Fax: 310-825-3883; Web site: http://www.cresst.org.
Publication Type: Reports - Evaluative; Tests/Questionnaires
Education Level: Elementary Education
Sponsor: Institute of Education Sciences (ED), Washington, DC.
Authoring Institution: National Center for Research on Evaluation, Standards, and Student Testing, Los Angeles, CA.