ERIC Number: EJ1212605
Record Type: Journal
Publication Date: 2019
Abstractor: As Provided
A Study of Reliability across Multiple Raters When Using the NAEP and MDFS Rubrics to Measure Oral Reading Fluency
Smith, Grant S.; Paige, David D.
Reading Psychology, v40 n1 p34-69 2019
Becoming a fluent reader has been established as important to reading comprehension. Prosody (expression) is an indicator of fluent reading that is linked to improved comprehension in students across elementary, middle, and secondary grades. Fluent reading is most often evaluated by classroom teachers through the use of a rubric, with the most common being the Multi-Dimensional Fluency Scale (MDFS) and the National Assessment of Educational Progress (NAEP) scale. This investigation uses a generalizability study (G-study) and a decision study (G-study) to determine reliability and efficiency of the two rubrics across five raters and two rating occasions in 177 first- through third-grade students. The results revealed the MDFS and NAEP to be parallel instruments with variance attributable to raters ranging from nearly 0 to 2.2%. Generalizability coefficients ranging from 0.91 to 0.94, indicating high reliability were found for both instruments. Recommendations for administration efficiency of each rubric are provided and instructional implications are discussed.
Descriptors: Interrater Reliability, Oral Reading, Reading Fluency, National Competency Tests, Reading Tests, Scoring Rubrics, Elementary School Students, Suprasegmentals, Grade 1, Grade 2, Grade 3
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: Elementary Education; Early Childhood Education; Grade 1; Primary Education; Grade 2; Grade 3
Authoring Institution: N/A
Identifiers - Assessments and Surveys: National Assessment of Educational Progress