NotesFAQContact Us
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1212605
Record Type: Journal
Publication Date: 2019
Pages: 25
Abstractor: As Provided
ISSN: ISSN-0270-2711
A Study of Reliability across Multiple Raters When Using the NAEP and MDFS Rubrics to Measure Oral Reading Fluency
Smith, Grant S.; Paige, David D.
Reading Psychology, v40 n1 p34-69 2019
Becoming a fluent reader has been established as important to reading comprehension. Prosody (expression) is an indicator of fluent reading that is linked to improved comprehension in students across elementary, middle, and secondary grades. Fluent reading is most often evaluated by classroom teachers through the use of a rubric, with the most common being the Multi-Dimensional Fluency Scale (MDFS) and the National Assessment of Educational Progress (NAEP) scale. This investigation uses a generalizability study (G-study) and a decision study (G-study) to determine reliability and efficiency of the two rubrics across five raters and two rating occasions in 177 first- through third-grade students. The results revealed the MDFS and NAEP to be parallel instruments with variance attributable to raters ranging from nearly 0 to 2.2%. Generalizability coefficients ranging from 0.91 to 0.94, indicating high reliability were found for both instruments. Recommendations for administration efficiency of each rubric are provided and instructional implications are discussed.
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: Elementary Education; Early Childhood Education; Grade 1; Primary Education; Grade 2; Grade 3
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Assessments and Surveys: National Assessment of Educational Progress