ERIC Number: EJ1019751
Record Type: Journal
Publication Date: 2013
Abstractor: As Provided
Reference Count: 54
An Examination of Assessment Fidelity in the Administration and Interpretation of Reading Tests
Reed, Deborah K.; Sturges, Keith M.
Remedial and Special Education, v34 n5 p259-268 Sep-Oct 2013
Researchers have expressed concern about "implementation" fidelity in intervention research but have not extended that concern to "assessment" fidelity, or the extent to which pre-/posttests are administered and interpreted as intended. When studying reading interventions, data gathering heavily influences the identification of students, the curricular components delivered, and the interpretation of outcomes. However, information on assessment fidelity is rarely reported. This study examined the fidelity with which individuals paid to be testers for research purposes were directly observed administering and interpreting reading assessments for middle school students. Of 589 testing packets, 45 (8% of the total) had to be removed from the data set for significant abnormalities and another 484 (91% of the remaining packets) had correctable errors only found in double scoring. Results indicate reading assessments require extensive training, highly structured protocols, and ongoing calibration to produce reliable and valid results useful in applied research.
Descriptors: Reading Tests, Fidelity, Pretests Posttests, Intervention, Evaluators, Middle School Students, Measures (Individuals), Interrater Reliability, Reading Fluency, Test Interpretation, Testing
SAGE Publications and Hammill Institute on Disabilities. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: firstname.lastname@example.org; Web site: http://sagepub.com
Publication Type: Journal Articles; Reports - Research
Education Level: Grade 6; Grade 7; Grade 8; Middle Schools
Authoring Institution: N/A