NotesFAQContact Us
Search Tips
ERIC Number: ED499773
Record Type: Non-Journal
Publication Date: 2001-Oct-25
Pages: 24
Abstractor: Author
Reference Count: 5
The Reading Excellence Act Grant Application Process: A Comprehensive Example of Applied Rasch Measurement
Basturk, Ramazan; Loadman, William E.
Online Submission, Paper presented at the Annual Meeting of the Mid-Western Educational Research Association (Chicago, IL, Oct 25, 2001)
Purpose: The purpose of this study is to assess and evaluate the grant selection process for reading excellence program in Ohio. School districts in Ohio were given the opportunity to apply for funding to support district based reading programs through a request for proposal procedures. An effort was made to reliably and equitably score the proposed applications. Methodology: The data set include 106 applications from over 3000 buildings in 612 school districts. Applications have been assigned randomly to 114 readers to evaluate the quality of applications and at least 4 raters were assigned per application. The survey that was used to evaluate Grant Applications for Reading Excellence Act contains three subscales and 26 questions. The first six items related to the district's reading tutor program as discussed in the application. The next eight questions outline school-based tutor service. Finally, the last eleven questions relate only to the contracted tutorial services. An overall evaluation of grant application quality is found in the last question, Question (#26). Results: In this analysis, the results showed that just 21% of the applications have acceptable quality. 11 out of 106 applications show very high infit statistics (3 greater than infit greater than -3) and 5 out of 106 applications showed very high outfit statistics (0.06 greater than outfit greater than -3). These statistics indicated that most applications were consistent with the estimated quality measures, or their scores were highly predictable of the 11 applications with high infit/outfit, only 3 showed cause for concern. For raters, results showed that 23 out of 114 raters have been found with high infit and outfit statistics. Sixteen of the raters had high infit/outfit statistics, but only 3 raters were problematic. None of the raters with low infit/outfit statistics were problematic. Conclusions: The results indicated that these raters' ordering of application was generally consistent with the estimatens. Finally, only 1 out of 26 items showed high infit and outfit statistics. This result indicated that this item may contribute minor noise to the overall calibration of the application. In general, the item functions are very well. Recommendations: This study demonstrated the application of a sophisticated assessment procedure in addressing a significant educational problem, i.e., a fair and consistent way to assess applications into a Reading Excellence program. This procedure has wide applicability, but is currently not well known. (Contains 4 tables.)
Publication Type: Reports - Evaluative; Speeches/Meeting Papers
Education Level: Early Childhood Education; Elementary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Ohio
Identifiers - Laws, Policies, & Programs: Reading Excellence Act