ERIC Number: ED080612
Record Type: Non-Journal
Publication Date: 1973-Jun
Reference Count: N/A
The Development of Revised Field Reader Evaluation Forms for Educational Research and Development Proposals. Final Report.
Crawford, Jack J.
The need for a revision of the Field Reader Evaluation Form used throughout the Regional Research Program, as well as by other programs in the Office of Education, is documented. An empirical development of a revised form was completed through two formative evaluation cycles. The revision was then subjected to a field test. Utilizing the revised form, field readers evaluated proposals which had previously been submitted to the Regional Research Program. As a control measure, previous evaluations were available. Comparisons with the existing form indicated that the revision provided greater objectivity and more comprehensive and specific coverage of proposal components. The mean number of comments and ratings per proposal obtained from four reviewers was 195 using the revision as compared to 48 via the old form. The revision provided equal inter-rater reliability. Decisions tended to be more critical, and favorable recommendations were more likely to impose conditions upon the proposed project. The revision provided more adequate bases for ranking proposals, including several alternative scales for ranking. A panel review judged the input from the revision to be a more useful evaluation for both decision makers and applicants. (Author/DB)
Publication Type: N/A
Education Level: N/A
Sponsor: National Center for Educational Research and Development (DHEW/OE), Washington, DC. Regional Research Program.
Authoring Institution: American Institutes for Research in the Behavioral Sciences, Palo Alto, CA.