ERIC Number: ED275713
Record Type: Non-Journal
Publication Date: 1986-Apr
Pages: 21
Abstractor: N/A
ISBN: N/A
ISSN: N/A
EISSN: N/A
Assessing a Federal Approach to Evaluating Evaluations: The Joint Dissemination Review Panel. Can Approved Submissions Be Distinguished from Those Not Approved?
Fang, Wei Li; Covert, Robert W.
Three studies identifying the characteristics of program submittals approved by the Joint Dissemintion Review Panel were examined. Between 1978-1985, 358 demonstration programs were submitted. For each of these years, between 51 percent and 83 percent of the submittals were approved. In this study, the submittals were reviewed on the basis of the Joint Panel's criteria for program effectiveness; evidence of impact; evidence of statistical reliability of effects; evidence that the effects are educationally meaningful; interpretability of tests; credibility of evidence; evidence that the effects are attributable to the intervention; and evidence of generalizability. The reviewers also considered the clarity and quality of the submittal itself. The program content areas most frequently included were basic skills (reading, mathematics, and writing), career education, and special education. Approved submittals, in addition to the official seven criteria, also provided adequate descriptions of the program components. Most approvals used quasi-experimental or experimental designs, and nonequivalent or randomized control groups. Although the number of submittals decreased, evaluation designs became more rigid in more recent years. Clear writing and presentation of results appeared to be a critical factor in acceptance. (GDC)
Publication Type: Speeches/Meeting Papers; Reports - Research
Education Level: N/A
Audience: Researchers
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A