ERIC Number: ED104918
Record Type: Non-Journal
Publication Date: 1974-Dec
Reference Count: N/A
A Procedural Guide for Validation Achievement Gains in Educational Projects. (Revised). RMC Report No. UR-240.
Tallmadge, G. Kasten; Horst, Donald P.
The orientation of this report is that of identifying educational projects which can be considered truly exemplary. The bulk of the report consists of a 23-step procedure for validating the effectiveness of educational programs using existing evaluation data. It is not intended as a guide for conducting evaluations but rather for interpreting data assembled by others using a wide variety of experimental and quasi-experimental designs. As such, its coverage is not restricted to "good" designs. It encompasses all of the commonly employed evaluation models. The report is concerned with deficiencies and hazards of various designs with emphasis on the weaker ones which, as it happens, are also the most feasible in real-world settings, the least costly, and the most commonly used. The appendixes contain project selection criteria worksheets, information regarding norm-referenced versus criterion-referenced tests, estimation of treatment effect from the performance of an initially superior comparison group, effects of noncomparable testing dates on experimental group versus norm group comparisons, and problems using grade-equivalent scores in evaluating educational gains. Changes from the original version include the removal of material which dealt with project selection criteria unrelated to cognitive achievement benefits. (Author/RC)
Descriptors: Academic Achievement, Achievement Gains, Achievement Tests, Criterion Referenced Tests, Decision Making, Demonstration Programs, Evaluation, Evaluation Criteria, Evaluation Needs, Grade Equivalent Scores, Guidelines, Norm Referenced Tests, Norms, Program Effectiveness, Program Evaluation, Research Design, Statistical Significance, Test Reliability, Testing Problems, Validity
Publication Type: Reports - Research
Education Level: N/A
Sponsor: Office of Education (DHEW), Washington, DC. Office of Planning, Budgeting, and Evaluation.
Authoring Institution: RMC Research Corp., Mountain View, CA.