ERIC Number: ED229426
Record Type: RIE
Publication Date: 1982-Oct
Reference Count: 0
The Measurement of Effectiveness: Some Methodological Problems.
Frechtling, Joy A.
This paper highlights measurement issues faced when attempting to assess and interpret results of a school improvement project. Based on the assumption that to measure effectiveness, one must measure a wide variety of school factors, the paper presents a broad perspective on measurement problems and dilemmas in analyzing norm-referenced test data and data obtained through interview, self appraisal, and observation concerning ll7 elementary schools. Trend analysis, two forms of residual gains analyses, traditional ranking, and expert judgment methods are compared. Data suggest that school level residual analysis appears to provide the best approach to selecting schools. The individual level residual scores yield a list which overlaps with the school level approach. Trend analysis is the most conservative and yields the fewest schools (which are also identified by residual score analyses). Expert opinion does not correlate positively with residual or trend analyses. Analyses indicated few consistencies over time. The authors conclude with two alternatives--either schools are not consistent in their impacts from year to year or their metric is suspect. (Author/CM)
Descriptors: Comparative Analysis, Data Analysis, Elementary Secondary Education, Evaluation Methods, Evaluation Needs, Grade 5, Longitudinal Studies, Measurement Objectives, Measurement Techniques, Norm Referenced Tests, Program Improvement, Reading Comprehension, Research Methodology, School Effectiveness, Scores, Trend Analysis
Publication Type: Speeches/Meeting Papers; Reports - Research
Education Level: N/A
Authoring Institution: N/A
Identifiers: Experts; Iowa Tests of Basic Skills; Measurement Problems; Ranking; Residual Scores
Note: Paper presented at the Annual Meeting of the Evaluation Network and Evaluation Research Society (Baltimore, MD, October 28-30, 1982).