ERIC Number: ED350313
Record Type: RIE
Publication Date: 1992-Apr
Reference Count: N/A
Does the Mean Score Mask Poor Delivery of Educational Services in School Effectiveness Ratings?
Lang, Michael H.; And Others
This study investigated whether mean scores in school effectiveness ratings were masking poor delivery of educational services to low achievers in a sample of 242 Louisiana public elementary schools accounting for over 18,000 third graders tested in 1989. Ten separate multiple regression models, each producing studentized residuals used as school effectiveness indicators (SEIs), were used. The SEIs classified schools as effective, average, or ineffective. Appropriate cross-classification results were analyzed, and each comparison was tested with the kappa z-test. The kappa z-tests were significant beyond the 0.05 level, and magnitude measures were generally high to moderately consistent for mean quartile comparisons. The most inconsistent classifications were between effective and average ratings. None of the SEI sets demonstrated a significant relationship with the independent variables in the regression models. Findings consequently indicate that few schools were classified as average on mean-based SEIs that were rated as ineffective on lower quartile based SEIs. Little mean-masking of lower quartile achievement is present. Six tables present study data, and 20 references are included. (SLD)
Descriptors: Academic Achievement, Classification, Comparative Analysis, Delivery Systems, Educational Indicators, Educational Quality, Effective Schools Research, Elementary Schools, Grade 3, Low Achievement, Primary Education, Public Schools, Regression (Statistics), School Effectiveness, Scores, State Surveys
Publication Type: Reports - Research; Speeches/Meeting Papers
Education Level: N/A
Authoring Institution: N/A
Identifiers: Kappa Coefficient; Louisiana; Mean (Statistics); Residuals (Statistics); Service Delivery Assessment
Note: Paper presented at the Annual Meeting of the National Council on Measurement in Education (San Francisco, CA, April 21-23, 1992).