ERIC Number: ED453252
Record Type: Non-Journal
Publication Date: 2001-Apr-11
Reference Count: N/A
Imperative or Choice? Multi-Level and Multi-Measure Analysis of Student Assessment Data for Evaluation of Systemic School Reform.
Lee, Jaekyung; Coladarci, Theodore
A systematic analysis of student assessment data from Maine and Kentucky, using National Assessment of Educational Progress (NAEP) data and state and local assessment results, was conducted to address issues of measurement and attribution involved in evaluating systemic school reform. This paper (1) examines ways to cope with the challenges of considering measures of school systems from multiple sources and combining multiple measures of student achievement data using state and local data from Maine; (2) examines ways to tackle the challenges of considering multiple levels of influences on student achievement and attributing achievement results to school effects using NAEP data from Maine and Kentucky; and (3) discusses the usefulness and limitations of multi-level and multi-measure approaches to the evaluation of systemic school reform. Results suggest that it is not necessary to weight each measure before forming an achievement composite to classify student performance. This is particularly true when measures are highly intercorrelated. Results also point to the possible hazards of classifying student achievement based on a single measure. Three different models of estimating school effects were tested, and reasons for their use are discussed. The estimation of school effects requires that "school effects" be defined so that an explicit model of these effects can be formulated. The model should be fully specified, with all variables representing school input, practice, context, and student background measured. (Contains 14 tables and 17 references.) (SLD)
Publication Type: Reports - Evaluative; Speeches/Meeting Papers
Education Level: N/A
Sponsor: National Science Foundation, Washington, DC.
Authoring Institution: N/A
Identifiers - Location: Kentucky; Maine
Identifiers - Assessments and Surveys: National Assessment of Educational Progress