ERIC Number: ED483513
Record Type: Non-Journal
Publication Date: 2004-Jan
Using Hierarchical Growth Models To Monitor School Performance Over Time: Comparing NCE to Scale Score Results. CSE Report 618
Goldschmidt, Pete; Choi, Kilchan; Martinez, Felipe
US Department of Education
Monitoring school performance increasingly uses sophisticated analytical techniques. This document investigates whether one such method, hierarchical growth modeling, yields consistent school performance results when different metrics are used as the outcome variable. It is examined as to whether statistical and substantive inferences are altered when using normal curve equivalents (NCEs) versus scale scores. The results indicate that the effect of the metric depends upon the evaluation objective. NCEs significantly underestimate absolute growth, but NCEs and scale scores yield highly correlated (0.9) results based on mean initial status and growth estimates. Correlations between NCE and scale score rankings, based on fitted school initial status and growth values are generally over 0.94. Statistical and substantive results, using NCEs and scale scores, pertaining to school-wide program effects are highly correlated (0.95). NCEs and scale scores matched 99% of the time on whether or not the program indicator variable was statistically significant.
Descriptors: Educational Research, Models, Data Analysis, Academic Achievement, Student Evaluation, Program Effectiveness, Inferences, Monte Carlo Methods, Student Characteristics, Scores
Center for the Study of Evaluation (CSE), National Center for Research on Evaluation, Standards, and Student Testing (CRESST), Graduate School of Education & Information Studies, University of California, Los Angeles, Los Angeles, CA 90095-1522. Tel: 310-206-1532.
Publication Type: Reports - Research
Education Level: Elementary Secondary Education
Sponsor: Institute of Education Sciences (ED), Washington, DC.
Authoring Institution: California Univ., Los Angeles. Center for the Study of Evaluation.