ERIC Number: EJ779662
Record Type: Journal
Publication Date: 2007
Reference Count: 31
Discrepancies between Score Trends from NAEP and State Tests: A Scale-Invariant Perspective
Ho, Andrew D.
Educational Measurement: Issues and Practice, v26 n4 p11-20 Win 2007
State test score trends are widely interpreted as indicators of educational improvement. To validate these interpretations, state test score trends are often compared to trends on other tests such as the National Assessment of Educational Progress (NAEP). These comparisons raise serious technical and substantive concerns. Technically, the most commonly used trend statistics--for example, the change in the percent of proficient students--are misleading in the context of cross-test comparisons. Substantively, it may not be reasonable to expect that NAEP and state test score trends should be similar. This paper motivates then applies a "scale-invariant" framework for cross-test trend comparisons to compare "high-stakes" state test score trends from 2003 to 2005 to NAEP trends over the same period. Results show that state trends are significantly more positive than NAEP trends. The paper concludes with cautions against the positioning of trend discrepancies in a framework where only one trend is considered "true."
Descriptors: Test Results, Educational Improvement, National Competency Tests, Measures (Individuals), Scores, Trend Analysis, State Standards, Comparative Analysis, Guidelines, High Stakes Tests, Educational Trends
Blackwell Publishing. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8599; Fax: 781-388-8232; e-mail: firstname.lastname@example.org; Web site: http://www.blackwellpublishing.com/jnl_default.asp
Publication Type: Journal Articles; Reports - Descriptive
Education Level: Elementary Secondary Education
Authoring Institution: N/A