ERIC Number: ED492886
Record Type: Non-Journal
Publication Date: 2006-Jan
Metric-Free Measures of Test Score Trends and Gaps with Policy-Relevant Examples. CSE Report 665
Ho, Andrew D.; Haertel, Edward H.
National Center for Research on Evaluation, Standards, and Student Testing (CRESST)
Problems of scale typically arise when comparing test score trends, gaps, and gap trends across different tests. To overcome some of these difficulties, we can express the difference between the observed test performance of two groups with graphs or statistics that are metric-free (i.e., invariant under positive monotonic transformations of the test score scale). In a series of studies broken into three parts, we develop a framework for the application of metric-free methods to routine policy questions. The first part introduces metric-free methodology and demonstrates the advantages of these methods when test score scales do not have defensible interval properties. The second part uses metric-free methods to compare gaps in Hispanic-White achievement in California across four testing programs over a 7-year period. The third part uses metric-free methods to compare trends for "high-stakes" State Reading test scores to State score trends on the National Assessment of Educational Progress from 2002 to 2003. As a whole, this series of studies represents an argument for the usefulness of metric-free methods for quantifying trends and gaps and the superiority of metric-free methods for comparing trends and gaps across tests with different score scales. (Contains 16 figures, 4 tables, and 3 notes.)
Descriptors: Testing Programs, Test Results, Comparative Testing, Multidimensional Scaling, Matrices, Statistical Analysis, Graphs, Scoring Rubrics, Item Analysis, National Standards, National Surveys, Measurement Objectives, Multivariate Analysis
National Center for Research on Evaluation, Standards, and Student Testing (CRESST). 300 Charles E Young Drive N, GSE&IS Building 3rd Floor, Mailbox 951522, Los Angeles, CA 90095-1522. Tel: 310-206-1532; Fax: 310-825-3883; Web site: http://www.cresst.org.
Publication Type: Reports - Evaluative
Education Level: Elementary Secondary Education
Sponsor: Institute of Education Sciences (ED), Washington, DC.
Authoring Institution: National Center for Research on Evaluation, Standards, and Student Testing, Los Angeles, CA.
Grant or Contract Numbers: N/A