ERIC Number: EJ1168486
Record Type: Journal
Publication Date: 2017-Dec
Pages: 19
Abstractor: As Provided
ISBN: N/A
ISSN: EISSN-2330-8516
EISSN: N/A
Articulation of Cut Scores in the Context of the Next-Generation Assessments. Research Report. ETS RR-17-34
Kannan, Priya; Sgammato, Adrienne
ETS Research Report Series, Dec 2017
Logistic regression (LR)-based methods have become increasingly popular for predicting and articulating cut scores. However, the precision of predictive relationships is largely dependent on the underlying correlations between the predictor and the criterion. In two simulation studies, we evaluated the impact of varying the underlying grade-level correlations on the resultant bias in cut scores articulated using the LR method. In Study 1, we compared different articulation methods (LR and equipercentile smoothing), and in Study 2, we evaluated different criteria for linking (e.g., adjacent grade or end of course). The collective results indicate that as correlations became smaller, cut scores articulated using LR-based predictions became increasingly biased when compared to a true value obtained under perfect correlation. The predicted values are significantly biased for lower achievement levels, irrespective of the linking criteria used. Results from these studies suggest that the LR method must be used with caution, particularly when articulating cut scores for multiple achievement levels.
Descriptors: Regression (Statistics), Cutting Scores, Prediction, Accuracy, Correlation, Simulation, Statistical Bias, Grades (Scholastic), Academic Achievement, Accountability, Educational Legislation, Federal Legislation, Elementary Secondary Education, Mathematics Tests, Evaluation Methods, Multivariate Analysis
Educational Testing Service. Rosedale Road, MS19-R Princeton, NJ 08541. Tel: 609-921-9000; Fax: 609-734-5410; e-mail: RDweb@ets.org; Web site: https://www.ets.org/research/policy_research_reports/ets
Publication Type: Journal Articles; Reports - Research
Education Level: Elementary Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Massachusetts
Identifiers - Laws, Policies, & Programs: No Child Left Behind Act 2001
Identifiers - Assessments and Surveys: Massachusetts Comprehensive Assessment System
Grant or Contract Numbers: N/A