ERIC Number: EJ1056799
Record Type: Journal
Publication Date: 2015
Abstractor: As Provided
Reference Count: 26
The Effect of Changing Content on IRT Scaling Methods
Keller, Lisa A.; Keller, Robert R.
Applied Measurement in Education, v28 n2 p99-114 2015
Equating test forms is an essential activity in standardized testing, with increased importance with the accountability systems in existence through the mandate of Adequate Yearly Progress. It is through equating that scores from different test forms become comparable, which allows for the tracking of changes in the performance of students from one year to the next. This study compares three different item response theory scaling methods (fixed common item parameter, Stocking & Lord, and Concurrent Calibration) with respect to examinee classification into performance categories, and estimation of the ability parameter, when the content of the test form changes slightly from year to year, and the examinee ability distribution changes. The results indicate that calibration methods, especially concurrent calibration, produced more stable results than the transformation method.
Descriptors: Item Response Theory, Rating Scales, Standardized Tests, Scoring Rubrics, Academic Ability, Test Format, Test Items, Item Analysis, Evaluation Criteria, Test Bias, Error Patterns, Weighted Scores, Test Content, Test Construction, Factor Analysis
Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Authoring Institution: N/A