ERIC Number: ED230569
Record Type: RIE
Publication Date: 1983-Feb
Reference Count: 0
Effects on Score Distributions of Deleting an Unkeyable Item from a Test.
Dorans, Neil J.
A formal analysis is presented of the effects of item deletion on equating/scaling functions and reported score distributions. The phrase "item deletion" refers to the process of changing the original key of a flawed item to either all options correct, including omits, or to no options correct, i.e., not scoring the flawed item. There are two aspects to the present analysis. The first aspect is analytical, focusing on the development of a formal model for the item deletion effect by decomposing it into its constituent elements. The second component of the analysis is empirical, involving the use of actual Scholastic Aptitude Test data to illustrate and supplement the analytical results. The analytical decomposition demonstrates how the effects of item properties, test properties, individual examinee responses and rounding rules combine to produce the item deletion effect on the equating/scaling function and candidate scores. In addition, the analytical component of the report examines the effects of not scoring vs. scoring all options correct and the effects of re-equating vs. not re-equating, as well as the interaction between the decision to re-equate or to not re-equate and the scoring option chosen for the flawed item. (Author/PN)
Descriptors: College Entrance Examinations, Equated Scores, Item Analysis, Mathematical Models, Psychometrics, Scaling, Scores, Secondary Education, Statistical Analysis, Test Construction, Test Items
Educational Testing Service, Research Publications Rm 116, Princeton, N.J. 08541.
Publication Type: Reports - Research
Education Level: N/A
Authoring Institution: Educational Testing Service, Princeton, NJ.
Identifiers: Educational Testing Service; Flawed Items; Item Deletion; Scholastic Aptitude Test; Score Distribution
Note: Some tables contain small print.