ERIC Number: ED078061
Record Type: RIE
Publication Date: 1973-Mar
Reference Count: 0
The Effects of Choice Weights and Item Weights on the Reliability and Predictive Validity of Aptitude-Type Tests. Final Report.
Bayuk, Robert J.
An investigation was conducted to determine the effects of response-category weighting and item weighting on reliability and predictive validity. Response-category weighting refers to scoring in which, for each category (including omit and "not read"), a weight is assigned that is proportional to the mean criterion score of examinees selecting that category. Item weighting refers to the application of multiple regression techniques to maximize the relationship between a composite of item scores and a criterion. The study of the effects of weighting on reliability indicated that scores resulting from response-category weighting were significantly more reliable than scores corrected for chance success. Response-category weighting in concert with item weighting resulted in scores significantly less reliable than scores corrected for chance success. The study of the effects of the weighting on predictive validity indicated that no gain in predictive validity accrued through the use of response-category weighting as opposed to scores corrected for chance success. Response-category weighting with item weighting resulted in scores significantly more reliable than scores corrected for chance success. (Author/CK)
Publication Type: N/A
Education Level: N/A
Sponsor: National Center for Educational Research and Development (DHEW/OE), Washington, DC. Regional Research Program.
Authoring Institution: Pennsylvania Univ., Philadelphia.