NotesFAQContact Us
Search Tips
ERIC Number: ED528982
Record Type: Non-Journal
Publication Date: 2011-Nov-22
Pages: 37
Abstractor: As Provided
Reference Count: 8
How Does the Knowledge of Subgroup Membership of Examinees Affect the Prediction of True Subscores? Research Report. ETS RR-11-43
Haberman, Shelby J.; Sinharay, Sandip
Educational Testing Service
Subscores are reported for several operational assessments. Haberman (2008) suggested a method based on classical test theory to determine if the true subscore is predicted better by the corresponding subscore or the total score. Researchers are often interested in learning how different subgroups perform on subtests. Stricker (1993) and Livingston and Rupp (2004) found that the mean difference between the subgroups was not the same for the different subscores. We suggest new methods to investigate whether the quality of prediction of the true subscore improves if the investigator knows about the subgroup membership. We applied our suggested method to data from 4 operational testing programs. We found that the quality of prediction of the true subscore does not improve if the investigator knows the subgroup membership. We also found that whether the subscores have value added does not depend on the subgroups. (Contains 7 tables, 10 figures and 3 notes.)
Educational Testing Service. Rosedale Road Mailstop 19R, Princeton, NJ 08541-0001. Tel: 609-921-9000; Fax: 609-734-5410; Web site:
Publication Type: Reports - Evaluative
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: Educational Testing Service