Download full text
Download full text
ERIC Number: EJ1110973
Record Type: Journal
Publication Date: 2009-Jul
Abstractor: As Provided
Reference Count: 13
Effect of Repeaters on Score Equating in a Large-Scale Licensure Test. Research Report. ETS RR-09-27
Kim, Sooyeon; Walker, Michael E.
ETS Research Report Series, Jul 2009
This study investigated the subgroup invariance of equating functions for a licensure test in the context of a nonequivalent groups with anchor test (NEAT) design. Examinees who had taken a new, to-be-equated form of the test were divided into three subgroups according to their previous testing experience: (a) repeaters who previously took the reference form, to which the new form would be equated; (b) repeaters who previously took any form other than the reference form; and (c) first-time test takers for whom the new form was the first exposure to the test. Equating functions obtained with two subgroups, all repeaters, and first-time test takers were similar to those obtained with the total group, supporting score equatability of the two forms. However, when the repeater subgroup was divided into two groups based on the particular form examinees took previously, subgroup equating functions substantially differed from the total-group equating function, indicating subgroup dependency of score equating. The results indicate that repeater membership needs to be more clearly specified to assess the impact of repeaters on score equating. Such clarification may be especially necessary for high-stakes licensure tests because repeaters tend to perform more poorly on such tests than first-time test takers.
Descriptors: Equated Scores, Licensing Examinations (Professions), Test Construction, Repetition, Norm Referenced Tests, Test Wiseness, High Stakes Tests, Regression (Statistics)
Educational Testing Service. Rosedale Road, MS19-R Princeton, NJ 08541. Tel: 609-921-9000; Fax: 609-734-5410; e-mail: RDweb@ets.org; Web site: https://www.ets.org/research/policy_research_reports/ets
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Authoring Institution: N/A