ERIC Number: EJ1111404
Record Type: Journal
Publication Date: 2006-Mar
Pages: 32
Abstractor: As Provided
ISBN: N/A
ISSN: EISSN-2330-8516
EISSN: N/A
The Correlation between the Scores of a Test and an Anchor Test. Research Report. ETS RR-06-04
Sinharay, Sandip; Holland, Paul
ETS Research Report Series, Mar 2006
It is a widely held belief that an anchor test used in equating should be a miniature version (or "minitest") of the tests to be equated; that is, the anchor test should be proportionally representative of the two tests in content and statistical characteristics. This paper examines the scientific foundation of this belief, especially regarding statistical characteristics. In particular, we study, through several simulation studies and a real data example, the correlation of the raw score of the total test with several anchor tests, including those having statistical characteristics that differ from those of the total test. Anchor tests with spread of item difficulties less than that of a total test are shown to consistently have higher correlations than a minitest. Because of the general view that higher correlations of the scores of an anchor test and the total test lead to better equating, our results suggest that requiring an anchor test to mimic the statistical characteristics of the total test may be too restrictive and may not be optimal.
Descriptors: Test Items, Equated Scores, Correlation, Tests, Statistical Data, Simulation, Difficulty Level, Item Response Theory, Regression (Statistics)
Educational Testing Service. Rosedale Road, MS19-R Princeton, NJ 08541. Tel: 609-921-9000; Fax: 609-734-5410; e-mail: RDweb@ets.org; Web site: https://www.ets.org/research/policy_research_reports/ets
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A