ERIC Number: ED451243
Record Type: Non-Journal
Publication Date: 2001-Feb
Reference Count: N/A
Suggestions for the Evaluation and Use of Concordance Results. ACT Research Report Series.
Hanson, Bradley A.; Harris, Deborah J.; Pommerich, Mary; Sconing, James A.; Yi, Qing
This paper discusses the evaluation and appropriate uses of concordances defined as linkages between scores on two tests that do not measure the same underlying construct. A conceptualization of score equivalence in terms of a latent variable model for test scores is presented. Two factors involved in evaluating the quality of a linkage of two scores are discussed: (1) the initial comparability of the scores; and (2) whether comparability is desired for scores of individual examinees or for score distributions. It is concluded that the only appropriate use of concordant scores of individuals is in situations where empirical evidence exists that the inferences made using concordant scores and the inferences made using actual scores are not too different. The use of concordant score distributions is likely to be less problematic than the use of concordant scores of individuals. Still, evidence should exist that a concordant score distribution does not differ greatly from the distribution of the actual scores in any population in which the concordance is used. Examples are presented to illustrate the evaluation and appropriate uses of concordances. (Contains 2 figures, 2 tables, and 14 references.) (Author/SLD)
ACT Research Report Series, P.O. Box 168, Iowa City, IA 52243-0168. Tel: 319-337-1028; Web site: http://www.act.org.
Publication Type: Reports - Descriptive
Education Level: N/A
Authoring Institution: American Coll. Testing Program, Iowa City, IA.