NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ864837
Record Type: Journal
Publication Date: 2009
Pages: 26
Abstractor: As Provided
Reference Count: 41
ISSN: ISSN-0895-7347
Testing Expert-Based and Student-Based Cognitive Models: An Application of the Attribute Hierarchy Method and Hierarchy Consistency Index
Leighton, Jacqueline P.; Cui, Ying; Cor, M. Ken
Applied Measurement in Education, v22 n3 p229-254 2009
The objective of the present investigation was to compare the adequacy of two cognitive models for predicting examinee performance on a sample of algebra I and II items from the March 2005 administration of the SAT[TM]. The two models included one generated from verbal reports provided by 21 examinees as they solved the SAT[TM] items, and the other generated from the judgment of a content expert. Using the attribute hierarchy method (Leighton, Gierl, & Hunka, 2004) and the hierarchy consistency index (Cui, Leighton, Gierl, & Hunka, 2006), the predictive adequacy of the two cognitive models was tested with three samples of varying size. Results indicated that the student-based model predicted the test performance of examinees of moderately high ability with excellent accuracy but not the test performance of examinees of moderate (or average) ability. In contrast, the expert-based model was more consistent, predicting the test performance of both moderately high ability examinees and moderate ability examinees with reasonable accuracy. Expert-based models may be more predictive of the general response processes used by diverse groups of examinees, whereas student-based models may be preferred when making inferences about examinees at specific ability levels. (Contains 5 footnotes, 4 tables and 3 figures.)
Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: Grade 10; High Schools
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: New York
Identifiers - Assessments and Surveys: Preliminary Scholastic Aptitude Test; SAT (College Admission Test)