ERIC Number: EJ929739
Record Type: Journal
Publication Date: 2011
Abstractor: As Provided
Reference Count: 49
Using the Attribute Hierarchy Method to Make Diagnostic Inferences about Examinees' Cognitive Skills in Critical Reading
Wang, Changjiang; Gierl, Mark J.
Journal of Educational Measurement, v48 n2 p165-187 Sum 2011
The purpose of this study is to apply the attribute hierarchy method (AHM) to a subset of SAT critical reading items and illustrate how the method can be used to promote cognitive diagnostic inferences. The AHM is a psychometric procedure for classifying examinees' test item responses into a set of attribute mastery patterns associated with different components from a cognitive model. The study was conducted in two steps. In step 1, three cognitive models were developed by reviewing selected literature in reading comprehension as well as research related to SAT Critical Reading. Then, the cognitive models were validated by having a sample of students think aloud as they solved each item. In step 2, psychometric analyses were conducted on the SAT critical reading cognitive models by evaluating the model-data fit between the expected and observed response patterns produced from two random samples of 2,000 examinees who wrote the items. The model that provided best data-model fit was then used to calculate attribute probabilities for 15 examinees to illustrate our diagnostic testing procedure.
Descriptors: Reading Comprehension, Test Items, Critical Reading, Protocol Analysis, Probability, Inferences, Thinking Skills, Cognitive Ability, Models, Cognitive Measurement, Diagnostic Tests, Psychometrics, College Entrance Examinations
Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail: firstname.lastname@example.org; Web site: http://www.wiley.com/WileyCDA/
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Authoring Institution: N/A
Identifiers - Assessments and Surveys: SAT (College Admission Test)