ERIC Number: EJ891890
Record Type: Journal
Publication Date: 2010-Jul
Pages: 17
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0146-6216
EISSN: N/A
Available Date: N/A
Designing Cognitive Complexity in Mathematical Problem-Solving Items
Daniel, Robert C.; Embretson, Susan E.
Applied Psychological Measurement, v34 n5 p348-364 Jul 2010
Cognitive complexity level is important for measuring both aptitude and achievement in large-scale testing. Tests for standards-based assessment of mathematics, for example, often include cognitive complexity level in the test blueprint. However, little research exists on how mathematics items can be designed to vary in cognitive complexity level. In fact, determining the cognitive complexity level of items is usually based on correspondence to definitions rather than on empirically and theoretically justifiable variables that can predict item difficulty. In the current study, mathematical problem-solving items were designed for varying cognitive complexity levels based on a cognitive model of item processing. Structural variants of item models were designed to vary on two aspects of the cognitive model, the equation source and the number of subgoals. Participants were randomly assigned to test forms that contained different structural variants of the item models. Results from the linear logistic test model, the two-parameter-logistic-constrained model, and a corresponding linear mixed modeling procedure indicated that the item design variables affected both item difficulty and response time. Implications of the results for using structural variants in item generation and for the plausibility of the hypothesized cognitive model are discussed. (Contains 3 figures and 4 tables.)
Descriptors: Mathematics Tests, Problem Solving, Test Items, Difficulty Level, Reaction Time, Word Problems (Mathematics), Item Response Theory, Undergraduate Students, Test Construction
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Assessments and Surveys: Graduate Record Examinations
Grant or Contract Numbers: N/A
Author Affiliations: N/A

Peer reviewed
Direct link
