ERIC Number: EJ1022040
Record Type: Journal
Publication Date: 2014
Pages: 21
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0211-2159
EISSN: N/A
Detection of Q-Matrix Misspecification Using Two Criteria for Validation of Cognitive Structures under the Least Squares Distance Model
Romero, Sonia J.; Ordoñez, Xavier G.; Ponsoda, Vincente; Revuelta, Javier
Psicologica: International Journal of Methodology and Experimental Psychology, v35 n1 p149-169 2014
Cognitive Diagnostic Models (CDMs) aim to provide information about the degree to which individuals have mastered specific attributes that underlie the success of these individuals on test items. The Q-matrix is a key element in the application of CDMs, because contains links item-attributes representing the cognitive structure proposed for solve the test. Using a simulation study we investigated the performance of two model-fit statistics (MAD and LSD) to detect misspecifications in the Q-matrix within the least squares distance modeling framework. The manipulated test design factors included the number of respondents (300, 500, 1000), attributes (1, 2, 3, 4), and type of model (conjunctive vs disjunctive). We investigated MAD and LSD behavior under correct Q-matrix specification, with Q-misspecifications and in a real data application. The results shows that the two model-fit indexes were sensitive to Q-misspecifications, consequently, cut points were proposed to use in applied context.
Descriptors: Evaluation Methods, Q Methodology, Matrices, Sampling, Simulation, Least Squares Statistics, Item Response Theory, Sample Size, Cutting Scores, Indexes, Cognitive Structures
University of Valencia. Dept. Metodologia, Facultad de Psicologia, Avda. Blasco Ibanez 21, 46010 Valencia, Spain. Tel: +34-96-386-4100; Web site: http://www.uv.es/revispsi/
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A