ERIC Number: EJ1111414
Record Type: Journal
Publication Date: 2006-May
Pages: 30
Abstractor: As Provided
ISBN: N/A
ISSN: EISSN-2330-8516
EISSN: N/A
Cognitive Diagnosis for NAEP Proficiency Data. Research Report. ETS RR-06-08
Xu, Xueli; von Davier, Matthias
ETS Research Report Series, May 2006
More than a dozen statistical models have been developed for the purpose of cognitive diagnosis. These models are supposed to extract a much finer level of information from item responses than traditional unidimensional item response models. In this paper, a general diagnostic model (GDM) was used to analyze a set of simulated sparse data and real data from National Assessment of Educational Progress (NAEP) assessments. The purpose of this study was to find out (a) whether the parameters can be recovered for a sparse data matrix in the framework of the GDM and (b) how to estimate group characteristics for large survey data, such as NAEP, in the framework of the GDM. The results of the simulation study show that GDM parameters can be recovered satisfactorily. The GDM under single group and multiple group assumptions were employed to fit NAEP assessment data. The results under these two assumptions and between the GDM and the statistics derived using the operational NAEP model were compared. The findings indicate that it is possible to conduct cognitive diagnosis for NAEP proficiency data.
Descriptors: Statistical Analysis, National Competency Tests, Diagnostic Tests, Item Response Theory, Models, Data Analysis, Guidelines, Simulation, Comparative Analysis, Item Analysis, Mastery Learning, Reading Tests, Grade 12, Test Items, Gender Differences, Racial Differences, Scores, Mathematics Tests, High School Students, Limited English Speaking, Disabilities
Educational Testing Service. Rosedale Road, MS19-R Princeton, NJ 08541. Tel: 609-921-9000; Fax: 609-734-5410; e-mail: RDweb@ets.org; Web site: https://www.ets.org/research/policy_research_reports/ets
Publication Type: Journal Articles; Reports - Research
Education Level: Grade 12; Secondary Education; High Schools
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Assessments and Surveys: National Assessment of Educational Progress
Grant or Contract Numbers: N/A