ERIC Number: EJ1160307
Record Type: Journal
Publication Date: 2017
Pages: 25
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1530-5058
EISSN: N/A
Incremental Validity of Multidimensional Proficiency Scores from Diagnostic Classification Models: An Illustration for Elementary School Mathematics
Kunina-Habenicht, Olga; Rupp, André A.; Wilhelm, Oliver
International Journal of Testing, v17 n4 p277-301 2017
Diagnostic classification models (DCMs) hold great potential for applications in summative and formative assessment by providing discrete multivariate proficiency scores that yield statistically driven classifications of students. Using data from a newly developed diagnostic arithmetic assessment that was administered to 2032 fourth-grade students in Germany, we evaluated whether the multidimensional proficiency scores from the best-fitting DCM have an added value, over and above the unidimensional proficiency score from a simpler unidimensional item response theory model, in explaining variance in external (a) school grades in mathematics and (b) unidimensional proficiency scores from a standards-based large-scale assessment of mathematics. Results revealed high classification reliabilities as well as interpretable parameter estimates for items and students for the best-fitting DCM. However, while DCM scores were moderately correlated with both external criteria, only a negligible incremental validity of the multivariate attribute scores was found.
Descriptors: Grade 4, Foreign Countries, Classification, Mathematics Tests, Arithmetic, Mathematics Skills, Grades (Scholastic), Scores, Standardized Tests, Summative Evaluation, Formative Evaluation, Elementary School Students, Models, National Standards, Measurement, Regression (Statistics), Statistical Analysis
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: Grade 4
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Germany
Grant or Contract Numbers: N/A