NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ683922
Record Type: Journal
Publication Date: 2004-Dec-1
Pages: 37
Abstractor: Author
ISBN: N/A
ISSN: ISSN-1530-5058
EISSN: N/A
Specifying and Refining a Measurement Model for a Computer-Based Interactive Assessment
Levy, Roy; Mislevy, Robert J.
International Journal of Testing, v4 n4 p333-369 Dec 2004
The challenges of modeling students' performance in computer-based interactive assessments include accounting for multiple aspects of knowledge and skill that arise in different situations and the conditional dependencies among multiple aspects of performance. This article describes a Bayesian approach to modeling and estimating cognitive models in such situations, both in terms of statistical machinery and actual instrument development. The method taps the knowledge of experts to provide initial estimates for the probabilistic relations among the variables in a multivariate latent variable model and refines these estimates using Markov chain Monte Carlo procedures. This process is illustrated in the context of Networking Performance Skill System (NetPASS), a computer-based interactive assessment in the domain of computer networking. We describe a parameterization of the relations in NetPASS via an ordered polytomous item-response model and detail the updating of the model with observed data via Bayesian statistical procedures ultimately being provided by Markov chain Monte Carlo estimation.
Lawrence Erlbaum Associates, Inc., Journal Subscription Department, 10 Industrial Avenue, Mahwah, NJ 07430-2262. Tel: 800-926-6579 (Toll Free); e-mail: journals@erlbaum.com.
Publication Type: Journal Articles; Reports - Descriptive
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A