ERIC Number: ED443881
Record Type: RIE
Publication Date: 2000-Mar
Reference Count: N/A
Bayes Nets in Educational Assessment: Where Do the Numbers Come from? CSE Technical Report.
Mislevy, Robert J.; Almond, Russell G.; Yan, Duanli; Steinberg, Linda S.
Educational assessments that exploit advances in technology and cognitive psychology can produce observations and pose student models that outstrip familiar test-theoretic models and analytic methods. Bayesian inference networks (BINs), which include familiar models and techniques as special cases, can be used to manage belief about students' knowledge and skills in light of what they say and do. BINs for assessments that add new tasks to their item pools and measure different students with different items can be assembled from building-blocks fragments. A student-model BIN (SM-BIN) fragment contains student model variables, which characterize aspects of knowledge. Evidence model BIN fragments (EM-BINs) contain observable variables and pointers to student model variables. Joining Em-BIN fragments to an SM-BIN fragment permits one to update belief about a student as observations arrive in a setting the EM-BIN was constructed to handle. Markov Chain Monte Carlo techniques can be used to estimate the conditional probabilities in the BINs from empirical data, supplemented by expert judgment or substantive theory. Details for the special cases of item response theory and multivariate latent class modeling are given, with a numerical example of the latter. (Contains 6 tables, 5 figures, and 23 references.) (Author/SLD)
Publication Type: Reports - Evaluative
Education Level: N/A
Sponsor: Office of Educational Research and Improvement (ED), Washington, DC.
Authoring Institution: California Univ., Los Angeles. Center for the Study of Evaluation.; Center for Research on Evaluation, Standards, and Student Testing, Los Angeles, CA.