ERIC Number: EJ1102992
Record Type: Journal
Publication Date: 2016
Abstractor: As Provided
Using Networks to Visualize and Analyze Process Data for Educational Assessment
Zhu, Mengxiao; Shu, Zhan; von Davier, Alina A.
Journal of Educational Measurement, v53 n2 p190-211 Sum 2016
New technology enables interactive and adaptive scenario-based tasks (SBTs) to be adopted in educational measurement. At the same time, it is a challenging problem to build appropriate psychometric models to analyze data collected from these tasks, due to the complexity of the data. This study focuses on process data collected from SBTs. We explore the potential of using concepts and methods from social network analysis to represent and analyze process data. Empirical data were collected from the assessment of Technology and Engineering Literacy, conducted as part of the National Assessment of Educational Progress. For the activity sequences in the process data, we created a transition network using weighted directed networks, with nodes representing actions and directed links connecting two actions only if the first action is followed by the second action in the sequence. This study shows how visualization of the transition networks represents process data and provides insights for item design. This study also explores how network measures are related to existing scoring rubrics and how detailed network measures can be used to make intergroup comparisons.
Descriptors: Measurement, Data Collection, National Competency Tests, Scoring Rubrics, Comparative Analysis, Educational Assessment, Social Networks, Network Analysis, Test Items, Problem Solving, Eye Movements, Feedback (Response)
Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail: email@example.com; Web site: http://www.wiley.com/WileyCDA
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Authoring Institution: N/A
Identifiers - Assessments and Surveys: National Assessment of Educational Progress