ERIC Number: EJ1078771
Record Type: Journal
Publication Date: 2015-Dec
Abstractor: As Provided
Reference Count: N/A
Taking Advantage of Automated Assessment of Student-Constructed Graphs in Science
Vitale, Jonathan M.; Lai, Kevin; Linn, Marcia C.
Journal of Research in Science Teaching, v52 n10 p1426-1450 Dec 2015
We present a new system for automated scoring of graph construction items that address complex science concepts, feature qualitative prompts, and support a range of possible solutions. This system utilizes analysis of spatial features (e.g., slope of a line) to evaluate potential student ideas represented within graphs. Student ideas are then scored with rubrics based upon the knowledge integration framework (Linn & Eylon, 2011). We tested the effectiveness of this system on graphs constructed by 397 8th-12th grade students preceding, during, and following a curriculum focusing on graphs of motion. Comparison with human-coded responses indicates that the automated scoring system is very accurate (??=?0.9). Also, ideas represented in constructions were generally similar to those demonstrated in written explanations; although individual students often shifted ideas between items. Learning gains were similar in both written and graph construction formats. Overall, these results suggest that graph construction is a valid and efficient means of evaluating students' complex ideas about data representation in science. We discuss the opportunities for incorporating graph construction into new science content areas, such as graphs representing density. We consider the implications of this system for generating automated, adaptive guidance to support instruction.
Descriptors: Scoring, Graphs, Scientific Concepts, Prompting, Science Instruction, Scoring Rubrics, Secondary School Students, Grade 8, Grade 9, Grade 10, Grade 11, Grade 12, Motion, Coding, Automation, Technology Uses in Education, Comparative Analysis, Accuracy, Evaluation Methods
Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail: email@example.com; Web site: http://www.wiley.com/WileyCDA
Publication Type: Journal Articles; Reports - Research
Education Level: Secondary Education; Grade 8; Junior High Schools; Middle Schools; Elementary Education; Grade 9; High Schools; Grade 10; Grade 11; Grade 12
Sponsor: National Science Foundation (NSF)
Authoring Institution: N/A
IES Grant or Contract Numbers: 1119670|1418423