Tabular presentations of student data often hide information about the switches in responses by individual students over the course of a semester. We extend unpublished work by Kanim on "escalator diagrams," which show changes in student responses from correct to incorrect (and vice versa) while representing pre- and postinstruction…

Previously, we analyzed the Force and Motion Conceptual Evaluation in terms of a resources-based model that allows for clustering of questions so as to provide useful information on how students correctly or incorrectly reason about physics. In this paper, we apply model analysis to show that the associated model plots provide more information…

Free-response research-based assessments, like the Colorado Upper-division Electrostatics Diagnostic (CUE), provide rich, fine-grained information about students' reasoning. However, because of the difficulties inherent in scoring these assessments, the majority of the large-scale conceptual assessments in physics are multiple choice. To…

Students taking introductory physics are rarely exposed to computational modeling. In a one-semester large lecture introductory calculus-based mechanics course at Georgia Tech, students learned to solve physics problems using the VPython programming environment. During the term, 1357 students in this course solved a suite of 14 computational…

Over the course of four years, we have researched and transformed a key course in the career of an undergraduate physics major--junior-level electricity and magnetism. With the aim of educating our majors based on a more complete understanding of the cognitive and conceptual challenges of upper-division courses, we used principles of active…

As part of an effort to systematically improve our junior-level E&M I course, we have developed a tool to assess student conceptual learning of electrostatics at the upper division. Together with a group of physics faculty, we established a list of learning goals for the course that, with results from student observations and interviews, served as…

In this study, we examine introductory physics students' ability to perform analogical reasoning between two isomorphic problems which employ the same underlying physics principles but have different surface features. Three hundred sixty-two students from a calculus-based and an algebra-based introductory physics course were given a quiz in the…

This paper introduces five commonly used approaches to analyzing multiple-choice test data. They are classical test theory, factor analysis, cluster analysis, item response theory, and model analysis. Brief descriptions of the goals and algorithms of these approaches are provided, together with examples illustrating their applications in physics…

We suggest one redefinition of common clusters of questions used to analyze student responses on the Force and Motion Conceptual Evaluation. Our goal is to propose a methodology that moves beyond an analysis of student learning defined by correct responses, either on the overall test or on clusters of questions defined solely by content. We use…

We investigate short-term learning from hints and feedback in a Web-based physics tutoring system. Both the skill of students and the difficulty and discrimination of items were determined by applying item response theory (IRT) to the first answers of students who are working on for-credit homework items in an introductory Newtonian physics…

Investigations related to expertise in problem solving and ability to transfer learning from one context to another are important for developing strategies to help students perform more expertlike tasks. Here we analyze written responses to a pair of nonintuitive isomorphic problems given to introductory physics students and discussions with a…

Pre- and postcourse assessment has become a very important tool for education research in physics and other areas. The web offers an attractive alternative to in-class paper administration, but concerns about web-based administration include reliability due to changes in medium, student compliance rates, and test security, both question leakage…

Pre-testing and post-testing is a commonly used method in Physics Education Research to assess student learning gains. It is well recognized in the community that timings and incentives in delivering conceptual tests can impact test results. However, it is difficult to control these variables across different studies. As a common practice, a…

In a recent study we showed that physics students' problem-solving performance can depend strongly on problem representation, and that giving students a choice of problem representation can have a significant impact on their performance [ P. B. Kohl and N. D. Finklestein, Phys. Rev. ST. Phys. Educ. Res. 1, 010104 (2005) ] In this paper, we…

Decades of education research have shown that students can simultaneously possess alternate knowledge frameworks and that the development and use of such knowledge are context dependent. As a result of extensive qualitative research, standardized multiple-choice tests such as Force Concept Inventory and Force-Motion Concept Evaluation tests…