ERIC Number: EJ1221057
Record Type: Journal
Publication Date: 2019
Pages: 13
Abstractor: As Provided
ISBN: N/A
ISSN: EISSN-2469-9896
EISSN: N/A
How Null Results Can Be Significant for Physics Education Research
Conlin, Luke D.; Kuo, Eric; Hallinen, Nicole R.
Physical Review Physics Education Research, v15 n2 Article 020104 Jul-Dec 2019
A central aim of physics education research is to understand the processes of learning and use that understanding to inform instruction. To this end, researchers often conduct studies to measure the effect of classroom interventions on student outcomes. Many of these intervention studies have provided an empirical foundation of reformed teaching techniques, such as active engagement. However, many times there is not sufficient evidence to conclude that the intervention had the intended effect, and these null results often end up in the proverbial file drawer. In this paper, we argue that null results can make significant contributions to physics education research, even if the results are not statistically significant. First, we review social science and biomedical research that documents widespread publication bias against null results, exploring why it occurs and how it can hurt the field. We then present three cases from physics education research to highlight how studies that yield null results can contribute to our understanding of teaching and learning. Finally, we distill from these studies some general principles for learning from null results, proposing that we should evaluate them not on whether they reject the null hypothesis but according to their potential for generating new understanding.
Descriptors: Physics, Outcomes of Education, Probability, Teaching Methods, Intervention, Case Studies, Social Science Research, Biomedicine, Hypothesis Testing, Educational Research, Scientific Concepts, Science Instruction
American Physical Society. One Physics Ellipse 4th Floor, College Park, MD 20740-3844. Tel: 301-209-3200; Fax: 301-209-0865; e-mail: assocpub@aps.org; Web site: http://prst-per.aps.org
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: National Science Foundation (NSF); Institute of Education Sciences (ED)
Authoring Institution: N/A
IES Funded: Yes
Grant or Contract Numbers: 09602; R305B150014