ERIC Number: EJ1051816
Record Type: Journal
Publication Date: 2014-Nov
Abstractor: As Provided
Replication and Robustness in Developmental Research
Duncan, Greg J.; Engel, Mimi; Claessens, Amy; Dowsett, Chantelle J.
Developmental Psychology, v50 n11 p2417-2425 Nov 2014
Replications and robustness checks are key elements of the scientific method and a staple in many disciplines. However, leading journals in developmental psychology rarely include explicit replications of prior research conducted by different investigators, and few require authors to establish in their articles or online appendices that their key results are robust across estimation methods, data sets, and demographic subgroups. This article makes the case for prioritizing both explicit replications and, especially, within-study robustness checks in developmental psychology. It provides evidence on variation in effect sizes in developmental studies and documents strikingly different replication and robustness-checking practices in a sample of journals in developmental psychology and a sister behavioral science--applied economics. Our goal is not to show that any one behavioral science has a monopoly on best practices, but rather to show how journals from a related discipline address vital concerns of replication and generalizability shared by all social and behavioral sciences. We provide recommendations for promoting graduate training in replication and robustness-checking methods and for editorial policies that encourage these practices. Although some of our recommendations may shift the form and substance of developmental research articles, we argue that they would generate considerable scientific benefits for the field.
Descriptors: Replication (Evaluation), Robustness (Statistics), Developmental Psychology, Educational Research, Journal Articles, Research Methodology, Research Reports, Effect Size, Educational Practices, Behavioral Science Research, Audits (Verification), Test Reliability, Test Validity, Item Analysis, Comparative Analysis
American Psychological Association. Journals Department, 750 First Street NE, Washington, DC 20002. Tel: 800-374-2721; Tel: 202-336-5510; Fax: 202-336-5502; e-mail: firstname.lastname@example.org; Web site: http://www.apa.org
Publication Type: Journal Articles; Information Analyses; Reports - Evaluative
Education Level: N/A
Sponsor: National Science Foundation
Authoring Institution: N/A
Grant or Contract Numbers: 0322356