The nation's lawmakers have frequently voiced the basic principle that important policy decisions should be evidence based. In this commentary, the authors describe the approach the U.S. Department of Education has taken in its Increasing Educational Productivity project. The authors argue that the department's actual practice in this instance has fallen short of the rhetorical embrace of evidence-based decision making, and they explain the potential harm done when leaders do not heed the importance of grounding policy in high-quality research. (Contains 5 notes.)