Teacher and school accountability systems based on high-stakes tests are ubiquitous throughout the United States and appear to be growing as a catalyst for reform. As a result, educators have increased the proportion of instructional time devoted to test preparation. Although guidelines for what constitutes appropriate and inappropriate test preparation exist, they are outdated and need revision. The current article proposes new guidelines within the framework of standards-based assessment. It also examines the test preparation practices in 32 third- and fifth-grade classrooms and examines the relationship between student test performance and test preparation activities using a two-level Hierarchical Linear Model. Instruction on tested objectives using items like those presented on the state test, decontextualized practice, and teaching test taking skills offered no student achievement benefit relative to general instruction on the state standards leading us to conclude that test preparation was not beneficial.