Online delivery methods offer much promise for anytime, anywhere adult learning. As a method of outreach, and to provide support for just-in-time learning, teacher educators are increasingly deciding to design Web sites that are online, resource-based learning environments for teachers and preservice teachers. Automated evaluation tools and data collection methods can help such Web site designers develop and use online, resource-based learning environments to meet their goals of providing high quality learning opportunities for teachers. This article presents a three-pronged approach for evaluating issues of pedagogical design and user-centered functionality in online, resource-based Web sites. Checklist, Web site traffic analysis, and talk aloud protocols are each described and then illustrated through their application to a site aimed at educating teachers about technology integration. We discuss the relevance for developing effective learning environments when teacher educators apply this evaluation approach to resource-based learning environments. (Contains 1 table and 3 footnotes.)