The effective integration of current technologies in teaching and research is a high priority for today's universities. To support the technology skills of university faculty, staff, and students, the subject university's office for faculty training and support, provides free, 24/7 access to a collection of online technology tutorials leased from a professional vendor, PBJ (pseudonym). Despite significant financial investment, the effectiveness of these tutorials has never been evaluated. The purpose of this study was to evaluate the effectiveness of PBJ online technology training tutorials in supporting the technology skills development of faculty, staff, and students at a large university. A customized Web-based survey was used to collect quantitative and qualitative data from PBJ users. Findings revealed that PBJ users are largely satisfied with this online learning resource. However, users also recommended improvements: providing alternative formats/media for flexibility in learning; offering more practice opportunities to skill-build; providing content that is current, comprehensive, and targets high-need areas; and resolving usability issues such as cumbersome navigation. In sum, findings resulted in practical recommendations for improvement to this facet of the university's technology support strategy as well as insights for other universities engaged in similar efforts. Implications for effective e-learning evaluation are offered. (Contains 3 tables and 3 figures.)