This paper reports on the development and implementation of a process of peer evaluation of teaching to assess librarian instruction in a high-enrollment online information literacy course for undergraduates. This paper also traces a shift within libraries from peer coaching to peer evaluation models. One common model for peer evaluation, using pre- and post-observation meetings between instructor and evaluator, as well as a formal summative report, has been adapted to focus attention on key aspects of online teaching. The paper also discusses the need for evaluating librarians' online teaching performance, as distinct from online course design.