Accountability is a high priority in the U.S. education system, and principals play an important role in student achievement. The author examined the means by which superintendents focus on characteristics identified in the literature on effective principals and student achievement when hiring building administrators. The author questioned whether superintendents considered and assessed candidates for the 21 responsibilities of successful principals identified by T. Waters, R. Marzano, and B. McNulty (2004). Results indicated that although superintendents agreed on the key characteristics necessary for principals to succeed, they did not have a credible way to measure the characteristics in the hiring process. In addition, superintendents need to revise their hiring processes to assess those characteristics correlated in principal applicants to improved student achievement. (Contains 5 tables.)