Teacher observation remains one of the primary data collection methods for analyzing teaching behaviors. States use various evaluation instruments and current trends across the United States show that more states are working to tie teacher evaluation to student performance. The purpose of this study was to determine to what extent there was interrater reliability among elementary principals in a large, urban district using the North Carolina Teacher Evaluation Process to rate classroom teachers. Four randomly selected teachers were videotaped while teaching a lesson of their choice. Thirty-nine randomly selected elementary principals rated each teacher and answered eight questions on a survey regarding their ratings. Levels of agreement among raters were calculated using Randolph's kappa coefficient. Recommendations were presented for increasing reliability among principals to create a more equitable evaluation process for all teachers. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page: http://www.proquest.com/en-US/products/dissertations/individuals.shtml.]