The federal definition of emotional disturbance (ED) has been heavily criticized as vaguely defined and poorly operationalized yet there has not been a formal analysis of the reliability of the ED criteria. This study examined the reliability of the federal criteria for a special education designation of ED. A total of 179 school psychologists reviewed a mock special education report, made an eligibility determination, and provided information about their eligibility decision. In all, 56 participants found the student met ED eligibility criteria using 16 different combinations of the five criteria. Krippendorff's a, a statistic preferred for content analysis, was calculated as a measure of criterion reliability. Results indicated extremely poor reliability (a = 0.2011). These findings demonstrate the importance of redefining the existing criteria.