ERIC Number: EJ1044841
Record Type: Journal
Publication Date: 2014-Dec
Abstractor: As Provided
Reference Count: 11
Reliability of the ADI-R for the Single Case-Part II: Clinical versus Statistical Significance
Cicchetti, Domenic V.; Lord, Catherine; Koenig, Kathy; Klin, Ami; Volkmar, Fred R.
Journal of Autism and Developmental Disorders, v44 n12 p3154-3160 Dec 2014
In an earlier investigation, the authors assessed the reliability of the ADI-R when multiple clinicians evaluated a single case, here a female 3 year old toddler suspected of having an autism spectrum disorder (Cicchetti et al. in "J Autism Dev Disord" 38:764-770, 2008). Applying the clinical criteria of Cicchetti and Sparrow ("Am J Men Def" 86:127-137, 1981); and those of Cicchetti et al. ("Child Neuropsychol" 126-137, 1995): 74% of the ADI-R items showed 100% agreement; 6% showed excellent agreement; 7% showed good agreement; 3% manifested average agreement; and the remaining 10% evidenced poor agreement. In this follow-up investigation, the authors described and applied a novel method for determining levels of statistical significance of the reliability coefficients obtained in the earlier investigation. It is based upon a modification of the Z test for comparing a given level of inter-examiner reliability with a lower limit value of 70% (Dixon and Massey in "Introduction to statistical analysis." McGraw-Hill, New York, 1957). Results indicated that every item producing a clinically acceptable level of inter-examiner reliability was also statistically significant. However, the reverse was not true, since a number of the items with statistically significant reliability levels did not reach levels of agreement that were clinically meaningful. This indicated that clinical significance was an accurate marker of statistical significance. The generalization of these findings to other areas of diagnostic interest and importance is also examined.
Descriptors: Autism, Females, Toddlers, Pervasive Developmental Disorders, Test Reliability, Test Items, Statistical Significance, Clinical Diagnosis, Disability Identification
Springer. 233 Spring Street, New York, NY 10013. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-348-4505; e-mail: firstname.lastname@example.org; Web site: http://www.springerlink.com
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Authoring Institution: N/A