Demographic and clinical factors may influence assessment of autism symptoms. This study evaluated these correlates and also examined whether social communication and interaction and restricted/repetitive behavior provided unique prediction of autism spectrum disorder diagnosis. We analyzed data from 7352 siblings included in the Interactive Autism Network registry. Social communication and interaction and restricted/repetitive behavior symptoms were obtained using caregiver-reports on the Social Responsiveness Scale. Demographic and clinical correlates were covariates in regression models predicting social communication and interaction and restricted/repetitive behavior symptoms. Logistic regression and receiver operating characteristic curve analyses evaluated the incremental validity of social communication and interaction and restricted/repetitive behavior domains over and above global autism symptoms. Autism spectrum disorder diagnosis was the strongest correlate of caregiver-reported social communication and interaction and restricted/repetitive behavior symptoms. The presence of comorbid diagnoses also increased symptom levels. Social communication and interaction and restricted/repetitive behavior symptoms provided significant, but modest, incremental validity in predicting diagnosis beyond global autism symptoms. These findings suggest that autism spectrum disorder diagnosis is by far the largest determinant of quantitatively measured autism symptoms. Externalizing (attention deficit hyperactivity disorder) and internalizing (anxiety) behavior, low cognitive ability, and demographic factors may confound caregiver-report of autism symptoms, potentially necessitating a continuous norming approach to the revision of symptom measures. Social communication and interaction and restricted/repetitive behavior symptoms may provide incremental validity in the diagnosis of autism spectrum disorder.