Stigma is widely perceived in the lives of families with autism spectrum disorder (ASD) yet large, systematic studies have not been undertaken. Following Link and Phelan's ("Ann Rev Sociol" 27:363-385, 2001) model, this study of 502 Simons Simplex Collection families details how different factors contribute to stigma and how each appears to increase the overall difficulty of raising a child with ASD. The model begins with the child's behavioral symptoms and then specifies stigma processes of stereotyping, rejection, and exclusion. Autism behaviors contribute both to the difficulty families experience raising a child with autism and to the stigma processes associated with those behaviors. Stigma also plays a significant role (0.282, p < 0.001) in predicting how difficult life is overall for parents.