Friendships and social participation are key domains of quality of life for individuals with intellectual disabilities. This study examined the friendships, social and recreational activities, and family social networks of individuals with intellectual disabilities from two distinct diagnostic groups: individuals diagnosed with fragile X syndrome (n = 81) compared with those diagnosed with autistic disorder (n = 226). Within each diagnostic group, individuals in two developmental stages were compared: adolescence and adulthood. Quality of life in friendships and social participation domains was notably low for individuals with fragile X and those with autism. Individuals with fragile X had more friendships and a less negative social impact on the family than individuals with autism. Across both groups, adolescents spent less time with friends and neighbors, and more time in exercising, than did adults.