Purpose: Many children with communication disorders have reading comprehension difficulties, and in order to target interventions effectively it is important to identify which specific components of comprehension are especially challenging. The current study explored the relationship between text-inferencing skill, autistic symptomatology, and language phenotype. Method: Typically developing children (n = 32), children with autism spectrum disorders (ASD) and age-appropriate structural language skills (n = 27), children with ASD and language impairment (n = 15), and nonautistic children with language impairment (n = 12) were administered the Neale Analysis of Reading Ability-Revised (Neale, 1997), and responses to literal and inferential questions were analyzed. Results: For the sample as a whole, inferencing competence was predicted by oral language skill, with autistic symptomatology not contributing significant variance. However, although only 12.5% of typically developing children found answering inferential questions disproportionally challenging relative to answering literal questions, one third of children with age-appropriate structural language skills demonstrated inferencing deficits, as did over 50% of children with language impairments, regardless of ASD status. Conclusion: These results indicate that children with language impairments are most likely to find inferencing challenging, but practitioners will also need to monitor the inferencing skills of children with ASD and good language and single-word reading skills.