Background: Social phobia aggregates in families. The genetic contribution to intergenerational transmission is modest, and parenting is considered important. Research on the effects of social phobia on parenting has been subject to problems of small sample size, heterogeneity of samples and lack of specificity of observational frameworks. We addressed these problems in the current study. Methods: We assessed mothers with social phobia (N = 84) and control mothers (N = 89) at 10 weeks in face-to-face interactions with their infants, and during a social challenge, namely, engaging with a stranger. We also assessed mothers with generalised anxiety disorder (GAD) (N = 50). We examined the contribution to infant social responsiveness of early infant characteristics (neonatal irritability), as well as maternal behaviour. Results: Mothers with social phobia were no less sensitive to their infants during face-to-face interactions than control mothers, but when interacting with the stranger they appeared more anxious, engaged less with the stranger themselves, and were less encouraging of the infant's interaction with the stranger; infants of index mothers also showed reduced social responsiveness to the stranger. These differences did not apply to mothers with GAD and their infants. Regression analyses showed that the reduction in social responsiveness in infants of mothers with social phobia was predicted by neonatal irritability and the degree to which the mother encouraged the infant to interact with the stranger. Conclusions: Mothers with social phobia show specific parenting difficulties, and their infants show early signs of reduced social responsiveness that are related to both individual infant differences and a lack of maternal encouragement to engage in social interactions.