Elucidating the neural basis of joint attention in infancy promises to yield important insights into the development of language and social cognition, and directly informs developmental models of autism. We describe a new method for evaluating responding to joint attention performance in infancy that highlights the 9- to 10-month period as a time interval of maximal individual differences. We then demonstrate that fractional anisotropy in the right uncinate fasciculus, a white matter fiber bundle connecting the amygdala to the ventral-medial prefrontal cortex and anterior temporal pole, measured in 6-month-olds predicts individual differences in responding to joint attention at 9 months of age. The white matter microstructure of the right uncinate was not related to receptive language ability at 9 months. These findings suggest that the development of core nonverbal social communication skills in infancy is largely supported by preceding developments within right lateralized frontotemporal brain systems. (Contains 4 figures and 1 table.) [Several members of the Infant Brain Imaging Study (IBIS) Network also contributed to this article: J. Piven, H.C. Hazlett, C. Chappell, S. Dager, A. Estes, D. Shaw, K. Botteron, R. McKinstry, J. Constantino, J. Pruett, R. Schultz, S. Paterson, L. Zwaigenbaum, A. C. Evans, D. L. Collins, G. B. Pike, P. Kostopolous, S. Das, G. Gerig, M. Styner, H. Gu, P. Sullivan, and F. Wright.]