Anterior temporal lobe resection is an effective treatment for refractory temporal lobe epilepsy. The structural consequences of such surgery in the white matter, and how these relate to language function after surgery remain unknown. We carried out a longitudinal study with diffusion tensor imaging in 26 left and 20 right temporal lobe epilepsy patients before and a mean of 4.5 months after anterior temporal lobe resection. The whole-brain analysis technique tract-based spatial statistics was used to compare pre- and postoperative data in the left and right temporal lobe epilepsy groups separately. We observed widespread, significant, mean 7%, decreases in fractional anisotropy in white matter networks connected to the area of resection, following both left and right temporal lobe resections. However, we also observed a widespread, mean 8%, increase in fractional anisotropy after left anterior temporal lobe resection in the ipsilateral external capsule and posterior limb of the internal capsule, and corona radiata. These findings were confirmed on analysis of the native clusters and hand drawn regions of interest. Postoperative tractography seeded from this area suggests that this cluster is part of the ventro-medial language network. The mean pre- and postoperative fractional anisotropy and parallel diffusivity in this cluster were significantly correlated with postoperative verbal fluency and naming test scores. In addition, the percentage change in parallel diffusivity in this cluster was correlated with the percentage change in verbal fluency after anterior temporal lobe resection, such that the bigger the increase in parallel diffusivity, the smaller the fall in language proficiency after surgery. We suggest that the findings of increased fractional anisotropy in this ventro-medial language network represent structural reorganization in response to the anterior temporal lobe resection, which may damage the more susceptible dorso-lateral language pathway. These findings have important implications for our understanding of brain injury and rehabilitation, and may also prove useful in the prediction and minimization of postoperative language deficits.