Many studies have shown that the visual cortex of blind humans is activated in non-visual tasks. However, the electrophysiological signals underlying this cross-modal plasticity are largely unknown. Here, we characterize the neuronal population activity in the visual and auditory cortex of congenitally blind humans and sighted controls in a complex cognitive task. We recorded magnetoencephalographic responses from participants performing semantic categorization of meaningful sounds that followed the presentation of a semantically related or unrelated haptic object. Source analysis of the spectrally resolved magnetoencephalography data revealed that: (i) neuronal responses to sounds were stronger and longer lasting in the auditory cortex of blind subjects; (ii) auditory stimulation elicited strong oscillatory responses in the visual cortex of blind subjects that closely resembled responses to visual stimulation in sighted humans; (iii) the signal in the gamma frequency range was modulated by semantic congruency between the sounds and the preceding haptic objects; and (iv) signal power in the gamma range was correlated on a trial-by-trial basis between auditory and visual cortex in blind subjects, and the strength of this correlation was modulated by semantic congruency. Our results suggest that specifically oscillatory activity in the gamma range reflects non-visual processing in the visual cortex of blind individuals. Moreover, our results provide evidence that the deprived visual cortex is functionally integrated into a larger network that serves non-visual functions.