Studies using fMRI have demonstrated that visual stimuli activate auditory cortex in deaf subjects. Given the low temporal resolution of fMRI, it is uncertain whether this activation is associated with initial stimulus processing. Here, we used MEG in deaf and hearing subjects to evaluate whether auditory cortex, devoid of its normal input, comes to serve the visual modality early in the course of stimulus processing. In line with previous findings, visual activity was observed in the auditory cortex of deaf, but not hearing, subjects. This activity occurred within 100-400 ms of stimulus presentation and was primarily over the right hemisphere. These results add to the mounting evidence that removal of one sensory modality in humans leads to neural reorganization of the remaining modalities.