Adaptive changes in respiratory and cardiovascular responses at high altitude (HA) have been well clarified. However, the central mechanisms underlying HA acclimatization remain unclear. Using voxel-based morphometry (VBM) and diffusion tensor imaging (DTI) with fractional anisotropy (FA) calculation, we investigated 28 Han immigrant residents (17-22 yr) born and raised at HA of 2616-4200 m in Qinghai-Tibetan Plateau for at least 17 years and who currently attended college at sea-level (SL). Their family migrated from SL to HA 2-3 generations ago and has resided at HA ever since. Control subjects were matched SL residents. HA residents (vs. SL) showed decreased grey matter volume in the bilateral anterior insula, right anterior cingulate cortex, bilateral prefrontal cortex, left precentral cortex, and right lingual cortex. HA residents (vs. SL) had significantly higher FA mainly in the bilateral anterior limb of internal capsule, bilateral superior and inferior longitudinal fasciculus, corpus callosum, bilateral superior corona radiata, bilateral anterior external capsule, right posterior cingulum, and right corticospinal tract. Higher FA values in those regions were associated with decreased or unchanged radial diffusivity coinciding with no change of longitudinal diffusivity in HA vs. SL group. Conversely, HA residents had lower FA in the left optic radiation and left superior longitudinal fasciculus. Our data demonstrates that HA acclimatization is associated with brain structural modifications, including the loss of regional cortical grey matter accompanied by changes in the white matter, which may underlie the physiological adaptation of residents at HA.