The E4 allele of the ApoE gene has consistently been shown to be related to an increased risk of Alzheimer's disease (AD). The E4 allele is also associated with functional and structural grey matter (GM) changes in healthy young, middle-aged and older subjects. Here, we assess volumes of deep grey matter structures of 22 healthy younger ApoE4 carriers and 22 non-carriers (20–38 years). Volumes of the nucleus accumbens, amygdala, caudate nucleus, hippocampus, pallidum, putamen, thalamus and brain stem were calculated by FMRIB's Integrated Registration and Segmentation Tool (FIRST) algorithm. A significant drop in volume was found in the right hippocampus of ApoE4 carriers (ApoE4+) relative to non-carriers (ApoE4−), while there was a borderline significant decrease in the volume of the left hippocampus of ApoE4 carriers. The volumes of no other structures were found to be significantly affected by genotype. Atrophy has been found to be a sensitive marker of neurodegenerative changes, and our results show that within a healthy young population, the presence of the ApoE4+ carrier gene leads to volume reduction in a structure that is vitally important for memory formation. Our results suggest that the hippocampus may be particularly vulnerable to further degeneration in ApoE4 carriers as they enter middle and old age. Although volume reductions were noted bilaterally in the hippocampus, atrophy was more pronounced in the right hippocampus. This finding relates to previous work which has noted a compensatory increase in right hemisphere activity in ApoE4 carriers in response to preclinical declines in memory function. Possession of the ApoE4 allele may lead to greater predilection for right hemisphere atrophy even in healthy young subjects in their twenties.