Human female life expectancy is higher than that of males. Intriguingly, it has been reported that women display faster rates of age-related cognitive decline and a higher prevalence of Alzheimer’s disease (AD). To assess the molecular bases of these contradictory trends, we analyzed differences in expression changes with age between adult males and females, in four brain regions. In the superior frontal gyrus (SFG), a part of the prefrontal cortex, we observed manifest differences between the two sexes in the timing of age-related changes, that is, sexual heterochrony. Intriguingly, age-related expression changes predominantly occurred earlier, or at a faster pace, in females compared to men. These changes included decreased energy production and neural function and up-regulation of the immune response, all major features of brain aging. Furthermore, we found that accelerated expression changes in the female SFG correlated with expression changes observed in AD, as well as stress effects in the frontal cortex. Accelerated aging-related changes in the female SFG transcriptome may provide a link between a higher stress exposure or sensitivity in women and the higher prevalence of AD.