Genetic factors make a substantial contribution to inter-individual variability in cognitive function. A recent meta-analysis of genome-wide association studies identified two loci, AKAP6 and MIR2113, that are associated with general cognitive function. Here, we extend this previous research by investigating the association of MIR2113 and AKAP6 with baseline and longitudinal non-linear change across a broad spectrum of cognitive domains in a community-based cohort of older adults without dementia. Two single nucleotide polymorphisms (SNPs), MIR211-rs10457441 and AKAP6-rs17522122 were genotyped in 1570 non-demented older Australians of European ancestry, who were examined up to 4 times over 12 years. Linear mixed effects models were used to examine the association between AKAP6 and MIR2113 with cognitive performance in episodic memory, working memory, vocabulary, perceptual speed and reaction time at baseline and with linear and quadratic rates of change. AKAP6-rs17522122*T was associated with worse baseline performance in episodic memory, working memory, vocabulary and perceptual speed, but it was not associated with cognitive change in any domain. MIR2113-rs10457441*T was associated with accelerated decline in episodic memory. No other associations with baseline cognitive performance or with linear or quadratic rate or cognitive changes were observed for this SNP. These results confirm the previous finding that AKAP6 is associated with performance across multiple cognitive domains at baseline but not with cognitive decline, while MIR2113 primarily affects the rate at which memory declines over time.