Though many cognitive abilities exhibit marked decline over the adult years, individual differences in rates of change have been observed. In the current study, biometrical latent growth models were used to examine sources of variability for ability level (intercept) and change (linear and quadratic effects) for verbal, fluid, memory, and perceptual speed abilities in the Swedish Adoption/Twin Study of Aging. Genetic influences were more important for ability level at age 65 and quadratic change than for linear slope at age 65. Expected variance components indicated decreasing genetic and increasing nonshared environmental variation over age. Exceptions included one verbal and two memory measures that showed increasing genetic and nonshared environmental variance. The present findings provide support for theories of the increasing influence of the environment with age on cognitive abilities.