Moment-to-moment intraindividual variability (IIV) in cognitive speed is a sensitive behavioral indicator of the integrity of the aging brain and brain damage, but little information is known about how IIV changes from being relatively low in young adulthood to substantially higher in older adulthood. We evaluated possible age group, sex, and task differences in IIV across adulthood using a large, neurologically normal, population-based sample evaluated thrice over 8 years. Multilevel modeling controlling for education, diabetes, hypertension, and anxiety and depressive symptoms showed expected age group differences in baseline IIV across the adult lifespan. Increase in IIV was not found until older adulthood on simple tasks but was apparent even in the 40s on a more complex task. Females were more variable than males but only at baseline. IIV in cognitive speed is a fundamental behavioral characteristic associated with growing older, even among healthy adults.