Three experiments examined the effects of target-distractor (T-D) similarity and old age on the efficiency of searching for single targets and enumerating multiple targets. Experiment 1 showed that increasing T-D similarity selectively reduced the efficiency of enumerating small (less than 4) numerosities (subitizing) but had little effect on enumerating larger numerosities (counting) or searching for a single target. Experiment 2 provided converging evidence using fixation frequencies and a finer range of T-D similarities. Experiment 3 showed that TD similarity had a greater impact on older than on young adults, but only for subitizing. The data are discussed in terms of the mechanisms and architecture of early visual tagging, dissociable effects in search and enumeration, and the effects of aging on visual processing.