Individuals with autism spectrum disorder (ASD) have been found to view social scenes differently compared to typically developing (TD) peers, but results can vary depending on context and age. We used eye-tracking in children and adults (age 6-63) to assess allocation of visual attention in a dynamic social orientation paradigm previously used only in younger children. The ASD group (n = 94) looked less at the actor's face compared to TD (n = 38) when they were engaged in activity (mean percentage of looking time, ASD = 30.7% vs TD = 34.9%; Cohen's d = 0.56; p value < 0.03) or looking at a moving toy (24.5% vs 33.2%; d = 0.65; p value < 0.001). Findings indicate that there are qualitative differences in allocation of visual attention to social stimuli across ages in ASD.