We examined whether a temporal interval between an action and its sensory effect is integrated in the cognitive action structure in a bidirectional fashion. In 3 experiments, participants first experienced that actions produced specific acoustic effects (high and low tones) that occurred temporally delayed after their actions. In a following test phase, the tones that were presented as action effects in the previous phase were now presented as primes for the responses that had caused them previously and, critically, also as primes for the interval that previously separated action and effects. The tones were presented as go-signals in a free-choice test and as response-imperative stimuli in a forced-choice test. In the free choice test, participants were more likely to choose responses consistent with the previous pairing, but these responses were initiated slower than responses that were inconsistent with previous action-effect learning (Experiment 1). Effect-consistent responses were also initiated slower in the speeded forced-choice test (Experiment 2). These observations suggest that retrieval of a long action-effect interval slows down response initiation. In Experiment 3, response-contingent effects were presented with a long or short delay after a response. Reaction times in both, a forced-choice and free-choice setup, were faster in the short- than in the long-interval condition. We conclude that temporal information about the interval between actions and effects is integrated into a cognitive action structure and is automatically retrieved during response selection.