When switching between tasks, participants are sometimes required to use different response sets for each task. Thus, task switch and response set switch are confounded. In 5 experiments, the authors examined transitions of response within a linear 4-finger arrangement. A random baseline condition was compared with the cuing of specific response subsets grouped by hand or by finger equivalence, and these subsets were examined in both single task and task-switching designs. Results showed that part of the task switch cost is associated with switching between response sets. Furthermore, the analysis revealed a novel effect: When task switching and repetition trials are mixed, a bias towards switching the response and/or hand is found in task repetition trials. Response repetition is hindered when a task switch is expected, even for those trials when a switch of task does not occur. The results demonstrate executive processes involved in task set configuration closely depend on the motoric processing of the response set. The results are also important for current theories of task set control.