Recent work has shown that Whorf effects of language on color discrimination are stronger in the right visual field than in the left. Here we show that this phenomenon is not limited to color: The perception of animal figures (cats and dogs) was more strongly affected by linguistic categories for stimuli presented to the right visual field than those presented to the left. Moreover, the magnitude of the visual field asymmetry was reduced when demands on verbal working memory were increased by a secondary task. This reduction did not occur when the secondary task imposed demands on spatial working memory. Taken together, these results demonstrate that the lateralized Whorf effect may be quite general, reflecting an interaction of linguistic and perceptual codes primarily in the left hemisphere.