Psychological research suggests that foreign-language vocabulary acquisition recruits the phonological loop for verbal working memory. To depict the neural underpinnings and shed light on the process of foreign language learning, we conducted functional magnetic resonance imaging of Japanese participants without previous exposure to the Uzbek language using learning of novel Uzbek words. During encoding, spoken Uzbek words and corresponding visual objects were shown, and subjects either overtly repeated the words (phonological rehearsal) or overtly rehearsed numbers (phonological suppression). Phonological rehearsal improved the encoding performance. A learning-related decrease in rehearsal-specific activation was found in the left fusiform gyrus, right inferior temporal gyrus, and right cerebellum. Recollection of the phonologically rehearsed words activated the right cerebellum and left fusiform gyrus more prominently than recollection of the phonologically suppressed words in a performance-dependent manner. The phonological loop might provide the temporal and fragile registration of the articulatory pattern that is converted into a more durable form in the right cerebellum, which is in turn integrated with the object information in the fusiform gyrus.