The central complex is a prominent structure in the "Drosophila" brain. Visual learning experiments in the flight simulator, with flies with genetically altered brains, revealed that two groups of horizontal neurons in one of its substructures, the fan-shaped body, were required for "Drosophila" visual pattern memory. However, little is known about the role of other components of the central complex for visual pattern memory. Here we show that a small set of neurons in the ellipsoid body, which is another substructure of the central complex and connected to the fan-shaped body, is also required for visual pattern memory. Localized expression of "rutabaga" adenylyl cyclase in either the fan-shaped body or the ellipsoid body is sufficient to rescue the memory defect of the "rut[superscript 2080]" mutant. We then performed RNA interference of "rutabaga" in either structure and found that they both were required for visual pattern memory. Additionally, we tested the above rescued flies under several visual pattern parameters, such as size, contour orientation, and vertical compactness, and revealed differential roles of the fan-shaped body and the ellipsoid body for visual pattern memory. Our study defines a complex neural circuit in the central complex for "Drosophila" visual pattern memory. (Contains 5 figures and 1 table.)