Background: There is debate as to whether chronic irritability (operationalized as severe mood dysregulation, SMD) is a developmental form of bipolar disorder (BD). Although structural brain abnormalities in BD have been demonstrated, no study compares neuroanatomy among SMD, BD, and healthy volunteers (HV) either cross-sectionally or over time. Furthermore, the developmental trajectories of structural abnormalities in BD or SMD are unknown. This study provides such data in BD, SMD, and HV. Methods: An optimized, modulated voxel-based morphometry (VBM) analysis was conducted on structural MRI scans from 201 children (78 SMD, 55 BD, and 68 HV). In addition, 92 children (31 SMD, 34 BD, and 27 HV) were rescanned after 2 years (mean interval 1.99 plus or minus 0.94 years), to compare time-related changes among the three groups. Results: Cross-sectionally, the groups differed in gray matter (GM) volume in presupplementary motor area (pre-SMA), dorsolateral prefrontal cortex (DLPFC), insula, and globus pallidus. The cortical differences were driven mainly by increased GM volume in HV compared with BD and SMD. In globus pallidus, there was increased GM in BD compared with HV and SMD. Longitudinally, group-by-time interactions were evident in two clusters in the superior/inferior parietal lobule (R SPL/IPL) and in the precuneus. In both clusters, the interactions were driven by an abnormal increase in volume in BD. Conclusions: Cross-sectionally, both BD and SMD are associated with structural abnormalities in frontal cortex, insula, and basal ganglia. Although some of these deficits overlap (insula and DLPFC), others differentiate SMD and BD (pre-SMA and globus pallidus). Abnormal developmental trajectories in lateral parietal cortex and precuneus are present in, and unique to, BD. Because of the high proportion of co-occurring ADHD in the SMD subjects, we could not separate effects of ADHD from those of SMD, and future research including a nonirritable ADHD group must address this issue. (Contains 6 tables and 2 figures.)