Recent advocacy and legislation across states calls for stricter accountability measures and closure of low-performing charter schools. As charter schools try to meet the multiple accountability standards they face from federal, state, local authorities, and their own associations, it is important to understand how these numerous frameworks intersect. Important lessons may be gleaned from previous accountability efforts as states redesign accountability under the Every Student Succeeds Act. This article analyzes the numerous frameworks faced by California charter school, home to nearly 20% of the nations charter school tpdel students, during the No Child Left Behind era. These frameworks use measures of test score levels, test score growth, and relative performance to determine which charter schools should be closed. Our analysis of how charter schools measure up provides some cautions about using test-based accountability metrics in high-stakes decisions. Notably, we find greater variation in test score performance for charter schools than traditional public schools, greater instability in test scores for small schools compared to large schools, and that many measures disproportionately identify schools serving large concentrations of socioeconomically disadvantaged students. Further, we find substantial overlap between the multiple frameworks, suggesting advocacy organizations' efforts to improve accountability may be better focused on encouraging clarity and enforcement of existing accountability mechanisms rather than developing new frameworks.