This article takes a critical approach to unsettling the apathy around Black girls' and women's mathematics achievement and participation. I discuss how prevailing narratives about White girls and women, as well as Black boys and men, make the existence of coherent narratives of Black girls and women in mathematics essentially impossible. I argue that Black girls and women serve as a referent group providing a quiet, invisible, and menial labor of sanitizing theoretical and empirical spaces for other demographic groups. Using an example, I describe the process through which Black girls and women are rendered invisible in mathematics. To conclude, I call for the creation, occupation, and sharing of positive, socio-epistemic spaces that allow for the visibility of Black girls and women in mathematics.