The aim of this study was to propose a new conceptualization of early number sense. Six-year-old students' (n = 204) number sense was tracked from the beginning of Grade 1 through the beginning of Grade 2. Data analysis suggested that elementary arithmetic, conventional arithmetic, and algebraic arithmetic contributed to the latent construct early number sense, and the invariance of the model over time was validated empirically. Algebraic arithmetic represents the dimension of early number sense that moves beyond conventional arithmetic and encompasses an abstract understanding of the relations between numbers. A parallel process growth model showed that the three components of number sense adopt a linear growth rate. A structural model showed that the growth rate of the algebraic arithmetic component has a direct effect on the growth rate of conventional arithmetic, and subsequently the growth rate of conventional arithmetic predicts the growth rate of elementary arithmetic.