The purpose of this research study is to design, develop, and validate an instrument for measuring undergraduate students' conceptions of artificial intelligence in education. Following systematic procedures, our team created a conceptual framework through an extant literature review and used it to create an initial item pool of 48-items across eight educational application domains of AI (Ahmad et al. (2020). We conducted think aloud protocols with a small group (N = 4) of undergraduate students and an expert review with researchers experienced in AI, psychometrics, and education (N = 3) to ensure the intended meaning of the language was aligned with our framework. Next, we recruited undergraduate student participants (N = 445) from two public universities and one state college in the southeastern United States to complete the final survey. Data were randomly split into two datasets, one for fitting a Confirmatory Factor Analysis model, and the other one for testing the model. The final model retained 37-items across the eight factors of conceptions of AI in education: (AI1) intelligent tutoring system, (AI2) students' grading and evaluation, (AI3) students' retention and dropout, (AI4) sentiment analysis in education, (AI5) recommendation systems, (AI6) classroom monitoring and visual analysis, (AI7) personalized learning, and (AI8) student's performance prediction. We present the results, provide interpretations and explanations, outline the limitations and delimitations of the study, and highlight recommendations for future research and practice.