Download full text
Download full text
ERIC Number: ED562339
Record Type: Non-Journal
Publication Date: 2015
Reference Count: 12
How Do We Match Instructional Effectiveness with Learning Curves?
Branum-Martin, Lee; Mehta, Paras D.; Taylor, W. Patrick; Carlson, Coleen D.; Lei, Xiaoxuan; Hunter, C. Vincent; Francis, David J.
Society for Research on Educational Effectiveness
In order to examine the effectiveness of instruction, the authors confront formidable statistical problems, including multivariate structure of classroom observations, longitudinal dependence of both classroom observations and student outcomes. As the authors begin to examine instruction, classroom observations involve multiple variables for which they need valid measurement models. These classrooms, however, involve students who are not only growing, but typically switching classrooms each year. While measurement models for multiple variables are commonplace as confirmatory factor analysis (CFA), and individual student growth can be modeled under switching classrooms with multilevel analysis software, connecting these two types of models is currently challenging and limited. Consequently, it becomes difficult to jointly examine two types of important substantive questions. First, the authors are interested in the nature of instruction: to what extent can they fit a measurement model which is consistent over time and what might that say about teachers and classrooms with respect to the stability of instructional quality? Second, how might instructional quality relate to student growth, given changing classrooms essentially every year? In order to answer these two substantive questions, the authors can fit a model of instructional observations, a model of student growth, and then join these two models. The authors present an empirical example involving a cohort sequential design of 13,236 students over three years (grades 1-3), nested in 974 classrooms, 762 teachers, in 146 schools. The measurement properties of the classroom observations were strong, with good fit and high validity coefficients (loadings). The instructional factors suggest an increase in quality and homogeneity across grades. Issues for future investigation include missing data, clustering due to teachers, and instructional carryover effects across years. Figures are appended.
Descriptors: Instructional Effectiveness, Learning Processes, Multivariate Analysis, Classroom Observation Techniques, Measurement, Cohort Analysis, Research Design, Elementary School Students, Goodness of Fit, Structural Equation Models, Factor Analysis, Longitudinal Studies
Society for Research on Educational Effectiveness. 2040 Sheridan Road, Evanston, IL 60208. Tel: 202-495-0920; Fax: 202-640-4401; e-mail: firstname.lastname@example.org; Web site: http://www.sree.org
Publication Type: Reports - Research
Education Level: Elementary Education
Authoring Institution: Society for Research on Educational Effectiveness (SREE)