ERIC Number: EJ1175066
Record Type: Journal
Publication Date: 2018
Abstractor: As Provided
Assessing Instructional Modalities: Individualized Treatment Effects for Personalized Learning
Beemer, Joshua; Spoon, Kelly; Fan, Juanjuan; Stronach, Jeanne; Frazee, James P.; Bohonak, Andrew J.; Levine, Richard A.
Journal of Statistics Education, v26 n1 p31-39 2018
Estimating the efficacy of different instructional modalities, techniques, and interventions is challenging because teaching style covaries with instructor, and the typical student only takes a course once. We introduce the individualized treatment effect (ITE) from analyses of personalized medicine as a means to quantify individual student performance under different instructional modalities or intervention strategies, despite the fact that each student may experience only one "treatment." The ITE is presented within an ensemble machine learning approach to evaluate student performance, identify factors indicative of student success, and estimate persistence. A key element is the use of a priori student information from institutional records. The methods are motivated and illustrated by a comparison of online and standard face-to-face offerings of an upper division applied statistics course that is a curriculum bottleneck at San Diego State University. The ITE allows us to characterize students that benefit from either the online or the traditional offerings. We find that students in the online class performed at least as well as the traditional lecture class on a common final exam. We discuss the general implications of this analytics framework for assessing pedagogical innovations and intervention strategies, identifying and characterizing at-risk students, and optimizing the individualized student learning environment.
Descriptors: Learning Modalities, Academic Achievement, Intervention, Educational Research, Data Collection, Data Analysis, Comparative Analysis, At Risk Students, Statistics, Individualized Instruction, Instructional Effectiveness, College Students, Units of Study, Introductory Courses, Experimental Groups, Online Courses, Statistical Analysis
Taylor & Francis. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education
Sponsor: National Science Foundation (NSF)
Authoring Institution: N/A
Identifiers - Location: California (San Diego)
Grant or Contract Numbers: 1633130