ERIC Number: EJ1078149
Record Type: Journal
Publication Date: 2015
Abstractor: As Provided
Reference Count: 58
The Beast of Aggregating Cognitive Load Measures in Technology-Based Learning
Leppink, Jimmie; van Merriënboer, Jeroen J. G.
Educational Technology & Society, v18 n4 p230-245 2015
An increasing part of cognitive load research in technology-based learning includes a component of repeated measurements, that is: participants are measured two or more times on the same performance, mental effort or other variable of interest. In many cases, researchers aggregate scores obtained from repeated measurements to one single sum or average score per participant and use these aggregated scores in subsequent analysis. This paper demonstrates some dangers of this commonly encountered aggregation approach and presents two comprehensive alternatives: Split-plot analysis of variance (ANOVA) and more flexible two-level regression analysis. The core message of this paper is that the application of the aggregation approach can seriously distort our view of effects and relations of interest and should therefore not be used in cognitive load research. Multilevel analysis of repeated measurements data can account for various features of the data and constitutes a best practice.
Descriptors: Cognitive Processes, Difficulty Level, Measures (Individuals), Statistical Analysis, Educational Technology, Computer Assisted Instruction, Regression (Statistics), Best Practices, Rating Scales, Randomized Controlled Trials, Computer Software, Simulation
International Forum of Educational Technology & Society. Athabasca University, School of Computing & Information Systems, 1 University Drive, Athabasca, AB T9S 3A3, Canada. Tel: 780-675-6812; Fax: 780-675-6973; Web site: http://www.ifets.info
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Authoring Institution: N/A