Developing immersive learning systems is challenging due to their multidisciplinary nature, involving game design, pedagogical modelling, computer science, and the application domain. The diversity of technologies, practices, and interventions makes it hard to explore solutions systematically. A new methodology called Multimodal Immersive Learning…

The cognitive theory of multimedia learning (Mayer, 2021, 2022), which seeks to explain how people learn academic material from words and graphics, has developed over the past four decades. Although the name and graphical representation of the theory have evolved over the years, the core ideas have been constant--dual channels (i.e., humans have…

Genetically modified organisms (GMOs) and their uses are often misunderstood. Consumers are regularly unsure what GMOs are, or if they are safe for consumption and the environment. Contradictory and sometimes inaccurate information is available from numerous sources, and challenges consumers and others to separate the facts from sensationalized…

The present research conducted two experiments with an intelligent tutoring system to investigate the overall and dynamic impact of emotional support from a pedagogical agent (PA). In Experiment 1, a single factor intergroup design was used to explore the impact of PA's emotional support (supportive vs. non-supportive) on learners' emotions,…

Multimodal composing, which has sometimes been referred to synonymously as multimodal composition or multimodal writing, is the use of different semiotic resources (e.g., audio, visual, gestural, and/or spatial resources) in addition to linguistic text for making meaning. Notably, multimodal composing is neither a new type of writing nor a new…

Background: Rapid growth in early childhood device usage has raised critical questions about the potential impact of digital storybooks on children's reading outcomes. The current study examined how two types of multimedia animations in digital storybooks -- animations of storyline elements or details in the illustrations -- influenced the story…

Students' engagement in multimodal remediation of learning material in the form of slideshow presentations dominates universities. Yet, diversification of learning artifacts through the creation of more diverse types of multimodal content is scarce. The current article therefore proposes an innovative project during which students summarize…

The COVID-19 pandemic and the subsequent lockdown measures in many countries have increased young people's engagement with digital media. The digital divide goes beyond just having devices and includes differences in how well young people can use digital technology. In this paper, we shift our attention beyond screen time to the nature of the…

Slide decks are a ubiquitous form of communication in both academia and business, and business communication instructors must be able to model and teach multimedia design principles. The literature regarding multimedia design has traditionally fallen into two camps: the cognitive school, focused on designing multimedia messages that accommodate…

The spatial contiguity principle is that people learn and perform better when corresponding printed text and graphics are placed near rather than far from each other on the screen or page. This is a well-established design principle in multimedia learning. However, there is insufficient research to establish the appropriate distance between text…

To consider whether multimodality matters, literacy researchers and educators must first explore the theoretical foundations of social semiotics and multimodality, how these theories have evolved to address current social, cultural, and material contexts, and the implications of these theories on literacy pedagogy. In addition to conceptualizing…

Authenticity in simulation-based learning is linked to cognitive processes implicated in learning. However, evidence on authenticity across formats is insufficient. We compared three case-based settings and investigated the effect of discontinuity in simulation on perceived authenticity. In a quasi-experiment, we compared formats of simulation in…

Digital edible literacies (DEL) are a new media phenomenon that has recently surfaced in social media but has not been examined in scholarly literature before. I exemplify the entanglements of food, media, and children's stories in three DEL exemplars shared on a private blog, Instagram, and connected Meta channels. Drawing on a genre analysis, I…

This study analyzed the contribution of spontaneous note-taking when undergraduates studied expository texts and videos. The study examined whether spontaneous note-taking had any effect on comprehension and if it was different for digital texts, presentation videos, or videos with decorative, irrelevant images. In addition, it explored whether…

Integrating multiple representations into a coherent mental model is one of the challenges when learning with multimedia. In this experimental study (N = 173), we examined how highlighting corresponding information in text-graph learning material can help higher education students to make the necessary connections and improve learning outcomes in…