In this era of rapid development in multimedia and technology, there is a growing awareness of the use of multiple semiotic resources in meaning-making (Fei, 2004). Music videos specifically harbor meaning within their semiotic features of visual communication. They also exert an enormous influence on the popularity of music (Fei, 2004). Music…

Research in a broad range of disciplines has explored how specific modes of communication can contribute to meaning-making in diverse texts such as picture books, films, short animated features, and to a lesser extent video games. Fields such as literacy, semiotics, and critical communication studies have aimed to reveal different interpretative…

The present study is aimed at unpacking Latino migrants' metaphorical conceptualizations of their language learning trajectories as sites for construction and negotiation of their complex identities throughout the process of transnational migration. In particular, our work intends to describe and interrogate three adult Latino migrants' personal,…

Multimodal composing is the construction of meanings through a combination of semiotic modes such as visual, audio, and textual to create multimodal texts. Studies have investigated the application of multimodal composing in the English language, in content area classrooms, and within various educational ESL and EFL contexts. However, the…

COVID-19 e-books have emerged as means for communicating information about coronavirus and the resulting disease to children during the pandemic. This material is multimodal, with images forming the most prevalent and crucial semiotic mode. Except for representational and compositional meaning, an image realises interpersonal meanings. The degree…

Online learning has gained increasing attention during the COVID-19 pandemic. Teachers face social exigencies to design ways of knowledge dissemination in online instruction. We posit that understanding how knowledge can be represented in successful online academic genres can inform teachers on how they can design students' online learning…

This qualitative study examines the semiotic meanings communicated through multiple representations in the teaching of an advanced undergraduate course in biology. Scientific discourse is intrinsically multimodal in nature; in other words, science is discussed and researched using multiple modes that convey meaning (Lemke, 1998). Therefore, to…

With the advancement of digital technology, the roles of teachers and students are slowly changing. The classroom is on the verge of becoming a new, more open place, one with fewer barriers to the rest of society. Our purpose in this paper is to discuss how the creation of videos with mathematical content may contribute to this process of…

Purpose: Young children often enter formal schooling with a range of digital experiences, including using apps on tablets and engaging with interactive educational toys. The convergence and increased accessibility of digital resources has made it more convenient for young children to navigate multiple modes (e.g. words, images, sound and movement)…

This study reports on a case study about multimodal work in a primary physics classroom focusing on forces. Previous research reports that students benefit from multimodal work in science classrooms. Yet, few systematic studies have been performed to reveal how students represent their experiences and ideas of science phenomena over time within…

Semiotics is simply defined as the sign-using to represent a mathematical concept in a problem-solving. Semiotic reasoning of constructing concept is a process of drawing a conclusion based on object, representamen (sign), and interpretant. This paper aims to describe the phases of semiotic reasoning of elementary students in constructing the…

As literacy researchers continue to investigate how young students make sense of texts, specifically picture books, attention has expanded beyond the role that written language plays in reading comprehension to the various ways that visual images, typography, design elements, and digital devices support and challenge young readers during the act…

Tackling mathematics tasks often involves reading and interpreting different semiotic resources such as natural language (words), mathematical notation, and images. This study aims to enhance knowledge of how meaning relations, in the form of "cohesive ties" between and within different semiotic resources, are related to how difficult it…

This article suggests a tool for analysing diagrams in mathematical texts. The starting point for this tool is Halliday's Systemic Functional Grammar (SFG), which considered language as a social practice. Kress and Van Leeuwen (2006) applied Halliday's SFG to images, suggesting a grammar for reading images. Morgan (1996) adopted Halliday's SFG and…

The curriculum used in educating young people has the ability either to serve as a catalyst for the development of a science identity or potentially sway individuals away from the fields of science, technology, engineering, and math (STEM). This study critically analyzed gender representation across 10 secondary education biology/life science…