Currently, the application of the network resources and various means of teaching such as multimedia into the classroom has led to the demonstration of multimodality in college English teaching. This paper analyzes the current status of college English teaching and the existing problems, elaborates the research trends of the theory of multimodal discourse analysis, and aims to explore the question as how to construct college English teaching model from the perspective of multimodal discourse. Under the multimodality-based college English teaching model, teachers should concentrate on cultivating students' multi-literacy, coordinating different modalities, to achieve the teaching objectives.