Synergistic Meaning-Making in Multimodal Science Texts：A Pedagogical Framework for Visual-Verbal Literacy 
Jixiu Xing

Heilongjiang Polytechnic，Harbin Heilongjiang，150000；

Abstract: Multimodality in education takes on an extended perspective on literacy to incorporate the scope of multimodal communicative practices in which youngsters are engaged in the present digital age. With the development of advanced technology, more and more semiotic resources are showing up in different texts, and English texts are getting increasingly multimodal due to the concurrent usage of devices from multiple semiotic communication modalities. Employing multimodal analysis, the author analyzes the scientific article “Every Cloud Tells a Story” from the following parts: genre, field and experiential meanings, tenor and interpersonal meaning, mode and textual meanings, and multimodality in the classroom. The analysis shows that visual thinking is vital in understanding the text’s meaning and helps learners understand how multimodal discourse uses semiotic resources to produce meaning. Language aspects, such as organization, cohesiveness, grammatical features, verb types, vocabulary choices, and layout, should also be assigned significant priority in the classroom to assist students in understanding how multimodal texts employ many semiotic resources to construct meanings.

Keywords：Multimodal；Genre；Multimodal Literacy

References

[1]Butt, D., Fahey, R., Feez, S., Spinks, S., & Yallop, C. (2000). Using functional grammar: An explorer’s guide (2nd ed.). Sydney: National Centre for English Language Teaching and Research (NCELTR).

[2]Gerot, L. (1995). Different genres, different meanings. In Gerot, L., Making Sense of Text: The Context-Text Relationship, pp.17–36.

[3]Gerot, L. & Wignell, P. (1994). The genre-grammar connection. In Gerot, L., & Wignell, P., Making Sense of Functional Grammar, pp.189-224.

[4]Goodman, S. (1996). Visual English. In Goodman, S & Graddol, D. Redesigning English: New Texts, New Identities. pp.38–51.

[5]Halliday, M., & Matthiessen, C. (2014). An introduction to functional grammar. London: Routledge.

[6]Knox, J. S. (2008). Online newspapers and TESOL classrooms: A multimodal perspective. In Unsworth, L. Multimodal Semiotics: Functional Analysis in Contexts of Education. pp.139–148.

[7]Kress, G., & Van Leeuwen, T. (2020). Reading images: The grammar of visual design. London: Routledge.

[8]Lim, F.V., Toh, W., & Nguyen, T.T.H. (2022). Multimodality in the English language classroom: A systematic review of literature. Linguistics and Education, 2022 (69).

[9]Li, M. J. (2023). A Multimodal Analysis of Teachers Two-handed Gestures in English Vocabulary Teaching. Lecture Notes in Education Psychology and Public Media.

[10]Royce, T. (2002). Multimodality in the TESOL classroom: exploring visual-verbal synergy. TESOL Quarterly, 36:2, pp. 191–205.

[11]Shin, D. S., Cimasko, T., & Yi, Y. (2020). Development of metalanguage for multimodal composing: A case study of an L2 writer’s design of multimedia texts. Journal of Second Language Writing, 47, 100714.

[12]Unsworth, L. (2001). Teaching Multiliteracies across the curriculum: changing contexts of text and image in classroom practice. Buckingham: Open University Press.