Current，Language communication research in multimodular vision has become an international hotspot，In our country, it is also in the ascendant。Language communication is essentially multimodal，But traditional linguistic research lacks enough attention to the fact that "the significance of human language communication is built by multiple modes"，This will lead to insufficient understanding of language communication。The transformation of language communication research from single -mode to multi -mode analysis，Reflecting a new view of language。

　Bet365 app download

Under different fields and paths，Scholars' definition of "modal" is different，If sensory and corresponding nervous system、symbol resource、Information presentation method, etc.。But no matter how defined，Based on a fact: Construction of meaning in human language communication、Delivery and understanding behaviors need to call a variety of symbol resources and multiple sensory systems with multi -mode synergy in the corresponding brain area，If you process the text symbol, you need to call the visual mode system、Treatment of odor symbols requires the olfactory mode of smell、Processing sound symbol requires calling the hearing mode system, etc.。

From the perspective of language understanding and output brain mechanism，Jerry A. Fodor believes that the mental mechanism of human brain handling language is highly modular;。Although there are differences in the language device model of Jimsky's language instrument and Ford's speech module，But both thinks that language organs or speech modules are a talent，And an autonomy、Self -sufficient system。bet365 Play online games But，Language studies based on multimodalism as the basis, hold a negative attitude towards this talent theory，It is believed that the language development and aging of individuals are closely related to multi -mode sensory，Children's language ability is gradually constructing after birth with the support of multimodalism.、developed，Therefore, it is advocated to examine the language acquisition of children based on a multi -mode perspective、Adult language communication、The language erosion of the elderly has fallen to various types of language obstacles and other problems。For example，Jean Piaget (Jean Piaget) uses symbolism as a boundary，Divided the development of human behavior into two stages in the front and back。The previous stage of the symbol is called "feeling -movement behavior" (about 1 and a half to 2 years old)，Babies mainly interact with the outside world through the multi -mode sensory system，The meaning transmission at this time must rely on multiple symbol modal。Another example，In addition to the reasons for aging，Elderly people will cause multi -mode sensory aging due to growth、Decreased efficiency or obstacles，These will affect the language understanding and output of the elderly，There is a error of language、Eclipse、Labels and other phenomena。

Start from the perspective of multi -mode，Examine the development and change of the communication ability of individual language，Study multi -mode discourse in the communication of language，greatly expand the vision and dimension of language communication research。Where，Study from the perspective of language symbols Starting multi -modal discourse, the earliest is the system functional language school，"Language is Social Symbol" view of "M. A. K. Halliday) view。For example，Michael bet365 best casino games O’TOOLE's "The Language Showing Art" was published in 1994、"Gunter Kress) and Theo Van Leeuwen's" Reading: Visual Design Grammar "published in 1996。This theory thinks，Other symbolic systems outside the language are also desirable resources，Can reflect the three yuan function as language (concept function、Interpersonal Function and Functions)，and accordingly developed visual grammar，The path and method of multi -mode discourse analysis have been opened。From this perspective，Multi -mode discourse research expands linguistics research into research on human communication methods。Later，Charles Forceville developed a multi -mode metaphor theory from the perspective of cognitive linguistics，Multi -mode view of language communication is gradually accepted。

　　Research paradigm and path

Multi -mode research is a new language communication research paradigm。This research paradigm is based on the occurrence and development of language communication、The communication between the communication between humans and the outside world requires the premise of multi -mode sensory system support，Pay attention to the meaning expression and transmission method that is not valued in traditional linguistics research，New research on human speech communication。Under this paradigm，The overall goal of related research includes both brain mechanisms that explore human language communication multi -mode interaction、Basic studies such as behavioral rules，It also includes multi -mode application research and development based on modern technology and future development，With problem -oriented and interdisciplinary attributes。One research paradigm can exist in multiple research paths，It can be used to multiple specific bet365 best casino games research areas。Current，Multi -mode research path related to language communication is generally included: multimodal analysis of symbolism attributes、Multi -mode language library method、Study on the nerve cognitive mechanism of multi -mode phenomenon、Multi -mode man -machine interactive technology research and development, etc.。

Multi -mode studies at home and abroad in the multi -mode studies of symbolic attributes are more mature，The results are quite abundant。The related research path includes the social symbol analysis faction represented by Chrys and Vanlavin，Eiter、Anthony Baldry、Paul Thibault、Kay O’Halloran's discourse analysis faction under the system functional grammar framework and Ron Scollon、multi -mode interactive analysis faction represented by Sigrid Norris。There are also scholars who use the image、Gesture、Sound, etc. It is deemed as a symbol resource，Multi -mode metaphorical metaphor research in areas such as metaphorical mechanism and cognitive characteristics，Extended Multimensive Sports、Multi -mode rhetoric and multi -mode cognitive poetics and other research directions。

Multi -mode state language library refers to a variety of data types (such as text、Audio and Video, etc.) Integrated，Researchers can process it in multimodal mode、Corgage for Research and Statistics for Related Research。Foreign scholars have built a lot of multi -mode libraries of different scale，To meet the needs of various research，and already in the theoretical basis、Craid Collection、Processing、Label、Analysis framework and tool development have formed many results。Research on this path usually uses quantitative statistical analysis methods，It has been applied to the development and change of language ability、Eclability、bet365 live casino games Foreign Language Teaching and other language research areas。

The study of neural cognitive mechanisms of multi -mode phenomena becomes hotspot。Multi -mode essence of language communication，Requires neuroscience to pay attention to the synergy of multiple brain areas in speech activities。For example，How to bind (integration) in the process of language communication process，"Binding Privem"，It is an important problem in the field of cognitive psychology and neuroscience。other，Under the wave of artificial intelligence，Multi -countries have regarded multi -mode human -computer interaction and artificial intelligence development as important strategic cutting -edge topics。Language characteristics and cognitive laws in multi -mode interactive environment、The application and effect of multi -mode interactive technology in language teaching、Development of Multi -mode reading and writing ability, etc.，All issues that have received the focus。

　　Core issues and future development

Current，The connotation and extension of multi -mode language research are continuously expanded，Research should continue to deepen the following four aspects in the future。

First, we must continue to strengthen the relationship between multi -symbolic modes，Optimized interpretation theory and analysis framework。For example，Multi -mode discourse analysis should strengthen the in -depth analysis of the characteristics of different symbolic modes and grammar relationships，Examine the system in multi -modal discourse construction、Select and provide characteristic issues，At the same time, how to realize how they realize a specific social significance。Related research can be a basic theoretical research，Expand and optimize existing language communication theory and related analysis frameworks in the multi bet365 Play online games -mode format; it can also be applied，Disciplinary dissemination、Education and Teaching、Interaction of doctors and patients、Legal investigation and other scenarios are continued to expand。

The second is to expand the multi -mode expression obstacle and compensation strategy of special groups。Autism、Disrooyal disease、Alzheimer's diseases such as dementia，Multi -mode expression disorders to a certain extent，But at the same time, the compensation strategy between multiple symbol modals，Implementing acting communication。If clinical linguistics fails to adhere to the multi -mode state perspective，Just treat the communication as a simple language phenomenon，will limit the understanding of the real language communication of the special population to a certain extent。

Third is to carry out neural cognitive research on the multi -mode phenomenon of language communication。In language development、Degenerate or obstacles，Modeling of Multi -mode sensory system、Normal language communication and obstacles involving multi -mode interaction brain mechanisms、Cognitive processing process of multimodal information，All are basic research fields。

Fourth, to optimize the research and development of human -computer interactive technology or multi -mode intervention methods that promote the communication of individual language。How to understand and output multi -modal information，and serving the communication needs of people in various languages，is the forefront of technology for the future，Multi -mode language research can promote research and development in related fields。At the same time，Facing people with language communication，How to develop a multi -modal intervention method for autism、Disrooyal disease、Alzheimeria and bet365 best casino games other people implement rehabilitation，Is a issue with humanistic care。

　(The author is a professor at the School of Foreign Languages ​​of Tongji University; Associate Professor of the School of Foreign Languages ​​of Tongji University)