A1 Journal article (refereed)
Audiovisual Processing of Chinese Characters Elicits Suppression and Congruency Effects in MEG (2019)

Xu, W., Kolozsvari, O., Oostenveld, R., Leppänen, P. H., & Hämäläinen, J. (2019). Audiovisual Processing of Chinese Characters Elicits Suppression and Congruency Effects in MEG. Frontiers in Human Neuroscience, 13, Article 18. https://doi.org/10.3389/fnhum.2019.00018

JYU authors or editors

Publication details

All authors or editorsXu, Weiyong; Kolozsvari, Orsolya; Oostenveld, Robert; Leppänen, Paavo H.T.; Hämäläinen, Jarmo

Journal or seriesFrontiers in Human Neuroscience



Publication year2019


Issue number0

Article number18

PublisherFrontiers Research Foundation

Publication countrySwitzerland

Publication languageEnglish


Publication open accessOpenly available

Publication channel open accessOpen Access channel

Publication is parallel published (JYX)https://jyx.jyu.fi/handle/123456789/63102


Learning to associate written letters/characters with speech sounds is crucial for reading acquisition. Most previous studies have focused on audiovisual integration in alphabetic languages. Less is known about logographic languages such as Chinese characters, which map onto mostly syllable-based morphemes in the spoken language. Here we investigated how long-term exposure to native language affects the underlying neural mechanisms of audiovisual integration in a logographic language using magnetoencephalography (MEG). MEG sensor and source data from 12 adult native Chinese speakers and a control group of 13 adult Finnish speakers were analyzed for audiovisual suppression (bimodal responses vs. sum of unimodal responses) and congruency (bimodal incongruent responses vs. bimodal congruent responses) effects. The suppressive integration effect was found in the left angular and supramarginal gyri (205–365 ms), left inferior frontal and left temporal cortices (575–800 ms) in the Chinese group. The Finnish group showed a distinct suppression effect only in the right parietal and occipital cortices at a relatively early time window (285–460 ms). The congruency effect was only observed in the Chinese group in left inferior frontal and superior temporal cortex in a late time window (about 500–800 ms) probably related to modulatory feedback from multi-sensory regions and semantic processing. The audiovisual integration in a logographic language showed a clear resemblance to that in alphabetic languages in the left superior temporal cortex, but with activation specific to the logographic stimuli observed in the left inferior frontal cortex. The current MEG study indicated that learning of logographic languages has a large impact on the audiovisual integration of written characters with some distinct features compared to previous results on alphabetic languages.

KeywordsChinese languagelanguage learningreadingsense of hearingeyesightgraphic charactersspeech soundscorrespondence (equivalence)brain researchMEG

Free keywordsaudiovisual integration; magnetoencephalography; auditory cortex; Chinese characters; Multisensory Integration; Audiovisual Equipment; Cross-Modal

Contributing organizations

Related projects

Ministry reportingYes

Reporting Year2019

JUFO rating1

Last updated on 2024-08-01 at 18:49