心理与行为研究 ›› 2017, Vol. 15 ›› Issue (5): 587-592.

• 基础心理学 • 上一篇    下一篇

注意对视听语义整合加工的影响

吕勇, 顾吉有   

  1. 教育部人文社会科学重点研究基地天津师范大学心理与行为研究院, 天津 300074
  • 收稿日期:2016-03-29 出版日期:2017-09-20 发布日期:2017-12-28
  • 通讯作者: 吕勇,E-mail:ly6312@163.com
  • 基金资助:
    天津市高等学校“心理健康与行为调控创新团队(39)”

The Effect of Attention on Audiovisual Speech Integration

LYU Yong, GU Jiyou   

  1. Academy of Psychology and Behavior, Tianjin Normal University, Key Research Base of Humanities and Social Sciences of the Ministry of Education, Tianjin 300074
  • Received:2016-03-29 Online:2017-09-20 Published:2017-12-28

摘要: 采用2×3的被试内实验设计,将注意条件和目标刺激类型作为实验变量,考察了指向不同感觉通道的注意对视听语义整合加工的不同影响。结果发现,只有在同时注意视觉和听觉刺激时,被试对语义一致的视听刺激反应最快,即产生冗余信号效应。而在选择性注意一个感觉通道时,语义一致的视听刺激并不具有加工优势。进一步分析发现,在同时注意视觉和听觉时语义一致视听刺激的加工优势源自于其视觉和听觉成分产生了整合。也就是说,只有在同时注意视觉和听觉时,语义一致视听刺激才会产生整合,语义不一致视听刺激不会产生整合。而在选择性注意一个感觉通道时,不论语义是否一致,视听刺激均不会产生整合。

关键词: 注意, 多感觉整合, 语义联结, 竞争模型

Abstract: The present research used the square and the triangle as visual stimuli and spoken words as auditory stimuli to investigate the effect of attention on multisensory speech integration. The visual and auditory stimuli were semantically congruent or incongruent. The results from a discrimination task showed that: 1) In the condition of divided attention, participants required less time to react to audiovisual semantic-congruent targets than other types of targets; that is the redundant signal effect; 2) According to the race model, the redundant signal effect in the condition of divided attention originated from the multisensory integration. To conclude, the multisensory integration occurred when the attention was divided between visual and auditory modality only in the semantic-congruent audiovisual stimuli.

Key words: attention, multisensory integration, semantic congruence, race model

中图分类号: