The Influence of Cross-Modal Audiovisual Emotional Information on Baby Schema Effect

Abstract

Abstract: This study used the faces and voices of infants and adults with different emotions (positive, neutral, negative) as experimental materials to investigate the influence of emotions and modalities (visual, auditory, audiovisual) on baby schema effect. The results showed that all three emotions could induce baby schema effect and the neutral emotion induced the largest baby schema effect in the visual and audiovisual modalities. However, in the auditory modality, only the negative emotion induced baby schema effect. Additionally, in positive and neutral emotions, the baby schema effect was induced by visual and audiovisual modalities but not the auditory modality. No significant difference appeared between the two modalities. In negative emotions, the baby schema effect was induced by all three modalities. No significant difference appeared among the three modalities either. The results indicate that the influence of emotion on baby schema effect relies on modality.

Key words: baby schema effect, cross-modal audiovisual, emotion

摘要： 以婴儿和成人不同情绪（积极、中性、消极）的面孔和声音作为实验材料，考察情绪和通道（视觉、听觉、视听觉）对婴儿图式效应的影响。结果发现，在视觉和视听觉通道中，三种情绪均能诱发婴儿图式效应，且中性情绪诱发的婴儿图式效应量最大；在听觉通道中，只有消极情绪诱发了婴儿图式效应，积极和中性情绪未诱发婴儿图式效应。在积极和中性情绪下，视觉和视听觉通道均能诱发婴儿图式效应，且诱发的婴儿图式效应量无显著差异，而听觉通道未诱发婴儿图式效应；在消极情绪下，三种通道均能诱发婴儿图式效应，且诱发的婴儿图式效应量无显著差异。结果表明，婴儿图式效应受到情绪和通道两者交互作用的影响，且情绪对婴儿图式效应的影响具有通道特异性。

关键词: 婴儿图式效应, 跨通道视听觉, 情绪

CLC Number:

B842

YANG Weiping, YANG Xiangfu, XU Jianping. The Influence of Cross-Modal Audiovisual Emotional Information on Baby Schema Effect[J]. Studies of Psychology and Behavior, 2021, 19(4): 447-453.

杨伟平, 杨项富, 徐建萍. 跨通道视听觉情绪信息对婴儿图式效应的影响[J]. 心理与行为研究, 2021, 19(4): 447-453.

References

程刚, 贾云丞, 丁芳媛, 张大均, 陈加, 龙女. (2019). 表情对婴儿面孔图式效应的调节及其机制. 心理科学进展, 27(5), 761–772
贾云丞, 丁芳媛, 程刚, 张文, 林楠, 张大均. (2019). 婴儿与成人同面孔多表情图库的初步建立. 中国心理卫生杂志, 33(12), 918–924, doi: 10.3969/j.issn.1000-6729.2019.12.007
李萍, 张明明, 李帅霞, 张火垠, 罗文波. (2019). 面孔表情和声音情绪信息整合加工的脑机制. 心理科学进展, 27(7), 1205–1214
刘涛生, 罗跃嘉, 马慧, 黄宇霞. (2006). 本土化情绪声音库的编制和评定. 心理科学, 29(2), 406–408, doi: 10.3969/j.issn.1671-6981.2006.02.040
Aradhye, C., Vonk, J., & Arida, D. (2015). Adults’ responsiveness to children’s facial expressions. Journal of Experimental Child Psychology, 135, 56–71, doi: 10.1016/j.jecp.2015.02.006.
Bakermans-Kranenburg, M. J., van Ijzendoorn, M. H., Riem, M. M. E., Tops, M., & Alink, L. R. A. (2012). Oxytocin decreases handgrip force in reaction to infant crying in females without harsh parenting experiences. Social Cognitive and Affective Neuroscience, 7(8), 951–957, doi: 10.1093/scan/nsr067.
Brosch, T., Sander, D., Pourtois, G., & Scherer, K. R. (2008). Beyond fear: Rapid spatial orienting toward positive emotional stimuli. Psychological Science, 19(4), 362–370, doi: 10.1111/j.1467-9280.2008.02094.x.
Brosch, T., Sander, D., & Scherer, K. R. (2007). That baby caught my eye: Attention capture by infant faces. Emotion, 7(3), 685–689, doi: 10.1037/1528-3542.7.3.685.
Cheng, G., Zhang, D. J., Sun, Y. Z., Jia, Y. C., & Ta, N. (2015). Childless adults with higher secure attachment state have stronger parenting motivation. Personality and Individual Differences, 87, 39–44, doi: 10.1016/j.paid.2015.07.004.
Collignon, O., Girard, S., Gosselin, F., Roy, S., Saint-Amour, D., Lassonde, M., & Lepore, F. (2008). Audio-visual integration of emotion expression. Brain Research, 1242, 126–135, doi: 10.1016/j.brainres.2008.04.023.
Ding, F. Y., Zhang, D. J., & Cheng, G. (2016). The effect of secure attachment state and infant facial expressions on childless adults’ parental motivation. Frontiers in Psychology, 7, 1237.
Giardino, J., Gonzalez, A., Steiner, M., & Fleming, A. S. (2008). Effects of motherhood on physiological and subjective responses to infant cries in teenage mothers: A comparison with non-mothers and adult mothers. Hormones and Behavior, 53(1), 149–158, doi: 10.1016/j.yhbeh.2007.09.010.
Glocker, M. L., Langleben, D. D., Ruparel, K., Loughead, J. W., Gur, R. C., & Sachser, N. (2009). Baby schema in infant faces induces cuteness perception and motivation for caretaking in adults. Ethology, 115(3), 257–263, doi: 10.1111/j.1439-0310.2008.01603.x.
Jessen, S., & Kotz, S. A. (2011). The temporal dynamics of processing emotions from vocal, facial, and bodily expressions. NeuroImage, 58(2), 665–674, doi: 10.1016/j.neuroimage.2011.06.035.
Jia, Y. C., Cheng, G., Zhang, D. J., Ta, N., Xia, M., & Ding, F. Y. (2017). Attachment avoidance is significantly related to attentional preference for infant faces: Evidence from eye movement data. Frontiers in Psychology, 8, 85, doi: 10.3389/fpsyt.2017.00085.
Jia, Y. C., Ding, F. Y., Cheng, G., Chen, J., Zhang, W., Lin, N., & Zhang, D. J. (2021). Adults’ responses to infant faces: Neutral infant facial expressions elicit the strongest baby schema effect. Quarterly Journal of Experimental Psychology, 74(5), 853–871, doi: 10.1177/1747021820981862.
Kreifelts, B., Ethofer, T., Grodd, W., Erb, M., & Wildgruber, D. (2007). Audiovisual integration of emotional signals in voice and face: An event-related fMRI study. NeuroImage, 37(4), 1445–1456, doi: 10.1016/j.neuroimage.2007.06.020.
Kringelbach, M. L., Lehtonen, A., Squire, S., Harvey, A. G., Craske, M. G., Holliday, I. E., … Stein, A. (2008). A specific and rapid neural signature for parental instinct. PLoS One, 3(2), e1664, doi: 10.1371/journal.pone.0001664.
Kringelbach, M. L., Stark, E. A., Alexander, C., Bornstein, M. H., & Stein, A. (2016). On cuteness: Unlocking the parental brain and beyond. Trends in Cognitive Sciences, 20(7), 545–558, doi: 10.1016/j.tics.2016.05.003.
Lei, Y., Xia, Q., Mo, Z. F., & Li, H. (2020). The attention bias effect of infant face: The mechanism of cuteness and familiarity. Acta Psychologica Sinica, 52(7), 811–822, doi: 10.3724/SP.J.1041.2020.00811.
Li, X., Zheng, Y., Meng, X., Li, P., & Li, H. (2013). Adult’s reaction to infant cry and its brain mechanism. Advances in Psychological Science, 21(10), 1770–1779, doi: 10.3724/SP.J.1042.2013.01770.
Lorenz, K. (1943). Die angeborenen formen möglicher erfahrung. Zeitschrift für Tierpsychologie, 5(2), 235–409
Mogg, K., & Bradley, B. P. (1999). Orienting of attention to threatening facial expressions presented under conditions of restricted awareness. Cognition & Emotion, 13(6), 713–740.
Parsons, C. E., Young, K. S., Joensson, M., Brattico, E., Hyam, J. A., Stein, A., … Kringelbach, M. L. (2014). Ready for action: A role for the human midbrain in responding to infant vocalizations. Social Cognitive and Affective Neuroscience, 9(7), 977–984, doi: 10.1093/scan/nst076.
Parsons, C. E., Young, K. S., Parsons, E., Stein, A., & Kringelbach, M. L. (2012). Listening to infant distress vocalizations enhances effortful motor performance. Acta Paediatrica, 101(4), e189–e191, doi: 10.1111/j.1651-2227.2011.02554.x.
Pfeifer, J. H., Iacoboni, M., Mazziotta, J. C., & Dapretto, M. (2008). Mirroring others’ emotions relates to empathy and interpersonal competence in children. NeuroImage, 39(4), 2076–2085, doi: 10.1016/j.neuroimage.2007.10.032.
Yang, W. P., Ren, Y. N., Yang, D. O., Yuan, X., & Wu, J. L. (2016). The influence of selective and divided attention on audiovisual integration in children. Perception, 45(5), 515–526, doi: 10.1177/0301006616629025.
Young, K. S., Parsons, C. E., Stein, A., & Kringelbach, M. L. (2015). Motion and emotion: Depression reduces psychomotor performance and alters affective movements in caregiving interactions. Frontiers in Behavioral Neuroscience, 9, 26.

[1]	MA Liyun, MO Wen. The Influence of Positive Emotion on Prosocial Behavior Under Ego-Depletion [J]. Studies of Psychology and Behavior, 2022, 20(5): 684-691.
[2]	LIU Jianrong, XIE Linjun, ZHENG Lin. The Recognition of Emotional Prosody in College Students with Social Delay [J]. Studies of Psychology and Behavior, 2022, 20(5): 714-720.
[3]	BAO Xuhui, HUANG Jie, LI Na, LI Jianjun, LI Yahong. The Influence of Proactive Personality on Learning Engagement: The Chain Mediating Effect of Perceived Social Support and Positive Emotions [J]. Studies of Psychology and Behavior, 2022, 20(4): 508-514.
[4]	LI Jiaojiao, LIU Xiaobing, PEI Dandan, XU Bibo, YIN Xiyang. The Relationship Between Emotional Intelligence and College Students’ Malicious Creativity: A Moderated Mediation Model [J]. Studies of Psychology and Behavior, 2022, 20(4): 563-569.
[5]	LI Yongzhan. The Moderating Effect of Emotional Intelligence in the Relationship Between Body-Esteem and Eating Disorder Tendency [J]. Studies of Psychology and Behavior, 2022, 20(4): 570-576.
[6]	YU Tengxu, LIU Wen, LIU Fang. The Relationship Between Psychological Maltreatment and Children’s Anhedonia: The Mediating Role of Cognitive Reappraisal [J]. Studies of Psychology and Behavior, 2022, 20(3): 361-367.
[7]	LIU Fang, HUO Rui, HAN Chengcheng, WANG Meiyi, YANG Haibo. The Influence of Executive Function on Emotion Regulation Strategy Use Tendency and Emotion Regulation Effect [J]. Studies of Psychology and Behavior, 2022, 20(3): 382-389.
[8]	LI Peng, ZHANG Zhichao, YANG Yang, YANG Jiaqi, LI Hongyu. The Relationship Between Job Stress and Job Burnout in Primary and Middle School Teachers: A Chain Mediating Effect of Emotional Labor and Job Satisfaction [J]. Studies of Psychology and Behavior, 2022, 20(3): 412-418.
[9]	ZHOU Aibao, ZHAO Haiyan, XIA Ruixue, YUAN Yue, JIA Tingting, XIE Pei. The Impact of Reference Styles, Emotional Valence, and Personality-Trait Assessment at Different Semantic Levels on Memory [J]. Studies of Psychology and Behavior, 2022, 20(2): 145-152.
[10]	ZHAO Siyi, LI Ying, WANG Yue. The Metaphorical Association Between Valence and Space Influences Emotional Word Learning in Adults and Children [J]. Studies of Psychology and Behavior, 2022, 20(2): 153-159.
[11]	WANG Junli, WEN Yanru, LIN Yi, HOU Limin. Cognitive Development Characteristics and Influencing Factors of Emotional Display Rules in Preschool Children: A Follow-Up Study [J]. Studies of Psychology and Behavior, 2021, 19(6): 764-770.
[12]	CHEN Peiyi, CHEN Yu, YANG Xueling. The Mediating Effect of Negative Cognitive Emotion Regulation Strategies on the Relationship Between Zhongyong Thinking and Depressive Symptoms Among College Students [J]. Studies of Psychology and Behavior, 2021, 19(4): 571-576.
[13]	YANG Jiawei, LI Dongling, LIU Jianrong. The Influence of Perceived Social Hostility on College Students’ Aggression: The Role of Negative Emotional Experience [J]. Studies of Psychology and Behavior, 2021, 19(3): 382-388.
[14]	DU Xiayu, SHI Congrong, ZHAO Ziyi, XUE Ting. The Influence of Emotional Valence and Motivational Emotion on Creativity [J]. Studies of Psychology and Behavior, 2021, 19(2): 160-165.
[15]	LI Xile, SUN Anqi, GAO Pingyuan, YAN Ni. Mother’s Context-Specific Attribution and Children’s Problem Behavior: The Moderating Effect of Children’s Negative Emotionality [J]. Studies of Psychology and Behavior, 2021, 19(1): 74-81.