How Spatial Contiguity Influence 7- and 9-Year-Old Children’s Text-Picture Reading: Evidence from Eye-Movement

Abstract

Abstract: Although the spatial contiguity principle has been tested in multimedia learning environment with adults from many countries, little is known about the effect on children’s text-picture integration (e.g., reading, animation). In this study, we manipulated the distribution of text-picture (integrated, separated) in the storybook, and used the Tobii T120 eye tracker to record children’s eye movements during reading a storybook in order to investigate the effect of spatial contiguity on 7- and 9-year-old children. The results showed that children in the integrated condition had a higher proportion of fixation duration on the text, more integrative saccades between text and picture, and got higher scores in the detailed recollection test than the separated condition. But there was no significant difference on the topic comprehension test or interaction between the distribution of text-picture and age. The findings of this study are consistent with the spatial contiguity principle which was mostly confirmed in adults.

Key words: spatial contiguity, children, text-picture reading, eye movement

摘要： 教育心理学中的空间邻近效应已经在成人群体中被验证，但是很少有研究探讨图文的邻近能否促进儿童图文阅读。本研究操纵图画故事书中图文空间位置（邻近、远离），使用Tobii T120眼动仪记录儿童的注意加工过程，考察空间邻近对7～9岁学龄初期儿童图文阅读的影响。结果发现，相比图文远离呈现，图文邻近呈现时儿童对文字区的注视时间更久，图文注视点转换次数更多，且细节回忆测验成绩更高；但是在主题理解测验中差异不显著，图文位置与年龄的交互作用均不显著。本研究结论为：儿童的多媒体信息加工也存在空间邻近效应，图文空间邻近能促进儿童的图文注意分配与整合，有助于儿童对故事细节的识记，但不能促进对故事的理解。

关键词: 空间邻近, 儿童, 图文阅读, 眼动

CLC Number:

B844

WANG Fuxing, YANG Xiaomeng, FAN Yingping, HU Xiangen. How Spatial Contiguity Influence 7- and 9-Year-Old Children’s Text-Picture Reading: Evidence from Eye-Movement[J]. Studies of Psychology and Behavior, 2020, 18(4): 503-509.

王福兴, 杨晓梦, 范颖平, 胡祥恩. 空间邻近对7～9岁儿童图文阅读的影响：来自眼动的证据[J]. 心理与行为研究, 2020, 18(4): 503-509.

References

段小菊, 施建农, 冉瑜英. (2009). 8岁到成年期工作记忆广度的发展. 心理科学, 32(2), 324-326, 280
侯公林, 缪小春, 陈云舫, 胡世红, 徐微云. (1998). 幼儿二维心理旋转能力发展的研究. 心理科学, 21(6), 494-497
李虹, 舒华. (2009). 学前和小学低段不同识字量儿童的认知能力比较. 心理发展与教育, 25(3), 1-8
林仲贤, 张增慧, 韩布新. (2002). 儿童、中青年及老年人心理旋转能力的比较研究. 心理科学, 25(3), 257-259
卢谢峰, 韩立敏. (2007). 中介变量、调节变量与协变量——概念、统计检验及其比较. 心理科学, 30(4), 934-936
王福兴, 段朝辉, 周宗奎, 陈珺. (2015). 邻近效应对多媒体学习中图文整合的影响: 线索的作用. 心理学报, 47(2), 224-233
王玉鑫, 谢和平, 王福兴, 安婧, 郝艳斌. (2016). 多媒体学习的图文整合: 空间邻近效应的元分析. 心理发展与教育, 32(5), 565-578
闫国利, 熊建萍, 臧传丽, 余莉莉, 崔磊, 白学军. (2013). 阅读研究中的主要眼动指标评述. 心理科学进展, 21(4), 589-605
周世杰, 龚耀先. (2004). 学龄期儿童记忆发展特点研究. 中国心理卫生杂志, 18(9), 610-612
Alemdag, E., & Cagiltay, K. (2018). A systematic review of eye tracking research on multimedia learning. Computers & Education, 125, 413-428.
Anmarkrud, Ø., Andresen, A., & Bråten, I. (2019). Cognitive load and working memory in multimedia learning: Conceptual and measurement issues. Educational Psychologist, 54(2), 61-83, doi: 10.1080/00461520.2018.1554484.
Cronbach, L. J., & Snow, R. E. (1969). Individual differences in learning ability as a function of instructional variables (Final Report). Stanford, CA: Stanford University.
Evans, M. A., & Saint-Aubin, J. (2005). What children are looking at during shared storybook reading: Evidence from eye movement monitoring. Psychological Science, 16(11), 913-920, doi: 10.1111/j.1467-9280.2005.01636.x.
Gordon, C., Tindall-Ford, S., Agostinho, S., & Paas, F. (2016). Learning from instructor-managed and self-managed split-attention materials. Applied Cognitive Psychology, 30(1), 1-9, doi: 10.1002/acp.3159.
Hannus, M., & Hyönä, J. (1999). Utilization of illustrations during learning of science textbook passages among low- and high-ability children. Contemporary Educational Psychology, 24(2), 95-123, doi: 10.1006/ceps.1998.0987.
Höffler, T. N. (2010). Spatial ability: Its influence on learning with visualizations—A meta-analytic review. Educational Psychology Review, 22(3), 245-269, doi: 10.1007/s10648-010-9126-7.
Holsanova, J., Holmberg, N., & Holmqvist, K. (2009). Reading information graphics: The role of spatial contiguity and dual attentional guidance. Applied Cognitive Psychology, 23(9), 1215-1226, doi: 10.1002/acp.1525.
Hyönä, J. (2010). The use of eye movements in the study of multimedia learning. Learning and Instruction, 20(2), 172-176, doi: 10.1016/j.learninstruc.2009.02.013.
Johnson, C. I., & Mayer, R. E. (2012). An eye movement analysis of the spatial contiguity effect in multimedia learning. Journal of Experimental Psychology: Applied, 18(2), 178-191, doi: 10.1037/a0026923.
Justice, L. M., Pullen, P. C., & Pence, K. (2008). Influence of verbal and nonverbal references to print on preschoolers’ visual attention to print during storybook reading. Developmental Psychology, 44(3), 855-866, doi: 10.1037/0012-1649.44.3.855.
Manor, B. R., & Gordon, E. (2003). Defining the temporal threshold for ocular fixation in free-viewing visuocognitive tasks. Journal of Neuroscience Methods, 128(1-2), 85-93.
Mayer, R. E. (2014). Cognitive theory of multimedia learning. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (2nd ed., pp. 43-71). New York: Cambridge University Press.
Mayer, R. E., & Fiorella, L. (2014). Principles for reducing extraneous processing in multimedia learning: Coherence, signaling, redundancy, spatial contiguity, and temporal contiguity principles. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (2nd ed., pp. 279-315). New York: Cambridge University Press.
Montag, J. L., Jones, M. N., & Smith, L. B. (2015). The words children hear: Picture books and the statistics for language learning. Psychological Science, 26(9), 1489-1496, doi: 10.1177/0956797615594361.
Price, L. H., van Kleeck, A., & Huberty, C. J. (2009). Talk during book sharing between parents and preschool children: A comparison between storybook and expository book conditions. Reading Research Quarterly, 44(2), 171-194, doi: 10.1598/RRQ.44.2.4.
Roy-Charland, A., Saint-Aubin, J., & Evans, M. A. (2007). Eye movements in shared book reading with children from kindergarten to grade 4. Reading and Writing, 20(9), 909-931, doi: 10.1007/s11145-007-9059-9.
Schmidt-Weigand, F., Kohnert, A., & Glowalla, U. (2010). Explaining the modality and contiguity effects: New insights from investigating students’ viewing behavior. Applied Cognitive Psychology, 24(2), 226-237, doi: 10.1002/acp.1554.
Schnotz, W. (2014). Integrated model of text and picture comprehension. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (2nd ed., pp. 72-103). New York: Cambridge University Press.
Schroeder, N. L., & Cenkci, A. T. (2018). Spatial contiguity and spatial split-attention effects in multimedia learning environments: A meta-analysis. Educational Psychology Review, 30(3), 679-701, doi: 10.1007/s10648-018-9435-9.
Sweller, J., Ayres, P., & Kalyuga, S. (2011). Intrinsic and extraneous cognitive load. In J. Sweller, P. Ayres, & S. Kalyuga (Eds.), Cognitive load theory (pp. 57-69). New York: Springer.
Tighe, E. L., Wagner, R. K., & Schatschneider, C. (2015). Applying a multiple group causal indicator modeling framework to the reading comprehension skills of third, seventh, and tenth grade students. Reading and Writing, 28(4), 439-466, doi: 10.1007/s11145-014-9532-1.
van Gog, T., & Scheiter, K. (2010). Eye tracking as a tool to study and enhance multimedia learning. Learning and Instruction, 20(2), 95-99, doi: 10.1016/j.learninstruc.2009.02.009.
Wiley, J., Sanchez, C. A., & Jaeger, A. J. (2014). The individual differences in working memory capacity principle in multimedia learning. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (2nd ed., pp. 598-619). New York: Cambridge University Press.
Witteman, M. J., & Segers, E. (2010). The modality effect tested in children in a user-paced multimedia environment. Journal of Computer Assisted Learning, 26(2), 132-142, doi: 10.1111/j.1365-2729.2009.00335.x.

[1]	JIA Ning, RONG Lizhuo, DAI Jinghua. Effects of Social Cues on Explicit and Implicit Metacognitive Monitoring and Control [J]. Studies of Psychology and Behavior, 2022, 20(5): 593-599.
[2]	JIANG Yingying, MA Li, ZHANG Lijin, ZHU Liqi. A Serial Mediation Model Between Number of Children and Life Satisfaction of Chinese Mothers of Childbearing Age [J]. Studies of Psychology and Behavior, 2022, 20(5): 651-656.
[3]	ZHAO Jinxia, GONG Xuxia. The Relationship Between Mother-Child Attachment and Rural Children’s Anxiety: The Moderating Role of HPA Activity [J]. Studies of Psychology and Behavior, 2022, 20(5): 665-671.
[4]	LI Shiyi, XIE Yanfeng, ZHAO Guang, BAI Xuejun. The Influence of Media Multitasking Experience on Implicit Memory in Different Attention Patterns [J]. Studies of Psychology and Behavior, 2022, 20(4): 433-440.
[5]	YU Yibing, YU Jiawei, LI Yanru, DU Yizhan. Cross-Lagged Analysis of Perceived Family Support, Friend Support and Depressive Symptoms Among Children Left-Behind in Rural Areas [J]. Studies of Psychology and Behavior, 2022, 20(4): 472-478.
[6]	ZHANG Manman, HU Huilan, BIAN Han, LI Fang, ZHANG Zhichao, ZANG Chuanli. Word Frequency Effects in Fast and Slow Readers During Skilled Chinese Reading [J]. Studies of Psychology and Behavior, 2022, 20(3): 304-310.
[7]	TAN Deqin, XIE Ruibo, DING Wan, WU Wei, SONG Shengcheng, LI Weijian. The Influence of Parent-Child Attachment and Teacher-Student Relationship on Left-Behind Children’s Internalizing Problems: The Mediating Role of Peer Attachment [J]. Studies of Psychology and Behavior, 2022, 20(3): 339-345.
[8]	LI Xiaomei, JIANG Yingjie, YU Mingyang, YUAN Yuan, LIU Fangfang. Left-Behind Children’s Psychological Maltreatment and Aggressive Behavior: Chain Mediating Effect of Resilience and Interpersonal Sensitivity [J]. Studies of Psychology and Behavior, 2022, 20(3): 353-360.
[9]	YU Tengxu, LIU Wen, LIU Fang. The Relationship Between Psychological Maltreatment and Children’s Anhedonia: The Mediating Role of Cognitive Reappraisal [J]. Studies of Psychology and Behavior, 2022, 20(3): 361-367.
[10]	ZHAO Siyi, LI Ying, WANG Yue. The Metaphorical Association Between Valence and Space Influences Emotional Word Learning in Adults and Children [J]. Studies of Psychology and Behavior, 2022, 20(2): 153-159.
[11]	HE Liyuan, ZHAO Xing, BAI Yu, LIU Nina. Multi-Word Unit Processing for Chinese Older Readers: Evidence from Eye Movements [J]. Studies of Psychology and Behavior, 2022, 20(2): 160-166.
[12]	QIN Zhao, WANG Yingchao, YE Jiaying, YUAN Xiaoyuan, YAN Guoli. Visual Compensation in Chinese Deaf Readers’ Sentence Reading: Evidence from Parafoveal-on-Foveal Effect [J]. Studies of Psychology and Behavior, 2022, 20(2): 167-173.
[13]	SUN Yunrui, HAN Yinghong, LYU Yong, LIU Fang. The Influence of Personality on Children’s White Lie Behavior: The Parallel Mediating Effect of “Cold” and “Hot” Executive Functions [J]. Studies of Psychology and Behavior, 2022, 20(2): 240-247.
[14]	LU Fang, FU Shuying. The Development of Rural Children’s Social Development Questionnaire [J]. Studies of Psychology and Behavior, 2022, 20(2): 248-254.
[15]	BAI Huihui, WANG Yuqing, SUN Wanjing. The Resilience Status of Left-Behind Children: A Meta-Analysis [J]. Studies of Psychology and Behavior, 2022, 20(2): 261-267.