Is There an Expertise Reversal Effect of Signaling Principle in Multimedia Learning? Evidences from Two Meta-Analyses

Abstract

Abstract: The expertise reversal effect suggests that novices should benefit from some of the principles of instructional design, whereas experts may not. The present two meta-analyses tested the effects of signal on learning performance and subjective cognitive load in more and less prior knowledge learners. The results revealed that for learners with less prior knowledge (Meta-analysis 1), signaling could significantly promote their learning performance, and reduce the subjective cognitive load. However, regarding to learners with high prior knowledge, the effectiveness of signaling on subjective cognitive load and learning performance was non-significant (Meta-analysis 2). Together, the expertise reversal effect of signaling principle was supported in multimedia learning, and the explanation based on cognitive load theory was supported in part.

Key words: signaling principle, expertise reversal effect, cognitive load theory, multimedia learning

摘要： 经验逆转效应指出，对低先备知识者学习有积极作用的教学设计可能对高先备知识者无效，甚至有消极影响。本研究分别对高、低先备知识者进行关于线索对其学习过程中主观认知负荷及学习结果影响的元分析，检验线索原则是否存在经验逆转效应及认知负荷理论能否解释线索原则的经验逆转效应。结果表明，线索能降低低先备知识者学习过程中的主观认知负荷并促进其学习表现；但线索对高先备知识者认知负荷及学习成绩的总效应均不显著。结合元分析结果，本研究证明了在多媒体学习环境下线索原则存在部分经验逆转，且部分支持了线索原则经验逆转效应的认知负荷理论解释。

关键词: 线索原则, 经验逆转效应, 认知负荷理论, 多媒体学习

CLC Number:

B842

ZHAO Tingting, YANG Xiaomeng, ZHANG Yang, WANG Yanqing, XIE Heping, WANG Fuxing. Is There an Expertise Reversal Effect of Signaling Principle in Multimedia Learning? Evidences from Two Meta-Analyses[J]. Studies of Psychology and Behavior, 2021, 19(1): 22-29.

赵婷婷, 杨晓梦, 张洋, 王燕青, 谢和平, 王福兴. 多媒体学习中线索原则是否存在经验逆转效应？——来自两项元分析的证据[J]. 心理与行为研究, 2021, 19(1): 22-29.

References

*为纳入元分析文献
*王福兴, 段朝辉, 周宗奎, 陈珺. (2015). 邻近效应对多媒体学习中图文整合的影响: 线索的作用. 心理学报, 47(2), 224–233
*王玉鑫. (2018). 眼动样例对多媒体学习的影响: 呈现步调与学习者经验的调节作用(硕士学位论文). 华中师范大学, 武汉.
*赵欢欢. (2013). 多媒体学习中图–文整合的经验效应: 基于眼动的研究(硕士学位论文). 华中师范大学, 武汉.
*周洁. (2014). 视觉空间线索对动画学习的影响: 来自眼动的证据(硕士学位论文). 华中师范大学, 武汉.
*邹琴. (2013). 内外部线索对多媒体学习效果的影响: 来自眼动的证据(硕士学位论文). 华中师范大学, 武汉.
Arslan-Ari, I. (2018). Learning from instructional animations: How does prior knowledge mediate the effect of visual cues? Journal of Computer Assisted Learning, 34(2), 140–149, doi: 10.1111/jcal.12222.
Azevedo, R. (2014). Multimedia learning of metacognitive strategies. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (pp. 647–672). New York: Cambridge University Press.
*Berthold, K., & Renkl, A. (2009). Instructional aids to support a conceptual understanding of multiple representations. Journal of Educational Psychology, 101(1), 70–87.
Borenstein, B., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009). Introduction to meta-analysis. Chichester, UK: Wiley.
Canham, M., & Hegarty, M. (2010). Effects of knowledge and display design on comprehension of complex graphics. Learning and Instruction, 20(2), 155–166, doi: 10.1016/j.learninstruc.2009.02.014.
Cierniak, G., Scheiter, K., & Gerjets, P. (2009). Explaining the split-attention effect: Is the reduction of extraneous cognitive load accompanied by an increase in germane cognitive load? Computers in Human Behavior, 25(2), 315–324, doi: 10.1016/j.chb.2008.12.020.
*Craig, S. D., Gholson, B., & Driscoll, D. M. (2002). Animated pedagogical agents in multimedia educational environments: Effects of agent properties, picture features and redundancy. Journal of Educational Psychology, 94(2), 428–434.
de Koning, B. B., & Jarodzka, H. (2017). Attention guidance strategies for supporting learning from dynamic visualizations. In R. Lowe & R. Ploetzner (Eds.), Learning from dynamic visualization: Innovations in research and application (pp. 255–278). Cham: Springer.
*de Koning, B. B., Tabbers, H. K., Rikers, R. M. J. P., & Paas, F. (2010). Learning by generating vs. receiving instructional explanations: Two approaches to enhance attention cueing in animations. Computers & Education, 55(2), 681–691.
Deleeuw, K. E., & Mayer, R. E. (2008). A comparison of three measures of cognitive load: Evidence for separable measures of intrinsic, extraneous, and germane load. Journal of Educational Psychology, 100(1), 223–234, doi: 10.1037/0022-0663.100.1.223.
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997). Bias in meta-analysis detected by a simple, graphical test. BMJ, 315(7109), 629–634, doi: 10.1136/bmj.315.7109.629.
*Fiorella, L., & Mayer, R. E. (2016). Effects of observing the instructor draw diagrams on learning from multimedia messages. Journal of Educational Psychology, 108(4), 528–546.
*Florax, M., & Ploetzner, R. (2010). What contributes to the split-attention effect? The role of text segmentation, picture labelling, and spatial proximity. Learning and Instruction, 20(3), 216–224.
*Folker, S., Ritter, H., & Sichelschmidt, L. (2005). Processing and integrating multimodal material: The influence of color-coding. In B. G. Bara, L. Barsalou, & M. Bucciarelli (Eds.), Proceedings of the 27th annual conference of the cognitive science society (pp. 690–695). Mahwah, New Jersey: Lawrence Erlbaum.
*Gordon, C., Tindall-Ford, S., Agostinho, S., & Paas, F. (2016). Learning from instructor-managed and self-managed split-attention materials. Applied Cognitive Psychology, 30(1), 1–9.
*Harp, S. F., & Mayer, R. E. (1998). How seductive details do their damage: A theory of cognitive interest in science learning. Journal of Educational Psychology, 90(3), 414–434.
Hedges, L. V., & Olkin, I. (1985). Statistical methods for meta-analysis. New York: Academic Press, Inc.
Hedges, L. V., & Vevea, J. L. (1998). Fixed- and random-effects models in meta-analysis. Psychological Methods, 3(4), 486–504, doi: 10.1037/1082-989X.3.4.486.
Hedges, L. V., Tipton, E., & Johnson, M. C. (2010). Robust variance estimation in meta-regression with dependent effect size estimates. Research Synthesis Methods, 1(1), 39–65, doi: 10.1002/jrsm.5.
*Jamet, E. (2014). An eye-tracking study of cueing effects in multimedia learning. Computers in Human Behavior, 32, 47–53.
*Jamet, E., Gavota, M., & Quaireau, C. (2008). Attention guiding in multimedia learning. Learning and Instruction, 18(2), 135–145.
Jarodzka, H., Scheiter, K., Gerjets, P., & van Gog, T. (2010). In the eyes of the beholder: How experts and novices interpret dynamic stimuli. Learning and Instruction, 20(2), 146–154, doi: 10.1016/j.learninstruc.2009.02.019.
*Jarodzka, H., Scheiter, K., Gerjets, P., van Gog, T., & Dorr, M. (2009). How to convey perceptual skills by displaying experts’ gaze data. In Proceedings of the 31st annual meeting of the cognitive science society (pp. 2920–2925). Austin, TX: Cognitive Science Society.
*Jarodzka, H., van Gog, T., Dorr, M., Scheiter, K., & Gerjets, P. (2013). Learning to see: Guiding students’ attention via a model’s eye movements fosters learning. Learning and Instruction, 25, 62–70.
*Jian, Y.C. (2019). Reading instructions facilitate signaling effect on science text for young readers: An eye-movement study. International Journal of Science and Mathematics Education, 17(3), 503–522.
*Johnson, A. M., Butcher, K. R., Ozogul, G., & Reisslein, M. (2013). Learning from abstract and contextualized representations: The effect of verbal guidance. Computers in Human Behavior, 29(6), 2239–2247.
*Johnson, A. M., Butcher, K. R., Ozogul, G., & Reisslein, M. (2014). Introductory circuit analysis learning from abstract and contextualized circuit representations: Effects of diagram labels. IEEE Transactions on Education, 57(3), 160–168.
Johnson, A. M., Ozogul, G., & Reisslein, M. (2015). Supporting multimedia learning with visual signalling and animated pedagogical agent: Moderating effects of prior knowledge. Journal of Computer Assisted Learning, 31(2), 97–115, doi: 10.1111/jcal.12078.
Johnson, A. M., Ozogul, G., Moreno, R., & Reisslein, M. (2013). Pedagogical agent signaling of multiple visual engineering representations: The case of the young female agent. Journal of Engineering Education, 102(2), 319–337, doi: 10.1002/jee.20009.
Kalyuga, S. (2007). Expertise reversal effect and its implications for learner-tailored instruction. Educational Psychology Review, 19(4), 509–539, doi: 10.1007/s10648-007-9054-3.
Kalyuga, S., & Renkl, A. (2010). Expertise reversal effect and its instructional implications: Introduction to the special issue. Instructional Science, 38(3), 209–215, doi: 10.1007/s11251-009-9102-0.
Kalyuga, S., Ayres, P., Chandler, P., & Sweller, J. (2003). The expertise reversal effect. Educational Psychologist, 38(1), 23–31, doi: 10.1207/S15326985EP3801_4.
*Kalyuga, S., Chandler, P., & Sweller, J. (1999). Managing split-attention and redundancy in multimedia instruction. Applied Cognitive Psychology, 13(4), 351–371.
Kalyuga, S., Chandler, P., & Sweller, J. (2001). Learner experience and efficiency of instructional guidance. Educational Psychology, 21(1), 5–23, doi: 10.1080/01443410124681.
*Kühl, T., Scheiter, K., & Gerjets, P. (2012). Enhancing learning from dynamic and static visualizations by means of cueing. Journal of Educational Multimedia and Hypermedia, 21(1), 71–88.
*Kutbay, E. (2016). An investigation of modality, redundancy and signaling effects in multimedia learning with abstract and concrete representation (Unpublished master’s thesis). Boğaziçi University, Istanbul, Republic of Turkey.
*Li, W. J., Wang, F. X., Mayer, R. E., & Liu, H. S. (2019). Getting the point: Which kinds of gestures by pedagogical agents improve multimedia learning? Journal of Educational Psychology, 111(8), 1382–1395.
*Lin, L. J. (2011). Learning with multimedia: Are visual cues and self-explanation prompts effective? (Unpublished doctorial dissertation). Arizona State University, Phoenix.
*Lin, L. J., & Atkinson, R. K. (2011). Using animations and visual cueing to support learning of scientific concepts and processes. Computers & Education, 56(3), 650–658.
Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis. Thousand Oaks, CA: Sage Publications, Inc.
*Liu, T. C., Lin, Y. C., & Paas, F. (2013). Effects of cues and real objects on learning in a mobile device supported environment. British Journal of Educational Technology, 44(3), 386–399.
Lowe, R. K. (1999). Extracting information from an animation during complex visual learning. European Journal of Psychology of Education, 14(2), 225–244, doi: 10.1007/BF03172967.
*Mason, L., Pluchino, P., & Tornatora, M. C. (2013). Effects of picture labeling on science text processing and learning: Evidence from eye movements. Reading Research Quarterly, 48(2), 199–214.
*Mautone, P. D., & Mayer, R. E. (2001). Signaling as a cognitive guide in multimedia learning. Journal of Educational Psychology, 93(2), 377–389.
Mayer, R. E. (2014). The Cambridge handbook of multimedia learning (2nd ed.). New York: Cambridge University Press.
*Moreno, R., Reislein, M., & Ozogul, G. (2010). Using virtual peers to guide visual attention during learning: A test of the persona hypothesis. Journal of Media Psychology, 22(2), 55–60.
*Nalanagula, D., Greenstein, J. S., & Gramopadhye, A. K. (2006). Evaluation of the effect of feedforward training displays of search strategy on visual search performance. International Journal of Industrial Ergonomics, 36(4), 289–300.
*Ozcelik, E., Arslan-Ari, I., & Cagiltay, K. (2010). Why does signaling enhance multimedia learning? Evidence from eye movements. Computers in Human Behavior, 26(1), 110–117.
*Ozcelik, E., Karakus, T., Kursun, E., & Cagiltay, K. (2009). An eye-tracking study of how color coding affects multimedia learning. Computers & Education, 53(2), 445–453.
Paas, F., & van Merriënboer, J. J. G. (1994). Variability of worked examples and transfer of geometrical problem-solving skills: A cognitive-load approach. Journal of Educational Psychology, 86(1), 122–133, doi: 10.1037/0022-0663.86.1.122.
Paas, F., Tuovinen, J. E., Tabbers, H., & van Gerven, P. W. M. (2003). Cognitive load measurement as a means to advance cognitive load theory. Educational Psychologist, 38(1), 63–71, doi: 10.1207/S15326985EP3801_8.
*Pi, Z. L., Hong, J. Z., & Yang, J. M. (2017). Effects of the instructor’s pointing gestures on learning performance in video lectures. British Journal of Educational Technology, 48(4), 1020–1029.
*Rey, G. D. (2010). Reading direction and signaling in a simple computer simulation. Computers in Human Behavior, 26(5), 1176–1182.
Rey, G. D., & Buchwald, F. (2011). The expertise reversal effect: Cognitive load and motivational explanations. Journal of Experimental Psychology: Applied, 17(1), 33–48, doi: 10.1037/a0022243.
Richter, J., Scheiter, K., & Eitel, A. (2016). Signaling text-picture relations in multimedia learning: A comprehensive meta-analysis. Educational Research Review, 17, 19–36, doi: 10.1016/j.edurev.2015.12.003.
*Richter, J., Scheiter, K., & Eitel, A. (2018). Signaling text-picture relations in multimedia learning: The influence of prior knowledge. Journal of Educational Psychology, 110(4), 544–560.
Scheiter, K., & Eitel, A. (2015). Signals foster multimedia learning by supporting integration of highlighted text and diagram elements. Learning and Instruction, 36, 11–26, doi: 10.1016/j.learninstruc.2014.11.002.
Schneider, S., Beege, M., Nebel, S., & Rey, G. D. (2018). A meta-analysis of how signaling affects learning with media. Educational Research Review, 23, 1–24, doi: 10.1016/j.edurev.2017.11.001.
Schnotz, W., & Lowe, R. K. (2008). A unified view of learning from animated and static graphics. In I. R. K. Lowe & W. Schnotz (Eds.), Learning with animation: Research implications for design (pp. 304–356). New York: Cambridge University Press.
*Seufert, T., & Brünken, R. (2006). Cognitive load and the format of instructional aids for coherence formation. Applied Cognitive Psychology, 20(3), 321–331.
*Skuballa, I. T., Schwonke, R., & Renkl, A. (2012). Learning from narrated animations with different support procedures: Working memory capacity matters. Applied Cognitive Psychology, 26(6), 840–847.
Sweller, J. (2005). Implications of cognitive load theory for multimedia learning. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (pp. 19–30). New York: Cambridge University Press.
Sweller, J. (2010). Element interactivity and intrinsic, extraneous, and germane cognitive load. Educational Psychology Review, 22(2), 123–138, doi: 10.1007/s10648-010-9128-5.
Sweller, J., Ayres, P., & Kalyuga, S. (2011a). Intrinsic and extraneous cognitive load. In J. Sweller, P. Ayres, & S. Kalyuga (Eds.), Cognitive load theory (pp. 57–70). New York: Springer.
Sweller, J., Ayres, P., & Kalyuga, S. (2011b). Measuring cognitive load. In J. Sweller, P. Ayres, & S. Kalyuga (Eds.), Cognitive load theory (pp. 71–85). New York: Springer.
*Tabbers, H. K., Martens, R. L., & van Merriënboer, J. J. G. (2004). Multimedia instructions and cognitive load theory: Effects of modality and cueing. British Journal of Educational Psychology, 74(1), 71–81.
*Valenzeno, L., Alibali, M. W., & Klatzky, R. (2003). Teachers’ gestures facilitate students’ learning: A lesson in symmetry. Contemporary Educational Psychology, 28(2), 187–204.
van Gog, T. (2014). The Signaling (or cueing) principle in multimedia learning. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (2nd ed., pp. 263–278). New York: Cambridge University Press.
*van Marlen, T., van Wermeskerken, M., Jarodzka, H., & van Gog, T. (2016). Showing a model’s eye movements in examples does not improve learning of problem-solving tasks. Computers in Human Behavior, 65, 448–459.
*van Marlen, T., van Wermeskerken, M., Jarodzka, H., & van Gog, T. (2018). Effectiveness of eye movement modeling examples in problem solving: The role of verbal ambiguity and prior knowledge. Learning and Instruction, 58, 274–283.
*van Noord, S. (2016). Effects of eye movements in modelling examples with ambiguous verbal explanations on visual attention and learning (Unpublished Bachelor thesis). Utrecht University, Netherlands.
Wang, F. X., Zhao, T. T., Mayer, R. E., & Wang, Y. X. (2020). Guiding the learner’s cognitive processing of a narrated animation. Learning and Instruction, 69, 101357, doi: 10.1016/j.learninstruc.2020.101357.
*Yang, H. Y. (2019). The effects of visuospatial cueing on EFL learners’ science text and picture processing through mobile phones. Technology in Society, 59, 101191.

[1]	LENG Xiaoxue, CHENG Meixia, WANG Fuxing. The Effects of Testing and Feedback on Segmentation Principle in Video Learning [J]. Studies of Psychology and Behavior, 2022, 20(1): 52-58.
[2]	ZHANG Dongmei, LU Haidong. Expertise Reversal Effect in the Use of Advance Organizer Strategy in Text Learning [J]. Studies of Psychology and Behavior, 2019, 17(1): 83-90.
[3]	Gong Shaoying, Zhang Panpan, Shangguan Chenyu. The Effect of Learner Control and Task Difficulty on Multimedia Learning [J]. Studies of Psychology and Behavior, 2017, 15(3): 335-342.
[4]	Sun Chongyong. The Influence of Speech-Associated Gestures on Cognitive Load in English Multimedia Learning [J]. Studies of Psychology and Behavior, 2016, 14(5): 633-639.