Eye Movements as an Index of Linguistic Processing in Language Production

Abstract

Abstract: Researchers have recently turned to eye tracking to study the complex cognitive processes underlying speech production. The present paper provides a brief overview of studies of sentence production and eye movements. A review then follows of research using eye tracking to investigate eye movements during multiple object naming and differences between findings in reading research. The majority of these studies attempt to determine the extent to which object naming can happen in serial or parallel. Lastly, I provide a brief comparison between seriality and parallelism in reading and multiple object naming.

摘要： Researchers have recently turned to eye tracking to study the complex cognitive processes underlying speech production. The present paper provides a brief overview of studies of sentence production and eye movements. A review then follows of research using eye tracking to investigate eye movements during multiple object naming and differences between findings in reading research. The majority of these studies attempt to determine the extent to which object naming can happen in serial or parallel. Lastly, I provide a brief comparison between seriality and parallelism in reading and multiple object naming.

Elizabeth R. Schotter. Eye Movements as an Index of Linguistic Processing in Language Production[J]. Studies of Psychology and Behavior, 2011, 9(1): 16-23.

Elizabeth R. Schotter. Eye Movements as an Index of Linguistic Processing in Language Production[J]. 心理与行为研究, 2011, 9(1): 16-23.

References

[1] Altarriba, J., Kambe, G., Pollatsek, A. & Rayner, K.(2001). Semantic codes are not used in integrating information across eye fixations in reading: Evidence from fluent Spanish-English bilinguals. Perception & Psychophysics, 63 , 875-890.
[2] Angele, B., Slattery, T., Yang, J., Kliegl, R., & Rayner, K.(2008). Parafoveal processing in reading: Manipulating n+1 and n+2 previews simultaneously. Visual Cognition, 16, 697-707.
[3] Balota, D., Pollatsek, A. & Rayner, K.(1985). The interaction of contextual constraints and parafoveal visual information in reading. Cognitive Psychology, 17 , 364-390.
[4] Bock, J. K.(1982). Toward a cognitive psychology of syntax: Information processing contributions to sentence formulation. Psychological Review, 89 , 1-47.
[5] Bock, J. K.(1986). Meaning, sound, and syntax: Lexical priming in sentence production. Journal of Experimental Psychology: Learning, Memory, and Cognition, 12 , 575-586.
[6] Carr, T., McCauley, C., Sperber, R. & Parmelee, C.(1982). Words, pictures and priming: On semantic activation, conscious identification, and the automaticity of information processing. Journal of Experimental Psychology: Human Perception and Performance, 8 , 757-777.
[7] Dahan, D., Magnuson, J. & Tanenhaus, M.(2001). Time course of frequency effects in spoken-word recognition: Evidence from eye movements. Cognitive Psychology, 42, 317-367.
[8] Frazier, L. & Rayner, K.(1982). Making and correcting errors during sentence comprehension: Eye movements in the analysis of structurally ambiguous sentences. Cognitive Psychology, 14 , 178-210.
[9] Gleitman. L., January, D., Nappa, R. & Trueswell, J.(2007). On the give and take between event apprehension and utterance formulation. Journal of Memory and Language, 57 , 544-569.
[10] Griffin, Z.(2001). Gaze durations during speech reflect word selection and phonological encoding. Cognition, 82 , B1-B14.
[11] Griffin, Z.,(2004). Why Look? Reasons for eye movements related to language production. In J. M. Henderson & F. Ferreira(Eds.), The interface of language, vision, and action: Eye movements and the visual world (pp. 213-247). New York: Psychology Press.
[12] Griffin Z. & Bock J. K.(2000). What they eyes say about speaking. Psychological Science, 11 , 274-279.
[13] Henderson, J. & Siefert, A.(2001). Types and tokens in transsaccadic object identification: Effects of spatial position and left-right orientation. Psychonomic Bulletin & Review, 8 , 753-760.
[14] Hohenstein, S., Laubrock, J. & Kliegl, R.(2010). Semantic preview benefit in eye movements during reading: a parafoveal fast-priming study. Journal of Experimental Psychology: Learning, Memory, and Cognition, 36 , 1150-1170.
[15] Hyönä, J. & Haikio, T.(2005). Is emotional content obtained from parafoveal words during reading? An eye movement analysis. Scandinavian Journal of Psychology, 46 , 475-483.
[16] Kennedy, A.(1998). The influence of foveal words on parafoveal inspection time: Evidence for a processing trade-off. In G. Underwood (Ed.), Eye guidance in reading and scene perception (pp149-179). Oxford, UK. Elsevier Science.
[17] Kennedy, A.(2000). Parafoveal processing in word recognition. The Quarterly Journal of Experimental Psychology, 53 , 429-455.
[18] Kennedy, A., Pynte, J. & Ducrot, S.(2002). Parafoveal-on-foveal interactions in word recognition. The Quarterly Journal of Experimental Psychology, 55 , 1307-1337.
[19] Kliegl, R., Risse, S. & Laubrock, J.(2007). Preview benefit and parafoveal-on-foveal effects from word n+2. Journal of Experimental Psychology: Human Perception and Performance, 33 , 1250-1255.
[20] Malpass, D. & Meyer, A.(2010). The time course of name retrieval during multiple-object naming: Evidence from extrafoveal-on-foveal effects. Journal of Experimental Psychology: Learning, Memory, and Cognition, 36 , 523-537.
[21] McConkie, G. & Zola, D.(1979). Is visual information integrated across successive fixations in reading? Perception & Psychophysics, 25 , 221-224.
[22] Meyer A. & Dobel, C.(2003). Application of eye tracking in speech production research. In J. Hyönä, R. Radach, and H. Deubel (Eds.), The mind′s eye: Cognitive and applied aspects of eye movement research (pp 253-272). Amsterdam: North Holland.
[23] Meyer, A.,(2004). The use of eye tracking in studies of sentence generation. In J. M. Henderson & F. Ferreira (Eds.), The interface of language, vision, and action: Eye movements and the visual world (pp. 191-211). New York: Psychology Press.
[24] Meyer, A., Ouellet, M. & Hacker, C.(2008). Parallel processing of objects in a naming task. Journal of Experimental Psychology, 34 , 982-987.
[25] Meyer, A., Sleiderink, A. & Levelt, W.(1998). Viewing and naming objects: Eye movements during noun phrase production. Cognition, 66 , B25-B33.
[26] Meyer, A. & van der Meulen, F.(2000). Phonological priming effects on speech onset latencies and viewing times in object naming. Psychonomic Bulletin & Review, 7 , 314-319.
[27] Morgan, J. & Meyer, A.(2005). Processing of extrafoveal objects during multiple-object naming. Journal of Experimental Psychology: Learning, Memory, and Cognition, 31 , 428-442.
[28] Morgan, J., van Elswijk, G. & Meyer, A.(2008). Extrafoveal processing of objects in a naming task: Evidence from word probe experiments. Psychonomic Bulletin & Review, 15 , 561-565.
[29] Murray, W. & Rowan, M.(1998). Early, mandatory, pragmatic processing. Journal of Psycholinguistic Research, 27 , 1-22.
[30] Pollatsek, A., Rayner, K. & Collins, W.(1984). Integrating pictorial information across eye movements. Journal of Experimental Psychology: General, 113 , 426-442.
[31] Pollatsek, A., Rayner, K. & Henderson, J.(1990). Role of spatial location in integration of pictorial information across saccades. Journal of Experimental Psychology: Human Perception & Performance, 16 , 199-210.
[32] Radach, R., Glover, L. & Vorstius, C.(2007). Exploring the limits of spatially distributed word processing in reading-a new look at N-2 preview effects. European Conference on Eye Movements; Potsdam, Germany.
[33] Rayner, K.(1998). Eye movements in reading and information processing: 20 years of research. Psychological Bulletin, 124 , 372-422.
[34] Rayner, K.(2009). Eye movements and attention in reading, scene perception and visual search. The Quarterly Journal of Experimental Psychology, 62 , 1457-1506.
[35] Rayner, K., Balota, D. & Pollatsek, A.(1985). Against parafoveal semantic processing during eye fixations during reading. Canadian Journal of Psychology, 40 , 473-483.
[36] Rayner, K., Juhasz, B. & Brown, S.(2007). Do readers obtain preview benefit from word n+2? A test of serial attention shift versus distributed lexical processing models of eye movement control in reading. Journal of Experimental Psychology: Human Perception and Performance, 33 , 230-245.
[37] Rayner, K., McConkie, G & Zola, D.(1980). Integrating information across eye movements. Cognitive Psychology, 12 , 206-226.
[38] Reichle, E., Liversedge, S., Pollatsek, A. & Rayner, K.(2009). Encoding multiple words simultaneously in reading is implausible. Trends in Cognitive Science, 13 , 115-119.
[39] Risse, S. & Kliegl, R.(2009). Delayed parafoveal-on-foveal effects in an n+2 boundary experiment demonstrate parallel processing in reading. The European Conference on Eye Movements, Southampton, UK.
[40] Schotter, E., Ferreira, V. & Rayner, K.(2009). Parallel processing in an object naming task: Tests of timing, location specificity and task relevance. The European Conference on Eye Movements, Southampton, UK.
[41] Schotter, E., Ferreira, V. & Rayner, K.(2010). Only to-be-named objects are semantically processed during multiple object naming. The Annual Meeting of the Psychonomic Society, St. Louis, MO.
[42] Tanenhaus, M., Spivey-Knowlton, M., Eberhard, K. & Sedivy, J. (1995). Integration of visual and linguistic information in spoken language comprehension. Science, 268 , 1632-1634.
[43] van der Meulen, F., Meyer, A. & Levelt, W.(2001). Eye movements during the production of nouns and pronouns. Memory & Cognition, 29 , 512-521.
[44] White, S., Bertram, R. & Hyönä, J.(2008). Semantic processing of previews within compound words. Journal of Experimental Psychology: Learning, Memory, and Cognition, 34 , 988-993.
[45] Yan, M., Richter, E., Shu, H. & Kliegl, R.(2009). Readers of Chinese extract semantic information from parafoveal words. Psychonomic Bulletin & Review, 16 , 561-566.
[46] Yang, J., Wang, S., Tong, X., & Rayner, K.(2011). Semantic and plausibility effects on preview benefit during eye fixations in Chinese reading. Reading & Writing , in press.
[47] Zelinsky, G. & Murphy, G.(2000). Synchronizing visual and language processing: An effect of object name length on eye movements. Psychological Science, 11 , 125-131.