The Emergence of Adaptive Eye-Movement Control in Reading: Theory and Data

心理与行为研究 ›› 2011, Vol. 9 ›› Issue (1): 45-52.

The Emergence of Adaptive Eye-Movement Control in Reading: Theory and Data

Erik D. Reichle¹,Yanping Liu¹,Patryk A. Laurent²

1 University of Pittsburgh;
2 The Johns Hopkins University

收稿日期:2010-11-27 出版日期:2011-03-20 发布日期:2011-03-20

The Emergence of Adaptive Eye-Movement Control in Reading: Theory and Data

Erik D. Reichle¹,Yanping Liu¹,Patryk A. Laurent²

1 University of Pittsburgh;
2 The Johns Hopkins University

Received:2010-11-27 Online:2011-03-20 Published:2011-03-20
Supported by:
Erik Reichle, University of Pittsburgh, 635 LRDC, 3939 O'Hara St; , Pittsburgh, PA, 15260; or via e-mail to: reichle@pitt; edu; The work described in this article was supported by an NIH R01 grant(HD053639) that was awarded to the first author and an award from the Chinese Scholarship Council to the second author

摘要/Abstract

摘要： Computational models of eye-movement control during reading provide precise quantitative descriptions of the perceptual, cognitive, and motoric processing that guide readers′ eyes, but are based on numerous equivocal a priori theoretical assumptions. This article describes an alternative approach to understanding eye-movement control: Using reinforcement learning to examine how complex eye-movement behaviors emerge from the requirement to identify words rapidly in the context of known psychological and physiological constraints(e.g., limited visual acuity). An example simulation is reported, as are key results from an fMRI experiment that demonstrates that structures implicated in reinforcement learning support the learning of eye-movement behavior in humans.

Abstract: Computational models of eye-movement control during reading provide precise quantitative descriptions of the perceptual, cognitive, and motoric processing that guide readers′ eyes, but are based on numerous equivocal a priori theoretical assumptions. This article describes an alternative approach to understanding eye-movement control: Using reinforcement learning to examine how complex eye-movement behaviors emerge from the requirement to identify words rapidly in the context of known psychological and physiological constraints(e.g., limited visual acuity). An example simulation is reported, as are key results from an fMRI experiment that demonstrates that structures implicated in reinforcement learning support the learning of eye-movement behavior in humans.

Erik D. Reichle,Yanping Liu,Patryk A. Laurent. The Emergence of Adaptive Eye-Movement Control in Reading: Theory and Data[J]. 心理与行为研究, 2011, 9(1): 45-52.

Erik D. Reichle,Yanping Liu,Patryk A. Laurent. The Emergence of Adaptive Eye-Movement Control in Reading: Theory and Data[J]. Studies of Psychology and Behavior, 2011, 9(1): 45-52.

参考文献

[1] Baird, L. C., III.(1995). Residual algorithms: Reinforcement learning with function approximation. In A. Prieditis & S. Russell(Eds.), Machine learning: Proceedings of the twelfth international conference . San Francisco, CA: Morgan Kaufman.
[2] Engbert, R., Nuthmann, A., Richter, E., & Kliegl, R.(2005). SWIFT: A dynamical model of saccade generation during reading. Psychological Review, 11 2, 777-813.
[3] Feng, G.(2006). Eye movements as time-series random variables: A stochastic model of eye movement control in reading. Cognitive Systems Research, 7 , 70-95.
[4] Findlay, J. M. & Gilchrist, I. D.(2003). Active vision: The psychology of looking and seeing . New York, NY: Oxford University Press.
[5] Hansen, N., Müller, S. D., & Koumoutsakos, P.(2003). Reducing the complexity of the Derandomized Evolution Strategy with Covariance Matrix Adaptation (CMA-ES). Evolutionary Computation, 11 , 1-18.
[6] Laurent, P. A.(2010). Basal ganglia involvement in the reinforcement learning of physical and cognitive actions . Unpublished dissertation, University of Pittsburgh.
[7] Laurent, P. A. & Reichle, E. D.(2011a). Coordinate cognition through reinforcement. Manuscript in preparation.
[8] Laurent, P. A. & Reichle, E. D.(2011b). Serial or parallel? Using reinforcement learning to examine attention allocation during reading. Manuscript submitted for review.
[9] Liu, Y. & Reichle, E. D.(2010). The emergence of adaptive eye movements in reading. In S. Ohlsson & R. Catrabone(Eds.), Proceedings of the 32nd Annual Conference of the Cognitive Science Society (pp. 1136-1131). Austin, TX: Cognitive Science Society.
[10] McClure, S. M., Berns, G. S., & Montague, P. R.(2003). Temporal prediction errors in a passive learning task activate human striatum . Neuron, 38 , 339-346.
[11] McDonald, S. A., Carpenter, R. H. S., & Shillcock, R. C.(2005). An anatomically constrained, stochastic model of eye movement control in reading. Psychological Review, 112 , 814-840.
[12] O′Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J.(2003). Temporal difference models and reward-related learning in the human brain. Neuron, 38 , 329-337.
[13] Pollatsek, A., Reichle, E. D., & Rayner, K.(2006). Tests of the E-Z Reader model: Exploring the interface between cognition and eye-movement control. Cognitive Psychology, 52 , 1-56.
[14] Perfetti, C. A.(1985). Reading ability . New York, NY: Oxford University Press.
[15] Rayner, K.(1998). Eye movements in reading and information processing: 20 years of research. Psychological Bulletin, 124 , 372-422.
[16] Rayner, K.(2009a). Eye movements in reading: Models and data. Journal of Eye Movement Research, 2 , 1-10.
[17] Rayner, K.(2009b). Eye movements and attention in reading, scene perception, and visual search. The Quarterly Journal of Experimental Psychology, 62 , 1457-1506.
[18] Rayner, K., Sereno, S. C., & Raney, G. E.(1996). Eye movement control in reading: A comparison of two types of models. Journal of Experimental Psychology: Human Perception and Performance, 22 , 1188-1200.
[19] Reichle, E. D.(2006). Theories of the“eye-mind”link: Computational models of eye-movement control during reading. Cognitive Systems Research, 7 , 2-3.
[20] Reichle, E. D. & Laurent, P. A.(2006). Using reinforcement learning to understand the emergence of“intelligent”eye-movement behavior during reading. Psychological Review, 113 , 390-408.
[21] Reichle, E. D., Liversedge, S. P., Pollatsek, A., & Rayner, K.(2009). Encoding multiple words simultaneously in reading is implausible. Trends in Cognitive Sciences, 13 , 115-119.
[22] Reichle, E. D., Pollatsek, A., Fisher, D. L., & Rayner, K.(1998). Toward a model of eye movement control in reading. Psychological Review, 105 , 125-157.
[23] Reichle, E. D., Rayner, K., & Pollatsek, A.(2003). The E-Z Reader model of eye movement control in reading: Comparisons to other models. Behavioral and Brain Sciences, 26 , 445-476.
[24] Reichle, E. D., Warren, T., & McConnell, K.(2009). Using E-Z Reader to model the effects of higher-level language processing on eye movements during reading. Psychonomic Bulletin & Review, 16 , 1-21.
[25] Reilly, R. & Radach, R.(2006). Some empirical tests of an interactive activation model of eye movement control in reading. Cognitive Systems Research, 7 , 34-55.
[26] Rumelhart, D. E., Hinton, G. E., & Williams, R. J.(1986). Learning internal representations by error propagation. In D. E. Rumelhart & J. L. McClelland(Eds.), Parallel distributed processing: Explorations in the microstructure of cognition (vol.1, pp.318-362). Cambridge, MA: MIT Press.
[27] Salvucci, D. D.(2001). An integrated model of eye movements and visual encoding. Cognitive Systems Research, 1 , 201-220.
[28] Schilling, H. E. H., Rayner, K., & Chumbley, J. I.(1998). Comparing naming, lexical decision, and eye fixation times: Word frequency effects and individual differences. Memory & Cognition, 26 , 1270-1281.
[29] Stanley, K. O. & Miikkulainen, R.(2002). Evolving neural networks through augmenting topologies. Evolutionary Computation, 10 , 99-127.
[30] Sutton, R. S. & Barto, A. G.(1998). Reinforcement learning: An introduction. Cambridge , MA: MIT Press.
[31] Tanaka, S. C., Doya, K., Okada, G., Ueda, K., Okamoto, Y., Yamawaki, S.(2004). Predictions of immediate and future rewards differentially recruits cortico-basal ganglia loops. Nature Neuroscience, 7 , 887-893.
[32] Yan, M., Kliegl, R., Richter, E. M., Nuthmann, A., & Shu, H.(2010). Flexible saccade-target selection in Chinese reading. The Quarterly Journal of Experimental Psychology, 63 , 705-725.
[33] Yang, S. N.(2006). A oculomotor-based model of eye movements in reading: The competition/activation model. Cognitive Systems Research, 7 , 56-69.

The Emergence of Adaptive Eye-Movement Control in Reading: Theory and Data

The Emergence of Adaptive Eye-Movement Control in Reading: Theory and Data

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 0

编辑推荐

Metrics

本文评价