Neural Mechanisms of Self-Control and Impulsivity in Reward Decision-Making

Abstract

Abstract: In reward decision-making, self-control is the choice pattern of resisting instant temptation in order to gain more valuable or long-run benefits, while impulsivity is the opposite preference. In different decision phases, different neural regions play roles in the spatial orientation of brain regions of self-control and impulsivity: in early stage of decisionmaking, limbic or paralimbic cortex, including ventral striatum, ventral medial prefrontal cortex and posterior cingulate cortex, involve in both self-controlled and impulsive decisions; in later period of decision-making, fronto-parietal and dorsolateral area mainly play an important role in self-controlled decisions, while limbic system and orbitofrontal cortex possibly play a dominate part in impulsive decisions. In addition, seen from point of reward types, secondary rewards share some brain regions such as limbic cortical with primary rewards, as well as its unique areas such as orbitofrontal cortex. With respect to ERP studies of time course, self-controlled and impulsive decisions will give rise to amplitude of fluctuation of some ERP components, such as early component P1 and N1, later component P3, ERN and so on. The future research should investigate the independent effect of each subregion and their interactive effects, incorporating more precise experimental design and brain location results.

Key words: reward decision-making, self-control and impulsivity, neural system hypothesis, time course

摘要： 奖赏决策中的自控是指为了获得更大价值或更长远利益而抵制即时诱惑的行为模式,而冲动则是指相反的选择偏好。自控与冲动的脑区空间定位是由不同的神经区域在不同决策阶段参与发挥作用的:在决策前期,无论是自控还是冲动决策都有边缘系统或旁边缘系统的参与,包括腹侧纹状体、腹内侧前额皮质、后扣带皮质等;而在决策后期,额顶叶区域和背外侧前额皮质可能在自控决策中发挥决定作用,边缘结构和眶额皮质可能在冲动决策中起支配作用。此外,从奖赏类型角度来看,二级奖赏与初级奖赏既共享一些脑区域如边缘系统,又拥有独特的脑区定位如眶额皮质。时间进程方面,相关的ERP研究表明自控与冲动决策会引起早期成分P1、N1以及晚期成分P3、ERN等成分的幅度变化。未来研究的方向包括设计更严密的实验范式和考察分析大脑各个子区域的单独作用以及彼此间的交互作用。

关键词: 奖赏决策, 自控与冲动, 神经系统假设, 时间进程

CLC Number:

B842

Wang Yujiao, Zhang Qinglin, Wei Shiyuan, Zeng Jianmin. Neural Mechanisms of Self-Control and Impulsivity in Reward Decision-Making[J]. Studies of Psychology and Behavior, 2013, 11(6): 854-859.

王玉娇, 张庆林, 韦世源, 曾建敏. 奖赏决策中自控与冲动的神经机制[J]. 心理与行为研究, 2013, 11(6): 854-859.

References

Ballard, K., & Knutson, B. (2009). Dissociable neural representations of future reward magnitude and delay during temporal discounting. Neuroimage, 45 (1), 143-150.
Barch, D. M., Braver, T. S., Akbudak, E., Conturo, T., Ollinger, J., & Snyder, A. (2001). Anterior cingulate cortex and response conflict: effects of response modality and processing domain. Cereb Cortex, 11 (9), 837-848.
Bechara, A., Damasio, A. R., Damasio, H., & Anderson, S. W. (1994). Insensitivity to future consequences following damage to human prefrontal cortex. Cognition, 50 (1-3), 7-15.
Bechara, A., Dolan, S., & Hindes, A. (2002). Decision-making and addiction (part II): myopia for the future or hypersensitivity to reward? Neuropsychologia, 40 (10), 1690-1705.
Botvinick, M. M., Braver, T. S., Barch, D. M., Carter, C. S., & Cohen, J. D. (2001). Conflict monitoring and cognitive control. Psychological Review, 108 (3), 624-652.
Botvinick, M. M., Cohen, J. D., & Carter, C. S. (2004). Conflict monitoring and anterior cingulate cortex: an update. Trends in Cognitive Sciences, 8 (12), 539-546.
De Martino, B., Kumaran, D., Seymour, B., & Dolan, R. J. (2006). Frames, biases, and rational decision-making in the human brain. Science, 313 (5787), 684-687.
Grossbard, C. L., & Mazur, J. E. (1986). A comparison of delays and ratio requirements in self-control choice. Journal of The Experimental Analysis of Behavior, 45 (3), 305-315.
Hare, T. A., O'Doherty, J., Camerer, C. F., Schultz, W., & Rangel, A. (2008). Dissociating the role of the orbitofrontal cortex and the striatum in the computation of goal values and prediction errors. Journal of Neuroscience, 28 (22), 5623-5630.
Houston, R. J., & Stanford, M. S. (2001). Mid-latency evoked potentials in self-reported impulsive aggression. International Journal of Psychophysiology, 40 (1), 1-15.
Kable, J. W., & Glimcher, P. W. (2009). The Neurobiology of Decision: Consensus and Controversy. Neuron, 63 (6), 733-745.
Kable, J. W., & Glimcher, P. W. (2010). An “As Soon As Possible” Effect in Human Intertemporal Decision Making: Behavioral Evidence and Neural Mechanisms. Journal of Neurophysiology, 103(5), 2513-2531.
Kalenscher, T., Ohmann, T., & Gunturkun, O. (2006). The neuroscience of impulsive and self-controlled decisions. International Journal of Psychophysiology, 62 (2), 203-211.
Koob, G. F., Sanna, P. P., & Bloom, F. E. (1998). Neuroscience of addiction. Neuron, 21 (3), 467-476.
Laibson, D. (1997). Golden eggs and hyperbolic discounting. The Quarterly Journal of Economics, 112 , 443-477.
Logue, A. W. (1988). Research on self-control: an integrating framework. Behavioral and Brain Science, 11 , 665-709.
Martin, L. E., & Potts, G. F. (2009). Impulsivity in decision-making: An event-related potential investigation. Personality and Individual Differences, 46 (3), 303-308.
Mazur, J. E. (1988). Estimation of indifference points with an adjustingdelay procedure. Journal of The Experimental Analysis of Behavior,49 (1), 37-47.
Miller, E. K., & Cohen, J. D. (2001). An integrative theory of prefrontal cortex function. Annual Review of Neuroscience, 24 , 167-202.
Mohr, P. N. C., Li, S. C., & Heekeren, H. R. (2010). Neuroeconomics and aging: Neuromodulation of economic decision making in old age. Neuroscience and Biobehavioral Reviews, 34 (5), 678-688.
Pine, A., Seymour, B., Roiser, J. P., Bossaerts, P., Friston, K. J., Curran, H. V., et al. (2009). Encoding of marginal utility across time in the human brain. Journal of Neuroscience, 29 (30), 9575-9581.
Rachlin, H., Raineri, A., & Cross, D. (1991). Subjective probability and delay. Journal of the Experimental Analysis of Behavior, 55 (2), 233-244.
Rangel, A., Camerer, C., & Montague, P. R. (2008). A framework for studying the neurobiology of value-based decision making. Nature Reviews Neuroscience, 9 (7), 545-556.
Rangel, A., & Hare, T. (2010). Neural computations associated with goaldirected choice. Current Opinion in Neurobiology, 20 (2), 262-270.
Reuben, E., Sapienza, P., & Zingales, L. (2010). Time discounting for primary and monetary rewards. Economics Letters, 106 (2), 125-127.
Schultz, W. (2006). Behavioral theories and the neurophysiology of reward. Annual Review of Psychology, 57 , 87-115.
Tanaka, S. C., Doya, K., Okada, G., Ueda, K., Okamoto, Y., & Yamawaki, S. (2004). Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops. Nature Neuroscience, 7 (8), 887-893.
Tangney, J. P., Baumeister, R. F., & Boone, A. L. (2004). High selfcontrol predicts good adjustment, less pathology, better grades, andinterpersonal success. Journal of Personality, 72 (2), 271-324.
Tanji, J., & Hoshi, E. (2001). Behavioral planning in the prefrontal cortex. Current Opinions in Neurobiology, 11 (2), 164-170.

[1]	LIU Wenli, LI Zhiyi, WANG Xiaowen, ZHOU Xiang. The Time Courses of Stop Consonant Category Activation: Evidence From Context Effects [J]. Studies of Psychology and Behavior, 2020, 18(2): 200-207.
[2]	Chen Baoguo1, Wang Lixin1, Peng Danling2. The Time Course of Graphic, Phonological and Semantic Activation of Chinese High-and-Low Frequency Characters [J]. , 2006, 4(4): 252-257.
[3]	Zhou Xiaolin,Qu Yanxuan,Zhuang Jie. THE RELATIVE TIME COURSE OF PHONOLOGICAL AND SEMANTIC ACTIVATION IN READING CHINESE: FURTHER EVIDENCE [J]. Studies of Psychology and Behavior, 2003, 1(4): 241-247.