The Impact of target prevalence in Medical Image Visual Searching of Novice and Expert Radiologists: Evidence from Eye Movement

Abstract

Abstract: To measure the effect of abnormality-prevalence on novices and experienced radiologists' performance during pulmonary nodular lesion detection on a chest radiograph, SMI250 eye tracker was used to record participants' eye movements. We asked experts and novices to detect chest X-ray in different target prevalence(50% or 10%). The results showed that: 1)the miss(false-negative)rate of experts and novices in low prevalence (10%)was significantly higher than that of high prevalence(50%), but the miss rate difference of experts in high and low prevalence was less than that of novices. 2)Experts and novices spent less fixation counts but more fixation duration average in low prevalence. In addition,the average saccade amplitude and the scanning error in low prevalence were greater than that in high prevalence. These findings suggested that scanning errors were the main reason for the more miss errors in low prevalence than those in high prevalence.

Key words: expert, novice, radiologist, target prevalence, visual search

摘要： 探讨低事件率对医学图像视觉搜索漏报的影响,用SMI250眼动仪记录放射科专家与新手检测胸部X光片的过程。结果发现：（1）专家和新手在低事件率（10%）下的漏报率多于高事件率（50%）,但专家在高低事件率的漏报率的差值小于新手。（2）专家和新手在低事件率下的注视次数少于高事件率,眼跳幅度、扫描错误比例大于高事件率。结论认为：专家与新手进行医学图像视觉搜索时出现低事件率效应,低事件率效应主要是由于扫描错误引起的。

关键词: 专家, 新手, 放射科医生, 事件率, 视觉搜索

CLC Number:

B842.1

Chen Meixiang, Bai Xuejun. The Impact of target prevalence in Medical Image Visual Searching of Novice and Expert Radiologists: Evidence from Eye Movement[J]. Studies of Psychology and Behavior, 2017, 15(3): 302-308.

陈梅香, 白学军. 事件率对专家与新手放射科医生医学图像视觉搜索的影响：来自眼动的证据^*[J]. 心理与行为研究, 2017, 15(3): 302-308.

References

1 贾守勤.(2009). 常规DR胸片对肺结节漏诊原因的分析(博士学位论文). 山东大学, 济南.
2 李富洪, 曹碧华, 肖风, 李红.(2011). 抑制控制在极小概率目标搜索任务中的作用. 心理学报, 43(5), 509-518.
3 李宇涵.(2014). 低事件率效应发生机制的研究(硕士学位论文), 河北师范大学, 石家庄.
4 王陵宇.(2015). 低事件率效应的机制与对策(博士学位论文). 中国科学院, 北京.
5 杨帆.(2011). X光行李检测中危险品漏报的影响因素和对策(博士学位论文). 中国科学院, 北京.
6 Beutel, J., Kundel, H. L., & Van Metter, R. L.(2000). Handbook of medical imaging: Physics and psychophysics(Vol. 1). Spie Press.
7 Burgess, A. E.(1999). Producing lesions for hybrid mammograms: Extracted tumors and simulated micro calcifications. Proceedings of SPIE-The International Society for Optical Engineering, 3663, 316-322.
8 Donovan, T., & Litchfield, D.(2013). Looking for cancer: Expertise related differences in searching and decision making. Applied Cognitive Psychology, 27(1), 43-49.
9 Egglin, T. K., & Feinstein, A. R.(1996). Context bias: A problem in diagnostic radiology. Jama, 276(21), 1752-1755.
10 Ericsson, K. A., Krampe, R. T., & Tesch-R?觟mer, C.(1993). The role of deliberate practice in the acquisition of expert performance. Psychological Review, 100(3), 363-406.
11 Ericsson, K.(2006). The influence of experience and deliberate practice on the development of superior expert performance. The Cambridge handbook of expertise and expert performance(pp.685–705). Cambridge: Cambridge University Press.
12 Ethell, S. C., & Manning, D.(2001). Effects of prevalence on visual search and decision making in fracture detection. Medical Imaging, 4324, 249-257.
13 Evans, K. K., Birdwell, R. L., & Wolfe, J. M.(2013). If you don′t find it often, you often don′t find it: Why some cancers are missed in breast cancer screening. Plos One, 8(5), e64366.
14 Fleck, M. S., & Mitroff, S. R.(2007). Rare targets are rarely missed in correctable search. Psychological Science, 18(11), 943-947.
15 Giovinco, N. A., Sutton, S. M., Miller, J. D., Rankin, T. M., Gonzalez, G. W., Najafi, B., & Armstrong, D. G.(2015). A passing glance? Differences in eye tracking and gaze patterns between trainees and experts reading plain film bunion radiographs. The Journal of Foot and Ankle Surgery, 54(3), 382-391.
16 Green, D. M., & Swets, J. A.(1966). Signal detection theory and psychophysics. The Quarterly Review of Biology, 42(4), 578.
17 Gur, D., Bandos, A. I., Fuhrman, C. R., Klym, A. H., King, J. L., & Rockette, H. E.(2007). The prevalence effect in a laboratory environment: Changing the confidence ratings. Academic Radiology, 14(1), 49-53.
18 Gur, D., Rockette, H. E., Warfel, T., Lacomis, J. M., & Fuhrman, C. R.(2003). From the laboratory to the clinic: The ″prevalence effect″. Academic Radiology, 10(11), 1324-1326.
19 Gur, D., Sumkin, J. H., Rockette, H. E., Ganott, M., Hakim, C., Hardesty, L., et al.(2004). Changes in breast cancer detection and mammography recall rates after the introduction of a computer-aided detection system. Journal of the National Cancer Institute, 96(3), 185-190.
20 Kunar, M. A., Rich, A. N., & Wolfe, J. M.(2010). Spatial and temporal separation fails to counteract the effects of low prevalence in visual search. Visual Cognition, 18(6), 881-897.
21 Kundel, H. L.(2000). Disease prevalence and the index of detectability: A survey of studies of lung cancer detection by chest radiography. Proceeding of SPIE, 3981, 135-144.
22 Kundel, H. L.(2015). Visual search and lung nodule detection on CT scans. Radiology, 274(1), 14-16.
23 Law, B., Atkins, M. S., Kirkpatrick, A. E., Lomax, A. J., & Mackenzie, C. L.(2004). Eye gaze patterns differentiate novice and experts in a virtual laparoscopic surgery training environment. In A. Duchowski, and R. Vertegan(Eds.), Proceedings of the 2004 symposium on eye tracking research and applications(pp.41-48). San Antonio, TX: Association for Computing Machinery.
24 Lee, S. L. A., Kouzani, A. Z., & Hu, E. J.(2012). Automated detection of lung nodules in computed tomography images: A review. Machine Vision and Applications, 23(1), 151-163.
25 Pisano, E. D., Gatsonis, C., Hendrick, E., Yaffe, M., Baum, J. K., & Acharyya, S., et al.(2005). Diagnostic performance of digital versus film mammography for breast-cancer screening. New England Journal of Medicine, 353(17), 1773-1783.
26 Reed, W. M., Chow, S. L. C., Chew, L. E., & Brennan, P. C.(2014). Can prevalence expectations drive radiologists′ behavior?. Academic Radiology, 21(4), 450-456.
27 Valente, I. R. S., Cortez, P. C., Neto, E. C., Soares, J. M., Albuquerque, V. H. C. D., & Tavares, J. M. R. S.(2016). Automatic 3d pulmonary nodule detection in CT images: A survey. Computer Methods and Programs in Biomedicine, 124, 91-107.
28 Van Wert, M. J., Horowitz, T. S., & Wolfe, J. M.(2009). Even in correctable search, some types of rare targets are frequently missed. Attention, Perception, & Psychophysics, 71(3), 541-553.
29 Wolfe, J. M., Horowitz, T. S., & Kenner, N. M.(2005). Rare items often missed in visual searches. Nature, 435(7041), 439-440.
30 Wolfe, J. M., Horowitz, T. S., Wert, M. J. V., Kenner, N. M., Place, S. S., & Kibbi, N.(2007). Low target prevalence is a stubborn source of errors in visual search tasks. Journal of Experimental Psychology General, 136(4), 623-638.

[1]	ZHU Huan, XIE Xiaowei, DAI Zheru, TANG Xiaoya, ZANG Jian, WU Jiao, ZANG Xuelian. Semantic Information Takes Precedence over Spatial Location and Glyph Feature in Contextual Cueing with Chinese Characters [J]. Studies of Psychology and Behavior, 2021, 19(5): 577-584.
[2]	ZHAO Tingting, YANG Xiaomeng, ZHANG Yang, WANG Yanqing, XIE Heping, WANG Fuxing. Is There an Expertise Reversal Effect of Signaling Principle in Multimedia Learning? Evidences from Two Meta-Analyses [J]. Studies of Psychology and Behavior, 2021, 19(1): 22-29.
[3]	LI Hengping, HE Shengxi, LIU Zhengkui. ERPs Study on the Effect of Fast Reading Training on Attention Based on Visual Beam Search [J]. Studies of Psychology and Behavior, 2020, 18(1): 78-84.
[4]	ZHANG Dongmei, LU Haidong. Expertise Reversal Effect in the Use of Advance Organizer Strategy in Text Learning [J]. Studies of Psychology and Behavior, 2019, 17(1): 83-90.
[5]	Yang Haibo,Yin Shasha,Bai Xuejun. THE INFLUENCE OF VISUAL WORKING MEMORY CONTENTS ON VISUAL SEARCH [J]. Studies of Psychology and Behavior, 2010, 8(2): 150-154.
[6]	Keith Rayner. Future Directions for Eye Movement Research [J]. Studies of Psychology and Behavior, 2004, 2(3): 489-496.
[7]	Zhang Yunliang,Li Zonghao,Sun Yanlin,Yang Xiaochen,Yan Guoli. EYE MOVEMENTS OF THE NOVICE AND THE EXPERT OF BASKETBALL GUARDS [J]. Studies of Psychology and Behavior, 2004, 2(3): 534-538.
[8]	Shi Jiannong,Yun Mei,Zhai Jinghua,Li Xinbing. DEVELOPMENT OF VISUAL SEARCH ABILITY OF CHILDREN AGED FROM 7- TO 12- YEAR OLD [J]. Studies of Psychology and Behavior, 2004, 2(1): 337-341.