等级反应题组模型在《基于实际操作的老年人日常问题解决能力测验》中的应用

摘要/Abstract

摘要： 为考查题组模型在实际应用中的性能及对《基于实际操作的老年人日常问题解决能力测验》的项目质量进行分析,选取了450个60到84岁的老年人的测量数据,进行了模型-数据拟合检验,比较了不同模型的拟合优度,并采用等级反应题组模型（GRTM）对测验项目的参数和题组效应进行了估计。结果显示,包含10个特殊因子和一个公共因子的双因子模型相对更拟合测量数据,将项目组成10个题组后,题组的效应非常显著的题组数达到了9个,GRTM相对于等级反应模型对测验的项目质量作了更好的分析,说明GRTM在测量实践中是可行的,未来测验的编制要加强测量模型的研究。

关键词: 等级反应题组模型, 等级反应模型, 局部相依性, 老年人, 日常问题解决。

Abstract: In order to investigate whether a testlet model can be applied into the performance-based assessment on everyday problem solving in Chinese older adults, 450 older adult participants from 60 to 84 years old from Jiangxi province in China were sampled, including 227 males and 223 females. The goodness-of-fit indexes were tested among the graded response model(GRM), the multidimensional GRM, and two bifactor models which have four and ten specific factors, respectively. The graded response testlet model(GRTM)and GRM were used to analyze the measurement data. The results showed that the bifactor model with ten specific factors was better fitted to the measurement data than other models, and that when items were incorporated into 10 testlets, there were 9 testlets whose effect size variances were beyond 0.50. It was concluded that GRTM can be applied to analyze the measurement data of the performance-based assessment on everyday problem solving in Chinese older adults.

Key words: graded response testlet model, graded response model, local dependence, older adults, everyday problem solving.

陈勃, 邓稳根, 李慧琦. 等级反应题组模型在《基于实际操作的老年人日常问题解决能力测验》中的应用[J]. 心理与行为研究, 2015, 13(6): 832-838.

Chen Bo, Deng Wengen, Li Huiqi. The Application of the Graded Response Testlet Model into the Performance-based Assessment on Everyday Problem Solving in Chinese Older Adults[J]. Studies of Psychology and Behavior, 2015, 13(6): 832-838.

参考文献

1 李茵, 王大华, 申继亮.(1997). 成人晚期自我觉知的日常问题解决能力及其与日常认知的关系. 心理科学, 21, 437-443.
2 詹沛达, 王文中, 王立君.(2013). 项目反应理论新进展之题组反应理论. 心理科学进展, 21(12), 2265-2280.
3 Allen, S., & Sudweeks, R. R.(2001, April). Identifying and managing local item dependence in context-dependent item sets. Paper presented at the Annual Meeting of the American Educational Research Association, Seattle, WA.
4 Allaire, J. C., Gamaldo, A., Ayotte, B. J., Sims, R., & Whitfield, K.(2009). Mild cognitive impairment and objective instrumental everyday functioning: The everyday cognition battery memory test. Journal of the American Geriatrics Society, 57(1), 120-125.
5 Birenbaum, A.(1968). Statistical theories of mental test scores. Blanchard-Fields, F., Chen, Y., & Norris, L.(1997). Everyday problem solving across the adult life span: influence of domain specificity and cognitive appraisal. Psychology and aging, 12(4), 684.
6 Blanchard-Fields, F., Chen, Y., & Norris, L.(1997). Everyday problem solving across the adult life span: Influence of domain specificity and cognitive appraisal. Psychology and aging, 12(4), 684-693.
7 Bradlow, E. T., Wainer, H., & Wang, X. H.(1999). A bayesian random effects model for testlets. Psychometrika, 64(2), 153-168.
8 Camp, C. J., Doherty, K., Moody-Thomas, S., & Denny, N. W.(1989). Practical problem solving in adults: A comparison of problem types and scoring methods. In J. Sinnott(Ed.), Everyday problem solving: Theory and application. New York: Praeger.
9 Chalmers, R. P.(2012). mirt: A multidimensional item response theory
10 package for the R environment. Journal of Statistical Software, 48(6), 1-29.
11 Diehl, M., Marsiske, M., Horgas, A. L., Rosenberg, A., Saczynski, J. S., & Willis, S. L.(2005). The revised observed tasks of daily living: A performance-based assessment of everyday problem solving in older adults. Journal of Applied Gerontology, 24(3), 211-230.
12 Diehl, M., Willis, S. L., & Schaie, K. W.(1995). The observed tasks of daily living(OTDL) test. Psychology and Aging, 10, 478-491.
13 Haladyna, T. M.(1992). Context-dependent item sets. Educational Measurement: Issues and Practice, 11(1), 21-25.
14 Lawton, M. P., Brody, E. M., & Médecin, U.(1988). Instrumental Activities of daily living(IADL).
15 Lee, G.(2000). A comparison of methods of estimating conditional standard errors of measurement for testlet-based test scores using simulation techniques. Journal of Educational Measurement, 36(2), 91-112.
16 Marsiske, M., Willis, S.(1995). Dimensionality of everyday problem solving in older adults. Psychology and Aging, 10, 269-280.
17 Samejima, F.(1969). Estimation of latent ability using a response pattern of graded scores. Psychometric Monograph No. 17(pp. 1-100). Richmond, VA: Psychometric Society.
18 Sireci, S. G., Wainer, H., Thissen, D.(1991). On the reliability of testlet-based tests. Journal of Educational Measurement, 28, 237-247.
19 Thissen, D., Chen, W. H., & Bock, R. D.(2003). Multilog(version 7)[Computer software]. Lincolnwood, IL: Scientific Software International.
20 Wainer, H., & Thissen, D.(1996). How is reliability related to the quality of testscores? What is the effect of local dependence on reliability?. Educational Measurement: Issues and Practice, 15(1), 22-29.
21 Wang, X., Bradlow, E. T., & Wainer, H.(2002). A General Bayesian Model for Testlets: Theory and Applications. Applied Psychological Measurement, 26(1), 109-128.
22 Wang, X., Bradlow, E. T., & Wainer, H.(2004). User's Guide for SCORIGHT(Version 3.0): A computer program for scoring tests built of testlets including a module for covariate analysis. ETS Research Report Series, 2004(2), 1-59.
23 Willis, S., & Marsiske, M.(1993). Manual for the everyday problem test. University Park: Pennsylvania State University.
24 Yen, W.(1993). Scaling performance assessments: Strategies for managing local item dependence. Journal of Educational Measurement, 30, 187-213.

[1]	金花, 贾丽娜, 单金磊. 相关度对老年人错误信息持续影响效应的影响：死亡态度和健康焦虑的作用[J]. 心理与行为研究, 2021, 19(3): 389-395.
[2]	张何雅婷, 张宝山, 金豆, 林瑶. 领悟社会支持在老年人的居住地情感认同和控制感之间的中介作用：一个纵向模型[J]. 心理与行为研究, 2020, 18(6): 854-860.
[3]	陶然, 付江宁, 李娟. 运动习惯与社区老年人认知功能的关系[J]. 心理与行为研究, 2020, 18(5): 707-713.
[4]	武剑倩, 钞秋玲, 陈媛. 家庭环境对老年人生活质量的影响：老化态度的中介作用[J]. 心理与行为研究, 2019, 17(2): 223-228.
[5]	吴捷, 徐晟, 马伟栋, 赵加伟, 邢彤, 刘安琪, 吴梦瑄. 中国老年人怀旧感量表的编制[J]. 心理与行为研究, 2019, 17(2): 246-252.
[6]	张林, 牟忠琛, 刘燊, 高飞. 社会支持与老年人受骗倾向的关系：一个有中介的调节模型[J]. 心理与行为研究, 2017, 15(6): 766-773.
[7]	武盼盼1,邵景进, 贺念, 张丽. 老年人年龄认同特征及其与心理健康的关系^*[J]. 心理与行为研究, 2017, 15(4): 520-527.
[8]	高锋剑,陈有国, 刘培朵, 江竹, 黄希庭. 心理韧性、孤独感、自我效能感预测老年人主观幸福感的优势分析*[J]. 心理与行为研究, 2017, 15(2): 227-232.
[9]	贾孟华, 杨小洋, 王大华. 婚姻自传体记忆的数量特征：时间与依恋风格的影响[J]. 心理与行为研究, 2015, 13(2): 271-277.
[10]	唐丹,姜凯迪. 家庭支持与朋友支持对不同自理能力老年人抑郁水平的影响[J]. 心理与行为研究, 2015, 13(1): 65-69.
[11]	王丽红, 白学军, 闫国利. 汉语阅读知觉广度的老化：一项眼动研究^*[J]. 心理与行为研究, 2014, 12(6): 763-768.
[12]	闫清伟, 田青. 中国林蛙卵油对焦虑大鼠行为的影响[J]. 心理与行为研究, 2013, 11(5): 622-629.
[13]	池丽萍. 大学新生亲子沟通质量与“信任圈”的关系[J]. 心理与行为研究, 2013, 11(5): 648-653.
[14]	周雪梅, 徐晟, 陈杉, 吴捷. 老年人生命态度及其与抑郁和社会支持的关系[J]. 心理与行为研究, 2013, 11(2): 164-169.
[15]	陈传锋, 金一波,3 汪莹4 刁娟4. 家庭居住与机构居住老年人社会支持的比较研究[J]. , 2008, 6(1): 23-29.