[1]蔡艳,涂冬波.基于属性层级关系的rRUM模型优化——模型解释力及判准率的提升视角[J].江西师范大学学报(自然科学版),2016,40(01):47-55.
　CAI Yan,TU Dongbo.The Revision of the Reduced RUM Based on the Attribute Hierarchy[J].Journal of Jiangxi Normal University:Natural Science Edition,2016,40(01):47-55.
点击复制

基于属性层级关系的rRUM模型优化——模型解释力及判准率的提升视角()
分享到：

《江西师范大学学报》（自然科学版）[ISSN:1006-6977/CN:61-1281/TN]

卷:
40
期数:
2016年01期
页码:
47-55
栏目:
出版日期:
2016-01-25

文章信息/Info

Title:
The Revision of the Reduced RUM Based on the Attribute Hierarchy
作者:
蔡艳;涂冬波
江西师范大学心理学院,江西省心理与认知科学重点实验室,江西 南昌 330022
Author(s):
CAI Yan; TU Dongbo
School of Psychology of Jiangxi Normal University,Lab of Psychology and Cognition Science of Jiangxi,Nanchang Jiangxi 330022,China
关键词:
认知诊断模型;  属性层级关系;  rRUM模型;  属性判准率
Keywords:
cognitive diagnosis models;  attribute hierarchy structure;  the reduced RUM;  classification accuracy
分类号:
B 841
文献标志码:
A
摘要:
以提高认知诊断模型判准率及对数据的解释力为视角,对当前应用较广泛的rRUM模型进行优化(优化后的模型简记为rRUM-AH),并采用Monte Carlo模拟研究及实证研究相结合的范式,比较分析了传统的rRUM模型和rRUM-AH模型的诊断正确率及诊断结果的解释力.研究结果表明:当属性间存在层级关系时,不论在何种实验设计条件下,优化后的rRUM-AH模型属性诊断正确率远远高于传统的rRUM模型; 当属性间存在层级关系时,rRUM模型的模式判准率平均不到80%(而rRUM-AH模型平均高达90%以上),难于满足实际需求,此时实际应用者选用该研究新开发的模型是一个较好的选择.
Abstract:
The Monte Carlo simulation method and empirical study were both used here to investigate the accuracy and the power of output explanation of diagnosis.Three simulation studies were conducted:Study 1 was based on the fix sample size,test length and the number of attributes.While Study 2 and Study 3 were based on the variable sample size and test length and the number of attributes respectively.Different attribute hierarchies were contained in all three simulation studies.At last the real data about syllogistic reasoning was chosen as an example to illustrate the application and comparison of the rRUM and the rRUM-AH.The findings showed that:If the relationship between attributes satisfied some hierarchy structure,then under any experiment design condition,the corrected ratios under rRUM-AH model were greater than those under rRUM model.When the relationship between attributes satisfied some hierarchy structure,the average of pattern corrected match ratios under rRUM model was less than 80 percent,otherwise,it under rRUM-AH model was greater than 90 percent.To satisfy the need in practice,the rRUM-AH model is a good choice for practitioner.Based on the analysis on the syllogistic reasoning data,the outputs indicated that the rRUM-AH model could fit the data better than rRUM model,and the power of result explanation under it was more reasonable.

参考文献/References:

[1] 涂冬波,蔡艳,丁树良.认知诊断理论方法、方法与应用 [M].北京:北京师范大学出版社,2012.
[2] Fu J,Li Y.Cognitively diagnostic psychometric models:an integrative review [R].ETS Research Report,2008.
[3] Tatsuoka K K.Cognitive assessment:an introduction of the rule space method [M].New York:Routledge,2009.
[4] Leighton J P,Gierl M J,Hunka S.The attribute hierarchy structure model:an approach for integrating cognitive theory with assessment practice [J].Journal of Educational Measurement,2004,41:205-236.
[5] Junker B W,Sijtsma K.Cognitive assessment models with few assumptions,and connections with nonparametric item response theory [J].Applied Psychological Measurement,2001,25(3):258-272.
[6] Hartz S M.A Bayesian framework for the unified model for assessing cognitive abilities:blending theory with practicality [D].IL:University of Illinois at Urbana-Champaign,2002.
[7] dela Torre J.The generalized DINA model framework [J].Psychometrika,2011,76(2):179-199.
[8] Feng Yuling,Habing B T,Huebne A.Paramter estimation of the reduced RUM using the EM algorithm [J].Applied Psychological Measurement,2014,38(2):137-150.
[9] Henson R,Douglas J.Test construction for cognitive diagnosis [J].Applied Psychological Measurement,2005,29(4):262-277.
[10] McGlohen M,Chang,Huahua.Combining computer adaptive testing technology with cognitively diagnostic assessment [J].Behavior Research Methods,2008,40(3):808-821.
[11] Wang Changjiang,Chang Huahua,Huebner A.Restrictive stochastic item selection methods in cognitive diagnostic computerized adaptive testing[J].Journal of Educational Measurement,2011,48(3):255-273.
[12] dela Torre J,Douglas J A.Higher order latent trait models for cognitive diagnosis [J].Psychometrika,2004,69(3):333-353.
[13] Kuhn D.Why development does(and does not)occur:evidence from the domain of inductive reasoning [A]// McClelland J L,Siegler R.Mechanisms of cognitive development:Behavioral and neural perspectives[C].Hillsdale,NJ:Erlbaum,2001:221-249.
[14] Vosniadou S,Brewer W F.Mental models of the earth:a study of conceptual change in childhood[J].Cognitive Psychology,1992,24(4):535-585.
[15] DiBello L V,Stout W.Arpeggio documentation and analyst manual(Ver.3.1.001)[Computer software].St.Paul,MN:Assessment Systems Corporation.
[16] Gelman A,Carlin J B,Stern H S,et al.Bayesian data analysis [M].London:Chapman & Hall Ltd,1995.
[17] Cui Ying,Leighton J P,Gierl M J,et al.A person-fit statistic for the attribute hierarchy method:the hierarchy consistency index [EB/OL].
[2015-09-12].http://www.ualberta.ca/～mgierl/files/conferences/NCME06_YC.pdf.
[18] Rupp A A,Templin J L.The effects of Q-matrix misspecification on parameter estimates and classification accuracy in the DINA model [J].Educational and Psychological Measurement,2008,68(1):78-96.

相似文献/References:

[1]杨淑群.认知评估中的属性关系[J].江西师范大学学报(自然科学版),2015,(02):132.
　YANG Shuqun.The Relationship among Attributes for Cognitive Assessment[J].Journal of Jiangxi Normal University:Natural Science Edition,2015,(01):132.
[2]丁树良,罗 芬,汪文义,等.0-1评分认知诊断测验设计[J].江西师范大学学报(自然科学版),2019,(05):441.[doi:10.16357/j.cnki.issn1000-5862.2019.05.01]
　DING Shuliang,LUO Fen,WANG Wenyi,et al.The Designing Cognitive Diagnostic Test with Dichotomous Scoring[J].Journal of Jiangxi Normal University:Natural Science Edition,2019,(01):441.[doi:10.16357/j.cnki.issn1000-5862.2019.05.01]
[3]汪文义,郑娟娟,宋丽红,等.认知诊断模型参数估计算法比较[J].江西师范大学学报(自然科学版),2022,(03):291.[doi:10.16357/j.cnki.issn1000-5862.2022.03.12]
　WANG Wenyi,ZHENG Juanjuan,SONG Lihong,et al.The Comparison of Parameter Estimation of Cognitive Diagnosis Models[J].Journal of Jiangxi Normal University:Natural Science Edition,2022,(01):291.[doi:10.16357/j.cnki.issn1000-5862.2022.03.12]

备注/Memo

备注/Memo:
基金项目:国家自然科学基金(31100756,31300876,31160203,31360237),江西省社会科学规划重点项目(13JY01),江西省教育科学规划(12YB088,13YB029),高等院校博士点基金(20123604120001)和江西师范大学青年英才培育资助计划资助项目.
更新日期/Last Update: 1900-01-01