[1]宋丽红,汪文义,丁树良.测验Q矩阵的修正方法及其比较研究[J].江西师范大学学报(自然科学版),2015,(06):623-630.
　SONG Lihong,WANG Wenyi,DING Shuliang.The Q-Matrix Validation Methods and Comparison to Three Existing Methods[J].Journal of Jiangxi Normal University:Natural Science Edition,2015,(06):623-630.
点击复制

测验Q矩阵的修正方法及其比较研究()
分享到：

《江西师范大学学报》（自然科学版）[ISSN:1006-6977/CN:61-1281/TN]

卷:
期数:
2015年06期
页码:
623-630
栏目:
出版日期:
2015-12-31

文章信息/Info

Title:
The Q-Matrix Validation Methods and Comparison to Three Existing Methods
作者:
宋丽红;汪文义;丁树良
1.江西师范大学初等教育学院,江西 南昌 330022; 2.江西师范大学计算机信息工程学院,江西 南昌 330022
Author(s):
SONG Lihong; WANG Wenyi; DING Shuliang
1.Elementary Educational College,Jiangxi Normal University,Nanchang Jiangxi 330022,China; 2.College of Computer Information Engineering,Jiangxi Normal University,Nanchang Jiangxi 330022,China
关键词:
认知诊断评估;  Q矩阵;  确定性输入噪音与门模型;  EM算法;  在线标定方法
Keywords:
cognitive diagnostic assessment;  the Q-matrix;  the DINA model;  the EM algorithm;  on-line calibration method
分类号:
B 841.7
文献标志码:
A
摘要:
在认知诊断评估中,构建正确测验Q矩阵十分关键,但比较困难.该文将确定性输入噪音与门模型下3种在线标定方法(极大似然估计方法,边际极大似然估计方法和交差方法)用于测验Q矩阵修正,并与δ方法,γ方法和最小残差平方和方法进行比较.采用模拟研究验证和比较各方法的表现,研究结果显示:边际极大似然估计方法表现良好,交差方法次之; 项目所考查的属性数目是影响δ方法和γ方法的表现.
Abstract:
The Q-matrix plays an important role in establishing the relation between latent attribute patterns and ideal response patterns.In practice,the Q-matrix is difficult to specify correctly in cognitive diagnostic assessment and misspecification of the Q-matrix can seriously affect the accuracy of both item parameter estimates and the classification of examinees.In the study,three on-line calibration methods have been extended to validate Q-matrix,and three related methods including the δ method,the γ method,and the Q-matrix refinement method(denoted by RSS)have been compared.A simulation study was conducted to investigate the sensitivity of validation methods to four factors(the distribution of attribute patterns,sample size,the quality of items,and the error rate of q-entries)under the deterministic inputs,noisy “and” gate(DINA)model.Results show that marginal maximum likelihood method performs best,both in terms of accuracy and robustness.

参考文献/References:

[1] Chen Jinsong,de la Torre J.A general cognitive diagnosis model for expert-defined polytomous attributes [J].Applied Psychological Measurement,2013,37(6):419-437.
[2] Sun Jia'nan,Xin Tao,Zhang Shumei,et al.A polytomous extension of the generalized distance discriminating method [J].Applied Psychological Measurement,2013,37(7):503-521.
[3] De Carlo L T.On the analysis of fraction subtraction data:the DINA model,classification,latent class sizes,and the Q-matrix [J].Applied Psychological Measurement,2011,35(1):8-26.
[4] Jang E E.Cognitive diagnostic assessment of L2 reading comprehension ability:validity arguments for fusion model application to languedge assessment [J].Language Testing,2009,26(1):31-73.
[5] McGlohen M K,Chang Huahua.Combining computer adaptive testing technology with cognitively diagnostic assessment [J].Behavior Research Methods,2008,40(3):808-821.
[6] Im S,Corter J E.Statistical consequences of attribute misspecification in the rule space method [J].Educational and Psychological Measurement,2011,71(4):712-731.
[7] Rupp A A,Templin J.The effects of Q-matrix misspecification on parameter estimates and classification accuracy in the DINA model [J].Educational and Psychological Measurement,2008,68(1):78-96.
[8] Junker B,Sijtsma K.Cognitive assessment models with few assumptions,and connections with nonparametric item response theory [J].Applied Psychological Measurement,2001,25:258-272.
[9] Haertel E H.Using restricted latent class models to map the skill structure of achievement items [J].Journal of Educational Measurement,1989,26(4):301-321.
[10] dela Torre J.An empirically based method of Q-matrix validation for the DINA model:development and applications [J].Journal of Educational Measurement,2008,45:343-362.
[11] 涂冬波,蔡艳,戴海琦.基于DINA模型的Q矩阵修正方法[J].心理学报,2012,44(4):558-568.
[12] Chiu Chiayi.Statistical refinement of the Q-Matrix in cognitive diagnosis [J].Applied Psychological Measurement,2013,37(8):598-618.
[13] Chen Ping,Xin Tao,Wang Chun,et al.On-line calibration methods for the DINA model with independent attributes in CA-CAT [J].Psychometrika,2012,77(2):201-222.
[14] 陈平,辛涛.认知诊断计算机化自适应测验中在线标定方法的开发 [J].心理学报,2011,43(6):710-724.
[15] 陈平,辛涛.认知诊断计算机化自适应测验中的项目增补 [J].心理学报,2011,43(7):836-850.
[16] 陈平,张佳慧,辛涛.在线标定技术在计算机化自适应测验中的应用 [J].心理科学进展,2013,21(10):1883-1892.
[17] 汪文义,丁树良.题库结构对原始题在线属性标定准确性之影响研究 [J].心理科学,2012,35(2):452-456.
[18] 汪文义,丁树良,游晓锋.计算机化自适应诊断测验中原始题的属性标定 [J].心理学报,2011,43(8):964-976.
[19] Wang Wenyi,Ding Shuliang,Song Lihong.New Q-matrix validation methods and their sensitivity under the DINA model [C].San Francisco:CA,2013.
[20] 丁树良,罗芬,汪文义.认知诊断分类中心的确定 [J].心理学探新,2013,33(5):396-401.
[21] 汪文义,宋丽红,丁树良.基于探索性因素分析的Q矩阵标定方法 [J].江西师范大学学报:自然科学版,2015,39(2):138-144,170.
[22] 喻晓锋,罗照盛,高椿雷,等.使用似然比D统计量的题目属性定义方法 [J].心理学报,2015,47(3):417-426.
[23] Leighton J P,Gierl M J,Hunka S M.The attribute hierarchy method for cognitive assessment:a variation on Tatsuoka's rule-space approach [J].Journal of Educational Measurement,2004,41(3):205-237.
[24] de la Torre J.DINA model and parameter estimation:a didactic [J].Journal of Educational and Behavioral Statistics,2009,34(1):115-130.
[25] de la Torre J,Douglas J.Higher-order latent trait models for cognitive diagnosis [J].Psychometrika,2004,69(3):333-353.
[26] Tatsuoka K K.Toward an integration of item-response theory and cognitive error diagnosis [C] ∥ Frederiksen N,Glaser R L,Lesgold A M,et al.Diagnostic monitoring of skill and knowledge acquisition [A].Erlbaum:Hillsdale,1990:453-488.
[27] Chiu Chiayi,Douglas J A.A nonparametric approach to cognitive diagnosis by proximity to ideal response patterns [J].Journal of Classification,2013,30:225-250.
[28] DiBello L V,Roussos L A,Stout W.Review of cognitively diagnostic assessment and a summary of psychometric models [C]∥ Rao C R,Sinharay S.Handbook of statistics [A].Elsevier:Amsterdam,2007:979-1030.
[29] 丁树良,汪文义,杨淑群.认知诊断测验蓝图的设计[J].心理科学,2011,34(2):258-265.
[30] 丁树良,杨淑群,汪文义.可达矩阵在认知诊断测验编制中的重要作用 [J].江西师范大学学报:自然科学版,2010,34(5):490-495.
[31] Liu Jingchen,Xu Gongjun,Ying Zhiliang.Data-driven learning of Q-matrix [J].Applied Psychological Measurement,2012,36(7):548-564.
[32] 喻晓锋,罗照盛,秦春影,等.基于作答数据的模型参数和Q矩阵联合估计 [J].心理学报,2015,47(2):273-282.

相似文献/References:

[1]武永华,杨淑群.属性蕴含Q矩阵理论的认知诊断模型[J].江西师范大学学报(自然科学版),2016,40(03):295.
　WU Yonghua,YANG Shuqun.The Cognitive Diagnosis Model of Q Matrix Theory with Attribute Implication[J].Journal of Jiangxi Normal University:Natural Science Edition,2016,40(06):295.
[2]詹沛达,丁树良,王立君.多分属性层级结构下引入逻辑约束的理想掌握模式[J].江西师范大学学报(自然科学版),2017,(03):289.
　ZHAN Peida,DING Shuliang,WANG Lijun.The Ideal Mastery Pattern for Polytomous Attributes with Hierarchical Structure Incorporating Mastery Level Restriction[J].Journal of Jiangxi Normal University:Natural Science Edition,2017,(06):289.
[3]罗 慧,熊建华,王晓庆,等.基于加权距离的一种认知诊断方法[J].江西师范大学学报(自然科学版),2018,(01):74.[doi:10.16357/j.cnki.issn1000-5862.2018.01.13]
　LUO Hui,XIONG Jianhua,WANG Xiaoqing,et al.The Generalized Cognitive Diagnosis Method Based on Weighted Distance[J].Journal of Jiangxi Normal University:Natural Science Edition,2018,(06):74.[doi:10.16357/j.cnki.issn1000-5862.2018.01.13]
[4]汪文义,汪 腾,宋丽红,等.基于可达阵的补偿模型Q矩阵标定方法[J].江西师范大学学报(自然科学版),2018,(05):441.[doi:10.16357/j.cnki.issn1000-5862.2018.05.01]
　WANG Wenyi,WANG Teng,SONG Lihong,et al.The Method for Compensatory Model's Q-Matrix Specification Based on the Reachability Matrix[J].Journal of Jiangxi Normal University:Natural Science Edition,2018,(06):441.[doi:10.16357/j.cnki.issn1000-5862.2018.05.01]
[5]黄 玉,罗 芬,熊建华,等.多级评分多策略认知诊断方法[J].江西师范大学学报(自然科学版),2019,(04):376.[doi:10.16357/j.cnki.issn1000-5862.2019.04.08]
　HUANG Yu,LUO Fen,XIONG Jianhua,et al.The Multiple-Strategy Cognitive Diagnosis Method with Polytomous Scoring[J].Journal of Jiangxi Normal University:Natural Science Edition,2019,(06):376.[doi:10.16357/j.cnki.issn1000-5862.2019.04.08]
[6]汪文义,高 朋,宋丽红,等.带噪音预处理的改进探索性Q矩阵标定方法[J].江西师范大学学报(自然科学版),2020,(02):136.[doi:10.16357/j.cnki.issn1000-5862.2020.02.04]
　WANG Wenyi,GAO Peng,SONG Lihong,et al.The Improved Exploratory Method of Q-Matrix Specification with Noise Preprocessing[J].Journal of Jiangxi Normal University:Natural Science Edition,2020,(06):136.[doi:10.16357/j.cnki.issn1000-5862.2020.02.04]

备注/Memo

备注/Memo:
基金项目:国家自然科学基金(31500909,31360237,31300876,31160203,31100756,30860084),教育部人文社会科学研究青年基金(13YJC880060)和江西省教育科学2013年度一般课题(13YB032)资助项目.
更新日期/Last Update: 1900-01-01