[1]康春花,朱仕浩,龚 伟,等.一种评判认知诊断方法有效性的新指标:真实判准率[J].江西师范大学学报(自然科学版),2020,(01):28-38.[doi:10.16357/j.cnki.issn1000-5862.2020.01.06]
　KANG Chunhua,ZHU Shihao,GONG Wei,et al.The New Index to Evaluate the Effectiveness of Cognitive Diagnosis:True Accuracy[J].Journal of Jiangxi Normal University:Natural Science Edition,2020,(01):28-38.[doi:10.16357/j.cnki.issn1000-5862.2020.01.06]
点击复制

一种评判认知诊断方法有效性的新指标:真实判准率()
分享到：

《江西师范大学学报》（自然科学版）[ISSN:1006-6977/CN:61-1281/TN]

卷:
期数:
2020年01期
页码:
28-38
栏目:
心理与教育测量
出版日期:
2020-02-10

文章信息/Info

Title:
The New Index to Evaluate the Effectiveness of Cognitive Diagnosis:True Accuracy
文章编号:
1000-5862(2020)01-0028-11
作者:
康春花; 朱仕浩; 龚 伟; 俞向军; 曾平飞*
浙江师范大学教师教育学院,浙江 金华 321004
Author(s):
KANG Chunhua; ZHU Shihao; GONG Wei; YU Xiangjun; ZENG Pingfei*
College of Teacher Education,Zhejiang Normal University,Jinhua Zhejiang 321004,China
关键词:
真实判准率;  方法有效性;  高低错判
Keywords:
true accuracy rate;  method validity;  high discriminant; low discriminant and error discriminant
分类号:
B 841
DOI:
10.16357/j.cnki.issn1000-5862.2020.01.06
文献标志码:
A
摘要:
该文提出了TPMR和TAAMR 2种真实判准率指标,用于替代现有评判认知诊断方法有效性的指标PMR与AAMR,并分析新旧指标的区别,随后比较参数和非参数方法在新旧指标上的表现以及高判、低判、错判情况,为认知诊断的实践提供理论依据.研究发现:(i)TPMR、TAAMR相比于PMR、AAMR而言,更能真实地反映认知诊断方法的有效性;(ii)TPMR、TAAMR在不同条件下表现均较为稳定,相比PMR、AAMR更能区分认知诊断方法的优劣;(iii)从高低错判的角度来看,PNN更适合于实践应用.
Abstract:
Two kinds of real equality rate that are TPMR and TAAMR are put forward,which are used to replace the existing evaluation effectiveness index PMR and AAMR cognitive diagnosis methods,and analyze the difference between the old and the new index,then compare parameters and nonparametric method on the performance of the old and the new indicators and the cases of high discriminant,low discriminant and error discriminant,as to provide theoretical basis for the practice of cognitive diagnosis.The findings are as follows.Compared with PMR and AAMR,TPMR and TAAMR can more truly reflect the effectiveness of cognitive diagnosis.The performances of TPMR and TAAMR are relatively stable under different conditions,and compared with PMR and AAMR,they can better distinguish the advantages and disadvantages of cognitive diagnosis methods.From the perspective of high discriminant,low discriminant and error discriminant,PNN is more suitable for application in practice.

参考文献/References:

[1] 辛涛,乐美玲,张佳慧.教育测量理论新进展及发展趋势[J].中国考试,2012(5):3-11.
[2] 汪文义,丁树良,宋丽红.认知诊断中基于条件期望的距离判别方法[J].心理学报,2015,47(12):1499-1510.
[3] 康春花,杨亚坤,曾平飞.一种混合计分的非参数认知诊断方法:曼哈顿距离判别法[J].心理科学,2019,42(2):455-462.
[4] 康春花,张淑君,李元白,等.KNN认知诊断法及其应用[J].江西师范大学学报:自然科学版,2019,43(2):29-35,53.
[5] 祝玉芳,王黎华,丁树良,等.多策略的多级评分认知诊断方法的开发[J].江西师范大学学报:自然科学版,2015,39(4):371-376.
[6] 蔡艳,涂冬波.基于属性层级关系的rRUM模型优化:模型解释力及判准率的提升视角[J].江西师范大学学报:自然科学版,2016,40(1):47-55.
[7] 李娟,丁树良,罗芬.基于等级反应模型的广义距离判别法[J].江西师范大学学报:自然科学版,2012,36(6):636-639.
[8] 罗欢,丁树良,汪文义,等.属性不等权重的多级评分属性层级方法[J].心理学报,2010,42(4):528-538.
[9] 张淑梅,包钰,郭文海.一种多级评分的广义认知诊断模型[J].心理学探新,2013,33(5):444-450.
[10] Junker B W,Sijtsma K.Cognitive assessment models with few assumptions,and connections with nonparametric item response theory[J].Applied Psychological Measurement,2001,25(3):258-272.
[11] Templin J L,Henson R A.Measurement of psychological disorders using cognitive diagnosis models[J].Psychol Methods,2006,11(3):287-305.
[12] De la Torre J D L.The generalized DINA model framework[J].Psychometrika,2011,76(2):179-199.
[13] Ma W,de la Torre J.A sequential cognitive diagnosis model for polytomous responses[J].British Journal of Mathematical Statistical Psychology,2016,69(3):253-275.
[14] 涂冬波,蔡艳,戴海琦,等.一种多级评分的认知诊断模型:P-DINA模型的开发[J].心理学报,2010,42(10):1011-1020.
[15] 蔡艳,赵洋,刘舒畅,等.一种优化的多级评分认知诊断模型[J].心理科学,2017,40(6):1491-1497.
[16] 涂冬波,蔡艳,戴海琦.基于HO-DINA模型的多级评分认知诊断模型的开发[J].心理科学,2013,36(4):984-988.
[17] 蔡艳,涂冬波,丁树良.五大认知诊断模型的诊断正确率比较及其影响因素:基于分布形态、属性数及样本容量的比较[J].心理学报,2013,45(11):1295-1304.
[18] Chiu C Y,Douglas J.A nonparametric approach to cognitive diagnosis by proximity to ideal response patterns[J].Journal of Classification,2013,30(2):225-250.
[19] 康春花,任平,曾平飞.非参数认知诊断方法:多级评分的聚类分析[J].心理学报,2015,47(8):1077-1088.
[20] 康春花,任平,曾平飞.多级评分聚类诊断法的影响因素[J].心理学报,2016,48(7):891-902.

备注/Memo

备注/Memo:
收稿日期:2019-09-12
基金项目:教育部人文社会科学青年基金(19YJC880122)和浙江省教育科学规划课题(2019SCG312)资助项目.
通信作者:曾平飞(1963-),男,广西荔浦人,教授,博士,主要从事心理测量与评价方面的研究.E-mail:zpf@zjnu.edu.cn
更新日期/Last Update: 2020-02-10