[1]李俊杰,郑慧婧,牛忆哲,等.融入选项信息的多项选择题认知诊断测验分析方法[J].江西师范大学学报(自然科学版),2023,(04):368-376.[doi:10.16357/j.cnki.issn1000-5862.2023.04.06]
　LI Junjie,ZHENG Huijing,NIU Yizhe,et al.The Analytical Method of Multiple Choice and Multiple Answer Cognitive Diagnostic Tests with Option Information[J].Journal of Jiangxi Normal University:Natural Science Edition,2023,(04):368-376.[doi:10.16357/j.cnki.issn1000-5862.2023.04.06]
点击复制

融入选项信息的多项选择题认知诊断测验分析方法()
分享到：

《江西师范大学学报》（自然科学版）[ISSN:1006-6977/CN:61-1281/TN]

卷:
期数:
2023年04期
页码:
368-376
栏目:
心理与教育测量
出版日期:
2023-07-25

文章信息/Info

Title:
The Analytical Method of Multiple Choice and Multiple Answer Cognitive Diagnostic Tests with Option Information
文章编号:
1000-5862(2023)04-0368-09
作者:
李俊杰1; 2; 郑慧婧1; 牛忆哲1; 康春花1; 曾平飞1*
(1.浙江师范大学基础教育质量监测中心,浙江 金华 3210041; 2.北京师范大学中国基础教育质量监测协同创新中心,北京 100875)
Author(s):
LI Junjie1; 2;  ZHENG Huijing1; NIU Yizhe1;  KANG Chunhua1;  ZENG Pingfei1*
(1.Assessment of Education Quality, Zhejiang Normal University,Jinhua Zhejiang 321004,China; 2.Collaborative Innovation Center of Assessment for Basic Education Quality,Beijing Normal University,Beijing 100875,China)
关键词:
多项选择题;  认知诊断测验;  计分方法;  判别方法
Keywords:
multiple choice and multiple answer questions;  cognitive diagnostic tests;  the scoring method;  discriminant method
分类号:
B 841
DOI:
10.16357/j.cnki.issn1000-5862.2023.04.06
文献标志码:
A
摘要:
多项选择题作为认知诊断测验中一种重要题型,具有诸多优点的同时,也具有多个正确答案的特性.目前大多数认知诊断模型在处理多项选择题反应数据时采用二级评分或多级计分方法来估计考生的知识状态,但这2种计分方法的计分仍停留在题目层面上,并未深入到具体的选项层面,不能充分利用多项选择题中的选项信息.因此,该文开发了选项向量计分和空间向量距离判别法对多项选择题认知诊断测验分析方法,并通过模拟研究和实证研究来验证选项向量计分和空间向量距离判别法分析多项选择题认知诊断测验的性能.
Abstract:
As an important type of cognitive diagnostic test, multiple choice and multiple answer questions have many advantages and uniqueness, especially in the aspect of correctness and non-uniqueness.At present, most cognitive diagnostic models use second-level scoring or multilevel scoring methods to estimate the knowledge state of the examinees when processing the response data of multiple choice and multiple answer questions. However, the scoring of the above two scoring methods is still at the item level, not in-depth into the specific option level, and make full use of the option information in multiple choice and multiple answuer questions.Therefore, the method of vector option scoring method and space vector distance discriminant method is developed to analyze the cognitive diagnostic test of multiple choice questions, and the performance of vector option scoring method and space vector distance discriminant Method is verified to analyze the cognitive diagnostic test of multiple choice and multiple answer questions through simulation study and empirical study.

参考文献/References:

[1] LEIGHTON J P,GIERL M J,HUNKA S M. The attribute hierarchy method for cognitive assessment: a variation on Tatsuoka's rule-space approach [J].Journal of Educational Measurement, 2004,41:41.
[2] YANG Xiaodong, EMBRETSON S E. Construct validity and cognitive diagnostic assessment [M]. Cambridge:Cambridge University Press,2007.
[3] LEIGHTON J P, GIERL M J.Cognitive diagnostic assessment for education: theory and applications [M]. Cambridge: Cambridge University Press, 2007.
[4] ROEDIGER H L, MARSH E J. The positive and negative consequences of multiple-choice testing [J].Journal of Experimental Psychology: Learning, Memory, and Cogni-tion, 2005, 31(5):1155-1159.
[5] JIMMY DE LA TORRE.A cognitive diagnosis model for cognitively based multiple-choice options[J].Applied Psychological Measurement, 2009, 33(3):163-183.
[6] TEMPLIN J L, HENSON R A.Cognitive diagnosis models for nominal response data [EB/OL].[2022-06-17]. https://www.researchgate.net/profile/Robert-Henson/publication/228894528_Cognitive_diagnosis_models_for_nominal_response_data/links/0a85e5332fadc2ef 60000000/Cognitive-diagnosis-models-for-nominal-response-data.pdf.
[7] OZAKI K.DINA models for multiple-choice items with few parameters: considering incorrect answers [J].Applied Psychological Measurement, 2015, 39(6):431-447.
[8] 郭磊,周文杰.基于选项层面的认知诊断非参数方法 [J].心理学报, 2021,53(9):1032-1043.
[9] 张晓涛,马秀谊.选择题的测试功能及其适用性分析[J].中国考试(研究版),2008(2):38-43.
[10] Thissen D,Steinberg L, FitzpatrickA R. Multiple-choice models: the distractors are also part of the OVS [J].Journal of Educational Measurement, 1989, 26(2):161-176
[11] 李瑜.多项选择题认知诊断测验编制及多策略的多项选择题认知诊断模型的开发 [D].南昌:江西师范大学, 2014.
[12] 刘拓.干扰项信息在计算机化自适应测验中的利用 [D]. 北京:北京师范大学,2016.
[13] 高旭亮,涂冬波.参数化认知诊断模型:心理计量特征、比较及其转换 [J].江西师范大学学报(哲学社会科学版),2017,50(1):88-104.
[14] CHIU C Y, DOUGLAS J. A Nonparametric approach to cognitive diagnosis by proximity to ideal tesponse patterns [J].Journal of Classification, 2013, 30(2):225-250.
[15] 康春花, 任平, 曾平飞.多级评分聚类诊断法的影响因素 [J].心理学报, 2016, 48(7):891-902.
[16] 罗欢,丁树良,汪文义,等.属性不等权重的多级评分属性层级方法 [J].心理学报,2010, 42(4):528-538.
[17] 康春花, 杨亚坤, 曾平飞.一种混合计分的非参数认知诊断方法:曼哈顿距离判别法[J].心理科学, 2019,42(2):455-462.
[18] 胡竹菁.心理统计学 [M].北京:高等教育出版社, 2010.
[19] 蔡艳,涂冬波,丁树良.五大认知诊断模型的诊断正确率比较及其影响因素:基于分布形态、属性数及样本容量的比较 [J].心理学报,2013,45(11):1295-1304.
[20] 张淑君.基于MDD的npCD-CAT研究及其在数与代数领域的应用 [D].金华:浙江师范大学, 2019.
[21] HENSON R, DOUGLAS J.Test construction for cognitive diagnosis [J].Applied Psychological Measurement,2005,29(4):262-277.
[22] 颜远海,丁树良,汪文义.影响AHM与DINA诊断准确率的因素研究 [J].江西师范大学学报(自然科学版),2011,35(6):640-645.
[23] 聂畅,孙小坚,辛涛.基于BP神经网络的认知诊断评估分类准确率影响因素分析 [J].中国考试,2021(3):28-35.

备注/Memo

备注/Memo:
收稿日期:2023-03-09
基金项目:教育部人文社会科学课题(22YJA190005)资助项目.
通信作者:曾平飞(1963—),男,广西荔浦人,教授,博士,主要从事心理测量与评价方面的研究.E-mail:zpf@zjnu.edu.cn
更新日期/Last Update: 2023-07-25