[1]高椿雷,罗照盛,丁树良.多级计分的CD-CAT曝光控制方法[J].江西师范大学学报(自然科学版),2019,(01):59-67+101.[doi:10.16357/j.cnki.issn1000-5862.2019.01.11]
 GAO Chunlei,LUO Zhaosheng,DING Shuliang.The Exposure Control Methods of Polytomous CD-CAT[J].Journal of Jiangxi Normal University:Natural Science Edition,2019,(01):59-67+101.[doi:10.16357/j.cnki.issn1000-5862.2019.01.11]
点击复制

多级计分的CD-CAT曝光控制方法()
分享到:

《江西师范大学学报》(自然科学版)[ISSN:1006-6977/CN:61-1281/TN]

卷:
期数:
2019年01期
页码:
59-67+101
栏目:
心理与教育测量
出版日期:
2019-02-10

文章信息/Info

Title:
The Exposure Control Methods of Polytomous CD-CAT
文章编号:
1000-5862(2019)01-0059-09
作者:
高椿雷罗照盛丁树良
江西师范大学初等教育学院,江西 南昌 330022
Author(s):
GAO ChunleiLUO ZhaoshengDING Shuliang
Elementary Education College,Jiangxi Normal University,Nanchang Jiangxi 330022,China
关键词:
P-DINA模型 CD-CAT 0-1计分 多级计分 曝光控制选题方法
Keywords:
P-DINA model CD-CAT dichotomous polytomous exposure control methods
分类号:
B 841
DOI:
10.16357/j.cnki.issn1000-5862.2019.01.11
文献标志码:
A
摘要:
相对于0-1计分,多级计分考察的认知能力水平更高,能够提供更丰富的诊断信息,同教学实践更相符,而现有研究中鲜有基于多级计分的CD-CAT.该文提出了5种新的曝光控制的选题策略,分别是BSCDI_A、BSCTTID_A、BSCDI_D、BSCTTID_D和RP_PWCDI,将这5种方法同已有的PWKL和RP_PWKL进行比较,并尝试将这7种选题策略从0-1计分拓展到多级计分.研究结果表明:不管是0-1计分还是多级计分,采用统一量纲后的综合指标进行评价时RP_PWCDI(β=0.5)表现最好,题库使用均匀性各
Abstract:
Many CD-CAT selection strategies focused on improving the classification correct rate,and ignoring the exposure rate.Most of them has high exposure rate,poor uniformity of item bank,and items drift.It spends more manpower and finacial resources on constructing item bank.So reasonable and effective exposure control methods are needed to improve item bank utilization for CD-CAT.In order to improve item bank uitilization,five exposure control methods are presented,they are binary searching algorithm and stratification with ascending Cognitive Diagnosis Index(BSCDI_A),binary searching algorithm and stratification with descending Cognitive Diagnosis Index(BSCDI_D),binary searching algorithm and stratification with ascending CTT item discrimination(BSCTTID_A),binary searching algorithm and stratification with descending CTT item discrimination(BSCTTID_D),combing RP with PWCDI(RP_PWCDI).Two simulation experiments were made to observe the five exposure control methods under dichotomous and polytomous models respectively.The results showed that under dichotomous model,the maximum exposure rate of the five methods was under 20%,the testing overlap rate was under 7%,BSCDI_A、BSCDI_D、BSCTTID_A、BSCTTID_D had the similar PCCR and item bank utilization.Under polytomous model,the PCCR of BSCDI_A、BSCDI_D、BSCTTID_A、BSCTTID_D was a little increased,and almost the same with RP_PWKL and RP_PWCDI.BSCDI_D and BSCTTID_D were a little poorer than BSCDI_A and BSCTTID_A on item bank utilization.

参考文献/References:

[1] 涂冬波,蔡艳,戴海琦,等.一种多级计分的认知诊断模型:P-DINA模型的开发[J].心理学报,2010,42(10):1011-1020.
[2] Hsu C L,Wang Wenchung.Viable-length computerized adpative testing using the higher order DINA model[J].Journal of Educational Measurement,2015,52(2):125-143.
[3] Kaplan M,de la Torre J,Barrada J R.New item selection methods for cognitive diagnosis computerized adaptive testing[J].Applied Psychological Measurement,2015,39(3):167-188.
[4] Liu Jingcheng,Ying Zhiliang,Zhang Stephanie.A rate function aproach to computerized adaptive testing for cognitive diagnosis[J].Psychometrika,2015,80(2):468-490.
[5] 涂冬波,蔡艳.基于属性多极化的认知诊断计算机化自适应测验设计与实现[J].心理学报,2015,47(11):1405-1414.
[6] 戴步云,张敏强,焦璨,等.基于CD-CAT的多策略RRUM模型及其选题方法开发[J].心理学报,2015,47(12):1511-1519.
[7] 郭磊,郑蝉金,边玉芳.变长CD-CAT中的曝光控制与终止规则[J].心理学报,2015,47(1):129-140.
[8] 高椿雷,罗照盛,郑蝉金,等.CD-CAT初始阶段项目选取方法[J].心理科学,2017,40(2):485-491.
[9] de la Torre J.The generalized DINA model framework[J].Psychometrika,2011,76(2):179-199.
[10] Li Feiming,Cohen A,Bottge B,et al.A latent transition analysis model for assessing change in cognitive skills[J].Educational and Psychological Measurement,2016,76(2):76-82.
[11] Zhan Peida,Wang Wenchung,Jiao Hong,et al.The probabilistic-inputs,noisy conjunctive models for cognitive diagnosis[EB/OL].[2018-03-13].https://doi.org/10.3389/fpsyg.2018.00997.
[12] 蔡艳,涂冬波.属性多极化的认知诊断模型拓展及其Q矩阵设计[J].心理学报,2015,47(10):1300-1308.
[13] Haertel E H,Wiley D E.Presentations of ability structures:Implications for testing[M].Hillsdale:Erlbaum,1993:359-384.
[14] Junker B W,Sijtsma K.Cognitive assessment models with few assumptions,and connections with nonparametric item response theory[J].Applied Psychological Measurement,2001,25(3):258-272.
[15] Templin J,Henson R.Measurement of psychological disorders using cognitive diagnosis models[J].Psychological Methods,2006,11(3):287-305.
[16] Hartz S.A bayesian framework for the unified model for assessing cognitive abilities:blending theory with practice[D].Urbana:University of Illinois at Urbana-Champaign,2002.
[17] von Davier M.A general diagnostic model applied to language testing data[J].British Journal of Mathematical and Statistical Psychology,2008,61(2):287-307.
[18] de la Torre J.The partial-credit DINA model[C].Athens:The International meeting of the Psychometric Society,2010.
[19] Ma Wenchao,de la Torre J.A sequential cognitive diagnosis model for polytomous responses[J].Ritish Journal of Mathematical and Statistical Psychology,2016,69(3):253-275.
[20] Cheng Ying.When cognitive diagnosis meets computerized adaptive testing:CD-CAT[J].Psychometrika,2009,74(4):619-632.
[21] Tatsuoka C.Data analytic methods for latent partially ordered classification models[J].Journal of the Royal Statistical Society,2002,51(3):337-350.
[22] Wang Chun.Mutual information item selection method in cognitive diagnostic computerized adaptive testing with short test length[J].Educational and Psychological Measurement,2013,73(6):1017-1035.
[23] Wang Chun,Chuang Huahua,Huebner A.Restrictive stochastic item selection methods in cognitive diagnostic CAT[J].Journal of Educational Measurement,2011,48(3):255-273.
[24] 陈平.认知诊断计算机化自适应测验的项目增补:以DINA模型为例[D].北京:北京师范大学,2011.
[25] Cheng Ying,Chang Huahua.The maximum priority index method for severely constrained item selection in computerized adaptive testing[J].The British Psychological Society,2009,62(2):369-383.
[26] 毛秀珍,辛涛.认知诊断CAT中项目曝光控制方法的比较[J].心理学报,2013,45(6):694-703.
[27] Zheng Chanjin.Some practical item selection algorithms in cognitive diagnostic computerized adpative testing-smart diagnosis for smart learning[D].Urbana:University of Illinois at Urbana-Champaign,2015.
[28] Zheng Chanjin,Wang Chun.Application of binary searching for itme exposure control in coginitive diagnostic computerized adaptive testing[J].Applied Psychological Measurement,2017,41(7):561-576.
[29] Tasuoka C,Ferguson T S.Sequential classificaton on partially ordered sets[J].J R Statist Sco B,2003,65(1):143-157.
[30] Henson R,Duglas J.Test construction for cognitive diagnosis[J].Applied Psychological Measurement,2005,29(4):62-77.
[31] Chang Huahua,Ying Zhiliang.a-stratified multistage computerized adaptive testing[J].Applied Psychological Measurement,1999,23(3):211-222.
[32] Chang Huahua,Stout W.The asymptotic posterior normality of the latent trait in an IRT model[J].Psychometrika,1993,58(1):37-52.
[33] Wang Chun,Zheng Chanjin,Chang Huahua.An enhanced approach to combine item response theory with cognitive diagnosis in ddaptive testing[J].Journal of Educational Measurement,2014,51(4):358-380.
[34] Rupp A A,Templin J,Henson R A.Diagnostic measurement:theory,methods,and application[M].NY:The Guilford Press,2010.
[35] 陈德枝.Samejima等级反应模型下CAT 选题策略比较研究[D].南昌:江西师范大学,.
[36] 刘珍,丁树良,林海菁.基于GPCM 的计算机自适应测验选题策略比较[J].心理学报,2008,40(5):618-625.
[37] 罗照盛,喻晓锋,高椿雷,等.基于属性掌握概率的认知诊断计算机化自适应测验选题策略[J].心理学报,2015,47(5):679-688.
[38] Chang Huahua.Psychometrics behind computerized adaptive testing[J].Psychometrika,2015,80(1):1-20.
[39] 詹沛达,陈平,边玉芳.使用验证性补偿多维IRT模型进行认知诊断评估[J].心理学报,2016,48(10):1347-1356.
[40] Huang Hungyu,Wang Wenchun.The random-effect DINA model[J].Journal of Educational Measurement,2014,51(1):75-97.
[41] Maris E.Estimating multiple classification latent calss models[J].Psychometrika,1999,64(2):187-212.
[42] Van der Linden W J,Hambleton R K.Handbook of modern item response theory[M].New York:Springe,1997:85-100.

备注/Memo

备注/Memo:
收稿日期:2018-09-08
基金项目:国家自然科学基金(31660279)和江西省社会科学规划(16JY36)资助项目.
作者简介:高椿雷(1983-),女,山东烟台人,讲师,博士,主要从事心理与教育测量评价.E-mail:gaochunlei51@qq.com
更新日期/Last Update: 2019-02-10