[1]李贵玉,涂冬波,戴步云,等.计算机多阶段自适应测验的组卷方法[J].江西师范大学学报(自然科学版),2017,(05):462-469.
 LI Guiyu,TU Dongbo,DAI Buyun,et al.The Test Assemble Methods of Multistage Adaptive Test[J].,2017,(05):462-469.
点击复制

计算机多阶段自适应测验的组卷方法()
分享到:

《江西师范大学学报》(自然科学版)[ISSN:1006-6977/CN:61-1281/TN]

卷:
期数:
2017年05期
页码:
462-469
栏目:
出版日期:
2017-11-01

文章信息/Info

Title:
The Test Assemble Methods of Multistage Adaptive Test
作者:
李贵玉涂冬波戴步云宗一涛高旭亮苗 莹
江西师范大学心理学院,江西 南昌 330022
Author(s):
LI GuiyuTU DongboDAI BuyunZONG YitaoGAO XuliangMIAO Ying
School of Psychology,Jiangxi Normal University,Nanchang Jiangxi 330022,China
关键词:
计算机多阶段自适应测验 自动组卷 组卷方法 测验规范
Keywords:
multistage adaptive Test automated test assemble test assemble methods test specification
分类号:
B 841
文献标志码:
A
摘要:
计算机多阶段自适应测验(MST)实施的关键是成功组建多个满足测验规范(即统计和非统计约束)的平行测验(或称测验面板),自动组卷(ATA)为实现测验平行提供了可能.现有的MST组卷方法研究主要包括以下几种:1)基于线性规范算法的组卷方法; 2)基于启发式算法的组卷方法; 3)基于蒙特卡洛算法的组卷方法; 4)基于在线组卷的方法.该文讨论这几种方法的优缺点并进行比较,同时指出未来可进一步改进这种方法并开发基于认知诊断测验的自动组卷方法.
Abstract:
The key to implement multistage adaptive test(MST)is to build multiple parallel tests(or panels)that meet statistical and nonstatistical constraints required.Automated test assemble(ATA)provides a way to achieve parallel tests.Existing assemble methods are mainly based on linear programming,heuristic algorithm,Monte Carlo and on-the-fly method.Future studies should focus on the comparison and improvement of these methods and the development of ATA based on cognitive diagnosis tests.

参考文献/References:

[1] 王钰彤,罗照盛,王睿.计算机多阶段自适应测验研究评述 [J].心理科学,2015,38(2):452-456.
[2] Kim S,Moses T,Yoo H.A comparison of IRT proficiency estimation methods under adaptive multistage testing [J].Journal of Educational Measurement,2015,52(1):70-79.
[3] Adema J J.The construction of customized two-stage tests [J].Journal of Educational Measurement,1990,27(3):241-253.
[4] Lewis C,Sheehan K.Using Bayesian decision theory to design a computerized mastery test [EB/OL].
[2017-01-21].http://www.iacat.org/sites/default/files/biblio/v14n4p367.pdf.
[5] Luecht R M.Computer-assisted test assembly using optimization heuristics [J].Applied Psychological Measurement,1998,22(3):224-236.
[6] Luecht R M,Nungester R.Some practical examples of computer-adaptive sequential testing [J].Journal of Educational Measurement,1998,35(3):229-249.
[7] Luecht R M,Brumfield T,Breithaupt K.A testlet assembly design for adaptive multistage tests [J].Applied Measurement in Education,2006,19(3):189-202.
[8] Armstrong R D,Jones D H,Kunce C S.Study of a network-flow algorithm for test assembly [J].Applied Psychological Measurement,1996,22:89-98.
[9] Armstrong R D,Jones D H,Koppe N B,et al.Computerized adaptive testing with multiple form structures [J].Applied Psychological Measurement,2004,28(3):147-164.
[10] Armstrong R D,Jones D H,Wu I.An automated test development of parallel tests from a seed test [J].Psychometrika,1992,57(2):271-288.
[11] Armstrong R D,Roussos L.A method to determine targets for multi-stage adaptive tests [R].Newton,PA:Law school Adamission Council,2005.
[12] Belov D I,Armstrong R D.Monte Carlo test assembly for item pool analysis and extension [J].Applied Psychological Measurement,2005,29(4):239-261.
[13] Belov D I,Armstrong R D.A Monte Carlo approach to the design,assembly,and evaluation of multistage adaptive tests [J].Applied Psychological Measurement,2008,32(2):119-137.
[14] Breithaupt K,Hare D R.Automated simultaneous assembly of multistage testlets for a high-stakes license examination [J].Educational and Psychological Measurement,2007,67(1):5-20.
[15] Chen Lingyin.An investigation of the optimal test designs for multi-stage test using the generalized partial credit model [D].Austin:University of Texas at Austin,2011.
[16] Chen Peihua,Chang Huahua,Wu Haiyan.Item selection for the development of parallel forms from an IRT-based seed test using a sampling and classification approach[J].Educational and Psychological Measurement,2012,72(6):933-953.
[17] Cheng Ying,Chang Huahua.The maximum priority index method for severely constrained item selection in computerized adaptive testing [J].British Journal of Mathematical and Statiatical Psychology,2009,62(2):369-383.
[18] Hambleton R K,Xing Dehui.Optimal and nonoptimal computer-based test designs for marking pass-fail decision [J].Applied Measurement in Education,2006,19(3):221-239.
[19] Jodoin M G,Zenisky A,Hambleton R K.Comparison of the psychometric properties of several computer-based test designs for credentialing exams with multiple purpose [J].Applied Measurement in Education,2006,19(3):203-220.
[20] Keng L.A comparison of the performance of testlet-based computer adaptive tests and multistage tests [D].Austin:University of Texas at Austin,2008.
[21] Luecht R M.Implementing the computer-adaptive sequential testing(CAST)framework to mass produce high quality computer-adaptive and mastery tests [EB/OL].
[2017-01-16].http://files.eric.ed.gov/fulltext/ED442823.pdf.
[22] Luecht R M.Exposure control using adaptive multi-stage item bundle [EB/OL].
[2017-01-16].http://files.eric.ed.gov/fulltext/ED475831.pdf.
[23] Luecht R M,Burgin W.Test information targeting strategies for adaptive multistage testing designs[EB/OL].
[2017-01-16].http://files.eric.ed.gov/fulltext/ED475830.pdf.
[24] Patsula L N.A comparison of computerized adaptive testing and multistage testing [D].Amherst:University of Massachusetts,Amherst,1999.
[25] Samejima F.A use of the information function for tailored testing [J].Applied Psychological Measurement,1977,1(2):233-247.
[26] Zheng Ying,Nozawa Y,Gao Xiaohong,et al.Multistage adaptive testing for a Large-Scale classification test:design,heuristic assembly,and comparison with other testing modes [R].ACT Research Report Series,2012.
[27] Zheng Yi,Chang Huahua.On-the-fly assembled multistage adaptive testing [J].Applied Psychological Measurement,2015,39(2):104-118.
[28] Yan Duanli,Alina A,von Davier.Computerized multistage testing theory and applications [M].New York:CRC Press,2014.
[29] Gulliksen H.Theory of mental tests [M].New York:John Wiley,1950.
[30] Lord F M.Practical applications of item characteristic curve theory [J].Journal of Educational Measurement,1977,14(2):117-138.
[31] Swanson L,Stocking M L.A model and heuristic for solving very large item selection problems [J].Applied Psychological Measurement,1993,17(2):151-166.
[32] Theunissen T J J M.Binary programming and test designs [J].Psychometrika,1985,50(4):411-420.
[33] Theunissen T J J M.Some applications of optimization algorithms in test design and adaptive test [J].Applied Psychological Measurement,1989,10(4):381-389.
[34] Timminga E.The construction of parallel tests from IRT-Based item banks [J].Journal of Education Statistics,1990,15(2):129-145.
[35] van der Linden W J.Optimal assembly of psychological and educational tests [J].Applied Psychological Measurement,1998,22(22):195-211.
[36] van der Linden W J,Glas G A W.Computerized adaptive testing:Theory and practice [M].Netherlands:Kluwer,2000.
[37] Ackerman T.An alternative methodology for creating parallel test forms using the IRT information function[EB/OL].
[2017-01-16].http://files.eric.ed.gov/fulltext/ED306279.pdf.
[38] 涂冬波,蔡艳,丁树良.认知诊断理论、方法与应用 [M].北京:北京师范大学出版社,2012.
[39] 高椿雷,罗照盛,郑蝉金,等.具有认知诊断功能的多阶段自适应测验及其影响因素研究 [J].心理科学,2015,39(6):1492-1499.
[40] Timminga E.Solving infeasibility problems in computerized test assembly [J].Applied Psychological Measurement,1998,22(3):280-291.

备注/Memo

备注/Memo:
收稿日期:2017-05-22基金项目:国家自然科学基金(31660278,31760288),教育部人文社科项目(11YJC190002),高等院校博士点基金(20123604120001),江西省社会科学规划重点项目(13JY01),江西省教育科学规划项目(12YB088,13YB029)和江西师范大学青年英才培育计划资助项目.通信作者:涂冬波(1978-),男,江西南昌人,教授,博士生导师,主要从事心理统计与测量的研究.E-mail:tudongbo@aligun.com
更新日期/Last Update: 1900-01-01