[1]陈军,卢涵宇,姚丹丹.一种基于处理时间的Map/Reduce动态均衡调度算法[J].江西师范大学学报(自然科学版),2013,(01):51-55.
　CHEN Jun,LU Han-yu,YAO Dan-dan.An Algorithm for Map/Reduce Dynamic Loading Balancing Policy Based on Processing Time[J].Journal of Jiangxi Normal University:Natural Science Edition,2013,(01):51-55.
点击复制

一种基于处理时间的Map/Reduce动态均衡调度算法()
分享到：

《江西师范大学学报》（自然科学版）[ISSN:1006-6977/CN:61-1281/TN]

卷:
期数:
2013年01期
页码:
51-55
栏目:
出版日期:
2013-01-01

文章信息/Info

Title:
An Algorithm for Map/Reduce Dynamic Loading Balancing Policy Based on Processing Time
作者:
陈军;卢涵宇;姚丹丹
成都理工大学地球探测与信息技术教育部重点实验室,四川成都610059;成都信息工程学院资源环境学院,四川成都610225；成都理工大学地球探测与信息技术教育部重点实验室,四川成都610059;贵州大学计算机与信息工程系,贵州贵阳550003；成都理工大学地球探测与信息技术教育部重点实验室,四川成都,610059
Author(s):
CHEN Jun；LU Han-yu；YAO Dan-dan
关键词:
云计算; 映射/规约; 负载均衡调度
Keywords:
cloud computing;  Map/Reduce;  load balancing scheduling
分类号:
TP391
文献标志码:
A
摘要:
提出了一种基于处理时间的Map/Reduce动态均衡调度算法.在该算法中,为参与计算的各节点建立处理总时间指标；当节点的子任务返回时动态更新当前节点的处理时间,并按照最小处理总时间来选择子任务处理的节点.实验证明:该算法不仅减少了节点与云中心服务器的负载信息传递,而且充分利用了各计算节点的处理能力,提高了Map/Reduce调度效率,对于提升云计算服务的质量具有十分重要的理论意义.
Abstract:
An algorithm of dynamic loading balancing policy for Map/Reduce based on processing time has been proposed.In this algorithm,each computing node is assinged the process total time indicators.The processing time of each node is updated after it returns the result of subtask,which is the key index for selecting the best node.Experiments show that,due to the reduction of communication frequency between the node and the cloud server,the algorithm can take full advantage of the processing power of computing nodes and improve the Map / Reduce scheduling efficiency.

参考文献/References:

[1] Yang Hung-chih,Ali Dasdan,Hsiao Ruey-lung,et al.Map-reduce-merge:simplified relational data processing on large clusters[EB/OL].
[2012-12-16].http:∥www.cs.duke.edu/courses/cps399.28/current/papers/sigmod07-YangDasdanEtAl-map_map_reduce_merge.pdf.
[2] 王霜,修保新,肖卫东.Web 服务器集群的负载均衡算法研究 [J].计算机工程与应用,2004,40(25):78-80.
[3] Foto N,Afriti,Jeffrey D,et al.Optimizing joins in a map-reduce environment[EB/OL].
[2012-12-16].http:∥infolab.stanford.edu/～ullman/pub/join-mr.pdf.
[4] 吴宝贵,丁振国.基于 Map/Reduce 的分布式搜索引擎研究 [J].现代图书情报技术,2007,2(8):52-55.
[5] Berthold Jost,Dieterle Mischa,Loogen Rita.Implementing parallel Google map-reduce in Eden [J].Euro-Par 2009 Parallel Processing,2009,5704:990-1002.
[6] Jeffrey Dean,Sanjay Ghemawat.MapReduce:simplified data processing on large clusters [J].Communications of the ACM,2008,51(1):107-113.
[7] Kevin Barker,Andrey Chernikov,Nikos Chrisochoides,et al.A load balancing framework for adaptive and asynchronous applications [J].Parallel and Distributed Systems,IEEE Transactions on,2004,15(2):183-192.
[8] Arnaud Legand,He'le ne Renard,Yves Robert,et al.Mapping and load-balancing iterative computations [J].Parallel and Distributed Systems,IEEE Transactions on,2004,15(6):546-558.
[9] Helene Renard,Yves Robert,Frederic Vivien.Static load-balancing techniques for iterative computations on heterogeneous clusters [J].Euro-Par 2003 Parallel Processing,2003,2790:148-159.
[10] 蒋翠清,杨善林,黄梯云.基于Agent的动态负载均衡技术及仿真实现 [J].微电子学与计算机,2005,22(10):47-50.
[11] 邓成玉 章,刘永山.动态负载均衡策略及相关模型研究 [J].计算机工程与应用,2011,47(8):131-134.
[12] Willbebek-Lemair Marc H,Reeves Anthony P.Strategies for dynamic load balancing on highly parallel computers [J].Parallel and Distributed Systems,IEEE Transactions on,1993,4(9):979-993.
[13] Zhang Xiayu,Yu Yongquan,Chen Baixing,et al.An extension-based dynamic load balancing model of heterogeneous server cluster[EB/OL].
[2012-12-16].http:∥ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=243526&userType=inst.
[14] Taylor,Ronald C.An overview of the Hadoop/MapReduce/HBase framework and its current applications in bioinformatics [EB/OL].
[2012-12-18].http:∥www.biomedcentral.com/1471-2105/11/S12/S1.
[15] 刘晔,沈潇军,刘摩西.基于云模式的负载均衡策略研究 [J].电脑与电信,2012,12:38-40.

相似文献/References:

[1]魏丹丹,邱乐兴.基于Web3.0的网络教学个性化服务平台构建[J].江西师范大学学报(自然科学版),2013,(06):584.
　WEI Dan-dan,QIU Le-xing.Network Teaching Personalized Service Platform Construction Based on Web3.0[J].Journal of Jiangxi Normal University:Natural Science Edition,2013,(01):584.
[2]周莉,王珏,周勇.云计算环境下可视化探索式搜索引擎的研究[J].江西师范大学学报(自然科学版),2015,(06):637.
　ZHOU Li,WANG Jue,ZHOU Yong.The Research on Visual Exploratory Search Engine in Cloud Computing Environment[J].Journal of Jiangxi Normal University:Natural Science Edition,2015,(01):637.
[3]杨 波,马 勇*,马志程,等.资源池安全接入管理关键技术研究[J].江西师范大学学报(自然科学版),2020,(06):639.[doi:10.16357/j.cnki.issn1000-5862.2020.06.16]
　YANG Bo,MA Yong*,MA Zhicheng,et al.The Study on Key Technology of Secure Access to the Resource Pool Management[J].Journal of Jiangxi Normal University:Natural Science Edition,2020,(01):639.[doi:10.16357/j.cnki.issn1000-5862.2020.06.16]

备注/Memo

备注/Memo:
国家自然科学基金(61071121)
更新日期/Last Update: 1900-01-01