摘要
针对Delay算法的不合理等待问题,提出一种基于资源预测的Delay调度算法(RFD),该算法基于对资源可用性的预测方法合理地调度作业.实验结果表明,在Hadoop机群一般应用场景下,该调度算法与已有算法相比,在保证作业本地化计算Map任务比例相近的同时,将作业平均运行效率提高28.8%,明显提高了Mapreduce作业的执行效率.
In order to solve the unreasonable wait existed in delay algorithm, this paper presents a method based on resource forecast delay scheduling algorithm, by which one reasonably dispatches operation on the basis of resource availability prediction method. The experimental results show that in the Hadoop cluster general application scenario, the scheduling algorithm, compared with related work, makes the average operating efficiency increased by a factor of 28.8% in the assurance of localization computing map task to be similar. This work will greatly improve the working efficiencY of Mapreduce.
出处
《吉林大学学报（理学版）》
CAS
CSCD
北大核心
2013年第1期101-106,共6页
Journal of Jilin University:Science Edition
基金
国家自然科学基金(批准号:61170004)
新世纪优秀人才支持计划项目(批准号:NCET-09-0428)
国家公益性科研专项基金(批准号:201011076)
