期刊文献+

基于蚁群算法的Hadoop资源感知调度器研究 被引量:7

Research of Hadoop resource-aware scheduler based on ant colony algorithm
在线阅读 下载PDF
导出
摘要 通过研究蚁群算法,针对现有Hadoop调度器的不足,提出一个基于蚁群算法的Hadoop资源感知调度器及其具体实现方案。从而使Hadoop作业调度器可以更有效地对任务进行分配,提高整体架构的作业性能。通过实验证明,利用蚁群算法实现的资源感知调度器在同构环境中虽没有明显改善系统计算速度,但是在异构环境中可以很好提高系统处理任务的性能,降低了运算时间。 By studying the colony algorithm, analyzing the deficiency of existing Hadoop scheduler, a resource-aware sched-uler based on ant colony algorithm is proposed. It can be more comprehensive and more scientific to assign tasks and improve the operating performance of the overall architecture. The experiment shows that, the resource-aware scheduler has not improved the performance markedly in isomorphic situation, however, it can significantly increase performance in isomerism situation. This resource-aware scheduler can improve the calculation speed of the system and reduce the computing time.
出处 《计算机工程与应用》 CSCD 2014年第15期65-71,共7页 Computer Engineering and Applications
基金 国家自然科学基金(No.61170268) 优秀青年教师科技支撑专项计划(No.YX2010-30)
关键词 HADOOP 资源感知调度器 蚁群算法 Hadoop resource-aware scheduler ant colony algorithm
  • 相关文献

参考文献12

二级参考文献68

  • 1VARIA J. Cloud architectures - Amazon Web services [ EB/OL]. [ 2009 - 03 - 01 ]. http://acmbangalore, org/events/monthly-talk/ may-2008 --cloud-architectures---amazon-web-services. html.
  • 2BRYANT R E. Data-intensive supercomputing: The case for DISC, CMU-CS-07-128 [ R]. Pittsburgh, PA, USA: Carnegie Mellon University, Department of Computer Science, 2007.
  • 3SZALAY A S, KUNSZT P, THAKAR A, et al. Designing and mining multi-terabyte astronomy archives: The sloan digital sky survey [ C]//Proceedings of the 2000 ACM SIGMOD International Conference on Management of Data. New York: ACM Press, 2000:451 - 462.
  • 4BARROSO L A, DEAN J, HOLZLE U. Web search for a planet: The Google cluster architecture [ J]. IEEE Micro, 2003, 23(2) : 22 -28.
  • 5GILES J. Google tops translation ranking [ EB/OL]. (2006 - 11 - 06) [ 2009 - 03 - 06 ]. http://www, nature, com/news/2006/ 061106/full/news061106-6. html.
  • 6维基百科.Cloud computing [ EB/OL]. [ 2009 - 03 - 10]. http://en. wikipedia, org/wiki/Cloud_computing.
  • 7中国云计算网.什么是云计算?[EB/OL].(2008-05-14)[2009-02-27].http://www.cloudcomputing-china.cn/Article/ShowArticle.asp?ArticleID=1.
  • 8VAQUERO L M, RODERO-MERINO L, CACERES J, et al. A break in the clouds: Towards a cloud definition [ J]. ACM SIGCOMM Computer Communication Review, 2009, 39(1): 50-55.
  • 9WEISS A. Computing in the clouds [ J]. ACM Networker, 2007, 11(4): 16 -25.
  • 10GRIFFITHS A, METHERALL G. Cluster intereonnection networks [ EB/OL]. (2000 -09 -01)[2009 -03 -03]. http://www, gridbus. org/-raj/csc433/ClusterNets, pdf.

共引文献1218

同被引文献49

引证文献7

二级引证文献24

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部