期刊文献+

基于FAHP的hadoop平台移动终端云存储优化研究

Study on the Optimization of Mobile Terminal Cloud Storage on Hadoop Platform based on FAHP
原文传递
导出
摘要 Hadoop云存储架构的设计初衷是实现大文件的高效存储处理,但在处理移动终端下诸如图片等小文件时会引起名称节点索引提取速度过慢和数据节点存储空间利用率不高等问题。针对这一问题,提出一种小文件归档的方案FHAR。方案综合考虑移动终端用户访问的实时性、名称节点服务器内存使用率、数据节点存储空间利用率等方面,利用双层索引的归档技术结合FAHP(模糊多属性决策理论)的系统负载预测算法实现系统的负载均衡,提高服务效率。同时利用数据预取机制对访问操作进行优化。仿真结果表明,该方案有效提高了节点的存储效率与用户访问的实时体验性。 Hadoop is a cloud storage architecture which was originally designed to realize the effi- cient storage of the large file processing, however, it will cause a low extraction speed of the name node index and low utilization of the data node storage space when processing the small file in the mobile terminal such as pictures. To solve this problem, we proposed a approach FHAR Considering the time of access to mobile users, the usage of name node memory and the efficiency of data stor- age. Combined with the theory of FAHP( Fuzzy Analytical Hierarchy Process) prediction algorithm and making with double indexing archiving technique to achieve load balancing of the system load and improve the efficiency of s.ervice. At the same time use data prefetching mechanism for accessing operation optimization. The simulation results show that this approach can effectively improve the u- tilization of the nodes and the real - time access.
作者 王彬 周莲英
出处 《无线通信技术》 2014年第1期32-36,共5页 Wireless Communication Technology
关键词 HADOOP 移动终端 FAHP 负载均衡 数据预取 Hadoop mobile terminal FAHP load balance data prefetching
  • 相关文献

参考文献9

  • 1Tom W. Hadoop : The Definitive Guide [ M ]. United States of America: OReilly Media,2009.
  • 2余思,桂小林,黄汝维,庄威.一种提高云存储中小文件存储效率的方案[J].西安交通大学学报,2011,45(6):59-63. 被引量:43
  • 3MACKEY G, SEHRI S, WANG Jun. Improving metadata management for small files in HDFS [ C/OL ]//Proceed- ings of 2009 IEEE International Conference on Cluster Computing and workshops [ 2010 - 08 - 10 ]. http ://iee- explore, ieee. org/stamp/stamp, jsptp = &amumber = 528913.
  • 4DONG Bo, QIU Jie, ZHENG Qinghua,et al. A norvel approach to improving the efficiency of storing and acess- ing small files on hadoop: a case study by PowerPoint files [C]// Proceedngs of the 7th International Confer- ence on Services Computing. Piscataway, NJ, USA: IEEE, 2010:65 - 72.
  • 5张吉军.模糊层次分析法(FAHP)[J].模糊系统与数学,2000,14(2):80-88. 被引量:1604
  • 6Cafare.Ua B, Cutting D. Hadoop : a framework for running applications on large clusters built of commodity hardware [ EB/OL ]. http ://lucene. Apache . org/hadoop/, 2005.
  • 7刘小珠,孙莎,曾承,彭智勇.基于缓存的倒排索引机制研究[J].计算机研究与发展,2007,44(z3):153-158. 被引量:8
  • 8Mingliang Liu, Lin Qiao, Fucen Zeng and Zhizhong Tang Exploring Data Prefetching Mechanisms for Last Level Cache in Chip Multi- processors[ C/OL]//2010 interna- tional Colloquium on Computling, Communication, Con- trol,and Management(CCCM2010) Volume 3,2010.
  • 9苗秀,俞俊生,刘绍华,陈晓东.基于云计算平台的移动IPTV系统设计及负载均衡技术研究[J].软件,2011,32(1):46-53. 被引量:13

二级参考文献30

  • 1李栋,史晓东.一种支持高效检索的实时更新倒排索引策略[J].情报学报,2006,25(1):16-20. 被引量:6
  • 2[1]D E Knuth.The Art of Computer Programming,Sorting and Searching.1st ed.Reading,MA:Addision-Wesley,1973
  • 3[2]Gonzalo Navarro,Edleno Silva Demoura,Nivio Ziviani.Adding compression to block addressing inverted indices.Information Retrieval Journal,2000,3(1):49-77
  • 4[4]Vongoc Anh,Alistair Moffat.Inverted index compression using word-aligned binary codes.Information Retrieval,2005,8(1):151-166
  • 5Google. Google App Engine[EB/OL].[2008].http://appengine.google.com/.
  • 6Amazon. Amazon EC2[EB/OL].[2010]. http://aws.amazon.com/ec2/.
  • 7Microsoft. Windows azure[EB/OL].[2010].
  • 8http://www.microso ft. Apache. Hadoop[EB/OL].[2010]. http://hadoop.apache.org/.
  • 9Eucalyptus Systems, Inc. Eucalyptus[EB/OL].[2010]. http ://www.eucalyptus.com/.
  • 10Abiquo. Abiquo Documentation Home[EB/OL].[2010]. http://abicloud.org/.

共引文献1664

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部