期刊文献+

MapReduce模型下Voronoi图栅格生成算法 被引量:2

Raster Generation of Voronoi Diagram under MapReduce
在线阅读 下载PDF
导出
摘要 针对"海量"点组成的平面点集Voronoi图栅格生成算法的效率问题,对其进行易并行性抽象,提出了一种MapReduce模型下基于欧氏距离的Voronoi图栅格生成算法,该算法采用三个MapReduce Job来实现。在第一个MapReduce Job中,将栅格按照隶属代码进行归属分类。在第二个MapReduce Job中,将新数据按照其对应的行号进行归类。在第三个MapReduce Job中,并行生成全局有序的Voronoi图部分文件,并连接各个部分文件,生成最终的Voronoi图。在多个不同大小数据集上的实验结果表明,这种MapReduce模型下的算法部署在Hadoop集群上运行具有较好的加速比和扩展性。 For the efficiency of the raster generation of Voronoi diagram on a planar point set composed of massive points, after its embarrassingly parallel abstract, this paper proposes the raster generation of Voronoi diagram based on the Euclidean distance. The algorithm is designed with three MapReduce Jobs. During the first MapReduce Job, the rasters are classified by the attached code. During the second MapReduce Job, the new data are classified according to its corresponding line number. During the third MapReduce Job, the partial Voronoi diagrams are generated in par- allel, and they maintain a global order, then the final Voronoi diagram is generated by connecting the partial Voronoi diagrams. The experiments on different sizes of datasets on the Hadoop platform demonstrate that the algorithm under MapReduce shows good performance on speedup and scaleup.
出处 《计算机科学与探索》 CSCD 2013年第2期160-168,共9页 Journal of Frontiers of Computer Science and Technology
基金 国家自然科学基金面上项目Nos.40971213 41171310 41271387~~
关键词 VORONOI图 MAPREDUCE HADOOP平台 栅格生成算法 Voronoi diagram MapReduce Hadoop platform raster generation algorithm
  • 相关文献

参考文献9

  • 1潘巍,李战怀,伍赛,陈群.基于消息传递机制的MapReduce图算法研究[J].计算机学报,2011,34(10):1768-1784. 被引量:44
  • 2李成名,陈军.Voronoi图生成的栅格算法[J].武汉测绘科技大学学报,1998,23(3):208-210. 被引量:31
  • 3Chen J.Voronoi - based dynamic spatial data model[]..2002
  • 4Okabe A,Boots B,Sugihara K,et al.Spatial Tessellations: Concepts and Applications of Voronoi Diagrams[]..2000
  • 5Aurenhammer F.Voronoi diagrams - a survey of a fundamental geometric data structure[].ACM Computing Surveys.1991
  • 6Held M V.An engineering approach to the reliable and efficient computation of Voronoi diagrams of points and line segments[].Computational Geosciences.2001
  • 7Dean J,Ghemawat S.MapReduce:Simplified data processing on large clusters[].Communications of the ACM.2005
  • 8Akdogan A,Demiryurek U,Banaei-Kashani F et al.Voronoi-based Geospatial Query Processing with MapReduce[].IEEE Second International Conference on Cloud Computing Technology and Science (CloudCom).2010
  • 9Shafer,J,Rixner,S,Cox,A.L.The Hadoop distributed filesystem:Balancing portability and performance[].IEEE International Symposium on Performance Analysis of Systems & Software (ISPASS).2010

二级参考文献36

  • 1Dean J, Ghemawat S. MapReduce: Simplified dala processing on large clusters//Proceedings of the Conference on Operating System Design and Implementation(OSDU04,). San Francisco, USA, 2004: 137-150.
  • 2Thusoo A, Sarma J S, JainN, Shao Z, Chakka P, Anthony S, Liu H, Wyckoff P, Murthy R. Hive: A warehousing solution over a map-reduce framework//Proceedings of the Conference on Very Large Databases (VLDB' 09). Lyon, France, 2009:1626-1629.
  • 3Olston C, Reed B, Srivastava U, Kumar R, Tomkins A. Pig Latin: A not-so-foreign language for data processing//Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data (SIGMOD' 08). Vancouver, BC, Canada, 2008:1099 1110.
  • 4Bu Y, Howe B, Balazinska M, Ernst M D. HaLoop.. Efficient iterative data processing on large clusters//Proceedings of the Conference on Very Large Databases (VLDB' 10). Sin gapore, 2010:285-296.
  • 5Ekanayake J, Li H, Zhang B, Gunarathne T, Bae S-H, Qiu J, Fox G. Twister: A runtime for iterative MapReduce// Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing. Chicago, Illinois, USA, 2010:810-818.
  • 6Wilson G V. Practical Parallel Programming. Cambridge, MA.. MIT Press, 1995.
  • 7Valiant L G. A bridging model for parallel computation. Communications of the ACM, 1990, 33(8): 103-111.
  • 8Dean J, Ghemawat S. MapReduce: A flexible data processing tool. Communications of the ACM, 2010, 53(1): 72-77.
  • 9Pavlo A, Paulson E, Rasin A, Abadi D J, DeWitt D J, Mad den S, Stonebraker M. A comparison of approaches to large scale data//Proceedings of the 2009 ACM SIGMOD Interna tional Conference on Management of Data (SIGMOD' 09) New York, USA, 2009:165-178.
  • 10Stonebraker M, Abadi D J, DeWitt D J, Madden S, Paulson E, Pavlo A, Rasin A. MapReduce and parallel DBMSs: Friends or foes? Communications of the ACM, 2010, 53(1) : 64-71.

共引文献73

同被引文献16

引证文献2

二级引证文献3

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部