期刊文献+

分布式并行地形分析中数据划分机制研究 被引量:5

Research on data partitioning of distributed parallel terrain analysis
在线阅读 下载PDF
导出
摘要 数据粒度是海量空间数据并行计算的重要问题之一。通过对不同性质的并行算法的对比分析,提出空间数据粒度模型,量化地反映并行地形分析中数据划分的规模,建立并行数据粒度评价模型。通过研究集群环境下不同算法的数据并行数据粒度问题,提出基于并行数据粒度评价模型的优化数据粒度调度算法。通过计算每一次并行计算的时间与数据粒度效率,从而实现对计算数据粒度动态更新以追求更高的加速比。经过实验验证,该算法较之传统算法,可提供更高的任务执行效率并具有更好的可移植性。 Data granularity is one of the most important issues of parallel computing based on large volume of spatial data. After a comparison with the different types of terrain analysis algorithms, a Geo-Data Granularity Model (GDGM in short) was proposed, which can be used for the quantitative description of data partition granularity in parallel computing process of massive spatial data. In this algorithm, according to the parallel evaluation method, the parallel data granularity was adaptively adjusted and finally an optimized data grain was obtained. The execution time of each parallel computing was recorded for the comparison of computing efficiency values from different data granularities. Furthermore, by means of the comparison, a dynamic algorithm was designed for the dynamic scheduling of different data granularity so that the optimal performance of specific algorithm was achieved. The preliminary experiments show that the algorithm has much better efficiency and portability than the traditional ones so far.
出处 《国防科技大学学报》 EI CAS CSCD 北大核心 2013年第1期130-135,共6页 Journal of National University of Defense Technology
基金 国家863计划资助项目(2011AA120303) 国家自然科学基金资助项目(41171298) 资源与环境信息系统国家重点实验室开放基金资助项目(2010KF0002SA) 江苏省普通高校研究生科研创新计划项目(CXZZ12_0393)
关键词 并行计算 数字地形分析 数据划分 数据粒度 parallel computing digital terrain analysis data partition data granularity
  • 相关文献

参考文献16

  • 1Ortega L, Rueda A. Parallei drainage network computation on CUDA [ J ]. Computers & Geosciences,2010,36 (2) : 171 - 178.
  • 2程果,景宁,陈荦,熊伟,欧阳柳.栅格数据处理中邻域型算法的并行优化方法[J].国防科技大学学报,2012,34(4):114-119. 被引量:10
  • 3Schiele S, Mfiller M, Blaar H, et al. Parallelization strategies to deal with non-localities in the calculation of regional land- surface parameters[ J]. Computers & Geosciences, 2012, 44: 1-9.
  • 4Li T, Wang G, Chen J. A modified binary tree codification of drainage networks to support complex hydrological models[ J]. Computers & Geosciences, 2010, 36 ( 11 ) : 1427 - 1435.
  • 5Alaln J M, Sophie L B, Zhen L. An analytical approach to the performance evaluation of master-slave computational model [J]. Parallel Computing, 1998, 24(5, 6) : 841 -862.
  • 6Sun X H, Gustafson J L. Toward a better parallel performance metric[J]. Parallel Computing, 1991, 17 ( 10 - 11 ) : 1093 - 1109.
  • 7舒继武,est4.cs.tsinghua.edu.cn,郑纬民,沈美明,汪东升.大规模问题数据并行性能的分析[J].软件学报,2000,11(5):628-633. 被引量:14
  • 8Lee J, Pillardy J, Czaplewski C, et al. Efficient parallel algorithms in global optimization of potential energy functions for peptides, proteins, and crystals [ J ]. Computer Physics Communications, 2000, 128(1-2): 399-411.
  • 9McCombs J R, Stathopoulos A. Parallel, muhigrain iterative solvers for hiding network latencies on MPPs and networks of clusters [ J ]. Parallel Computing, 2003, 29 ( 9 ) : 1237 - 1259.
  • 10周启呜,刘学军.数字地形分析[M].北京:科学出版社,2007.

二级参考文献18

  • 1刘学军,龚健雅,周启鸣,汤国安.基于DEM坡度坡向算法精度的分析研究[J].测绘学报,2004,33(3):258-263. 被引量:165
  • 2刘德才,王鼎兴,沈美明,郑纬民.数据并行的性能分析[J].软件学报,1994,5(5):8-15. 被引量:4
  • 3Alain J M,Parallel Computing,1998年,24卷,5,6期,841页
  • 4Sun X H,Parallel Computing,1991年,17卷,10,11期,1093页
  • 5Kuck D J. High performance computing: challenges for future systems[ M]. New York, NY: Oxford University Press, 1996.
  • 6Guan X F, Wu H Y. Leveraging the power of multi-core platforms for large-scale geospatial data [ J ]. Computers & Geosciences, 2010, 36 : 1276 - 1282.
  • 7Huang Q Y, Yang C W. Optimizing grid computing configuration and scheduling for geospatial analysis: an example with interpolating DEM [ J ]. Computers & Geosciences, 2011,37(2) :165 - 176.
  • 8Tomlin C I). Geographic information systems and cartographic modelling[M]. Englewood Cliffs, NJ: Prentice Hall, 1990.
  • 9Clematis A, Mineter M, Marciano R. High performance computing with geographical data [ J]. Parallel Computing, 2003, 29(10) : 1275 - 1279.
  • 10Jeffrey D, Sanjay G. MapReduce: simplified data processing on large clusters [ C ]//Proceedings of OSDI' 04. USENIX Association, 2004 : 137 - 150.

共引文献22

同被引文献126

引证文献5

二级引证文献47

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部