期刊文献+

基于递推算法的海量COMTRADE数据计算并行化 被引量:5

Calculation Parallelization for Massive COMTRADE Data Based on Recursive Algorithms
在线阅读 下载PDF
导出
摘要 针对海量暂态数据交换通用格式(COMTRADE)数据计算时,由于基础算法和串行编程造成的效率瓶颈,经过试验和改进,优选出了可适应快速计算的递推全波离散傅里叶算法、加窗递推全波离散傅里叶算法和能滤除直流分量的可递推算法。在这3种递推算法的基础上,提出了海量通道数据计算并行化框架,此框架为避免伪共享效应所引起的效率损失,在每个计算线程内对参与计算的每个通道提供了一个独立的"通道高速缓存队列",并提供基于下标映射的虚拟块数据访问机制,形成递推算法可直接访问的窗口数据映射块。试验证明,此递推算法和并行化框架相结合可大幅提升计算效率,并且可随着CPU核心数的增加和计算数据量的加大,获得线性加速比。 In order to improve the calculation efficiency of mass common format for transient data exchange(COMTRADE) data caused by the basic algorithms and serial programming,three fast computation algorithms have preferentially been chosen by tests and improvement:a recursive full-wave discrete Fourier algorithm,a windowed recursive full-wave discrete Fourier algorithm and a recursive algorithm for filtering out the direct current(DC)component.A parallelization framework is proposed for mass COMTRADE data calculation based on the three aforementioned algorithms.To avoid efficiency losses due to the false memory sharing effect,the framework provides a separate channel cache queue for each calculation thread and a data access mechanism based on the virtual block index map,by means of which recursive algorithms can directly access the window data mapping block.Test indicates that high acceleration ratio is achieved and the linear acceleration ratio can be attained with an increase in the core number and COMTRADE data.
作者 桂勋
出处 《电力系统自动化》 EI CSCD 北大核心 2014年第1期86-91,共6页 Automation of Electric Power Systems
基金 中央高校基本科研业务费专项资金资助项目(ZYGX2009J089)~~
关键词 暂态数据交换通用格式(COMTRADE) 海量数据 递推算法 并行化 common format for transient data exchange(COMTRADE) massive data recursive algorithm parallelization
  • 相关文献

参考文献15

二级参考文献81

共引文献466

同被引文献72

  • 1陈小林,罗毅,王伟平,龙赛,莫京军.基于故障录波数据的保护特性分析方法及其实现[J].电网技术,2005,29(18):70-74. 被引量:25
  • 2刘洋,谢开贵,周家启,赵霞.大电力系统可靠性评估高性能计算平台设计与实现[J].电力系统自动化,2006,30(18):89-93. 被引量:18
  • 3刘吉臻,杨光军,谭文,房方.基于数据驱动的电站燃烧稳定度综合评价[J].中国电机工程学报,2007,27(35):1-6. 被引量:14
  • 4WU J.Design of fastquery:how to generalize indexing and querying system for scientific data. http://escholarship.org/uc/item/6x7592q5 . 2012
  • 5CHANG J,CHEN Z,ZHENG W,et al.PLWAH+:a bitmap index compressing scheme based on PLWAH. Proceedings of the 10th ACM/IEEE Symposium on Architectures for Networking and Communications Systems . 2014
  • 6MCCAMISH B,HISTAND M,LANDFORD J,et al.Managing PMU data sets with bitmap indexes. Conference on Technologies for Sustainability (SusTech) . 2014
  • 7SU Y,AGRAWAL G,WOODRING J,et al.Supporting correlation analysis on scientific datasets in parallel and distributed settings. Proceedings of the 23rd International Symposium on High-performance Parallel and DistributedComputing . 2014
  • 8SLECHTA R,SAWIN J,MCCAMISH B,et al.Optimizing query execution for variable-aligned length compression of bitmap indices. Proceedings of the 18th International Database Engineering&Applications; Symposium . 2014
  • 9CHOU J,HOWISON M,AUSTIN B,et al.Parallel index and query for large scale data analysis. Proceedings of2011 International Conference for High Performance Computing,Networking,Storage and Analysis . 2011
  • 10PARKER-WOOD A,LONG D E L,MADDEN B A,et al.Examining extended and scientific metadata for scalable index designs. Proceedings of the 6th International Systems and Storage Conference . 2013

引证文献5

二级引证文献50

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部