期刊文献+

基于硬件加速的高速数据流连续实时聚集查询 被引量:2

Continual Aggregation Queries over High Rate Data Streams Based on Hardware Acceleration
在线阅读 下载PDF
导出
摘要 近年来,动态数据流环境下的聚集查询正成为一个热点研究问题.目前的相关算法主要是采用近似技术,以牺牲精度来换取处理速度的提高.然而,在高速数据流环境下,处理速度仍然难以满足需求.软硬件协同的高速数据流处理技术逐渐引起人们的关注.提出了一种基于硬件加速的高速数据流聚集查询方法,充分发挥硬件在处理速度上的优势和软件在灵活性方面的长处.算法是增量的,也实现了多窗口资源共享.最后,给出了算法的复杂度分析并实验验证了方法的有效性. Recently there has been a growing interest in aggregation queries for scenarios in which data streams arrive at very high rates and a data stream system is registered with many simultaneous queries. In order to dealing with the huge amounts of data and increasingly stringent response-time requirements, Most existing work in this area has to adopt approximate technology which sacrifice aggregate veracity. But in the environment of high rate data streams, the processing rate still cannot satisfy requirements. So query processing based on hardware-software codesign has recently emerged as a viable solution for dealing with high rate data streams.In this paper, We propose a kind of novel aggregate query algorithms based on hardware-software codesign, which incorpo- rate hardware advantage in processing rate and software long suit in agility. Many incremental computation approaches and resourue sharing techniques in sliding-window aggregations are introduced.Lastly,time cost of the algorithm is analyzed and the experiment show the feasibility and effectiveness of the approach.
出处 《电子学报》 EI CAS CSCD 北大核心 2007年第2期228-233,共6页 Acta Electronica Sinica
基金 江苏省高技术项目(No.BG2004034) 江苏省2004年度研究生创新计划项目(No.xm04-36)
关键词 数据流 聚集查询 软硬件协同 增量计算 data streams aggregation queries hardware-software codesign incremental computation
  • 相关文献

参考文献9

  • 1S R Madden, M J Franklin, J M Hellerstein, W Hong. TAG: a tiny AGgregation service for ad-hoc sensor networks [ A ]. In Fifth Symposium on Operating Systems Design and Implementation[C]. Boston,MA,2002.131 - 146.
  • 2Madden SR, Szewczyk R, Franklin MJ, Culler D. Supporting aggregate queries over ad-hoc wireless sensor networks [ A ]. In: Kindberg T, ed. Proceedings of the Fourth Workshop on Mobile Computing and Systems Applications [ C ]. Los Alamitos: IEEE. Computer Press,2002.49 - 58.
  • 3Alin Dobra,Minos Garofalakis, Johannes Gehrke,Rajeev Rastogi. Processing complex aggregate queries over data streams [ A]. In Proceedings of the 2002 ACM SIGMOD International Conference on Management of Data [ C ]. Madison, Wisconsin, 2002.61 - 72.
  • 4A C Gilbert, Y Kotidis, S Muthukrishnan, M Strauss. Surfing wavelets on streams: One-pass summaries for approximate aggregate queries[A ]. In Proceedings of the 27th Conference on Very Large Data Bases[C]. Roma, Italy,2001.79 - 88.
  • 5D Zhang,D Gunopulos,V J Tsotras B Seeger. Temporal aggregation over data streams using multiple granularities [ A ]. In Proceeding of International Conference on Extending Database Technology [ C ]. Prague, Czech Republic, 2002.646 - 663.
  • 6J Gehrke, F Korn, D Srivastava. On computing correlated aggregates over continual data streams [ A ]. In Proceedings of the ACM SIGMOD Conference [ C ]. Santa Barbara, CA, USA, 2001.13 - 24.
  • 7Ujval J Kapasi, Peter Mattson, William J Daily, John D Owens, Brian Towles. Stream scheduling[ A]. EE482C Advanced Computer Organization:Stream Processor Architecture,Spring 2001/2002. In Proceedings of the 3rd Workshop on Media and Streaming Processors[C]. Austin,Texas,2001. 101 - 106.
  • 8B Khailany, WJ Dally, UJ Kapasi, P Mattson, J Namkoong, JD Owens,B Towles,A Chang,S Rixner. Imagine: media processing with sterams[ J]. IEEE Micro,2001,21(2) :35 - 46.
  • 9J-B Qian, H-B Xu, Y-S Dong,X-J Liu, Y-L Wang. FPGA acceleration window joins over multiple data streams [ J ]. Journal of Circuits,Systems,and Computers,2005,14(4) :813 - 830.

同被引文献32

  • 1钱江波,徐宏炳,王永利,刘学军,董逸生.多数据流滑动窗口并发连接方法[J].计算机研究与发展,2005,42(10):1771-1778. 被引量:10
  • 2曹锋,周傲英.基于图形处理器的数据流快速聚类[J].软件学报,2007,18(2):291-302. 被引量:24
  • 3Arasu A, Babu S, Widom J. An Abstract Semantics and Concrete Language for Continuous Queries over Streams and Relationsl EB/OL ]. http://dbpubs.stanford. edu: 8090/pub/2002 - 57.
  • 4Golab L, Ozsu M T. Issues in Data Stream Management [J].SIGMOD Record, 2003,32(2) : 5 - 14.
  • 5Ayad Ahmed, Naughton Jeffrey F. Static Optimization of Conjunctive Queries with Sliding Windows Over Infinite Streams [A]. Sigmod 2004[C ]. New York: ACM Press, 21304. 419 - 430.
  • 6Abadi D J, Carney D,Cetintemel U,et al,Aurora:a new model and architecture for data stream management [ J ]. The VLDB Journal, 2003,12(2) : 120 - 139.
  • 7The STREAM Group. STREAM:the stanford stream data manager[J]. IEEE Data Engineering Bulletin, 2003,26 ( 1 ) : 19 - 26.
  • 8Tatbul N, Cetintemel U, Zdonik S, et al. Load shedding in a data stream manager[ A]. VLDB 2003[ C]. San Fransisco: Morgan Kaufmann,2003.309- 320.
  • 9Gedik B, Yu P, Bordawekar R. Executing stream joins on the cell processor[ A ]. VLDB 2007[ C]. San Fransisco: Morgan Kaufmann, 2007.363 - 374.
  • 10Govindaraju N, Lloyd B, Wang W, et al. Fast computation of database operations using graphics processors [ A]. SIGMOD 2004[ C] .New York: ACM Press,2004.215 - 226.

引证文献2

二级引证文献5

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部