期刊文献+

基于MapReduce的连续Skyline查询

Continuous Skyline Queries Based on MapReduce
在线阅读 下载PDF
导出
摘要 随着Web网络和无线传感器网络的不断发展,大数据的出现对数据查询和处理产生了挑战。研究了MapReduce框架下移动对象的并行Skyline计算问题,采用基于角度划分的方法解决负载平衡问题,并提出了一种过滤策略进行剪枝提高计算效率,在此基础上分别实现了静态Skyline算法和基于事件跟踪的MR-Track算法。最后通过对比实验验证了算法的有效性。 With the development of Web and wireless sensor networks, the appearance of big data has brought a great challenge to data query and process. The parallel Skyline computing issue of a moving query object under the MapReduce framework was studied. To solve the problem of load balance, a method based on angle partition was adopted. Then a filtering method was introduced to improve the efficiency. On the basis of those methods, a static Skyline algorithm and an event tracking algorithm named MR-Track were implemented respectively. Finally, many experiments were made to verify the effective and efficient of MR-Track algorithm.
出处 《电信科学》 北大核心 2014年第5期94-104,共11页 Telecommunications Science
基金 国家自然科学基金资助项目(No.61202007) 宁波市自然科学基金资助项目(No.2013A610063)
关键词 SKYLINE查询 MAPREDUCE HADOOP 移动对象 连续查询 Skyline query MapReduce Hadoop moving object continuous query
  • 相关文献

参考文献19

  • 1Borzsonyi S,Kossmann D,Stocker K.The Skyline operator.Proceedings of the International Conference on Data Engineering(ICDE),Heidelberg,Germany,2001:421-430
  • 2Dean J,Ghemawat S.MapReduce:simplified data processing on large clusters.Communications of the ACM,2005,51(1):107-113
  • 3Tan K L,Eng P K,Ooi B C.Efficient progressive skyline computation.Proceedings of the VLDB,Roma,Italy,2001:301-310
  • 4Kossmann D,Ramsak F,Rost S.Shooting stars in the sky:an online algorithm for skyline queries.Proceedings of the Very Large Data Bases(VLDB),Hong Kong,China,2002:275-286
  • 5Papadias D,Tao Y F,Fu G,et al.An optimal and progressive algorithm for skyline queries.Proceedings of ACM Management of Data(SIGMOD),San Diego,California,USA,2003:467-478
  • 6Balke W T,Güntzer U,Zheng J X.Efficient distributed Skylining for web information systems.Proceedings of International Conference on Extending Database Technology(EDBT),Heraklion,Crete,Greece,2004:256-273
  • 7Cui B,Lu H,Xu Q Q,et al.Parallel distributed processing of constrained Skyline queries by ltering.Proceedings of International Conference on Data Engineering(ICDE),Cancun,Mexico,2008:546-555
  • 8Huang Z Y,Lu H,Ooi B C,et al.Continuous skyline queries for moving objects.IEEE Transactions on Knowledge and Data Engineering,2006,18(12):1645-1658
  • 9Tian L,Wang L,Zou P,et al.Continuous monitoring of skyline query over highly dynamic moving objects.Proceedings of the AC M International Workshop on Data Engineering for Wireless and Mobile Access,Beijing,China,2007:59-66
  • 10付世昌,董一鸿,唐燕琳,陈华辉,钱江波.基于事件的位置不确定移动对象连续概率Skyline查询[J].自动化学报,2011,37(7):836-848. 被引量:8

二级参考文献81

  • 1周红福,宫学庆,郑凯,周傲英.基于高维空间的在线高效子空间Skyline算法——CSky[J].计算机学报,2007,30(8):1409-1417. 被引量:8
  • 2孙圣力,黄震华,李金玖,郭建奎,朱扬勇.数据流上高效计算子空间Skyline的算法[J].计算机学报,2007,30(8):1418-1428. 被引量:9
  • 3Chomicki J, Godfrey P, Gryz J, et al. Skyline with pre- sorting[C]//Proceedings of the 19th International Confer- ence on Data Engineering (ICDE), Los Alamitos, CA, USA, 2003. Washington, DC, USA: IEEE Computer Society, 2003: 717-719.
  • 4Tan K L, Eng P K, Ooi B C. Efficient progressive Skyline computation[C]//Proceedings of the 27th International Conference on Very Large Data Bases (VLDB), 2001. San Francisco, CA, USA: Morgan Kaufmann, 2001:301-310.
  • 5Kossmann D, Ramsak F, Rost S. Shooting stars in the sky an online algorithm for Skyline queries[C]//Proceedings of the 28th International Conference on Very Large Data Bases (VLDB), Hong Kong, China, 2002. San Francisco, CA, USA: Morgan Kaufmann, 2002: 275-286.
  • 6Papadias D, Tao Y, Fu G, et al. Progressive Skyline com- putation in database systems[J]. ACM Transactions on Database Systems, 2005, 30(1): 41-82.
  • 7Chan C Y, Jagadish H V, Tan K L, et al. Finding k-dominant Skylines in high dimensional space[C]//Pro- ceedings of the 25th ACM SIGMOD International Con- ference on Management of Data, Chicago, Illinois, USA, 2006. New York, NY, USA: ACM, 2006: 503-514.
  • 8Lin X, Yuan Y, Wang W, et al. Stabbing the sky: efficient Skyline computation over sliding windows[C]//Procee- dings of the 21st International Conference on Data Engi- neering (ICDE), Tokyo, Japan, 2005. Washington, DC, USA: IEEE Computer Society, 2005:502-513.
  • 9Balke W T, Guntzer U, Zheng J X. Efficient distributed skylining for Web information systems[C]//Proceedings of the 9th International Conference on Extending Data- base Technology (EDBT), Heraklion, Crete, Greece, 2004 [S.l.]: Springer, 2004: 256-273.
  • 10Wang S, Beng Chin Ooi, Tung A K H, et al. Efficient Skyline query processing on peer-to-peer networks[C]// Proceedings of the 23rd International Conference on Data Engineering (ICDE), Istanbul, Turkey, 2007. Washington, DC, USA: IEEE Computer Society, 2007:1126-1135.

共引文献59

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部