期刊文献+
共找到1,233篇文章
< 1 2 62 >
每页显示 20 50 100
CloudViT:A Lightweight Ground-Based Cloud Image Classification Model with the Ability to Capture Global Features
1
作者 Daoming Wei Fangyan Ge +5 位作者 Bopeng Zhang Zhiqiang Zhao Dequan Li Lizong Xi Jinrong Hu Xin Wang 《Computers, Materials & Continua》 2025年第6期5729-5746,共18页
Accurate cloud classification plays a crucial role in aviation safety,climate monitoring,and localized weather forecasting.Current research has been focusing on machine learning techniques,particularly deep learning b... Accurate cloud classification plays a crucial role in aviation safety,climate monitoring,and localized weather forecasting.Current research has been focusing on machine learning techniques,particularly deep learning based model,for the types identification.However,traditional approaches such as convolutional neural networks(CNNs)encounter difficulties in capturing global contextual information.In addition,they are computationally expensive,which restricts their usability in resource-limited environments.To tackle these issues,we present the Cloud Vision Transformer(CloudViT),a lightweight model that integrates CNNs with Transformers.The integration enables an effective balance between local and global feature extraction.To be specific,CloudViT comprises two innovative modules:Feature Extraction(E_Module)and Downsampling(D_Module).These modules are able to significantly reduce the number of model parameters and computational complexity while maintaining translation invariance and enhancing contextual comprehension.Overall,the CloudViT includes 0.93×10^(6)parameters,which decreases more than ten times compared to the SOTA(State-of-the-Art)model CloudNet.Comprehensive evaluations conducted on the HBMCD and SWIMCAT datasets showcase the outstanding performance of CloudViT.It achieves classification accuracies of 98.45%and 100%,respectively.Moreover,the efficiency and scalability of CloudViT make it an ideal candidate for deployment inmobile cloud observation systems,enabling real-time cloud image classification.The proposed hybrid architecture of CloudViT offers a promising approach for advancing ground-based cloud image classification.It holds significant potential for both optimizing performance and facilitating practical deployment scenarios. 展开更多
关键词 Image classification ground-based cloud images lightweight neural networks attention mechanism deep learning vision transformer
在线阅读 下载PDF
A modified method of discontinuity trace mapping using three-dimensional point clouds of rock mass surfaces 被引量:15
2
作者 Keshen Zhang Wei Wu +3 位作者 Hehua Zhu Lianyang Zhang Xiaojun Li Hong Zhang 《Journal of Rock Mechanics and Geotechnical Engineering》 SCIE CSCD 2020年第3期571-586,共16页
This paper presents an automated method for discontinuity trace mapping using three-dimensional point clouds of rock mass surfaces.Specifically,the method consists of five steps:(1)detection of trace feature points by... This paper presents an automated method for discontinuity trace mapping using three-dimensional point clouds of rock mass surfaces.Specifically,the method consists of five steps:(1)detection of trace feature points by normal tensor voting theory,(2)co ntraction of trace feature points,(3)connection of trace feature points,(4)linearization of trace segments,and(5)connection of trace segments.A sensitivity analysis was then conducted to identify the optimal parameters of the proposed method.Three field cases,a natural rock mass outcrop and two excavated rock tunnel surfaces,were analyzed using the proposed method to evaluate its validity and efficiency.The results show that the proposed method is more efficient and accurate than the traditional trace mapping method,and the efficiency enhancement is more robust as the number of feature points increases. 展开更多
关键词 Rock mass DISCONTINUITY Three-dimensional point clouds Trace mapping
在线阅读 下载PDF
Improving Satellite-Retrieved Cloud Base Height with Ground-Based Cloud Radar Measurements 被引量:1
3
作者 Zhonghui TAN Ju WANG +3 位作者 Jianping GUO Chao LIU Miao ZHANG Shuo MA 《Advances in Atmospheric Sciences》 SCIE CAS CSCD 2024年第11期2131-2140,共10页
Cloud base height(CBH) is a crucial parameter for cloud radiative effect estimates, climate change simulations, and aviation guidance. However, due to the limited information on cloud vertical structures included in p... Cloud base height(CBH) is a crucial parameter for cloud radiative effect estimates, climate change simulations, and aviation guidance. However, due to the limited information on cloud vertical structures included in passive satellite radiometer observations, few operational satellite CBH products are currently available. This study presents a new method for retrieving CBH from satellite radiometers. The method first uses the combined measurements of satellite radiometers and ground-based cloud radars to develop a lookup table(LUT) of effective cloud water content(ECWC), representing the vertically varying cloud water content. This LUT allows for the conversion of cloud water path to cloud geometric thickness(CGT), enabling the estimation of CBH as the difference between cloud top height and CGT. Detailed comparative analysis of CBH estimates from the state-of-the-art ECWC LUT are conducted against four ground-based millimeter-wave cloud radar(MMCR) measurements, and results show that the mean bias(correlation coefficient) is0.18±1.79 km(0.73), which is lower(higher) than 0.23±2.11 km(0.67) as derived from the combined measurements of satellite radiometers and satellite radar-lidar(i.e., Cloud Sat and CALIPSO). Furthermore, the percentages of the CBH biases within 250 m increase by 5% to 10%, which varies by location. This indicates that the CBH estimates from our algorithm are more consistent with ground-based MMCR measurements. Therefore, this algorithm shows great potential for further improvement of the CBH retrievals as ground-based MMCR are being increasingly included in global surface meteorological observing networks, and the improved CBH retrievals will contribute to better cloud radiative effect estimates. 展开更多
关键词 cloud base height passive radiometer ground-based cloud radar remote sensing
在线阅读 下载PDF
Ground-Based Cloud Using Exponential Entropy/Exponential Gray Entropy and UPSO
4
作者 吴一全 殷骏 毕硕本 《Transactions of Nanjing University of Aeronautics and Astronautics》 EI 2014年第6期599-608,共10页
Objective and accurate classification model or method of cloud image is a prerequisite for accurate weather monitoring and forecast.Thus safety of aircraft taking off and landing and air flight can be guaranteed.Thres... Objective and accurate classification model or method of cloud image is a prerequisite for accurate weather monitoring and forecast.Thus safety of aircraft taking off and landing and air flight can be guaranteed.Thresholding is a kind of simple and effective method of cloud classification.It can realize automated ground-based cloud detection and cloudage observation.The existing segmentation methods based on fixed threshold and single threshold cannot achieve good segmentation effect.Thus it is difficult to obtain the accurate result of cloud detection and cloudage observation.In view of the above-mentioned problems,multi-thresholding methods of ground-based cloud based on exponential entropy/exponential gray entropy and uniform searching particle swarm optimization(UPSO)are proposed.Exponential entropy and exponential gray entropy make up for the defects of undefined value and zero value in Shannon entropy.In addition,exponential gray entropy reflects the relative uniformity of gray levels within the cloud cluster and background cluster.Cloud regions and background regions of different gray level ranges can be distinguished more precisely using the multi-thresholding strategy.In order to reduce computational complexity of original exhaustive algorithm for multi-threshold selection,the UPSO algorithm is adopted.It can find the optimal thresholds quickly and accurately.As a result,the real-time processing of segmentation of groundbased cloud image can be realized.The experimental results show that,in comparison with the existing groundbased cloud image segmentation methods and multi-thresholding method based on maximum Shannon entropy,the proposed methods can extract the boundary shape,textures and details feature of cloud more clearly.Therefore,the accuracies of cloudage detection and morphology classification for ground-based cloud are both improved. 展开更多
关键词 detection of ground-based cloud multi-thresholding of cloud image exponential entropy exponential gray entropy uniform searching particle swarm optimization(UPSO)
在线阅读 下载PDF
Mapping High-Level Application Requirements onto Low-Level Cloud Resources
5
作者 Yih Leong Sun Terence Harmer Alan Stewart 《Journal of Software Engineering and Applications》 2012年第11期894-902,共9页
Cloud computing has created a paradigm shift that affects the way in which business applications are developed. Many business organizations use cloud infrastructures as platforms on which to deploy business applicatio... Cloud computing has created a paradigm shift that affects the way in which business applications are developed. Many business organizations use cloud infrastructures as platforms on which to deploy business applications. Increasing numbers of vendors are supplying the cloud marketplace with a wide range of cloud products. Different vendors offer cloud products in different formats. The cost structures for consuming cloud products can be complex. Finding a suitable set of cloud products that meets an application’s requirements and budget can be a challenging task. In this paper, an ontology-based resource mapping mechanism is proposed. Domain-specific ontologies are used to specify high-level application’s requirements. These are then translated into high-level infrastructure ontologies which then can be mapped onto low-level descriptions of cloud resources. Cost ontologies are proposed for cloud resources. An exemplar media transcoding and delivery service is studied in order to illustrate how high-level requirements can be modeled and mapped onto cloud resources within a budget constraint. The proposed ontologies provide an application-centric mechanism for specifying cloud requirements which can then be used for searching for suitable resources in a multi-provider cloud environment. 展开更多
关键词 cloud Computing RESOURCE mapping cloud ONTOLOGY Cost Model
在线阅读 下载PDF
A multi-layered policy generation and management engine for semantic policy mapping in clouds
6
作者 Faraz Fatemi Moghaddam Philipp Wieder Ramin Yahyapour 《Digital Communications and Networks》 SCIE 2020年第1期38-50,共13页
The long awaited cloud computing concept is a reality now due to the transformation of computer generations.However,security challenges have become the biggest obstacles for the advancement of this emerging technology... The long awaited cloud computing concept is a reality now due to the transformation of computer generations.However,security challenges have become the biggest obstacles for the advancement of this emerging technology.A well-established policy framework is defined in this paper to generate security policies which are compliant to requirements and capabilities.Moreover,a federated policy management schema is introduced based on the policy definition framework and a multi-level policy application to create and manage virtual clusters with identical or common security levels.The proposed model consists in the design of a well-established ontology according to security mechanisms,a procedure which classifies nodes with common policies into virtual clusters,a policy engine to enhance the process of mapping requests to a specific node as well as an associated cluster and matchmaker engine to eliminate inessential mapping processes.The suggested model has been evaluated according to performance and security parameters to prove the efficiency and reliability of this multilayered engine in cloud computing environments during policy definition,application and mapping procedures. 展开更多
关键词 cloud computing Security Security management Policy management Access control Policy mapping
在线阅读 下载PDF
Formula for calculating spatial similarity degrees between point clouds on multi-scale maps taking map scale change as the only independent variable 被引量:6
7
作者 Yang Weifang Yan Haowen Li Jonathan 《Geodesy and Geodynamics》 2015年第2期113-125,共13页
The degree of spatial similarity plays an important role in map generalization, yet there has been no quantitative research into it. To fill this gap, this study first defines map scale change and spatial similarity d... The degree of spatial similarity plays an important role in map generalization, yet there has been no quantitative research into it. To fill this gap, this study first defines map scale change and spatial similarity degree/relation in multi-scale map spaces and then proposes a model for calculating the degree of spatial similarity between a point cloud at one scale and its gener- alized counterpart at another scale. After validation, the new model features 16 points with map scale change as the x coordinate and the degree of spatial similarity as the y coordinate. Finally, using an application for curve fitting, the model achieves an empirical formula that can calculate the degree of spatial similarity using map scale change as the sole independent variable, and vice versa. This formula can be used to automate algorithms for point feature generalization and to determine when to terminate them during the generalization. 展开更多
关键词 Spatial similarity degree map generalization map scale change Point clouds Quantitative description Spatial similarity relations Multi-scale map spaces Curve fitting method
原文传递
Enhanced Autonomous Exploration and Mapping of an Unknown Environment with the Fusion of Dual RGB-D Sensors 被引量:7
8
作者 Ningbo Yu Shirong Wang 《Engineering》 SCIE EI 2019年第1期164-172,共9页
The autonomous exploration and mapping of an unknown environment is useful in a wide range of applications and thus holds great significance. Existing methods mostly use range sensors to generate twodimensional (2D) g... The autonomous exploration and mapping of an unknown environment is useful in a wide range of applications and thus holds great significance. Existing methods mostly use range sensors to generate twodimensional (2D) grid maps. Red/green/blue-depth (RGB-D) sensors provide both color and depth information on the environment, thereby enabling the generation of a three-dimensional (3D) point cloud map that is intuitive for human perception. In this paper, we present a systematic approach with dual RGB-D sensors to achieve the autonomous exploration and mapping of an unknown indoor environment. With the synchronized and processed RGB-D data, location points were generated and a 3D point cloud map and 2D grid map were incrementally built. Next, the exploration was modeled as a partially observable Markov decision process. Partial map simulation and global frontier search methods were combined for autonomous exploration, and dynamic action constraints were utilized in motion control. In this way, the local optimum can be avoided and the exploration efficacy can be ensured. Experiments with single connected and multi-branched regions demonstrated the high robustness, efficiency, and superiority of the developed system and methods. 展开更多
关键词 AUTONOMOUS EXPLORATION Red/green/blue-depth Sensor fusion Point cloud Partial map simulation Global FRONTIER search
在线阅读 下载PDF
A Forensic Method for Efficient File Extraction in HDFS Based on Three-Level Mapping 被引量:2
9
作者 GAO Yuanzhao LI Binglong 《Wuhan University Journal of Natural Sciences》 CAS CSCD 2017年第2期114-126,共13页
The large scale and distribution of cloud computing storage have become the major challenges in cloud forensics for file extraction. Current disk forensic methods do not adapt to cloud computing well and the forensic ... The large scale and distribution of cloud computing storage have become the major challenges in cloud forensics for file extraction. Current disk forensic methods do not adapt to cloud computing well and the forensic research on distributed file system is inadequate. To address the forensic problems, this paper uses the Hadoop distributed file system (HDFS) as a case study and proposes a forensic method for efficient file extraction based on three-level (3L) mapping. First, HDFS is analyzed from overall architecture to local file system. Second, the 3L mapping of an HDFS file from HDFS namespace to data blocks on local file system is established and a recovery method for deleted files based on 3L mapping is presented. Third, a multi-node Hadoop framework via Xen virtualization platform is set up to test the performance of the method. The results indicate that the proposed method could succeed in efficient location of large files stored across data nodes, make selective image of disk data and get high recovery rate of deleted files. 展开更多
关键词 the Hadoop distributed file system (HDFS) forensics cloud forensics three-level (3L) mapping metadata file extraction file recovery Ext4
原文传递
Some Thoughts on the Earthquake Science Experimental Site——The Underground Cloud Map
10
作者 CHEN Yong XU Yihe +1 位作者 CAI Huiteng LI Wen 《Earthquake Research in China》 CSCD 2019年第1期1-8,共8页
The Western Yunnan Earthquake Predication Test Site set up jointly by the China Earthquake Administration,the National Science Foundation Commission of America,and United States Geological Survey has played an importa... The Western Yunnan Earthquake Predication Test Site set up jointly by the China Earthquake Administration,the National Science Foundation Commission of America,and United States Geological Survey has played an important role in development of early earthquake research work in China. Due to various objective reasons, most of the predicted targets in the earthquake prediction test site have not been achieved,and the development has been hindered. In recent years, the experiment site has been reconsidered,and renamed the "Earthquake Science Experimental Site". Combined with the current development of seismology and the practical needs of disaster prevention and mitigation,we propose adding the "Underground Cloud Map"as the new direction of the experimental site. Using highly repeatable, environmentally friendly and safe airgun sources,we could send constant seismic signals,which realizes continuous monitoring of subsurface velocity changes. Utilizing the high-resolution 3-D crustal structure from ambient noise tomography,we could obtain 4-D (3-D space+1-D time) images of subsurface structures, which we termed the "Underground Cloud Map". The"Underground Cloud Map" can reflect underground velocity and stress changes,providing new means for the earthquake monitoring forecast nationwide,which promotes the conversion of experience-based earthquake prediction to physics-based prediction. 展开更多
关键词 Earthquake Science EXPERIMENTAL SITE The UNDERGROUND cloud map 4-D SEISMOLOGY Airgun
在线阅读 下载PDF
室外半静态环境下基于快速会话对齐的地图更新方法
11
作者 方宝富 谢艺 +1 位作者 王浩 袁晓辉 《机器人》 北大核心 2026年第1期137-149,共13页
目前室外半静态环境下的地图更新算法普遍存在速度较慢,无法实时运行的问题。为此,本文提出一种基于会话快速对齐的地图更新方法,目的是提高会话对齐的速度,保证地图与环境的一致性。首先引入高斯曲率来稀疏化点云以减小点云规模,并进... 目前室外半静态环境下的地图更新算法普遍存在速度较慢,无法实时运行的问题。为此,本文提出一种基于会话快速对齐的地图更新方法,目的是提高会话对齐的速度,保证地图与环境的一致性。首先引入高斯曲率来稀疏化点云以减小点云规模,并进行体素化点云配准,利用所获取的约束构造因子图;然后,引入历史约束实现局部会话的因子图修补,解决因回环检测和点云配准失效导致的因子图构造失败问题;最后,通过因子图优化实现会话对齐,并基于对齐的会话进行地图更新。在MulRan数据集和LT-ParkingLot数据集上评估了该方法,其会话对齐频率达到了13 Hz,相较于原方法提升了80%,可实现在工厂等经典半静态场景下实时对齐会话。通过实验证明了本文方法在地图更新方面的有效性。 展开更多
关键词 地图更新 长期SLAM(同步定位与地图构建) 会话对齐 点云配准 因子图修补
原文传递
一种集成BIM数据的ROS室内语义地图构建与动态更新方法
12
作者 李朝奎 钟林强 +2 位作者 郭瑞荣 曾宇 江岭 《时空信息学报》 2026年第1期114-126,共13页
视觉同步定位与建图(simultaneous localization and mapping,SLAM)是实现移动机器人自主定位并构建环境地图的关键环节。SLAM技术虽能精确重建环境几何结构,却难以为机器人提供执行复杂任务所需的语义理解能力;建筑信息模型(building i... 视觉同步定位与建图(simultaneous localization and mapping,SLAM)是实现移动机器人自主定位并构建环境地图的关键环节。SLAM技术虽能精确重建环境几何结构,却难以为机器人提供执行复杂任务所需的语义理解能力;建筑信息模型(building information model,BIM)包含丰富的建筑信息,但与机器人操作系统(robot operating system,ROS)之间存在显著的数据格式和表达方式差异,且现有研究多采用人工方式进行转换,效率低下难以规模化应用,且室内环境并非静态不变,从而会影响机器人的导航决策。因此,提出一种集成BIM数据的ROS室内语义地图构建与动态更新方法。通过研发工业基础类(industry foundation classes,IFC)到统一机器人描述格式(unified robot description format,URDF)自动转换器,实现从BIM到机器人仿真环境的自动化建模;融合YOLOv8与随机采样一致性(random sample consensus,RANSAC)算法,建立视觉驱动的语义地图动态更新机制。结果表明,静态建筑元素还原准确率达98%以上,动态物体识别精度达0.9以上,显著提升了语义地图的自动化程度、知识丰富度及环境适应性。 展开更多
关键词 BIM 语义地图 ROS IFC YOLOv8 点云拟合
在线阅读 下载PDF
基于元宇宙电力轻量化三维引擎的电网一张图展示与优化调度
13
作者 郭凌旭 唐萍 +3 位作者 李宜芳 马世乾 高圣源 马万乐 《湖南电力》 2026年第1期54-59,共6页
本文提出一种基于元宇宙的电力轻量化三维引擎设计,以模型轻量化、高性能渲染与算力网络优化为核心,通过几何与纹理压缩、多细节层次技术降低模型数据量,引入屏幕空间环境光遮蔽与几何着色器优化算法提升渲染性能,并构建“云—端多级弹... 本文提出一种基于元宇宙的电力轻量化三维引擎设计,以模型轻量化、高性能渲染与算力网络优化为核心,通过几何与纹理压缩、多细节层次技术降低模型数据量,引入屏幕空间环境光遮蔽与几何着色器优化算法提升渲染性能,并构建“云—端多级弹性算力网络”实现资源协同与能耗优化,可高效支撑“电网一张图”和虚拟调度指挥中心等应用。该研究为电力系统可视化的智能化与元宇宙化提供了新路径。 展开更多
关键词 电力轻量化三维引擎 电网一张图 优化调度 云—端协同 元宇宙
在线阅读 下载PDF
一种动态环境下改进的点云室内地图构建方法
14
作者 刘芳 赵贯群 黄珂婷 《计算机仿真》 2026年第1期269-274,共6页
当今主流地图构建系统由于定位精度不高、重投影误差较大等问题,限制了稠密地图的生成。尤其在动态场景中,系统的实时性和地图的高精度之间无法共存,以及物体的往复移动为后续地图精度的提升带来了额外的困难。针对上述问题,提出了一种... 当今主流地图构建系统由于定位精度不高、重投影误差较大等问题,限制了稠密地图的生成。尤其在动态场景中,系统的实时性和地图的高精度之间无法共存,以及物体的往复移动为后续地图精度的提升带来了额外的困难。针对上述问题,提出了一种基于闭环检测和自适应降采样的视觉SLAM点云地图构建方法(Visual SLAM point cloud map construction method based on closed-loop detection and adaptive downsampling,PCL-LCAD)。上述方法从视觉SLAM系统建图的角度出发,加入3D点云技术,构建一个闭环检测优化模型,扩大生成地图的面积,再建立一个点云自适应降采样模型,利用KD-tree算法对其体素滤波进行改进。实验结果表明,PCL-LCAD方法能在保障准确性和实时性的同时,降低地图占用空间并且提高地图稠密度。 展开更多
关键词 实时性 即时定位与地图构建 点云地图 闭环检测 稠密度
在线阅读 下载PDF
基于知识图谱的公共文化服务云平台建设初探
15
作者 金昆 陈安琪 《新世纪图书馆》 2026年第2期68-75,共8页
研究针对国内外公共数字文化云平台的研究和建设现状,引入了知识图谱的概念,分析了知识图谱在云平台中的应用,并提出了平台的优化策略。将知识图谱引入数字文化云平台的建设,能够智能化地筛选和过滤海量数字文化资源,构建体系化的信息... 研究针对国内外公共数字文化云平台的研究和建设现状,引入了知识图谱的概念,分析了知识图谱在云平台中的应用,并提出了平台的优化策略。将知识图谱引入数字文化云平台的建设,能够智能化地筛选和过滤海量数字文化资源,构建体系化的信息资源知识图谱,并根据用户画像知识图谱分析用户需求,从而为用户提供更精准、便捷的文化服务,实现资源的智慧化应用,有效提升云平台的服务效能。 展开更多
关键词 公共数字文化服务 云平台 知识图谱
在线阅读 下载PDF
智能审图平台与众源更新安全监管平台联动研究
16
作者 吴飞 甘霖 +3 位作者 陈灿东 申婷 王青青 高丹 《测绘地理信息》 2026年第2期121-126,共6页
在车路云一体化系统建设与应用下,众源更新安全监管平台旨在对高精度地图众源更新过程提供全流程动态长期安全监管能力,智能审图平台则提供快速审图能力。但在实际应用过程中,两大平台存在数据孤岛问题,导致监管效能未能充分发挥。本文... 在车路云一体化系统建设与应用下,众源更新安全监管平台旨在对高精度地图众源更新过程提供全流程动态长期安全监管能力,智能审图平台则提供快速审图能力。但在实际应用过程中,两大平台存在数据孤岛问题,导致监管效能未能充分发挥。本文提出审图平台与监管平台双向赋能闭环协同方案。一方面,监管平台随着车辆轨迹、涉及测绘行为日志及合规脱敏日志的收集,动态更新审图地理围栏规则并推送网联车辆测绘违规行为数据;另一方面,审图平台补充地理围栏和审图号发放信息。通过平台之间双向赋能,使得“车辆实时位置、涉及测绘行为日志、众源更新成图、审图号及增审号、地理围栏”等数据信息在平台间流动,实现准确的快速审图与智能网联车辆测绘合规的动态长期监管。为车路云一体化系统建设与应用提供可落地的安全监管方案。 展开更多
关键词 车路云一体化 众源更新 智能审图 安全监管 审管联动
原文传递
基于Map-Reduce的海量数据高效Skyline查询处理 被引量:45
17
作者 丁琳琳 信俊昌 +1 位作者 王国仁 黄山 《计算机学报》 EI CSCD 北大核心 2011年第10期1785-1796,共12页
Skyline查询已成为现今数据库和信息检索领域的研究热点之一,伴随着人类可以采集和利用的数据信息的急剧增长,使得如何处理海量数据的Skyline查询成为急需解决的问题.近年来兴起的Map-Reduce编程框架能够有效地处理基于海量数据的应用,... Skyline查询已成为现今数据库和信息检索领域的研究热点之一,伴随着人类可以采集和利用的数据信息的急剧增长,使得如何处理海量数据的Skyline查询成为急需解决的问题.近年来兴起的Map-Reduce编程框架能够有效地处理基于海量数据的应用,该文既是研究如何运用Map-Reduce编程框架解决海量数据的Skyline查询问题.在Map-Reduce框架下处理Skyline查询的直接方法是扫描整个数据集进而得到查询结果,但是在海量数据Skyline查询问题中,查询结果的数量远小于原始数据集的数据量,对此该文提出了一系列的Skyline查询算法及优化,有效地过滤掉部分不能成为Skyline查询结果的数据对象,大幅度提高了在Map-Reduce框架下处理Skyline查询的效率.大量运行在Hadoop平台上的实验验证了该文所提出的Skyline查询处理算法具有良好的有效性、准确性和可用性. 展开更多
关键词 云计算 SKYLINE查询 map-REDUCE 海量数据 HADOOP
在线阅读 下载PDF
基于Map/Reduce的改进选择算法在云计算的Web数据挖掘中的研究 被引量:13
18
作者 方少卿 周剑 张明新 《计算机应用研究》 CSCD 北大核心 2013年第2期377-379,395,共4页
针对目前在搜索方面的数据量大、搜索延迟的特点,提出了基于云计算的Web挖掘的搜索模型。采用提出的基于Map/Reduce模型的改进型算法,通过仿真实验验证了该算法的可行性,在一定程度上减少了搜索的代价,提高了搜索效率。
关键词 云计算 WEB数据挖掘 map REDUCE
在线阅读 下载PDF
基于R-树索引的Map-Reduce空间连接聚集操作 被引量:5
19
作者 刘义 陈荦 +1 位作者 景宁 熊伟 《国防科技大学学报》 EI CAS CSCD 北大核心 2013年第1期136-141,共6页
空间连接聚集是一种常用并且非常耗时的空间数据库操作,特别是在面对大规模空间数据集时,单机运行环境难以满足其对时空开销的需求,如何设计高效的面向云计算环境中的分布式空间连接聚集算法越来越受到人们关注。Map-Reduce作为云计算... 空间连接聚集是一种常用并且非常耗时的空间数据库操作,特别是在面对大规模空间数据集时,单机运行环境难以满足其对时空开销的需求,如何设计高效的面向云计算环境中的分布式空间连接聚集算法越来越受到人们关注。Map-Reduce作为云计算的核心模式受限于其扁平化的串行扫描操作模型,常被用来加速非索引的空间连接操作,现有工作尚无将Map-Reduce和R-树索引结合来处理空间连接聚集。因此,提出了基于R-树索引的Map-Reduce空间连接聚集算法(RSJA-MR)来更高效地返回连接聚集结果。提出一种分布式R-树索引结构以支持大规模空间数据的索引,RSJA-MR算法利用分布式R-树生成任务集,任务集的执行满足无依赖并行计算模式,很容易在Map-Reduce框架中进行表达。文中提出一种实时缓存策略以支持索引并发访问。实验结果表明:相比非索引的Map-Reduce连接聚集算法,在空间交叠连接聚集查询上,时间性能最少提升8%,在空间包含连接聚集查询上,时间性能最少提升近35%。 展开更多
关键词 云计算 map-REDUCE 空间连接聚集 R-树
在线阅读 下载PDF
基于Map-Reduce模型的云资源调度方法研究 被引量:9
20
作者 张恒巍 韩继红 +1 位作者 卫波 王晋东 《计算机科学》 CSCD 北大核心 2015年第8期118-123,共6页
为提高Map-Reduce模型资源调度问题的求解效能,分别考虑Map和Reduce阶段的调度过程,建立带服务质量(QoS)约束的多目标资源调度模型,并提出用于模型求解的混沌多目标粒子群算法。算法采用信息熵理论来维护非支配解集,以保持解的多样性和... 为提高Map-Reduce模型资源调度问题的求解效能,分别考虑Map和Reduce阶段的调度过程,建立带服务质量(QoS)约束的多目标资源调度模型,并提出用于模型求解的混沌多目标粒子群算法。算法采用信息熵理论来维护非支配解集,以保持解的多样性和分布均匀性;在利用Sigma方法实现快速收敛的基础上,引入混沌扰动机制,以提高种群多样性和算法全局寻优能力,避免算法陷入局部最优。实验表明,算法求解所需的迭代次数少,得到的非支配解分布均匀。Map-Reduce资源调度问题的求解过程中,在收敛性和解集的多样性方面,所提算法均明显优于传统多目标粒子群算法。 展开更多
关键词 云计算 map-REDUCE 资源调度 粒子群算法 信息熵 混沌扰动
在线阅读 下载PDF
上一页 1 2 62 下一页 到第
使用帮助 返回顶部