期刊文献+
共找到4篇文章
< 1 >
每页显示 20 50 100
基于Structured Streaming的实时文本画像系统设计与实现
1
作者 谢莹庆 熊义龙 曹炳尧 《工业控制计算机》 2022年第11期114-116,118,共4页
针对大数据环境下画像系统的实时性和准确性问题,提出一种基于Structured Streaming的实时画像系统设计与实现。利用canal组件对用户行为日志系统实现增量订阅,kafka消息中间件完成实时数据流接入,应用Structured Streaming实时计算框... 针对大数据环境下画像系统的实时性和准确性问题,提出一种基于Structured Streaming的实时画像系统设计与实现。利用canal组件对用户行为日志系统实现增量订阅,kafka消息中间件完成实时数据流接入,应用Structured Streaming实时计算框架对用户的实时数据进行分析处理,刻画用户的实时兴趣。通过改进的TF-IDF算法改善文本画像系统的准确性与可靠性,并借助Structured Streaming与静态数据良好的交互性减轻实时计算压力,提高系统响应速度。 展开更多
关键词 structured streaming 大数据 画像系统 TF-IDF
在线阅读 下载PDF
Degrading river network due to urbanization in Yangtze River Delta 被引量:5
2
作者 韩龙飞 许有鹏 +4 位作者 雷超桂 杨柳 邓晓军 胡春生 徐光来 《Journal of Geographical Sciences》 SCIE CSCD 2016年第6期694-706,共13页
Evolution of river systems under the background of human activities has been a heated topic among geographers and hydrologists. Spatial and temporal variations of river systems during the 1960s-2010s in the Yangtze Ri... Evolution of river systems under the background of human activities has been a heated topic among geographers and hydrologists. Spatial and temporal variations of river systems during the 1960s-2010s in the Yangtze River Delta (YRD) were investigated based on streams derived from the topographic maps in the 1960s, 1980s and 2010s. A list of indi- ces, drainage density (Dd), water surface ratio (WSR), ratio of area to length of main streams (R), evolution coefficient of tributaries (K) and box dimension (D), were classified into three types (quantitative, structural, and complex indices) and used to quantify the variations of stream structure. Results showed that: (1) quantitative indices (Dd, WSR) presented de- creasing trend in the past 50 years, and Dd in Wuchengxiyu, Hangjiahu and Yindongnan have decreased most, about 20%. Structurally, the Qinhuai River basin was characterized by sig- nificant upward R, and K value in Hangjiahu went down dramatically by 46.8% during the 1960s-2010s. Decreasing tendency in D was found dominating across the YRD, and de- creasing magnitude in Wuchengxiyu and Hangjiahu peaks for 7.8% and 6.5%, respectively in the YRD. (2) Urbanization affected the spatial pattern of river system, and areas with high level of urbanization exhibited least Dd (2.18 km/km2), WSR (6.52%), K (2.64) and D (1.42), compared to moderate and low levels of urbanization. (3) Urbanization also affected the evo- lution of stream system. In the past 50 years, areas with high level of urbanization showed compelling decreasing tendency in quantitative (27.2% and 19.3%) and complex indices (4.9%) and trend of enlarging of main rivers (4.5% and 7.9% in periods of the 1960s-1980s and the 1980s-2010s). In the recent 30 years, areas with low level of urbanization were detected with significant downward trend in Dd and K. (4) Expanding of urban land, construction of hydraulic engineering and irrigation and water conservancy activities were the main means which degraded the river system in the YRD. 展开更多
关键词 stream structure spatial and temporal change URBANIZATION Yangtze River Delta
原文传递
基于Spark的实时数据分析及可视化系统
3
作者 史亚平 王安琪 《黄河科技学院学报》 2025年第11期44-50,共7页
随着大数据技术的快速发展,企业对实时数据处理与可视化分析的需求日益迫切。旨在设计并实现一套基于Spark的实时数据分析及可视化系统,以解决传统批处理模式难以满足实时性要求的问题。系统采用分层架构设计,通过Kafka实现高吞吐量的... 随着大数据技术的快速发展,企业对实时数据处理与可视化分析的需求日益迫切。旨在设计并实现一套基于Spark的实时数据分析及可视化系统,以解决传统批处理模式难以满足实时性要求的问题。系统采用分层架构设计,通过Kafka实现高吞吐量的实时数据采集与消息缓冲,利用Spark Structured Streaming框架进行毫秒级延迟的流式数据处理,并基于Flask和WebSocket协议构建前后端双向通信,最终通过ECharts动态展示实时分析结果,构建了从数据采集到可视化展示的全流程解决方案。实验以淘宝用户行为日志为数据集,以可视化大屏动态展示各省份购买量、用户性别比例及年龄段行为等趋势,能够更直观的研究数据更深层次的价值。验证了该系统具有高实时性、可扩展性和易用性特点,能有效支持企业决策,未来可进一步优化复杂事件处理能力并拓展应用场景。 展开更多
关键词 spark kafka structured streaming流处理 echarts websocket
在线阅读 下载PDF
Observations of several characteristics of aeolian sand movement in the Taklimakan Desert 被引量:8
4
作者 HAN Zhiwen DONG Zhibao +3 位作者 WANG Tao CHEN Guangting YAN Changzhen YAO Zhengyi 《Science China Earth Sciences》 SCIE EI CAS 2004年第1期86-96,共11页
With both sides of the Taklimakan Desert highway line as the study area, three typical aeolian sand landforms, i.e. complex dune ridge, barchan dune and flat sand land, were selected as sand beds for the observation, ... With both sides of the Taklimakan Desert highway line as the study area, three typical aeolian sand landforms, i.e. complex dune ridge, barchan dune and flat sand land, were selected as sand beds for the observation, analysis and research of the characteristics of aeolian sand movement such as aeolian sand stream structure, sand transport intensity, etc. in the Taklimakan Desert. The results show that there is a linear relation between the height and the log of sand transport rate over transverse dune chain, longitudinal dune ridge and flat sand land, i.e. the sand transport percentage decreases exponentially with increasing height. Sand transport rate within the 10 cm height above the bed surface accounts for 80%-95% of the total sand transport rate of the observed height (40 cm), while the sand transport rate in 20 cm occupies 98% of the total amount. Sand transport rate (g·cm-1·min-1) differs greatly with respect to different landform types and different topographic positions. Based on the investigation and analysis on aeolian sand landform origin, morphological type and distribution feature, the two typical landform assemblages, complex transverse dune chain-alluvial plain and huge longitudinal dune ridge-interridge lowland in the Taklimakan Desert were divided into several characteristic zones of aeolian sand movement states. From this one can qualitatively judge the types and severities of sand disasters at various topographic positions in the engineering installation region and further put forward concrete schemes and measures to control sand damages. 展开更多
关键词 Taklimakan Desert aeolian sand stream structure sand transport intensity state of aeolian sand stream movement
原文传递
上一页 1 下一页 到第
使用帮助 返回顶部