摘要
针对轨道交通车辆智能运维系统中海量车载数据处理需求,为解决单点数据处理模式下海量数据在接收、处理、存储、查询、分析等各环节的性能瓶颈问题,文章提出一种基于Lambda架构原理搭建的数据处理架构方案。其以分布式服务器集群作为底层硬件支撑,采用分布式处理框架,大幅提高了运维系统的数据并发处理能力。实验结果证明,该方案相对于单点数据处理模式,在各环节的处理性能都大幅提升。在多个车辆智能运维项目的实践也证明,基于该方案的轨道交通智能运维系统能有效满足车辆下发的海量数据的快速处理需求。
In view of the massive on-board data processing requirements in the intelligent operation and maintenance system for rail transit vehicles,this paper proposes a data processing architecture scheme based on the principle of Lambda architecture in order to overcome the performance bottlenecks in the reception,processing,storage,query,analysis and other links of massive data under the single-point data processing mode.It adopts distributed server cluster as the underlying hardware support and uses distributed processing framework,which greatly improves data concurrent processing ability of the operation and maintenance system.Experimental results show that compared with the single point data processing mode,processing performances are greatly improved in every link by this scheme.The application of many railway intelligent operation and maintenance projects also proves that the rail intelligent operation and maintenance system based on this scheme can effectively meet the demand of rapid processing of massive data issued by vehicles.
作者
胡卫民
HU Weimin(Zhuzhou CRRC Times Electric Co.,Ltd.,Zhuzhou,Hunan 412001,China)
出处
《控制与信息技术》
2021年第2期67-71,共5页
CONTROL AND INFORMATION TECHNOLOGY
基金
国家重点研发计划(2016YFB1200401)。
关键词
Lambda架构
智能运维系统
大数据
轨道交通
Lambda architecture
intelligent operation and maintenance system
big data
rail transit