摘要
为增强测震流式数据采集的容错纠错能力,提高数据处理的稳定性和可靠性,提出基于ZooKeeper的分布式测震实时流数据处理方法。构建ZooKeeper分布式服务架构;通过监听动作完成整个流程中的主备切换,并继续进行数据消费行为,实现服务注册、服务加载、服务容错、策略调度功能。测试结果表明该方法下系统平均每小时服务修复时间(MTTR)降低98.4%,平均每小时故障间隔时间(MTTF)提升33.5%,对于故障场景下数据完整率提升20%,能够较好解决测震流式数据面临的稳定性和可靠性困难,具备区域地震台网技术推广应用潜力。
In order to enhance the fault-tolerant and error-correcting ability of massive seismic streaming data acquisition and improve the stability and reliability of data processing,a distributed real-time seismic streaming data processing method based on ZooKeeper is proposed.ZooKeeper distributed service architecture was constructed,and the active and standby switching in the whole process was completed through the monitoring action,and the data consumption behavior was continued,which realized the functions of service registration,service loading,service fault tolerance and policy scheduling.The test results show that the average hourly service repair time(MTTR)of the system is reduced by 98.4%,the average hourly time between failures(MTTF)is increased by 33.5%,and the data integrity rate is increased by 20%compared with the failure scenario,which can better solve the stability and reliability of seismic streaming data.It has the potential of popularization and application of regional seismic network technology.
作者
李杨
冯兵
蔡寅
张秀萍
许利娜
Li Yang;Feng Bing;Cai Yin;Zhang Xiuping;Xu Lina(The Second Monitoring and Application Center,CEA,Xi an 710054,Shaanxi,China;Earthquake Administration of Shandong Province,Jinan 250014,Shandong,China)
出处
《计算机应用与软件》
北大核心
2026年第2期64-70,146,共8页
Computer Applications and Software
基金
国家重点研发计划项目(2017YFC1500503)
中国地震局地震应急与信息青年重点任务(CEA_ED EM(ITN S)-2023)
陕西省自然科学基础研究计划项目(2021JQ-981)。
关键词
实时流数据
容错纠错
协调服务
服务模型
Real-time streaming data
Fault-tolerant error correction
Coordination of services
Service model