摘要
本文针对气候监测预测分析系统(CIPAS3.0)数据环境的系统架构、总体设计,提出系统实现的若干关键技术并进行深入分析。CIPAS3.0作为国家气候中心面向气候监测、预测、诊断业务的核心业务系统,其数据支撑环境已全面融入气象大数据云平台“天擎”,针对不同存储格式的数据源,建立了以GBASE和PostgreSQL底层存储架构为基础的气候专题数据库,采用基于配置文件的可插拔数据加工处理框架,并提供了具有数算一体能力的数据访问接口。CIPAS数据环境设计采用OBS(Object Storage Service)对象存储进行产品的管理,同时针对数据产品完整性和分布式集群管理建立了全流程的监控系统,实现了数据从采集、入库、存储、加工处理、访问、监控等各环节的支撑作用。目前,CIPAS3.0数据环境已投入业务使用,其建设成果在国家级业务单位和试点省份的试用显示出其在支撑业务应用能力与发展前景方面具备较好的基础。
This paper focuses on the system architecture and overall design of the Climate Monitoring and Prediction Analysis System(CIPAS 3.O)data environment,proposing and providing an in-depth analysis of several key technologies for system implementation.As the core business system for climate monitoring,prediction,and diagnosis at the National Climate Centre,CIPAS 3.O integrates its data support environment fully into the meteorological big data cloud platform"Tianqing,"supporting the"cloud+client"climate business system framework,providing stable and reliable support for various stages such as data collection,storage,processing and monitoring.To support the storage and management of high-resolution grid data and long-time sequence data from the meteorological station,the CIPAS 3.O data environment designs and applies a spatial analysis database and a historical analysis database based on PostgreSQL and GBASE.This fills the performance bottlenecks of traditional databases and ensures efficient data storage and management functions.By integrating the Tianqing data collection,storage and monitoring,the CIPAS 3.O data environment adopts a pluggable data processing framework based on profile to achieve automatic operation and construction of the whole process.Based on the standard meteorological service interface specifications,a data access interface with integrated numerical computation capabilities is provided.This not only improve the efficiency of real-time interactive computation,but also enhances the sensitivity to information such as data reporting and storage.The CIPAS 3.O data environment design adopts OBS(Object Storage Service)for product management,and concurrently,a data monitoring system based on Tianjing has been constructed,which resolves the difficulties encountered in the daily operation and maintenance of CIPAS 3.O such as data integrity monitoring,one-click supplementary recording,and data source tracing.It actualises the support role of data collection,storage,processing,access,monitoring,and other links.Currently,the CIPAS 3.O data environment is in operation,and its construction achievements have demonstrated its good potential for supporting business applications and development prospects through testing in national-level business units and pilot provinces.The future development of the CIPAS 3.O data environment will be driven by demand to dynamically expand the types of data in the data environment;it will develop a general configurable system page to enable rapid data configuration and storage as needed,utilise matrix arithmetic to optimise the performance of the algorithm and interfaces of the spatial analysis database,implement automated operation and maintenance processes based on data perception and trigger message mechanisms,optimise data registration and review processes,alarm mechanisms,and automatic recovery,etc.,to further enhance the supporting role of the CIPAS 3.0 data environment for business application capabilities.
作者
刘北
王舒
吴焕萍
刘媛媛
胡昕
李玉
胡川叶
LIU Bei;WANG Shu;WU Huanping;LU Yuanyuan;HU Xin;LI Yu;HU Chuanye(National Climate Center,Beijing 100081)
出处
《气象科技》
2023年第6期917-926,共10页
Meteorological Science and Technology
基金
农业大灾风险综合集成智能分析与决策研究(2022ZD0119505)
风云卫星应用先行计划(FY-APP-2021.0304)
2022年度气候研究开放课题青年基金资助。
关键词
数据环境
气候监测预测
业务系统
数算一体
data environment
climate monitoring and prediction
business system
data computing integration
