摘要
【目的】本文对国家高能物理科学数据中心分布式数据平台进行系统全面介绍,为高能物理及相关领域大科学实验的数据处理提供参考。【方法】文章介绍了国家高能物理科学数据中心分布式数据处理平台的总体构成、运行模式和智能运维等方面的关键技术。通过分析高能物理实验数据处理的计算特点与实际需求,介绍了数据中心“一平台多中心”的数据处理平台建设思想,阐述了平台为高能物理实验提供的跨地域资源共享、高性能海量数据访问以及用户实时交互服务等技术方案设计与实现。【结果】文章列举了数据中心分布式数据处理平台对两个高能物理实验的支持实例,助力科学研究成果获取。【结论】国家高能物理科学数据中心分布式数据处理平台已经成为高能物理学科的重要基础设施和组成,是学科融合、开展新研究方法的主要场所,满足了粒子物理、理论物理、空间天文、射线学科、加速器设计等科研领域的数据处理需求。
[Objective]This paper introduces the distributed data processing platform of the National High Energy Physics Data Center(NHEPDC).It also provides a reference for data processing in the HEP and related science experiments.[Methods]This paper introduces the composition,key technologies,and intelligent operation of the distributed data processing platform of NHEPDC.By analyzing the characteristics and actual requirements of high energy physics data processing,the paper introduces the strategy of"one platform and multiple centers"for construction of the distributed data processing platform in the data center and elaborates the realization of cross-regional resource sharing,high performance data access,and user interaction data processing.[Results]The paper enumerates two examples of support for high-energy physics experiments on the distributed data processing platform of NHEPDC to facilitate the acquisition of scientific research results.[Conclusions]The distributed data processing platform of NHEPDC has become an important infrastructure and composition of high energy physics,the main place to integrate new research methods.It meets the computing needs of particle physics,theoretical physics,space astronomy,ray science,accelerator design,and other scientific research fields.
作者
石京燕
黄秋兰
汪璐
李海波
杜然
姜晓巍
胡庆宝
郑伟
闫晓飞
张玄同
SHI Jingyan;HUANG Qiulan;Wang Lu;LI Haibo;DU Ran;JIANG Xiaowei;HU Qingbao;ZHENG Wei;Yan Xiaofei;ZHANG Xuantong(Institute of High Energy Physics,Chinese Academy of Sciences,Beijing 100049,China)
出处
《数据与计算发展前沿》
CSCD
2022年第1期97-112,共16页
Frontiers of Data & Computing
基金
国家自然科学基金(11775250,11805226,12075268,11875283)。
关键词
分布式数据处理平台
跨地域资源共享
高性能计算
高通量计算
distributed data processing platform
cross-regional resource sharing
high performance computing
high throughput computing
