Current shipping,tourism,and resource development requirements call for more accurate predictions of the Arctic sea-ice concentration(SIC).However,due to the complex physical processes involved,predicting the spatiote...Current shipping,tourism,and resource development requirements call for more accurate predictions of the Arctic sea-ice concentration(SIC).However,due to the complex physical processes involved,predicting the spatiotemporal distribution of Arctic SIC is more challenging than predicting its total extent.In this study,spatiotemporal prediction models for monthly Arctic SIC at 1-to 3-month leads are developed based on U-Net-an effective convolutional deep-learning approach.Based on explicit Arctic sea-ice-atmosphere interactions,11 variables associated with Arctic sea-ice variations are selected as predictors,including observed Arctic SIC,atmospheric,oceanic,and heat flux variables at 1-to 3-month leads.The prediction skills for the monthly Arctic SIC of the test set(from January 2018 to December 2022)are evaluated by examining the mean absolute error(MAE)and binary accuracy(BA).Results showed that the U-Net model had lower MAE and higher BA for Arctic SIC compared to two dynamic climate prediction systems(CFSv2 and NorCPM).By analyzing the relative importance of each predictor,the prediction accuracy relies more on the SIC at the 1-month lead,but on the surface net solar radiation flux at 2-to 3-month leads.However,dynamic models show limited prediction skills for surface net solar radiation flux and other physical processes,especially in autumn.Therefore,the U-Net model can be used to capture the connections among these key physical processes associated with Arctic sea ice and thus offers a significant advantage in predicting Arctic SIC.展开更多
由于患者个体差异、采集协议多样性和数据损坏等因素,现有基于磁共振成像(Magnetic resonance imaging,MRI)的脑肿瘤分割方法存在模态数据丢失问题,导致分割精度不高。为此,本文提出了一种基于U-Net和Transformer结合的不完整多模态脑...由于患者个体差异、采集协议多样性和数据损坏等因素,现有基于磁共振成像(Magnetic resonance imaging,MRI)的脑肿瘤分割方法存在模态数据丢失问题,导致分割精度不高。为此,本文提出了一种基于U-Net和Transformer结合的不完整多模态脑肿瘤分割(Incomplete multimodal brain tumor segmentation based on the combination of U-Net and Transformer,IM TransNet)方法。首先,针对脑肿瘤MRI的4个不同模态设计了单模态特定编码器,提升模型对各模态数据的表征能力。其次,在U-Net中嵌入双重注意力的Transformer模块,克服模态缺失引起的信息不完整问题,减少U-Net的长距离上下文交互和空间依赖性局限。在U-Net的跳跃连接中加入跳跃交叉注意力机制,动态关注不同层级和模态的特征,即使在模态缺失时,也能有效融合特征并进行重建。此外,针对模态缺失引起的训练不平衡问题,设计了辅助解码模块,确保模型在各种不完整模态子集上均能稳定高效地分割脑肿瘤。最后,基于公开数据集BRATS验证模型的性能。实验结果表明,本文提出的模型在增强型肿瘤、肿瘤核心和全肿瘤上的平均Dice评分分别为63.19%、76.42%和86.16%,证明了其在处理不完整多模态数据时的优越性和稳定性,为临床实践中脑肿瘤的准确、高效和可靠分割提供了一种可行的技术手段。展开更多
基金supported by the National Key Research and Development Program of China[grant number 2022YFE0106800]an Innovation Group Project of the Southern Marine Science and Engineering Guangdong Laboratory(Zhuhai)[grant number 311024001]+3 种基金a project supported by the Southern Marine Science and Engineering Guangdong Laboratory(Zhuhai)[grant number SML2023SP209]a Research Council of Norway funded project(MAPARC)[grant number 328943]a Nansen Center´s basic institutional funding[grant number 342624]the high-performance computing support from the School of Atmospheric Science at Sun Yat-sen University。
文摘Current shipping,tourism,and resource development requirements call for more accurate predictions of the Arctic sea-ice concentration(SIC).However,due to the complex physical processes involved,predicting the spatiotemporal distribution of Arctic SIC is more challenging than predicting its total extent.In this study,spatiotemporal prediction models for monthly Arctic SIC at 1-to 3-month leads are developed based on U-Net-an effective convolutional deep-learning approach.Based on explicit Arctic sea-ice-atmosphere interactions,11 variables associated with Arctic sea-ice variations are selected as predictors,including observed Arctic SIC,atmospheric,oceanic,and heat flux variables at 1-to 3-month leads.The prediction skills for the monthly Arctic SIC of the test set(from January 2018 to December 2022)are evaluated by examining the mean absolute error(MAE)and binary accuracy(BA).Results showed that the U-Net model had lower MAE and higher BA for Arctic SIC compared to two dynamic climate prediction systems(CFSv2 and NorCPM).By analyzing the relative importance of each predictor,the prediction accuracy relies more on the SIC at the 1-month lead,but on the surface net solar radiation flux at 2-to 3-month leads.However,dynamic models show limited prediction skills for surface net solar radiation flux and other physical processes,especially in autumn.Therefore,the U-Net model can be used to capture the connections among these key physical processes associated with Arctic sea ice and thus offers a significant advantage in predicting Arctic SIC.
文摘由于患者个体差异、采集协议多样性和数据损坏等因素,现有基于磁共振成像(Magnetic resonance imaging,MRI)的脑肿瘤分割方法存在模态数据丢失问题,导致分割精度不高。为此,本文提出了一种基于U-Net和Transformer结合的不完整多模态脑肿瘤分割(Incomplete multimodal brain tumor segmentation based on the combination of U-Net and Transformer,IM TransNet)方法。首先,针对脑肿瘤MRI的4个不同模态设计了单模态特定编码器,提升模型对各模态数据的表征能力。其次,在U-Net中嵌入双重注意力的Transformer模块,克服模态缺失引起的信息不完整问题,减少U-Net的长距离上下文交互和空间依赖性局限。在U-Net的跳跃连接中加入跳跃交叉注意力机制,动态关注不同层级和模态的特征,即使在模态缺失时,也能有效融合特征并进行重建。此外,针对模态缺失引起的训练不平衡问题,设计了辅助解码模块,确保模型在各种不完整模态子集上均能稳定高效地分割脑肿瘤。最后,基于公开数据集BRATS验证模型的性能。实验结果表明,本文提出的模型在增强型肿瘤、肿瘤核心和全肿瘤上的平均Dice评分分别为63.19%、76.42%和86.16%,证明了其在处理不完整多模态数据时的优越性和稳定性,为临床实践中脑肿瘤的准确、高效和可靠分割提供了一种可行的技术手段。
