semantics information while maintaining spatial detail con-texts.Long-range context information plays a crucial role in this scenario.How-ever,the traditional convolution kernel only provides the local and small size ...semantics information while maintaining spatial detail con-texts.Long-range context information plays a crucial role in this scenario.How-ever,the traditional convolution kernel only provides the local and small size of the receptivefield.To address the problem,we propose a plug-and-play module aggregating both local and global information(aka LGIA module)to capture the high-order relationship between nodes that are far apart.We incorporate both local and global correlations into hypergraph which is able to capture high-order rela-tionships between nodes via the concept of a hyperedge connecting a subset of nodes.The local correlation considers neighborhood nodes that are spatially adja-cent and similar in the same CNN feature maps of magnetic resonance(MR)image;and the global correlation is searched from a batch of CNN feature maps of MR images in feature space.The influence of these two correlations on seman-tic segmentation is complementary.We validated our LGIA module on various CNN segmentation models with the cardiac MR images dataset.Experimental results demonstrate that our approach outperformed several baseline models.展开更多
知识超图(knowledge hypergraph,KHG)是一种超图结构的知识图谱。知识超图链接预测是基于已知的实体和关系来预测缺失的实体或关系,具有重要的意义和价值。然而,现有基于神经网络的知识超图链接预测方法,只关注关系事实局部的语义特征,...知识超图(knowledge hypergraph,KHG)是一种超图结构的知识图谱。知识超图链接预测是基于已知的实体和关系来预测缺失的实体或关系,具有重要的意义和价值。然而,现有基于神经网络的知识超图链接预测方法,只关注关系事实局部的语义特征,缺乏对关系事实之间关联特征的表示学习。针对以上问题,提出了一种基于图注意力网络与卷积神经网络的链接预测方法(knowledge prediction based on GAT and convolutional neural network,HPGC)。一方面,采用改进的卷积网络(convolutional neural network,CNN)提取知识超图中节点实体表示的局部特征;另一方面,使用改进的GAT对节点和关系进行注意力建模,捕获节点之间的全局特征关系,并将两者进行融合,从而获取关系事实更全面的邻域结构,丰富超图关系事实的语义表示。此外,针对HPGC的GAT层输出矢量问题,引入多层感知机(multilayer perceptron,MLP)和正则化技术,提高模型训练的泛化能力。真实数据集上的大量实验结果验证了所提出方法的预测性能均优于基线方法。展开更多
Graph neural networks have been shown to be very effective in utilizing pairwise relationships across samples.Recently,there have been several successful proposals to generalize graph neural networks to hypergraph neu...Graph neural networks have been shown to be very effective in utilizing pairwise relationships across samples.Recently,there have been several successful proposals to generalize graph neural networks to hypergraph neural networks to exploit more com-plex relationships.In particular,the hypergraph collaborative networks yield superior results compared to other hypergraph neural net-works for various semi-supervised learning tasks.The collaborative network can provide high quality vertex embeddings and hyperedge embeddings together by formulating them as a joint optimization problem and by using their consistency in reconstructing the given hy-pergraph.In this paper,we aim to establish the algorithmic stability of the core layer of the collaborative network and provide generaliz--ation guarantees.The analysis sheds light on the design of hypergraph filters in collaborative networks,for instance,how the data and hypergraph filters should be scaled to achieve uniform stability of the learning process.Some experimental results on real-world datasets are presented to illustrate the theory.展开更多
基金supported by the Sichuan Science and Technology Program(Grant No.2019ZDZX0005,2019YFG0496,2020YFG0143,2019JDJQ0002 and 2020YFG0009).
文摘semantics information while maintaining spatial detail con-texts.Long-range context information plays a crucial role in this scenario.How-ever,the traditional convolution kernel only provides the local and small size of the receptivefield.To address the problem,we propose a plug-and-play module aggregating both local and global information(aka LGIA module)to capture the high-order relationship between nodes that are far apart.We incorporate both local and global correlations into hypergraph which is able to capture high-order rela-tionships between nodes via the concept of a hyperedge connecting a subset of nodes.The local correlation considers neighborhood nodes that are spatially adja-cent and similar in the same CNN feature maps of magnetic resonance(MR)image;and the global correlation is searched from a batch of CNN feature maps of MR images in feature space.The influence of these two correlations on seman-tic segmentation is complementary.We validated our LGIA module on various CNN segmentation models with the cardiac MR images dataset.Experimental results demonstrate that our approach outperformed several baseline models.
文摘知识超图(knowledge hypergraph,KHG)是一种超图结构的知识图谱。知识超图链接预测是基于已知的实体和关系来预测缺失的实体或关系,具有重要的意义和价值。然而,现有基于神经网络的知识超图链接预测方法,只关注关系事实局部的语义特征,缺乏对关系事实之间关联特征的表示学习。针对以上问题,提出了一种基于图注意力网络与卷积神经网络的链接预测方法(knowledge prediction based on GAT and convolutional neural network,HPGC)。一方面,采用改进的卷积网络(convolutional neural network,CNN)提取知识超图中节点实体表示的局部特征;另一方面,使用改进的GAT对节点和关系进行注意力建模,捕获节点之间的全局特征关系,并将两者进行融合,从而获取关系事实更全面的邻域结构,丰富超图关系事实的语义表示。此外,针对HPGC的GAT层输出矢量问题,引入多层感知机(multilayer perceptron,MLP)和正则化技术,提高模型训练的泛化能力。真实数据集上的大量实验结果验证了所提出方法的预测性能均优于基线方法。
基金Ng was supported in part by Hong Kong Research Grant Council General Research Fund(GRF),China(Nos.12300218,12300519,117201020,17300021,CRF C1013-21GF,C7004-21GF and Joint NSFC-RGC NHKU76921)Wu is supported by National Natural Science Foundation of China(No.62206111)+3 种基金Young Talent Support Project of Guangzhou Association for Science and Technology,China(No.QT-2023-017)Guangzhou Basic and Applied Basic Research Foundation,China(No.2023A04J1058)Fundamental Research Funds for the Central Universities,China(No.21622326)China Postdoctoral Science Foundation(No.2022M721343).
文摘Graph neural networks have been shown to be very effective in utilizing pairwise relationships across samples.Recently,there have been several successful proposals to generalize graph neural networks to hypergraph neural networks to exploit more com-plex relationships.In particular,the hypergraph collaborative networks yield superior results compared to other hypergraph neural net-works for various semi-supervised learning tasks.The collaborative network can provide high quality vertex embeddings and hyperedge embeddings together by formulating them as a joint optimization problem and by using their consistency in reconstructing the given hy-pergraph.In this paper,we aim to establish the algorithmic stability of the core layer of the collaborative network and provide generaliz--ation guarantees.The analysis sheds light on the design of hypergraph filters in collaborative networks,for instance,how the data and hypergraph filters should be scaled to achieve uniform stability of the learning process.Some experimental results on real-world datasets are presented to illustrate the theory.
