Contrastive self‐supervised representation learning on attributed graph networks with Graph Neural Networks has attracted considerable research interest recently.However,there are still two challenges.First,most of t...Contrastive self‐supervised representation learning on attributed graph networks with Graph Neural Networks has attracted considerable research interest recently.However,there are still two challenges.First,most of the real‐word system are multiple relations,where entities are linked by different types of relations,and each relation is a view of the graph network.Second,the rich multi‐scale information(structure‐level and feature‐level)of the graph network can be seen as self‐supervised signals,which are not fully exploited.A novel contrastive self‐supervised representation learning framework on attributed multiplex graph networks with multi‐scale(named CoLM^(2)S)information is presented in this study.It mainly contains two components:intra‐relation contrast learning and interrelation contrastive learning.Specifically,the contrastive self‐supervised representation learning framework on attributed single‐layer graph networks with multi‐scale information(CoLMS)framework with the graph convolutional network as encoder to capture the intra‐relation information with multi‐scale structure‐level and feature‐level selfsupervised signals is introduced first.The structure‐level information includes the edge structure and sub‐graph structure,and the feature‐level information represents the output of different graph convolutional layer.Second,according to the consensus assumption among inter‐relations,the CoLM^(2)S framework is proposed to jointly learn various graph relations in attributed multiplex graph network to achieve global consensus node embedding.The proposed method can fully distil the graph information.Extensive experiments on unsupervised node clustering and graph visualisation tasks demonstrate the effectiveness of our methods,and it outperforms existing competitive baselines.展开更多
Scanning Electron Microscopes(SEMs)are widely used in experimental science laboratories,often requiring cumbersome and repetitive user analysis.Automating SEM image analysis processes is highly desirable to address th...Scanning Electron Microscopes(SEMs)are widely used in experimental science laboratories,often requiring cumbersome and repetitive user analysis.Automating SEM image analysis processes is highly desirable to address this challenge.In particle sample analysis,Machine Learning(ML)has emerged as the most effective approach for particle segmentation.However,the time-intensive process of manually annotating thousands of SEM images limits the applicability of supervised learning approaches.Self-Supervised Learning(SSL)offers a promising alternative by enabling knowledge extraction from raw,unlabeled data.This study presents a framework for evaluating SSL techniques in SEM image analysis,focusing on novel methods leveraging the ConvNeXtV2 architecture for particle detection.A dataset comprising 25,000 SEM images is curated to benchmark these proposed SSL methods.The results demonstrate that ConvNeXtV2 models,with varying parameter counts,consistently outperform other techniques in particle detection across different length scales,achieving up to a34%reduction in relative error compared to established SSL methods.Furthermore,an ablation study explores the relationship between dataset size and SSL performance,providing actionable insights for practitioners regarding model selection and resource efficiency.This research advances the integration of SSL into autonomous analysis pipelines and supports its application in accelerating materials science discovery.展开更多
Volumetric imaging is increasingly in demand for its precision in statistically visualizing and analyzing the intricacies of biological phenomena.To visualize the intricate details of these minute structures and facil...Volumetric imaging is increasingly in demand for its precision in statistically visualizing and analyzing the intricacies of biological phenomena.To visualize the intricate details of these minute structures and facilitate the analysis in biomedical research,high-signal-to-noise ratio(SNR)images are indispensable.However,the inevitable noise presents a significant barrier to imaging qualities.Here,we propose SelfMirror,a self-supervised deep-learning denoising method for volumetric image reconstruction.SelfMirror is developed based on the insight that the variation of biological structure is continuous and smooth;when the sampling interval in volumetric imaging is sufficiently small,the similarity of neighboring slices in terms of the spatial structure becomes apparent.Such similarity can be used to train our proposed network to revive the signals and suppress the noise accurately.The denoising performance of SelfMirror exhibits remarkable robustness and fidelity even in extremely low-SNR conditions.We demonstrate the broad applicability of SelfMirror on multiple imaging modalities,including two-photon microscopy,confocal microscopy,expansion microscopy,computed tomography,and 3D electron microscopy.This versatility extends from single neuron cells to tissues and organs,highlighting SelfMirror's potential for integration into diverse imaging and analysis pipelines.展开更多
基金support by the National Natural Science Foundation of China(NSFC)under grant number 61873274.
文摘Contrastive self‐supervised representation learning on attributed graph networks with Graph Neural Networks has attracted considerable research interest recently.However,there are still two challenges.First,most of the real‐word system are multiple relations,where entities are linked by different types of relations,and each relation is a view of the graph network.Second,the rich multi‐scale information(structure‐level and feature‐level)of the graph network can be seen as self‐supervised signals,which are not fully exploited.A novel contrastive self‐supervised representation learning framework on attributed multiplex graph networks with multi‐scale(named CoLM^(2)S)information is presented in this study.It mainly contains two components:intra‐relation contrast learning and interrelation contrastive learning.Specifically,the contrastive self‐supervised representation learning framework on attributed single‐layer graph networks with multi‐scale information(CoLMS)framework with the graph convolutional network as encoder to capture the intra‐relation information with multi‐scale structure‐level and feature‐level selfsupervised signals is introduced first.The structure‐level information includes the edge structure and sub‐graph structure,and the feature‐level information represents the output of different graph convolutional layer.Second,according to the consensus assumption among inter‐relations,the CoLM^(2)S framework is proposed to jointly learn various graph relations in attributed multiplex graph network to achieve global consensus node embedding.The proposed method can fully distil the graph information.Extensive experiments on unsupervised node clustering and graph visualisation tasks demonstrate the effectiveness of our methods,and it outperforms existing competitive baselines.
基金funded by the German Research Foundation(DFG)under Project ID 390874152(POLiS Cluster of Excellence)N.J.S.,A.G.,G.C.,O.D.,A.J.were supported by the D2S2 program within the U.S.Department of Energy,Office of Basic Energy Sciences,Materials Sciences and Engineering Division under Contract No.DE-AC02-05-CH11231(D2S2 program,KCD2S2)A.G.acknowledges support from the Swiss National Science Foundation(SNSF,project#P500PN_222166).
文摘Scanning Electron Microscopes(SEMs)are widely used in experimental science laboratories,often requiring cumbersome and repetitive user analysis.Automating SEM image analysis processes is highly desirable to address this challenge.In particle sample analysis,Machine Learning(ML)has emerged as the most effective approach for particle segmentation.However,the time-intensive process of manually annotating thousands of SEM images limits the applicability of supervised learning approaches.Self-Supervised Learning(SSL)offers a promising alternative by enabling knowledge extraction from raw,unlabeled data.This study presents a framework for evaluating SSL techniques in SEM image analysis,focusing on novel methods leveraging the ConvNeXtV2 architecture for particle detection.A dataset comprising 25,000 SEM images is curated to benchmark these proposed SSL methods.The results demonstrate that ConvNeXtV2 models,with varying parameter counts,consistently outperform other techniques in particle detection across different length scales,achieving up to a34%reduction in relative error compared to established SSL methods.Furthermore,an ablation study explores the relationship between dataset size and SSL performance,providing actionable insights for practitioners regarding model selection and resource efficiency.This research advances the integration of SSL into autonomous analysis pipelines and supports its application in accelerating materials science discovery.
基金National Natural Science Foundation of China(62027812,62333012)。
文摘Volumetric imaging is increasingly in demand for its precision in statistically visualizing and analyzing the intricacies of biological phenomena.To visualize the intricate details of these minute structures and facilitate the analysis in biomedical research,high-signal-to-noise ratio(SNR)images are indispensable.However,the inevitable noise presents a significant barrier to imaging qualities.Here,we propose SelfMirror,a self-supervised deep-learning denoising method for volumetric image reconstruction.SelfMirror is developed based on the insight that the variation of biological structure is continuous and smooth;when the sampling interval in volumetric imaging is sufficiently small,the similarity of neighboring slices in terms of the spatial structure becomes apparent.Such similarity can be used to train our proposed network to revive the signals and suppress the noise accurately.The denoising performance of SelfMirror exhibits remarkable robustness and fidelity even in extremely low-SNR conditions.We demonstrate the broad applicability of SelfMirror on multiple imaging modalities,including two-photon microscopy,confocal microscopy,expansion microscopy,computed tomography,and 3D electron microscopy.This versatility extends from single neuron cells to tissues and organs,highlighting SelfMirror's potential for integration into diverse imaging and analysis pipelines.
