A new algorithm taking the spatial context of local features into account by utilizing contextualized histograms was proposed to recognize facial expression. The contextualized histograms were extracted fromtwo widely...A new algorithm taking the spatial context of local features into account by utilizing contextualized histograms was proposed to recognize facial expression. The contextualized histograms were extracted fromtwo widely used descriptors—the local binary pattern（ LBP） and weber local descriptor（ WLD）. The LBP and WLD feature histograms were extracted separately fromeach facial image,and contextualized histogram was generated as feature vectors to feed the classifier. In addition,the human face was divided into sub-blocks and each sub-block was assigned different weights by their different contributions to the intensity of facial expressions to improve the recognition rate. With the support vector machine（SVM） as classifier,the experimental results on the 2D texture images fromthe 3D-BU FE dataset indicated that contextualized histograms improved facial expression recognition performance when local features were employed.展开更多
Current integration methods for single-cell RNA sequencing(scRNA-seq)data and spatial transcriptomics(ST)data are typically designed for specific tasks,such as deconvolution of cell types or spatial distribution predi...Current integration methods for single-cell RNA sequencing(scRNA-seq)data and spatial transcriptomics(ST)data are typically designed for specific tasks,such as deconvolution of cell types or spatial distribution prediction of RNA transcripts.These methods usually only offer a partial analysis of ST data,neglecting the complex relationship between spatial expression patterns underlying cell-type specificity and intercellular cross-talk.Here,we present eMCI,an explainable multimodal correlation integration model based on deep neural network framework.eMCI leverages the fusion of scRNA-seq and ST data using different spot–cell correlations to integrate multiple synthetic analysis tasks of ST data at cellular level.First,eMCI can achieve better or comparable accuracy in cell-type classification and deconvolution according to wide evaluations and comparisons with state-of-the-art methods on both simulated and real ST datasets.Second,eMCI can identify key components across spatial domains responsible for different cell types and elucidate the spatial expression patterns underlying cell-type specificity and intercellular communication,by employing an attribution algorithm to dissect the visual input.Especially,eMCI has been applied to 3 cross-species datasets,including zebrafish melanomas,soybean nodule maturation,and human embryonic lung,which accurately and efficiently estimate per-spot cell composition and infer proximal and distal cellular interactions within the spatial and temporal context.In summary,eMCI serves as an integrative analytical framework to better resolve the spatial transcriptome based on existing single-cell datasets and elucidate proximal and distal intercellular signal transduction mechanisms over spatial domains without requirement of biological prior reference.This approach is expected to facilitate the discovery of spatial expression patterns of potential biomolecules with cell type and cell–cell communication specificity.展开更多
基金Supported by the National Natural Science Foundation of China(60772066)
文摘A new algorithm taking the spatial context of local features into account by utilizing contextualized histograms was proposed to recognize facial expression. The contextualized histograms were extracted fromtwo widely used descriptors—the local binary pattern（ LBP） and weber local descriptor（ WLD）. The LBP and WLD feature histograms were extracted separately fromeach facial image,and contextualized histogram was generated as feature vectors to feed the classifier. In addition,the human face was divided into sub-blocks and each sub-block was assigned different weights by their different contributions to the intensity of facial expressions to improve the recognition rate. With the support vector machine（SVM） as classifier,the experimental results on the 2D texture images fromthe 3D-BU FE dataset indicated that contextualized histograms improved facial expression recognition performance when local features were employed.
基金supported by the National Key R&D Program of China(Nos.2023YFF1204700 and 2022YFF1202100)the National Natural Science Foundation of China(Nos.12371485,62201150,T2341022,62172164,12322119,and 12271180)the Natural Science Foundation of Guangdong Province of China(Nos.2022A1515110759,2023A1515110558,and 2024A1515011797).
文摘Current integration methods for single-cell RNA sequencing(scRNA-seq)data and spatial transcriptomics(ST)data are typically designed for specific tasks,such as deconvolution of cell types or spatial distribution prediction of RNA transcripts.These methods usually only offer a partial analysis of ST data,neglecting the complex relationship between spatial expression patterns underlying cell-type specificity and intercellular cross-talk.Here,we present eMCI,an explainable multimodal correlation integration model based on deep neural network framework.eMCI leverages the fusion of scRNA-seq and ST data using different spot–cell correlations to integrate multiple synthetic analysis tasks of ST data at cellular level.First,eMCI can achieve better or comparable accuracy in cell-type classification and deconvolution according to wide evaluations and comparisons with state-of-the-art methods on both simulated and real ST datasets.Second,eMCI can identify key components across spatial domains responsible for different cell types and elucidate the spatial expression patterns underlying cell-type specificity and intercellular communication,by employing an attribution algorithm to dissect the visual input.Especially,eMCI has been applied to 3 cross-species datasets,including zebrafish melanomas,soybean nodule maturation,and human embryonic lung,which accurately and efficiently estimate per-spot cell composition and infer proximal and distal cellular interactions within the spatial and temporal context.In summary,eMCI serves as an integrative analytical framework to better resolve the spatial transcriptome based on existing single-cell datasets and elucidate proximal and distal intercellular signal transduction mechanisms over spatial domains without requirement of biological prior reference.This approach is expected to facilitate the discovery of spatial expression patterns of potential biomolecules with cell type and cell–cell communication specificity.
