针对真实复杂场景下模态缺失带来的模型兼容性问题,提出一种支持任意模态输入的情感识别方法。首先,在预训练和精调阶段,采用模态随机丢弃的训练策略保证模型在推理阶段的兼容性;其次,分别提出时空掩码策略和基于跨模态注意力机制的特...针对真实复杂场景下模态缺失带来的模型兼容性问题,提出一种支持任意模态输入的情感识别方法。首先,在预训练和精调阶段,采用模态随机丢弃的训练策略保证模型在推理阶段的兼容性;其次,分别提出时空掩码策略和基于跨模态注意力机制的特征融合机制,以减少模型过拟合的风险并优化模型跨模态特征融合的效果;最后,为了解决多种模态情感标签不一致带来的噪声标签问题,提出一种基于多原型聚类的自适应去噪策略,该策略为多种模态分别设置类中心,并通过对比每种模态特征对应的聚类类别与标签的一致性去除噪声标签。实验结果表明:在自建数据集上,所提方法相比基线AV-HuBERT(Audio-Visual Hidden unit Bidirectional Encoder Representation from Transformers)在加权平均召回率(WAR)指标上,模态对齐推理、视频缺失推理和音频缺失推理分别提升了6.98、4.09和33.05个百分点;在视频公开数据集DFEW上,相较于AV-HuBERT,所提方法取得了最高的WAR指标,达到了68.94%。展开更多
The protein connector enhancer of kinase suppressor of Ras 2(CNKSR2),present in both the postsynaptic density and cytoplasm of neurons,is a scaffolding protein with several protein-binding domains.Variants of the CNKS...The protein connector enhancer of kinase suppressor of Ras 2(CNKSR2),present in both the postsynaptic density and cytoplasm of neurons,is a scaffolding protein with several protein-binding domains.Variants of the CNKSR2 gene have been implicated in neurodevelopmental disorders,particularly intellectual disability,although the precise mechanism involved has not yet been fully understood.Research has demonstrated that CNKSR2 plays a role in facilitating the localization of postsynaptic density protein complexes to the membrane,thereby influencing synaptic signaling and the morphogenesis of dendritic spines.However,the function of CNKSR2 in the cytoplasm remains to be elucidated.In this study,we used immunoprecipitation and high-resolution liquid chromatography-mass spectrometry to identify the interactors of CNKSR2.Through a combination of bioinformatic analysis and cytological experiments,we found that the CNKSR2 interactors were significantly enriched in the proteome of the centrosome.We also showed that CNKSR2 interacted with the microtubule protein DYNC1H1 and with the centrosome marker CEP290.Subsequent colocalization analysis confirmed the centrosomal localization of CNKSR2.When we downregulated CNKSR2 expression in mouse neuroblastoma cells(Neuro 2A),we observed significant changes in the expression of numerous centrosomal genes.This manipulation also affected centrosome-related functions,including cell size and shape,cell proliferation,and motility.Furthermore,we found that CNKSR2 interactors were highly enriched in de novo variants associated with intellectual disability and autism spectrum disorder.Our findings establish a connection between CNKSR2 and the centrosome,and offer new insights into the underlying mechanisms of neurodevelopmental disorders.展开更多
Detection of ultralow magnetic field requires magnetic sensors with high sensitivity and low noise level,especially for low operating frequency applications.We investigated the transport properties of tunnel magnetore...Detection of ultralow magnetic field requires magnetic sensors with high sensitivity and low noise level,especially for low operating frequency applications.We investigated the transport properties of tunnel magnetoresistance(TMR)sensors based on the double indirect exchange coupling effect.The TMR ratio of about 150%was obtained in the magnetic tunnel junctions and linear response to an in-plane magnetic field was successfully achieved.A high sensitivity of 1.85%/Oe was achieved due to a designed soft pinned sensing layer of CoFeB/NiFe/Ru/IrMn.Furthermore,the voltage output sensitivity and the noise level of 10.7 mV/V/Oe,10 nT/Hz^(1/2)at 1 Hz and3.3 nT/Hz^(1/2)at 10 Hz were achieved in Full Wheatstone Bridge configuration.This kind of magnetic sensors can be used in the field of smart grid for current detection and sensing.展开更多
文摘针对真实复杂场景下模态缺失带来的模型兼容性问题,提出一种支持任意模态输入的情感识别方法。首先,在预训练和精调阶段,采用模态随机丢弃的训练策略保证模型在推理阶段的兼容性;其次,分别提出时空掩码策略和基于跨模态注意力机制的特征融合机制,以减少模型过拟合的风险并优化模型跨模态特征融合的效果;最后,为了解决多种模态情感标签不一致带来的噪声标签问题,提出一种基于多原型聚类的自适应去噪策略,该策略为多种模态分别设置类中心,并通过对比每种模态特征对应的聚类类别与标签的一致性去除噪声标签。实验结果表明:在自建数据集上,所提方法相比基线AV-HuBERT(Audio-Visual Hidden unit Bidirectional Encoder Representation from Transformers)在加权平均召回率(WAR)指标上,模态对齐推理、视频缺失推理和音频缺失推理分别提升了6.98、4.09和33.05个百分点;在视频公开数据集DFEW上,相较于AV-HuBERT,所提方法取得了最高的WAR指标,达到了68.94%。
基金supported by the National Nature Science Foundation of China,No.32101020(to JL)the Natural Science Foundation of Shandong Province,Nos.ZR2020MC071(to JL),ZR2023MH327(to HZ)+1 种基金the Integrated Project of Major Research Plan of National Natural Science Foundation of China,No.92249303(to PL)the Natural Science Foundation of Qingdao,No.23-2-1-193-zyyd-jch(to HZ)。
文摘The protein connector enhancer of kinase suppressor of Ras 2(CNKSR2),present in both the postsynaptic density and cytoplasm of neurons,is a scaffolding protein with several protein-binding domains.Variants of the CNKSR2 gene have been implicated in neurodevelopmental disorders,particularly intellectual disability,although the precise mechanism involved has not yet been fully understood.Research has demonstrated that CNKSR2 plays a role in facilitating the localization of postsynaptic density protein complexes to the membrane,thereby influencing synaptic signaling and the morphogenesis of dendritic spines.However,the function of CNKSR2 in the cytoplasm remains to be elucidated.In this study,we used immunoprecipitation and high-resolution liquid chromatography-mass spectrometry to identify the interactors of CNKSR2.Through a combination of bioinformatic analysis and cytological experiments,we found that the CNKSR2 interactors were significantly enriched in the proteome of the centrosome.We also showed that CNKSR2 interacted with the microtubule protein DYNC1H1 and with the centrosome marker CEP290.Subsequent colocalization analysis confirmed the centrosomal localization of CNKSR2.When we downregulated CNKSR2 expression in mouse neuroblastoma cells(Neuro 2A),we observed significant changes in the expression of numerous centrosomal genes.This manipulation also affected centrosome-related functions,including cell size and shape,cell proliferation,and motility.Furthermore,we found that CNKSR2 interactors were highly enriched in de novo variants associated with intellectual disability and autism spectrum disorder.Our findings establish a connection between CNKSR2 and the centrosome,and offer new insights into the underlying mechanisms of neurodevelopmental disorders.
基金Supported by the Framework Project of SGCC(Grant No.5700-202058381A-0-0-00)the National Key Research and Development Program of China(Grant No.2017YFA0206200)。
文摘Detection of ultralow magnetic field requires magnetic sensors with high sensitivity and low noise level,especially for low operating frequency applications.We investigated the transport properties of tunnel magnetoresistance(TMR)sensors based on the double indirect exchange coupling effect.The TMR ratio of about 150%was obtained in the magnetic tunnel junctions and linear response to an in-plane magnetic field was successfully achieved.A high sensitivity of 1.85%/Oe was achieved due to a designed soft pinned sensing layer of CoFeB/NiFe/Ru/IrMn.Furthermore,the voltage output sensitivity and the noise level of 10.7 mV/V/Oe,10 nT/Hz^(1/2)at 1 Hz and3.3 nT/Hz^(1/2)at 10 Hz were achieved in Full Wheatstone Bridge configuration.This kind of magnetic sensors can be used in the field of smart grid for current detection and sensing.
