In multi-modal emotion recognition,excessive reliance on historical context often impedes the detection of emotional shifts,while modality heterogeneity and unimodal noise limit recognition performance.Existing method...In multi-modal emotion recognition,excessive reliance on historical context often impedes the detection of emotional shifts,while modality heterogeneity and unimodal noise limit recognition performance.Existing methods struggle to dynamically adjust cross-modal complementary strength to optimize fusion quality and lack effective mechanisms to model the dynamic evolution of emotions.To address these issues,we propose a multi-level dynamic gating and emotion transfer framework for multi-modal emotion recognition.A dynamic gating mechanism is applied across unimodal encoding,cross-modal alignment,and emotion transfer modeling,substantially improving noise robustness and feature alignment.First,we construct a unimodal encoder based on gated recurrent units and feature-selection gating to suppress intra-modal noise and enhance contextual representation.Second,we design a gated-attention crossmodal encoder that dynamically calibrates the complementary contributions of visual and audio modalities to the dominant textual features and eliminates redundant information.Finally,we introduce a gated enhanced emotion transfer module that explicitly models the temporal dependence of emotional evolution in dialogues via transfer gating and optimizes continuity modeling with a comparative learning loss.Experimental results demonstrate that the proposed method outperforms state-of-the-art models on the public MELD and IEMOCAP datasets.展开更多
Optical skyrmions,as quasiparticles with non-trivial topological structures,have garnered significant attention in recent years.This paper proposes a method for customized spin angular momentum(SAM)distribution in hig...Optical skyrmions,as quasiparticles with non-trivial topological structures,have garnered significant attention in recent years.This paper proposes a method for customized spin angular momentum(SAM)distribution in highly localized focal fields,thereby enabling the generation of SAM skyrmion and bimeron topologies.The skyrmionic SAM textures can be flexibly controlled,such as polarity,vorticity,and helicity.In addition,the two-dimensional projection plane can be arbitrarily oriented within three-dimensional space.By utilizing time-reversal techniques,we obtain the required illumination fields of the 4π-focusing system and subsequently evaluate the tightly focused field using vector Debye integral theory.Our results show that the SAM orientation within the focal field is controlled by the orientation of orthogonal dipole pairs.Using the radiation field of a multi-concentric array of orthogonal dipole pairs,the distribution of SAM orientation in the target plane can be tailored to generate SAM topological structures such as skyrmions and bimerons.Highly localized and tunable SAM engineering holds great potential for applications in optical manipulation,light–matter interactions,optical information processing,transmission,and storage.展开更多
基金funded by“the Fanying Special Program of the National Natural Science Foundation of China,grant number 62341307”“the Scientific research project of Jiangxi Provincial Department of Education,grant number GJJ200839”“theDoctoral startup fund of JiangxiUniversity of Technology,grant number 205200100402”.
文摘In multi-modal emotion recognition,excessive reliance on historical context often impedes the detection of emotional shifts,while modality heterogeneity and unimodal noise limit recognition performance.Existing methods struggle to dynamically adjust cross-modal complementary strength to optimize fusion quality and lack effective mechanisms to model the dynamic evolution of emotions.To address these issues,we propose a multi-level dynamic gating and emotion transfer framework for multi-modal emotion recognition.A dynamic gating mechanism is applied across unimodal encoding,cross-modal alignment,and emotion transfer modeling,substantially improving noise robustness and feature alignment.First,we construct a unimodal encoder based on gated recurrent units and feature-selection gating to suppress intra-modal noise and enhance contextual representation.Second,we design a gated-attention crossmodal encoder that dynamically calibrates the complementary contributions of visual and audio modalities to the dominant textual features and eliminates redundant information.Finally,we introduce a gated enhanced emotion transfer module that explicitly models the temporal dependence of emotional evolution in dialogues via transfer gating and optimizes continuity modeling with a comparative learning loss.Experimental results demonstrate that the proposed method outperforms state-of-the-art models on the public MELD and IEMOCAP datasets.
基金National Natural Science Foundation of China(12434012,92050202,12274299)Natural Science Foundation of Fujian Province(2024J01789,2022J011102)+1 种基金Science and Technology Commission of Shanghai Municipality(22QA1406600)Quanzhou City Science and Technology Program(2024QZGZ7)。
文摘Optical skyrmions,as quasiparticles with non-trivial topological structures,have garnered significant attention in recent years.This paper proposes a method for customized spin angular momentum(SAM)distribution in highly localized focal fields,thereby enabling the generation of SAM skyrmion and bimeron topologies.The skyrmionic SAM textures can be flexibly controlled,such as polarity,vorticity,and helicity.In addition,the two-dimensional projection plane can be arbitrarily oriented within three-dimensional space.By utilizing time-reversal techniques,we obtain the required illumination fields of the 4π-focusing system and subsequently evaluate the tightly focused field using vector Debye integral theory.Our results show that the SAM orientation within the focal field is controlled by the orientation of orthogonal dipole pairs.Using the radiation field of a multi-concentric array of orthogonal dipole pairs,the distribution of SAM orientation in the target plane can be tailored to generate SAM topological structures such as skyrmions and bimerons.Highly localized and tunable SAM engineering holds great potential for applications in optical manipulation,light–matter interactions,optical information processing,transmission,and storage.
