To overcome the deficiencies of single-modal emotion recognition based on facial expression or bodily posture in natural scenes,a spatial guidance and temporal enhancement(SG-TE)network is proposed for facial-bodily e...To overcome the deficiencies of single-modal emotion recognition based on facial expression or bodily posture in natural scenes,a spatial guidance and temporal enhancement(SG-TE)network is proposed for facial-bodily emotion recognition.First,ResNet50,DNN and spatial ransformer models are used to capture facial texture vectors,bodily skeleton vectors and wholebody geometric vectors,and an intraframe correlation attention guidance(S-CAG)mechanism,which guides the facial texture vector and the bodily skeleton vector by the whole-body geometric vector,is designed to exploit the spatial potential emotional correlation between face and posture.Second,an interframe significant segment enhancement(T-SSE)structure is embedded into a temporal transformer to enhance high emotional intensity frame information and avoid emotional asynchrony.Finally,an adaptive weight assignment(M-AWA)strategy is constructed to realise facial-bodily fusion.The experimental results on the BabyRobot Emotion Dataset(BRED)and Context-Aware Emotion Recognition(CAER)dataset indicate that the proposed network reaches accuracies of 81.61%and 89.39%,which are 9.61%and 9.46%higher than those of the baseline network,respectively.Compared with the state-of-the-art methods,the proposed method achieves 7.73%and 20.57%higher accuracy than single-modal methods based on facial expression or bodily posture,respectively,and 2.16%higher accuracy than the dual-modal methods based on facial-bodily fusion.Therefore,the proposed method,which adaptively fuses the complementary information of face and posture,improves the quality of emotion recognition in real-world scenarios.展开更多
德勒兹与瓜塔里的“无器官身体”(Body Without Organs,BWO)理论通过解构功能化与层级化的身体观,为当代空间设计提供了哲学启示。本文以BWO理论为核心,结合建筑实践案例及设计实验,探讨其在空间设计中如何通过去中心化、流动性与生成...德勒兹与瓜塔里的“无器官身体”(Body Without Organs,BWO)理论通过解构功能化与层级化的身体观,为当代空间设计提供了哲学启示。本文以BWO理论为核心,结合建筑实践案例及设计实验,探讨其在空间设计中如何通过去中心化、流动性与生成性塑造多维度的身体体验。笔者认为,打破传统功能分区、强化动态交互空间、利用技术媒介延伸感官,能够实现身体与空间的自由对话。本文通过文献分析、跨学科研究及实验性设计,论证BWO理论在突破同质化设计思维中的理论价值与实践路径,为当代空间设计提供创新性视角。展开更多
基金National Natural Science Foundation of China,Grant/Award Number:62176084,Natural Science Foundation of Anhui Province of China,Grant/Award Number:1908085MF195,Natural Science Research Project of the Education Department of Anhui Province of China Grant/Award Numbers:2022AH051038,2023AH050474 and 2023AH050490.
文摘To overcome the deficiencies of single-modal emotion recognition based on facial expression or bodily posture in natural scenes,a spatial guidance and temporal enhancement(SG-TE)network is proposed for facial-bodily emotion recognition.First,ResNet50,DNN and spatial ransformer models are used to capture facial texture vectors,bodily skeleton vectors and wholebody geometric vectors,and an intraframe correlation attention guidance(S-CAG)mechanism,which guides the facial texture vector and the bodily skeleton vector by the whole-body geometric vector,is designed to exploit the spatial potential emotional correlation between face and posture.Second,an interframe significant segment enhancement(T-SSE)structure is embedded into a temporal transformer to enhance high emotional intensity frame information and avoid emotional asynchrony.Finally,an adaptive weight assignment(M-AWA)strategy is constructed to realise facial-bodily fusion.The experimental results on the BabyRobot Emotion Dataset(BRED)and Context-Aware Emotion Recognition(CAER)dataset indicate that the proposed network reaches accuracies of 81.61%and 89.39%,which are 9.61%and 9.46%higher than those of the baseline network,respectively.Compared with the state-of-the-art methods,the proposed method achieves 7.73%and 20.57%higher accuracy than single-modal methods based on facial expression or bodily posture,respectively,and 2.16%higher accuracy than the dual-modal methods based on facial-bodily fusion.Therefore,the proposed method,which adaptively fuses the complementary information of face and posture,improves the quality of emotion recognition in real-world scenarios.
文摘德勒兹与瓜塔里的“无器官身体”(Body Without Organs,BWO)理论通过解构功能化与层级化的身体观,为当代空间设计提供了哲学启示。本文以BWO理论为核心,结合建筑实践案例及设计实验,探讨其在空间设计中如何通过去中心化、流动性与生成性塑造多维度的身体体验。笔者认为,打破传统功能分区、强化动态交互空间、利用技术媒介延伸感官,能够实现身体与空间的自由对话。本文通过文献分析、跨学科研究及实验性设计,论证BWO理论在突破同质化设计思维中的理论价值与实践路径,为当代空间设计提供创新性视角。
