This paper presents a data fusion method in distributed multi-sensor system including GPS and INS sensors’ data processing. First, a residual χ 2 \|test strategy with the corresponding algorithm is designed. Then a ...This paper presents a data fusion method in distributed multi-sensor system including GPS and INS sensors’ data processing. First, a residual χ 2 \|test strategy with the corresponding algorithm is designed. Then a coefficient matrices calculation method of the information sharing principle is derived. Finally, the federated Kalman filter is used to combine these independent, parallel, real\|time data. A pseudolite (PL) simulation example is given.展开更多
Climate change,natural disasters,pollution,and fast urbanization have made environmental security a more serious international issue.Timely,accurate,and multi-dimensional information is essential in the effective moni...Climate change,natural disasters,pollution,and fast urbanization have made environmental security a more serious international issue.Timely,accurate,and multi-dimensional information is essential in the effective monitoring and management of such complex challenges in the environment.The Earth Observation(EO)systems,including optical sensors,radar sensors,Light Detection and Ranging(LiDAR)sensors,thermal sensors,Unmanned Aerial Vehicle(UAV)sensors,and in-situ sensors,offer a good coverage of space and time,as well as provide useful information on land,water,and atmospheric processes.But the shortcomings or weaknesses of individual sensors,such as their vulnerability to weather conditions,spectral or spatial resolution,and gaps in time,can tend to limit their ability to provide a complete picture of the environment.One of the solutions has been multi-sensor fusion,which combines heterogeneous data and makes it more accurate,robust,and interpretable.This systematic review analyzes the latest methods of multi-sensor fusion,which are machine learning,deep learning,probabilistic models,and hybrid approaches,in terms of methodological principles,preprocessing needs,and computational frameworks.Applications in environmental security are highlighted,which include monitoring natural disasters,monitoring of climate and ecosystem,pollution monitoring,monitoring of land use change,and early warning systems.The review also covers evaluation measures,validation plans,and uncertainty measures,where a strict measure of evaluation is vital to making actionable decisions.Lastly,emerging issues,e.g.,data heterogeneity,computational needs,sensor interoperability,and prospects in the future,e.g.,AI-based adaptive fusion,UAVs and Internet of Things(IoT)integration,and scalable cloud-based systems,are discussed.The synthesis has highlighted the transformational capability of multi-sensor EO in terms of improving the environment in the context of environmental security and sustainable management.展开更多
Deep learning-based wind turbine blade fault diagnosis has been widely applied due to its advantages in end-to-end feature extraction.However,several challenges remain.First,signal noise collected during blade operati...Deep learning-based wind turbine blade fault diagnosis has been widely applied due to its advantages in end-to-end feature extraction.However,several challenges remain.First,signal noise collected during blade operation masks fault features,severely impairing the fault diagnosis performance of deep learning models.Second,current blade fault diagnosis often relies on single-sensor data,resulting in limited monitoring dimensions and ability to comprehensively capture complex fault states.To address these issues,a multi-sensor fusion-based wind turbine blade fault diagnosis method is proposed.Specifically,a CNN-Transformer Coupled Feature Learning Architecture is constructed to enhance the ability to learn complex features under noisy conditions,while a Weight-Aligned Data Fusion Module is designed to comprehensively and effectively utilize multi-sensor fault information.Experimental results of wind turbine blade fault diagnosis under different noise interferences show that higher accuracy is achieved by the proposed method compared to models with single-source data input,enabling comprehensive and effective fault diagnosis.展开更多
With the intelligent upgrading of manufacturing equipment,achieving high-precision and efficient fault diagnosis is essential to enhance equipment stability and increase productivity.Online monitoring and fault diagno...With the intelligent upgrading of manufacturing equipment,achieving high-precision and efficient fault diagnosis is essential to enhance equipment stability and increase productivity.Online monitoring and fault diagnosis technology play a critical role in improving the stability of metal additive manufacturing equipment.However,the limited proportion of fault data during operation challenges the accuracy and efficiency of multi-classification models due to excessive redundant data.A multi-sensor and principal component analysis(PCA)and support vector machine(SVM)asymptotic classification(PCSV)for additive manufacturing fault diagnosis method is proposed,and it divides the fault diagnosis into two steps.In the first step,real-time data are evaluated using the T2 and Q statistical parameters of the PCAmodel to identify potential faults while filtering non-fault data,thereby reducing redundancy and enhancing real-time efficiency.In the second step,the identified fault data are input into the SVM model for precise multi-class classification of fault categories.The PCSV method advances the field by significantly improving diagnostic accuracy and efficiency,achieving an accuracy of 99%,a diagnosis time of 0.65 s,and a training time of 503 s.The experimental results demonstrate the sophistication of the PCSV method for high-precision and high-efficiency fault diagnosis of small fault samples.展开更多
Ensuring that autonomous vehicles maintain high precision and rapid response capabilities in complex and dynamic driving environments is a critical challenge in the field of autonomous driving.This study aims to enhan...Ensuring that autonomous vehicles maintain high precision and rapid response capabilities in complex and dynamic driving environments is a critical challenge in the field of autonomous driving.This study aims to enhance the learning efficiency ofmulti-sensor feature fusion in autonomous driving tasks,thereby improving the safety and responsiveness of the system.To achieve this goal,we propose an innovative multi-sensor feature fusion model that integrates three distinct modalities:visual,radar,and lidar data.The model optimizes the feature fusion process through the introduction of two novel mechanisms:Sparse Channel Pooling(SCP)and Residual Triplet-Attention(RTA).Firstly,the SCP mechanism enables the model to adaptively filter out salient feature channels while eliminating the interference of redundant features.This enhances the model’s emphasis on critical features essential for decisionmaking and strengthens its robustness to environmental variability.Secondly,the RTA mechanism addresses the issue of feature misalignment across different modalities by effectively aligning key cross-modal features.This alignment reduces the computational overhead associated with redundant features and enhances the overall efficiency of the system.Furthermore,this study incorporates a reinforcement learning module designed to optimize strategies within a continuous action space.By integrating thismodulewith the feature fusion learning process,the entire system is capable of learning efficient driving strategies in an end-to-end manner within the CARLA autonomous driving simulator.Experimental results demonstrate that the proposedmodel significantly enhances the perception and decision-making accuracy of the autonomous driving system in complex traffic scenarios while maintaining real-time responsiveness.This work provides a novel perspective and technical pathway for the application of multi-sensor data fusion in autonomous driving.展开更多
Quadruped robots with body joints exhibit enhanced mobility,however,in outdoor environments,the energy that the robot can carry is limited,necessitating optimization of energy consumption to accomplish more tasks with...Quadruped robots with body joints exhibit enhanced mobility,however,in outdoor environments,the energy that the robot can carry is limited,necessitating optimization of energy consumption to accomplish more tasks within these constraints.Inspired by quadruped animals,this paper proposes an energy-saving strategy for a body joint quadruped robot based on Central Pattern Generator(CPG)with multi-sensor fusion bio-reflexes.First,an energy consumption model for the robot is established,and energy characteristic tests are conducted under different gait parameters.Based on these energy characteristics,optimal energy-efficient gait parameters are determined for various environmental conditions.Second,biological reflex mechanisms are studied,and a motion control model based on multi-sensor fusion biological reflexes is established using CPG as the foundation.By integrating the reflex model and gait parameters,real-time adaptive adjustments to the robot’s motion gait are achieved on complex terrains,reducing energy loss caused by terrain disturbances.Finally,a prototype of the body joint quadruped robot is built for experimental verification.Simulation and experimental results demonstrate that the proposed algorithm effectively reduces the robot’s Cost of Transport(COT)and significantly improves energy efficiency.The related research results can provide a useful reference for the research on energy efficiency of quadruped robots on complex terrain.展开更多
Microseismic (MS) source location plays an important role in MS monitoring. This paper proposes a MS source location method based on particle swarm optimization (PSO) and multi-sensor arrays, where a free weight joint...Microseismic (MS) source location plays an important role in MS monitoring. This paper proposes a MS source location method based on particle swarm optimization (PSO) and multi-sensor arrays, where a free weight joints the P-wave first arrival data. This method adaptively adjusts the preference for “superior” arrays and leverages “inferior” arrays to escape local optima, thereby improving the location accuracy. The effectiveness and stability of this method were validated through synthetic tests, pencil-lead break (PLB) experiments, and mining engineering applications. Specifically, for synthetic tests with 1 μs Gaussian noise and 100 μs large noise in rock samples, the location error of the multi-sensor arrays jointed location method is only 0.30 cm, which improves location accuracy by 97.51% compared to that using a single sensor array. The average location error of PLB events on three surfaces of a rock sample is reduced by 48.95%, 26.40%, and 55.84%, respectively. For mine blast event tests, the average location error of the dual sensor arrays jointed method is 62.74 m, 54.32% and 14.29% lower than that using only sensor arrays 1 and 2, respectively. In summary, the proposed multi-sensor arrays jointed location method demonstrates good noise resistance, stability, and accuracy, providing a compelling new solution for MS location in relevant mining scenarios.展开更多
At present, multi-se nsor fusion is widely used in object recognition and classification, since this technique can efficiently improve the accuracy and the ability of fault toleranc e. This paper describes a multi-se...At present, multi-se nsor fusion is widely used in object recognition and classification, since this technique can efficiently improve the accuracy and the ability of fault toleranc e. This paper describes a multi-sensor fusion system, which is model-based and used for rotating mechanical failure diagnosis. In the data fusion process, the fuzzy neural network is selected and used for the data fusion at report level. By comparing the experimental results of fault diagnoses based on fusion data wi th that on original separate data,it is shown that the former is more accurate than the latter.展开更多
In this note,we study the state estimation problem for a multi-sensor system subject to multiple packet dropouts.A novel optimal distributed fusion estimator is derived by applying a resending mechanism and a parallel...In this note,we study the state estimation problem for a multi-sensor system subject to multiple packet dropouts.A novel optimal distributed fusion estimator is derived by applying a resending mechanism and a parallel information filtering structure.It is shown that the proposed distributed fusion estimator has smaller estimation error covariance and less computation complexity when compared with the centralised Kalman like estimator with multiple intermittent measurements.展开更多
同步定位与地图构建(Simultaneous Localization and Mapping,SLAM)是自主导航无人系统的核心技术,其性能稳定性决定了实际应用中的可靠性和安全性。单一传感器在动态环境中常显不足,其感知局限性直接导致精度下降。多传感器融合策略虽...同步定位与地图构建(Simultaneous Localization and Mapping,SLAM)是自主导航无人系统的核心技术,其性能稳定性决定了实际应用中的可靠性和安全性。单一传感器在动态环境中常显不足,其感知局限性直接导致精度下降。多传感器融合策略虽增加了校准复杂度,却是提升鲁棒性不可或缺的手段。然而,时空校准、数据冲突消解及资源分配问题成为瓶颈,制约了系统稳定性的提升。为保证位姿估计一致性,研究提出智能化融合算法,具体策略包括改进校准方法以消解数据冲突、优化资源分配以增强长期运行能力。实测数据表明,该策略可提高地图构建精度,强化非结构化场景下的系统性能。这一融合方案虽非完美,但为复杂环境下的导航提供了可靠保障,提升了实际应用中的安全性。展开更多
文摘This paper presents a data fusion method in distributed multi-sensor system including GPS and INS sensors’ data processing. First, a residual χ 2 \|test strategy with the corresponding algorithm is designed. Then a coefficient matrices calculation method of the information sharing principle is derived. Finally, the federated Kalman filter is used to combine these independent, parallel, real\|time data. A pseudolite (PL) simulation example is given.
文摘Climate change,natural disasters,pollution,and fast urbanization have made environmental security a more serious international issue.Timely,accurate,and multi-dimensional information is essential in the effective monitoring and management of such complex challenges in the environment.The Earth Observation(EO)systems,including optical sensors,radar sensors,Light Detection and Ranging(LiDAR)sensors,thermal sensors,Unmanned Aerial Vehicle(UAV)sensors,and in-situ sensors,offer a good coverage of space and time,as well as provide useful information on land,water,and atmospheric processes.But the shortcomings or weaknesses of individual sensors,such as their vulnerability to weather conditions,spectral or spatial resolution,and gaps in time,can tend to limit their ability to provide a complete picture of the environment.One of the solutions has been multi-sensor fusion,which combines heterogeneous data and makes it more accurate,robust,and interpretable.This systematic review analyzes the latest methods of multi-sensor fusion,which are machine learning,deep learning,probabilistic models,and hybrid approaches,in terms of methodological principles,preprocessing needs,and computational frameworks.Applications in environmental security are highlighted,which include monitoring natural disasters,monitoring of climate and ecosystem,pollution monitoring,monitoring of land use change,and early warning systems.The review also covers evaluation measures,validation plans,and uncertainty measures,where a strict measure of evaluation is vital to making actionable decisions.Lastly,emerging issues,e.g.,data heterogeneity,computational needs,sensor interoperability,and prospects in the future,e.g.,AI-based adaptive fusion,UAVs and Internet of Things(IoT)integration,and scalable cloud-based systems,are discussed.The synthesis has highlighted the transformational capability of multi-sensor EO in terms of improving the environment in the context of environmental security and sustainable management.
基金supported by the China Three Gorges Corporation(No.NBZZ202300860)the National Natural Science Foundation of China(No.52275104)the Science and Technology Innovation Program of Hunan Province(No.2023RC3097).
文摘Deep learning-based wind turbine blade fault diagnosis has been widely applied due to its advantages in end-to-end feature extraction.However,several challenges remain.First,signal noise collected during blade operation masks fault features,severely impairing the fault diagnosis performance of deep learning models.Second,current blade fault diagnosis often relies on single-sensor data,resulting in limited monitoring dimensions and ability to comprehensively capture complex fault states.To address these issues,a multi-sensor fusion-based wind turbine blade fault diagnosis method is proposed.Specifically,a CNN-Transformer Coupled Feature Learning Architecture is constructed to enhance the ability to learn complex features under noisy conditions,while a Weight-Aligned Data Fusion Module is designed to comprehensively and effectively utilize multi-sensor fault information.Experimental results of wind turbine blade fault diagnosis under different noise interferences show that higher accuracy is achieved by the proposed method compared to models with single-source data input,enabling comprehensive and effective fault diagnosis.
基金supported in part by the National Key R&D Program of China Grant 2022YFB4602200.
文摘With the intelligent upgrading of manufacturing equipment,achieving high-precision and efficient fault diagnosis is essential to enhance equipment stability and increase productivity.Online monitoring and fault diagnosis technology play a critical role in improving the stability of metal additive manufacturing equipment.However,the limited proportion of fault data during operation challenges the accuracy and efficiency of multi-classification models due to excessive redundant data.A multi-sensor and principal component analysis(PCA)and support vector machine(SVM)asymptotic classification(PCSV)for additive manufacturing fault diagnosis method is proposed,and it divides the fault diagnosis into two steps.In the first step,real-time data are evaluated using the T2 and Q statistical parameters of the PCAmodel to identify potential faults while filtering non-fault data,thereby reducing redundancy and enhancing real-time efficiency.In the second step,the identified fault data are input into the SVM model for precise multi-class classification of fault categories.The PCSV method advances the field by significantly improving diagnostic accuracy and efficiency,achieving an accuracy of 99%,a diagnosis time of 0.65 s,and a training time of 503 s.The experimental results demonstrate the sophistication of the PCSV method for high-precision and high-efficiency fault diagnosis of small fault samples.
文摘Ensuring that autonomous vehicles maintain high precision and rapid response capabilities in complex and dynamic driving environments is a critical challenge in the field of autonomous driving.This study aims to enhance the learning efficiency ofmulti-sensor feature fusion in autonomous driving tasks,thereby improving the safety and responsiveness of the system.To achieve this goal,we propose an innovative multi-sensor feature fusion model that integrates three distinct modalities:visual,radar,and lidar data.The model optimizes the feature fusion process through the introduction of two novel mechanisms:Sparse Channel Pooling(SCP)and Residual Triplet-Attention(RTA).Firstly,the SCP mechanism enables the model to adaptively filter out salient feature channels while eliminating the interference of redundant features.This enhances the model’s emphasis on critical features essential for decisionmaking and strengthens its robustness to environmental variability.Secondly,the RTA mechanism addresses the issue of feature misalignment across different modalities by effectively aligning key cross-modal features.This alignment reduces the computational overhead associated with redundant features and enhances the overall efficiency of the system.Furthermore,this study incorporates a reinforcement learning module designed to optimize strategies within a continuous action space.By integrating thismodulewith the feature fusion learning process,the entire system is capable of learning efficient driving strategies in an end-to-end manner within the CARLA autonomous driving simulator.Experimental results demonstrate that the proposedmodel significantly enhances the perception and decision-making accuracy of the autonomous driving system in complex traffic scenarios while maintaining real-time responsiveness.This work provides a novel perspective and technical pathway for the application of multi-sensor data fusion in autonomous driving.
基金supported by the National Natural Science Foundation of China(Grant no.52075488)the Natural Science Foundation of Zhejiang Province(LY20E050023).
文摘Quadruped robots with body joints exhibit enhanced mobility,however,in outdoor environments,the energy that the robot can carry is limited,necessitating optimization of energy consumption to accomplish more tasks within these constraints.Inspired by quadruped animals,this paper proposes an energy-saving strategy for a body joint quadruped robot based on Central Pattern Generator(CPG)with multi-sensor fusion bio-reflexes.First,an energy consumption model for the robot is established,and energy characteristic tests are conducted under different gait parameters.Based on these energy characteristics,optimal energy-efficient gait parameters are determined for various environmental conditions.Second,biological reflex mechanisms are studied,and a motion control model based on multi-sensor fusion biological reflexes is established using CPG as the foundation.By integrating the reflex model and gait parameters,real-time adaptive adjustments to the robot’s motion gait are achieved on complex terrains,reducing energy loss caused by terrain disturbances.Finally,a prototype of the body joint quadruped robot is built for experimental verification.Simulation and experimental results demonstrate that the proposed algorithm effectively reduces the robot’s Cost of Transport(COT)and significantly improves energy efficiency.The related research results can provide a useful reference for the research on energy efficiency of quadruped robots on complex terrain.
基金Project(SICGM2023301) supported by the State Key Laboratory of Strata Intelligent Control and Green Mining Co-founded by Shandong Province and the Ministry of Science and Technology,ChinaProject(SMDPC202202) supported by the Key Laboratory of Mining Disaster Prevention and Control,ChinaProject(U21A2030) supported by the National Natural Science Foundation of China。
文摘Microseismic (MS) source location plays an important role in MS monitoring. This paper proposes a MS source location method based on particle swarm optimization (PSO) and multi-sensor arrays, where a free weight joints the P-wave first arrival data. This method adaptively adjusts the preference for “superior” arrays and leverages “inferior” arrays to escape local optima, thereby improving the location accuracy. The effectiveness and stability of this method were validated through synthetic tests, pencil-lead break (PLB) experiments, and mining engineering applications. Specifically, for synthetic tests with 1 μs Gaussian noise and 100 μs large noise in rock samples, the location error of the multi-sensor arrays jointed location method is only 0.30 cm, which improves location accuracy by 97.51% compared to that using a single sensor array. The average location error of PLB events on three surfaces of a rock sample is reduced by 48.95%, 26.40%, and 55.84%, respectively. For mine blast event tests, the average location error of the dual sensor arrays jointed method is 62.74 m, 54.32% and 14.29% lower than that using only sensor arrays 1 and 2, respectively. In summary, the proposed multi-sensor arrays jointed location method demonstrates good noise resistance, stability, and accuracy, providing a compelling new solution for MS location in relevant mining scenarios.
文摘At present, multi-se nsor fusion is widely used in object recognition and classification, since this technique can efficiently improve the accuracy and the ability of fault toleranc e. This paper describes a multi-sensor fusion system, which is model-based and used for rotating mechanical failure diagnosis. In the data fusion process, the fuzzy neural network is selected and used for the data fusion at report level. By comparing the experimental results of fault diagnoses based on fusion data wi th that on original separate data,it is shown that the former is more accurate than the latter.
基金supported by the National Natural Science Foundation of China(61473306).
文摘In this note,we study the state estimation problem for a multi-sensor system subject to multiple packet dropouts.A novel optimal distributed fusion estimator is derived by applying a resending mechanism and a parallel information filtering structure.It is shown that the proposed distributed fusion estimator has smaller estimation error covariance and less computation complexity when compared with the centralised Kalman like estimator with multiple intermittent measurements.
文摘同步定位与地图构建(Simultaneous Localization and Mapping,SLAM)是自主导航无人系统的核心技术,其性能稳定性决定了实际应用中的可靠性和安全性。单一传感器在动态环境中常显不足,其感知局限性直接导致精度下降。多传感器融合策略虽增加了校准复杂度,却是提升鲁棒性不可或缺的手段。然而,时空校准、数据冲突消解及资源分配问题成为瓶颈,制约了系统稳定性的提升。为保证位姿估计一致性,研究提出智能化融合算法,具体策略包括改进校准方法以消解数据冲突、优化资源分配以增强长期运行能力。实测数据表明,该策略可提高地图构建精度,强化非结构化场景下的系统性能。这一融合方案虽非完美,但为复杂环境下的导航提供了可靠保障,提升了实际应用中的安全性。
