Visible and infrared(RGB-IR)fusion object detection plays an important role in security,disaster relief,etc.In recent years,deep-learning-based RGB-IR fusion detection methods have been developing rapidly,but still st...Visible and infrared(RGB-IR)fusion object detection plays an important role in security,disaster relief,etc.In recent years,deep-learning-based RGB-IR fusion detection methods have been developing rapidly,but still struggle to deal with the complex and changing scenarios captured by drones,mainly due to two reasons:(A)RGB-IR fusion detectors are susceptible to inferior inputs that degrade performance and stability.(B)RGB-IR fusion detectors are susceptible to redundant features that reduce accuracy and efficiency.In this paper,an innovative RGB-IR fusion detection framework based on global-local feature optimization,named GLFDet,is proposed to improve the detection performance and efficiency of drone-captured objects.The key components of GLFDet include a Global Feature Optimization(GFO)module,a Local Feature Optimization(LFO)module and a Channel Separation Fusion(CSF)module.Specifically,GFO calculates the information content of the input image from the frequency domain and optimizes the features holistically.Then,LFO dynamically selects high-value features and filters out low-value features before fusion,which significantly improves the efficiency of fusion.Finally,CSF fuses the RGB and IR features across the corresponding channels,which avoids the rearrangement of the channel relationships and enhances the model stability.Extensive experimental results show that the proposed method achieves the best performance on three popular RGB-IR datasets Drone Vehicle,VEDAI,and LLVIP.In addition,GLFDet is more lightweight than other comparable models,making it more appealing to edge devices such as drones.The code is available at https://github.com/lao chen330/GLFDet.展开更多
Deep learning-based wind turbine blade fault diagnosis has been widely applied due to its advantages in end-to-end feature extraction.However,several challenges remain.First,signal noise collected during blade operati...Deep learning-based wind turbine blade fault diagnosis has been widely applied due to its advantages in end-to-end feature extraction.However,several challenges remain.First,signal noise collected during blade operation masks fault features,severely impairing the fault diagnosis performance of deep learning models.Second,current blade fault diagnosis often relies on single-sensor data,resulting in limited monitoring dimensions and ability to comprehensively capture complex fault states.To address these issues,a multi-sensor fusion-based wind turbine blade fault diagnosis method is proposed.Specifically,a CNN-Transformer Coupled Feature Learning Architecture is constructed to enhance the ability to learn complex features under noisy conditions,while a Weight-Aligned Data Fusion Module is designed to comprehensively and effectively utilize multi-sensor fault information.Experimental results of wind turbine blade fault diagnosis under different noise interferences show that higher accuracy is achieved by the proposed method compared to models with single-source data input,enabling comprehensive and effective fault diagnosis.展开更多
Aiming at the problem that the traditional SRP-PHAT sound source localization method performs intensive search in a 360-degree space,resulting in high computational complexity and difficulty in meeting real-time requi...Aiming at the problem that the traditional SRP-PHAT sound source localization method performs intensive search in a 360-degree space,resulting in high computational complexity and difficulty in meeting real-time requirements,an innovative high-precision sound source localization method is proposed.This method combines the selective SRP-PHAT algorithm with real-time visual analysis.Its core innovations include using face detection to dynamically determine the scanning angle range to achieve visually guided selective scanning,distinguishing face sound sources from background noise through a sound source classification mechanism,and implementing intelligent background orientation selection to ensure comprehensive monitoring of environmental noise.Experimental results show that the method achieves a positioning accuracy of±5 degrees and a processing speed of more than 10FPS in complex real environments,and its performance is significantly better than the traditional full-angle scanning method.展开更多
In order to effectively reduce the uncertainty error of mobile robot localization with a single sensor and improve the accuracy and robustness of robot localization and mapping,a mobile robot localization algorithm ba...In order to effectively reduce the uncertainty error of mobile robot localization with a single sensor and improve the accuracy and robustness of robot localization and mapping,a mobile robot localization algorithm based on multi-sensor information fusion(MSIF)was proposed.In this paper,simultaneous localization and mapping(SLAM)was realized on the basis of laser Rao-Blackwellized particle filter(RBPF)-SLAM algorithm and graph-based optimization theory was used to constrain and optimize the pose estimation results of Monte Carlo localization.The feature point extraction and quadrilateral closed loop matching algorithm based on oriented FAST and rotated BRIEF(ORB)were improved aiming at the problems of generous calculation and low tracking accuracy in visual information processing by means of the three-dimensional(3D)point feature in binocular visual reconstruction environment.Factor graph model was used for the information fusion under the maximum posterior probability criterion for laser RBPF-SLAM localization and binocular visual localization.The results of simulation and experiment indicate that localization accuracy of the above-mentioned method is higher than that of traditional RBPF-SLAM algorithm and general improved algorithms,and the effectiveness and usefulness of the proposed method are verified.展开更多
The localization of the blanket jamming is studied and a new method of solving the localization ambiguity is proposed. Radars only can acquire angle information without range information when encountering the blanket ...The localization of the blanket jamming is studied and a new method of solving the localization ambiguity is proposed. Radars only can acquire angle information without range information when encountering the blanket jamming. Netted radars could get position information of the blanket jamming by make use of radars' relative position and the angle information, when there is one blanket jamming. In the presence of error, the localization method and the accuracy analysis of one blanket jamming are given. However, if there are more than one blanket jamming, and the two blanket jamming and two radars are coplanar, the localization of jamming could be error due to localization ambiguity. To solve this confusion, the Kalman filter model is established for all intersections, and through the initiation and association algorithm of multi-target, the false intersection can be eliminated. Simulations show that the presented method is valid.展开更多
For existing indoor localization algorithm has low accuracy, high cost in deployment and maintenance, lack of robustness, and low sensor utilization, this paper proposes a particle filter algorithm based on multi-sens...For existing indoor localization algorithm has low accuracy, high cost in deployment and maintenance, lack of robustness, and low sensor utilization, this paper proposes a particle filter algorithm based on multi-sensor fusion. The pedestrian’s localization in indoor environment is described as dynamic system state estimation problem. The algorithm combines the smart mobile terminal with indoor localization, and filters the result of localization with the particle filter. In this paper, a dynamic interval particle filter algorithm based on pedestrian dead reckoning (PDR) information and RSSI localization information have been used to improve the filtering precision and the stability. Moreover, the localization results will be uploaded to the server in time, and the location fingerprint database will be built incrementally, which can adapt the dynamic changes of the indoor environment. Experimental results show that the algorithm based on multi-sensor improves the localization accuracy and robustness compared with the location algorithm based on Wi-Fi.展开更多
This paper presents the Optimized Kalman Particle Swarm (OKPS) filter. This filter results from two years of research and improves the Swarm Particle Filter (SPF). The OKPS has been designed to be both cooperative and...This paper presents the Optimized Kalman Particle Swarm (OKPS) filter. This filter results from two years of research and improves the Swarm Particle Filter (SPF). The OKPS has been designed to be both cooperative and reactive. It combines the advantages of the Particle Filter (PF) and the metaheuristic Particle Swarm Optimization (PSO) for ego-vehicles localization applications. In addition to a simple fusion between the swarm optimization and the particular filtering (which leads to the Swarm Particle Filter), the OKPS uses some attributes of the Extended Kalman filter (EKF). The OKPS filter innovates by fitting its particles with a capacity of self-diagnose by means of the EKF covariance uncertainty matrix. The particles can therefore evolve by exchanging information to assess the optimized position of the ego-vehicle. The OKPS fuses data coming from embedded sensors (low cost INS, GPS and Odometer) to perform a robust ego-vehicle positioning. The OKPS is compared to the EKF filter and to filters using particles (PF and SPF) on real data from our equipped vehicle.展开更多
The fast growth of mobile autonomous machines from traditional equipment to unmanned autonomous vehicles has fueled the demand for accurate and reliable localization solutions in diverse application domains.Ultra Wide...The fast growth of mobile autonomous machines from traditional equipment to unmanned autonomous vehicles has fueled the demand for accurate and reliable localization solutions in diverse application domains.Ultra Wide Band(UWB)technology has emerged as a promising candidate for addressing this need,offering high precision,immunity to multipath interference,and robust performance in challenging environments.In this comprehensive survey,we systematically explore UWB-based localization for mobile autonomous machines,spanning from fundamental principles to future trends.To the best of our knowledge,this review paper stands as the pioneer in systematically dissecting the algorithms of UWB-based localization for mobile autonomous machines,covering a spectrum from bottom-ranging schemes to advanced sensor fusion,error mitigation,and optimization techniques.By synthesizing existing knowledge,evaluating current methodologies,and highlighting future trends,this review aims to catalyze progress and innovation in the field,unlocking new opportunities for mobile autonomous machine applications across diverse industries and domains.Thus,it serves as a valuable resource for researchers,practitioners,and stakeholders interested in advancing the state-of-the-art UWB-based localization for mobile autonomous machines.展开更多
This paper investigates the problem of decentralized multi-robot cooperative localization.This problem involves collaboratively estimating the poses of a group of robots with respect to a common reference coordinate s...This paper investigates the problem of decentralized multi-robot cooperative localization.This problem involves collaboratively estimating the poses of a group of robots with respect to a common reference coordinate system using robot-to-robot relative measurements and intermittent absolute measurements in a distributed manner.To address this problem,we present a decentralized fusion method that enables batch updating to handle relative measurements from multiple robots simultaneously.This method can improve both the accuracy and computational efficiency of cooperative localization.To reduce communication costs and reliance on connectivity,we do not maintain the inter-robot state correlations.Instead,we adopt a covariance intersection(CI)technique to design an upper bound that replaces unknown joint correlations.We propose an optimization method to determine a tight upper bound for the correlations in the joint update.The consistency and convergence of our proposed algorithm is theoretically analyzed.Furthermore,we conduct Monte Carlo numerical simulations and real-world experiments to demonstrate that the proposed method outperforms existing approaches in terms of both accuracy and consistency.展开更多
In this paper, an innovative collaborative data fusion approach to ego-vehicle localization is presented. This approach called Optimized Kalman Swarm (OKS) is a data fusion and filtering method, fusing data from a low...In this paper, an innovative collaborative data fusion approach to ego-vehicle localization is presented. This approach called Optimized Kalman Swarm (OKS) is a data fusion and filtering method, fusing data from a low cost GPS, an INS, an Odometer and a Steering wheel angle encoder. The OKS is developed addressing the challenge of managing reactivity and robustness during a real time ego-localization process. For ego-vehicle localization, especially for highly dynamic on-road maneuvers, a filter needs to be robust and reactive at the same time. In these situations, the balance between reactivity and robustness concepts is crucial. The OKS filter represents an intelligent cooperative-reactive localization algorithm inspired by dynamic Particle Swarm Optimization (PSO). It combines advantages coming from two filters: Particle Filter (PF) and Extended Kalman filter (EKF). The OKS is tested using real embedded sensors data collected in the Satory’s test tracks. The OKS is also compared with both the well-known EKF and the Particle Filters (PF). The results show the efficiency of the OKS for a high dynamic driving scenario with damaged and low quality GPS data.展开更多
Ensuring that autonomous vehicles maintain high precision and rapid response capabilities in complex and dynamic driving environments is a critical challenge in the field of autonomous driving.This study aims to enhan...Ensuring that autonomous vehicles maintain high precision and rapid response capabilities in complex and dynamic driving environments is a critical challenge in the field of autonomous driving.This study aims to enhance the learning efficiency ofmulti-sensor feature fusion in autonomous driving tasks,thereby improving the safety and responsiveness of the system.To achieve this goal,we propose an innovative multi-sensor feature fusion model that integrates three distinct modalities:visual,radar,and lidar data.The model optimizes the feature fusion process through the introduction of two novel mechanisms:Sparse Channel Pooling(SCP)and Residual Triplet-Attention(RTA).Firstly,the SCP mechanism enables the model to adaptively filter out salient feature channels while eliminating the interference of redundant features.This enhances the model’s emphasis on critical features essential for decisionmaking and strengthens its robustness to environmental variability.Secondly,the RTA mechanism addresses the issue of feature misalignment across different modalities by effectively aligning key cross-modal features.This alignment reduces the computational overhead associated with redundant features and enhances the overall efficiency of the system.Furthermore,this study incorporates a reinforcement learning module designed to optimize strategies within a continuous action space.By integrating thismodulewith the feature fusion learning process,the entire system is capable of learning efficient driving strategies in an end-to-end manner within the CARLA autonomous driving simulator.Experimental results demonstrate that the proposedmodel significantly enhances the perception and decision-making accuracy of the autonomous driving system in complex traffic scenarios while maintaining real-time responsiveness.This work provides a novel perspective and technical pathway for the application of multi-sensor data fusion in autonomous driving.展开更多
s-Lap is a new gene sequence from pig retinal pigment epithelial(RPE) cells, which was found and cloned in the early period of apoptosis of RPE cells damaged with visible light. We cloned the coding area sequence of t...s-Lap is a new gene sequence from pig retinal pigment epithelial(RPE) cells, which was found and cloned in the early period of apoptosis of RPE cells damaged with visible light. We cloned the coding area sequence of the novel gene of s-Lap and constructed its recombinant eukaryotic plasmid pcDNA3.1-GFP/s-lap with the recombinant DNA technique. The expression and localization of s-lap/GFP fusion protein in CHO and B_~16 cell lines were studied with the instantaneously transfected pcDNA3.1-GFP/s-lap recombinant plasmid. ~s-Lap/GFP fusion protein can be expressed in CHO and B_~16 cells with a high rate expression in the nuclei.展开更多
In this paper,an effective target locating approach based on the fingerprint fusion posi-tioning(FFP)method is proposed which integrates the time-difference of arrival(TDOA)and the received signal strength according t...In this paper,an effective target locating approach based on the fingerprint fusion posi-tioning(FFP)method is proposed which integrates the time-difference of arrival(TDOA)and the received signal strength according to the statistical variance of target position in the stationary 3D scenarios.The FFP method fuses the pedestrian dead reckoning(PDR)estimation to solve the moving target localization problem.We also introduce auxiliary parameters to estimate the target motion state.Subsequently,we can locate the static pedestrians and track the the moving target.For the case study,eight access stationary points are placed on a bookshelf and hypermarket;one target node is moving inside hypermarkets in 2D and 3D scenarios or stationary on the bookshelf.We compare the performance of our proposed method with existing localization algorithms such as k-nearest neighbor,weighted k-nearest neighbor,pure TDOA and fingerprinting combining Bayesian frameworks including the extended Kalman filter,unscented Kalman filter and particle fil-ter(PF).The proposed approach outperforms obviously the counterpart methodologies in terms of the root mean square error and the cumulative distribution function of localization errors,espe-cially in the 3D scenarios.Simulation results corroborate the effectiveness of our proposed approach.展开更多
Because the hydraulic directional valve usually works in a bad working environment and is disturbed by multi-factor noise,the traditional single sensor monitoring technology is difficult to use for an accurate diagnos...Because the hydraulic directional valve usually works in a bad working environment and is disturbed by multi-factor noise,the traditional single sensor monitoring technology is difficult to use for an accurate diagnosis of it.Therefore,a fault diagnosis method based on multi-sensor information fusion is proposed in this paper to reduce the inaccuracy and uncertainty of traditional single sensor information diagnosis technology and to realize accurate monitoring for the location or diagnosis of early faults in such valves in noisy environments.Firstly,the statistical features of signals collected by the multi-sensor are extracted and the depth features are obtained by a convolutional neural network(CNN)to form a complete and stable multi-dimensional feature set.Secondly,to obtain a weighted multi-dimensional feature set,the multi-dimensional feature sets of similar sensors are combined,and the entropy weight method is used to weight these features to reduce the interference of insensitive features.Finally,the attention mechanism is introduced to improve the dual-channel CNN,which is used to adaptively fuse the weighted multi-dimensional feature sets of heterogeneous sensors,to flexibly select heterogeneous sensor information so as to achieve an accurate diagnosis.Experimental results show that the weighted multi-dimensional feature set obtained by the proposed method has a high fault-representation ability and low information redundancy.It can diagnose simultaneously internal wear faults of the hydraulic directional valve and electromagnetic faults of actuators that are difficult to diagnose by traditional methods.This proposed method can achieve high fault-diagnosis accuracy under severe working conditions.展开更多
As the differences of sensor＇s precision and some random factors are difficult to control,the actual measurement signals are far from the target signals that affect the reliability and precision of rotating machinery...As the differences of sensor＇s precision and some random factors are difficult to control,the actual measurement signals are far from the target signals that affect the reliability and precision of rotating machinery fault diagnosis.The traditional signal processing methods,such as classical inference and weighted averaging algorithm usually lack dynamic adaptability that is easy for trends to cause the faults to be misjudged or left out.To enhance the measuring veracity and precision of vibration signal in rotary machine multi-sensor vibration signal fault diagnosis,a novel data level fusion approach is presented on the basis of correlation function analysis to fast determine the weighted value of multi-sensor vibration signals.The approach doesn＇t require knowing the prior information about sensors,and the weighted value of sensors can be confirmed depending on the correlation measure of real-time data tested in the data level fusion process.It gives greater weighted value to the greater correlation measure of sensor signals,and vice versa.The approach can effectively suppress large errors and even can still fuse data in the case of sensor failures because it takes full advantage of sensor＇s own-information to determine the weighted value.Moreover,it has good performance of anti-jamming due to the correlation measures between noise and effective signals are usually small.Through the simulation of typical signal collected from multi-sensors,the comparative analysis of dynamic adaptability and fault tolerance between the proposed approach and traditional weighted averaging approach is taken.Finally,the rotor dynamics and integrated fault simulator is taken as an example to verify the feasibility and advantages of the proposed approach,it is shown that the multi-sensor data level fusion based on correlation function weighted approach is better than the traditional weighted average approach with respect to fusion precision and dynamic adaptability.Meantime,the approach is adaptable and easy to use,can be applied to other areas of vibration measurement.展开更多
This paper presents a data fusion method in distributed multi-sensor system including GPS and INS sensors’ data processing. First, a residual χ 2 \|test strategy with the corresponding algorithm is designed. Then a ...This paper presents a data fusion method in distributed multi-sensor system including GPS and INS sensors’ data processing. First, a residual χ 2 \|test strategy with the corresponding algorithm is designed. Then a coefficient matrices calculation method of the information sharing principle is derived. Finally, the federated Kalman filter is used to combine these independent, parallel, real\|time data. A pseudolite (PL) simulation example is given.展开更多
To overcome the shortcomings of 1 D and 2 D Otsu’s thresholding techniques, the 3 D Otsu method has been developed.Among all Otsu’s methods, 3 D Otsu technique provides the best threshold values for the multi-level ...To overcome the shortcomings of 1 D and 2 D Otsu’s thresholding techniques, the 3 D Otsu method has been developed.Among all Otsu’s methods, 3 D Otsu technique provides the best threshold values for the multi-level thresholding processes. In this paper, to improve the quality of segmented images, a simple and effective multilevel thresholding method is introduced. The proposed approach focuses on preserving edge detail by computing the 3 D Otsu along the fusion phenomena. The advantages of the presented scheme include higher quality outcomes, better preservation of tiny details and boundaries and reduced execution time with rising threshold levels. The fusion approach depends upon the differences between pixel intensity values within a small local space of an image;it aims to improve localized information after the thresholding process. The fusion of images based on local contrast can improve image segmentation performance by minimizing the loss of local contrast, loss of details and gray-level distributions. Results show that the proposed method yields more promising segmentation results when compared to conventional1 D Otsu, 2 D Otsu and 3 D Otsu methods, as evident from the objective and subjective evaluations.展开更多
The coal-rock interface recognition method based on multi-sensor data fusiontechnique is put forward because of the localization of single type sensor recognition method. Themeasuring theory based on multi-sensor data...The coal-rock interface recognition method based on multi-sensor data fusiontechnique is put forward because of the localization of single type sensor recognition method. Themeasuring theory based on multi-sensor data fusion technique is analyzed, and hereby the testplatform of recognition system is manufactured. The advantage of data fusion with the fuzzy neuralnetwork (FNN) technique has been probed. The two-level FNN is constructed and data fusion is carriedout. The experiments show that in various conditions the method can always acquire a much higherrecognition rate than normal ones.展开更多
Global Navigation Satellite System(GNSS)can provide all-weather,all-time,high-precision positioning,navigation and timing services,which plays an important role in national security,national economy,public life and ot...Global Navigation Satellite System(GNSS)can provide all-weather,all-time,high-precision positioning,navigation and timing services,which plays an important role in national security,national economy,public life and other aspects.However,in environments with limited satellite signals such as urban canyons,tunnels,and indoor spaces,it is difficult to provide accurate and reliable positioning services only by satellite navigation.Multi-source sensor integrated navigation can effectively overcome the limitations of single-sensor navigation through the fusion of different types of sensor data such as Inertial Measurement Unit(IMU),vision sensor,and LiDAR,and provide more accurate,stable and robust navigation information in complex environments.We summarizes the research status of multi-source sensor integrated navigation technology,and focuses on the representative innovations and applications of integrated navigation and positioning technology by major domestic scientific research institutions in China during 2019—2023.展开更多
基金supported by the National Natural Science Foundation of China(No.62276204)the Fundamental Research Funds for the Central Universities,China(No.YJSJ24011)+1 种基金the Natural Science Basic Research Program of Shaanxi,China(Nos.2022JM-340 and 2023-JC-QN-0710)the China Postdoctoral Science Foundation(Nos.2020T130494 and 2018M633470)。
文摘Visible and infrared(RGB-IR)fusion object detection plays an important role in security,disaster relief,etc.In recent years,deep-learning-based RGB-IR fusion detection methods have been developing rapidly,but still struggle to deal with the complex and changing scenarios captured by drones,mainly due to two reasons:(A)RGB-IR fusion detectors are susceptible to inferior inputs that degrade performance and stability.(B)RGB-IR fusion detectors are susceptible to redundant features that reduce accuracy and efficiency.In this paper,an innovative RGB-IR fusion detection framework based on global-local feature optimization,named GLFDet,is proposed to improve the detection performance and efficiency of drone-captured objects.The key components of GLFDet include a Global Feature Optimization(GFO)module,a Local Feature Optimization(LFO)module and a Channel Separation Fusion(CSF)module.Specifically,GFO calculates the information content of the input image from the frequency domain and optimizes the features holistically.Then,LFO dynamically selects high-value features and filters out low-value features before fusion,which significantly improves the efficiency of fusion.Finally,CSF fuses the RGB and IR features across the corresponding channels,which avoids the rearrangement of the channel relationships and enhances the model stability.Extensive experimental results show that the proposed method achieves the best performance on three popular RGB-IR datasets Drone Vehicle,VEDAI,and LLVIP.In addition,GLFDet is more lightweight than other comparable models,making it more appealing to edge devices such as drones.The code is available at https://github.com/lao chen330/GLFDet.
基金supported by the China Three Gorges Corporation(No.NBZZ202300860)the National Natural Science Foundation of China(No.52275104)the Science and Technology Innovation Program of Hunan Province(No.2023RC3097).
文摘Deep learning-based wind turbine blade fault diagnosis has been widely applied due to its advantages in end-to-end feature extraction.However,several challenges remain.First,signal noise collected during blade operation masks fault features,severely impairing the fault diagnosis performance of deep learning models.Second,current blade fault diagnosis often relies on single-sensor data,resulting in limited monitoring dimensions and ability to comprehensively capture complex fault states.To address these issues,a multi-sensor fusion-based wind turbine blade fault diagnosis method is proposed.Specifically,a CNN-Transformer Coupled Feature Learning Architecture is constructed to enhance the ability to learn complex features under noisy conditions,while a Weight-Aligned Data Fusion Module is designed to comprehensively and effectively utilize multi-sensor fault information.Experimental results of wind turbine blade fault diagnosis under different noise interferences show that higher accuracy is achieved by the proposed method compared to models with single-source data input,enabling comprehensive and effective fault diagnosis.
基金the research result of the 2024 Guangxi Higher Education Undergraduate Teaching Reform Project“OBE-Guided,Digitally Empowered‘Hadoop Big Data Development Technology’Course Ideological and Political Construction Innovation Exploration and Practice”(Project No.:2024JGA396).
文摘Aiming at the problem that the traditional SRP-PHAT sound source localization method performs intensive search in a 360-degree space,resulting in high computational complexity and difficulty in meeting real-time requirements,an innovative high-precision sound source localization method is proposed.This method combines the selective SRP-PHAT algorithm with real-time visual analysis.Its core innovations include using face detection to dynamically determine the scanning angle range to achieve visually guided selective scanning,distinguishing face sound sources from background noise through a sound source classification mechanism,and implementing intelligent background orientation selection to ensure comprehensive monitoring of environmental noise.Experimental results show that the method achieves a positioning accuracy of±5 degrees and a processing speed of more than 10FPS in complex real environments,and its performance is significantly better than the traditional full-angle scanning method.
基金Natural Science Foundation of Shaanxi Province(No.2019JQ-004)Scientific Research Plan Projects of Shaanxi Education Department(No.18JK0438)Youth Talent Promotion Project of Shaanxi Province(No.20180112)。
文摘In order to effectively reduce the uncertainty error of mobile robot localization with a single sensor and improve the accuracy and robustness of robot localization and mapping,a mobile robot localization algorithm based on multi-sensor information fusion(MSIF)was proposed.In this paper,simultaneous localization and mapping(SLAM)was realized on the basis of laser Rao-Blackwellized particle filter(RBPF)-SLAM algorithm and graph-based optimization theory was used to constrain and optimize the pose estimation results of Monte Carlo localization.The feature point extraction and quadrilateral closed loop matching algorithm based on oriented FAST and rotated BRIEF(ORB)were improved aiming at the problems of generous calculation and low tracking accuracy in visual information processing by means of the three-dimensional(3D)point feature in binocular visual reconstruction environment.Factor graph model was used for the information fusion under the maximum posterior probability criterion for laser RBPF-SLAM localization and binocular visual localization.The results of simulation and experiment indicate that localization accuracy of the above-mentioned method is higher than that of traditional RBPF-SLAM algorithm and general improved algorithms,and the effectiveness and usefulness of the proposed method are verified.
文摘The localization of the blanket jamming is studied and a new method of solving the localization ambiguity is proposed. Radars only can acquire angle information without range information when encountering the blanket jamming. Netted radars could get position information of the blanket jamming by make use of radars' relative position and the angle information, when there is one blanket jamming. In the presence of error, the localization method and the accuracy analysis of one blanket jamming are given. However, if there are more than one blanket jamming, and the two blanket jamming and two radars are coplanar, the localization of jamming could be error due to localization ambiguity. To solve this confusion, the Kalman filter model is established for all intersections, and through the initiation and association algorithm of multi-target, the false intersection can be eliminated. Simulations show that the presented method is valid.
文摘For existing indoor localization algorithm has low accuracy, high cost in deployment and maintenance, lack of robustness, and low sensor utilization, this paper proposes a particle filter algorithm based on multi-sensor fusion. The pedestrian’s localization in indoor environment is described as dynamic system state estimation problem. The algorithm combines the smart mobile terminal with indoor localization, and filters the result of localization with the particle filter. In this paper, a dynamic interval particle filter algorithm based on pedestrian dead reckoning (PDR) information and RSSI localization information have been used to improve the filtering precision and the stability. Moreover, the localization results will be uploaded to the server in time, and the location fingerprint database will be built incrementally, which can adapt the dynamic changes of the indoor environment. Experimental results show that the algorithm based on multi-sensor improves the localization accuracy and robustness compared with the location algorithm based on Wi-Fi.
文摘This paper presents the Optimized Kalman Particle Swarm (OKPS) filter. This filter results from two years of research and improves the Swarm Particle Filter (SPF). The OKPS has been designed to be both cooperative and reactive. It combines the advantages of the Particle Filter (PF) and the metaheuristic Particle Swarm Optimization (PSO) for ego-vehicles localization applications. In addition to a simple fusion between the swarm optimization and the particular filtering (which leads to the Swarm Particle Filter), the OKPS uses some attributes of the Extended Kalman filter (EKF). The OKPS filter innovates by fitting its particles with a capacity of self-diagnose by means of the EKF covariance uncertainty matrix. The particles can therefore evolve by exchanging information to assess the optimized position of the ego-vehicle. The OKPS fuses data coming from embedded sensors (low cost INS, GPS and Odometer) to perform a robust ego-vehicle positioning. The OKPS is compared to the EKF filter and to filters using particles (PF and SPF) on real data from our equipped vehicle.
文摘The fast growth of mobile autonomous machines from traditional equipment to unmanned autonomous vehicles has fueled the demand for accurate and reliable localization solutions in diverse application domains.Ultra Wide Band(UWB)technology has emerged as a promising candidate for addressing this need,offering high precision,immunity to multipath interference,and robust performance in challenging environments.In this comprehensive survey,we systematically explore UWB-based localization for mobile autonomous machines,spanning from fundamental principles to future trends.To the best of our knowledge,this review paper stands as the pioneer in systematically dissecting the algorithms of UWB-based localization for mobile autonomous machines,covering a spectrum from bottom-ranging schemes to advanced sensor fusion,error mitigation,and optimization techniques.By synthesizing existing knowledge,evaluating current methodologies,and highlighting future trends,this review aims to catalyze progress and innovation in the field,unlocking new opportunities for mobile autonomous machine applications across diverse industries and domains.Thus,it serves as a valuable resource for researchers,practitioners,and stakeholders interested in advancing the state-of-the-art UWB-based localization for mobile autonomous machines.
文摘This paper investigates the problem of decentralized multi-robot cooperative localization.This problem involves collaboratively estimating the poses of a group of robots with respect to a common reference coordinate system using robot-to-robot relative measurements and intermittent absolute measurements in a distributed manner.To address this problem,we present a decentralized fusion method that enables batch updating to handle relative measurements from multiple robots simultaneously.This method can improve both the accuracy and computational efficiency of cooperative localization.To reduce communication costs and reliance on connectivity,we do not maintain the inter-robot state correlations.Instead,we adopt a covariance intersection(CI)technique to design an upper bound that replaces unknown joint correlations.We propose an optimization method to determine a tight upper bound for the correlations in the joint update.The consistency and convergence of our proposed algorithm is theoretically analyzed.Furthermore,we conduct Monte Carlo numerical simulations and real-world experiments to demonstrate that the proposed method outperforms existing approaches in terms of both accuracy and consistency.
文摘In this paper, an innovative collaborative data fusion approach to ego-vehicle localization is presented. This approach called Optimized Kalman Swarm (OKS) is a data fusion and filtering method, fusing data from a low cost GPS, an INS, an Odometer and a Steering wheel angle encoder. The OKS is developed addressing the challenge of managing reactivity and robustness during a real time ego-localization process. For ego-vehicle localization, especially for highly dynamic on-road maneuvers, a filter needs to be robust and reactive at the same time. In these situations, the balance between reactivity and robustness concepts is crucial. The OKS filter represents an intelligent cooperative-reactive localization algorithm inspired by dynamic Particle Swarm Optimization (PSO). It combines advantages coming from two filters: Particle Filter (PF) and Extended Kalman filter (EKF). The OKS is tested using real embedded sensors data collected in the Satory’s test tracks. The OKS is also compared with both the well-known EKF and the Particle Filters (PF). The results show the efficiency of the OKS for a high dynamic driving scenario with damaged and low quality GPS data.
文摘Ensuring that autonomous vehicles maintain high precision and rapid response capabilities in complex and dynamic driving environments is a critical challenge in the field of autonomous driving.This study aims to enhance the learning efficiency ofmulti-sensor feature fusion in autonomous driving tasks,thereby improving the safety and responsiveness of the system.To achieve this goal,we propose an innovative multi-sensor feature fusion model that integrates three distinct modalities:visual,radar,and lidar data.The model optimizes the feature fusion process through the introduction of two novel mechanisms:Sparse Channel Pooling(SCP)and Residual Triplet-Attention(RTA).Firstly,the SCP mechanism enables the model to adaptively filter out salient feature channels while eliminating the interference of redundant features.This enhances the model’s emphasis on critical features essential for decisionmaking and strengthens its robustness to environmental variability.Secondly,the RTA mechanism addresses the issue of feature misalignment across different modalities by effectively aligning key cross-modal features.This alignment reduces the computational overhead associated with redundant features and enhances the overall efficiency of the system.Furthermore,this study incorporates a reinforcement learning module designed to optimize strategies within a continuous action space.By integrating thismodulewith the feature fusion learning process,the entire system is capable of learning efficient driving strategies in an end-to-end manner within the CARLA autonomous driving simulator.Experimental results demonstrate that the proposedmodel significantly enhances the perception and decision-making accuracy of the autonomous driving system in complex traffic scenarios while maintaining real-time responsiveness.This work provides a novel perspective and technical pathway for the application of multi-sensor data fusion in autonomous driving.
文摘s-Lap is a new gene sequence from pig retinal pigment epithelial(RPE) cells, which was found and cloned in the early period of apoptosis of RPE cells damaged with visible light. We cloned the coding area sequence of the novel gene of s-Lap and constructed its recombinant eukaryotic plasmid pcDNA3.1-GFP/s-lap with the recombinant DNA technique. The expression and localization of s-lap/GFP fusion protein in CHO and B_~16 cell lines were studied with the instantaneously transfected pcDNA3.1-GFP/s-lap recombinant plasmid. ~s-Lap/GFP fusion protein can be expressed in CHO and B_~16 cells with a high rate expression in the nuclei.
基金partially supported by the National Natural Science Foun-dation of China(No.62071389).
文摘In this paper,an effective target locating approach based on the fingerprint fusion posi-tioning(FFP)method is proposed which integrates the time-difference of arrival(TDOA)and the received signal strength according to the statistical variance of target position in the stationary 3D scenarios.The FFP method fuses the pedestrian dead reckoning(PDR)estimation to solve the moving target localization problem.We also introduce auxiliary parameters to estimate the target motion state.Subsequently,we can locate the static pedestrians and track the the moving target.For the case study,eight access stationary points are placed on a bookshelf and hypermarket;one target node is moving inside hypermarkets in 2D and 3D scenarios or stationary on the bookshelf.We compare the performance of our proposed method with existing localization algorithms such as k-nearest neighbor,weighted k-nearest neighbor,pure TDOA and fingerprinting combining Bayesian frameworks including the extended Kalman filter,unscented Kalman filter and particle fil-ter(PF).The proposed approach outperforms obviously the counterpart methodologies in terms of the root mean square error and the cumulative distribution function of localization errors,espe-cially in the 3D scenarios.Simulation results corroborate the effectiveness of our proposed approach.
基金supported by the National Natural Science Foundation of China(Nos.51805376 and U1709208)the Zhejiang Provincial Natural Science Foundation of China(Nos.LY20E050028 and LD21E050001)。
文摘Because the hydraulic directional valve usually works in a bad working environment and is disturbed by multi-factor noise,the traditional single sensor monitoring technology is difficult to use for an accurate diagnosis of it.Therefore,a fault diagnosis method based on multi-sensor information fusion is proposed in this paper to reduce the inaccuracy and uncertainty of traditional single sensor information diagnosis technology and to realize accurate monitoring for the location or diagnosis of early faults in such valves in noisy environments.Firstly,the statistical features of signals collected by the multi-sensor are extracted and the depth features are obtained by a convolutional neural network(CNN)to form a complete and stable multi-dimensional feature set.Secondly,to obtain a weighted multi-dimensional feature set,the multi-dimensional feature sets of similar sensors are combined,and the entropy weight method is used to weight these features to reduce the interference of insensitive features.Finally,the attention mechanism is introduced to improve the dual-channel CNN,which is used to adaptively fuse the weighted multi-dimensional feature sets of heterogeneous sensors,to flexibly select heterogeneous sensor information so as to achieve an accurate diagnosis.Experimental results show that the weighted multi-dimensional feature set obtained by the proposed method has a high fault-representation ability and low information redundancy.It can diagnose simultaneously internal wear faults of the hydraulic directional valve and electromagnetic faults of actuators that are difficult to diagnose by traditional methods.This proposed method can achieve high fault-diagnosis accuracy under severe working conditions.
基金supported by National Hi-tech Research and Development Program of China (863 Program, Grant No. 2007AA04Z433)Hunan Provincial Natural Science Foundation of China (Grant No. 09JJ8005)Scientific Research Foundation of Graduate School of Beijing University of Chemical and Technology,China (Grant No. 10Me002)
文摘As the differences of sensor＇s precision and some random factors are difficult to control,the actual measurement signals are far from the target signals that affect the reliability and precision of rotating machinery fault diagnosis.The traditional signal processing methods,such as classical inference and weighted averaging algorithm usually lack dynamic adaptability that is easy for trends to cause the faults to be misjudged or left out.To enhance the measuring veracity and precision of vibration signal in rotary machine multi-sensor vibration signal fault diagnosis,a novel data level fusion approach is presented on the basis of correlation function analysis to fast determine the weighted value of multi-sensor vibration signals.The approach doesn＇t require knowing the prior information about sensors,and the weighted value of sensors can be confirmed depending on the correlation measure of real-time data tested in the data level fusion process.It gives greater weighted value to the greater correlation measure of sensor signals,and vice versa.The approach can effectively suppress large errors and even can still fuse data in the case of sensor failures because it takes full advantage of sensor＇s own-information to determine the weighted value.Moreover,it has good performance of anti-jamming due to the correlation measures between noise and effective signals are usually small.Through the simulation of typical signal collected from multi-sensors,the comparative analysis of dynamic adaptability and fault tolerance between the proposed approach and traditional weighted averaging approach is taken.Finally,the rotor dynamics and integrated fault simulator is taken as an example to verify the feasibility and advantages of the proposed approach,it is shown that the multi-sensor data level fusion based on correlation function weighted approach is better than the traditional weighted average approach with respect to fusion precision and dynamic adaptability.Meantime,the approach is adaptable and easy to use,can be applied to other areas of vibration measurement.
文摘This paper presents a data fusion method in distributed multi-sensor system including GPS and INS sensors’ data processing. First, a residual χ 2 \|test strategy with the corresponding algorithm is designed. Then a coefficient matrices calculation method of the information sharing principle is derived. Finally, the federated Kalman filter is used to combine these independent, parallel, real\|time data. A pseudolite (PL) simulation example is given.
文摘To overcome the shortcomings of 1 D and 2 D Otsu’s thresholding techniques, the 3 D Otsu method has been developed.Among all Otsu’s methods, 3 D Otsu technique provides the best threshold values for the multi-level thresholding processes. In this paper, to improve the quality of segmented images, a simple and effective multilevel thresholding method is introduced. The proposed approach focuses on preserving edge detail by computing the 3 D Otsu along the fusion phenomena. The advantages of the presented scheme include higher quality outcomes, better preservation of tiny details and boundaries and reduced execution time with rising threshold levels. The fusion approach depends upon the differences between pixel intensity values within a small local space of an image;it aims to improve localized information after the thresholding process. The fusion of images based on local contrast can improve image segmentation performance by minimizing the loss of local contrast, loss of details and gray-level distributions. Results show that the proposed method yields more promising segmentation results when compared to conventional1 D Otsu, 2 D Otsu and 3 D Otsu methods, as evident from the objective and subjective evaluations.
基金This project is supported by Provincial Youth Science Foundation of Shanxi China (No.20011020)National Natural Science Foundation of China (No.59975064).
文摘The coal-rock interface recognition method based on multi-sensor data fusiontechnique is put forward because of the localization of single type sensor recognition method. Themeasuring theory based on multi-sensor data fusion technique is analyzed, and hereby the testplatform of recognition system is manufactured. The advantage of data fusion with the fuzzy neuralnetwork (FNN) technique has been probed. The two-level FNN is constructed and data fusion is carriedout. The experiments show that in various conditions the method can always acquire a much higherrecognition rate than normal ones.
基金National Key R&D Program of China(No.2021YFB2501102)。
文摘Global Navigation Satellite System(GNSS)can provide all-weather,all-time,high-precision positioning,navigation and timing services,which plays an important role in national security,national economy,public life and other aspects.However,in environments with limited satellite signals such as urban canyons,tunnels,and indoor spaces,it is difficult to provide accurate and reliable positioning services only by satellite navigation.Multi-source sensor integrated navigation can effectively overcome the limitations of single-sensor navigation through the fusion of different types of sensor data such as Inertial Measurement Unit(IMU),vision sensor,and LiDAR,and provide more accurate,stable and robust navigation information in complex environments.We summarizes the research status of multi-source sensor integrated navigation technology,and focuses on the representative innovations and applications of integrated navigation and positioning technology by major domestic scientific research institutions in China during 2019—2023.
