Localization along fixed routes is the fundamental function of transportation applications,including patrol vehicles,shuttles,buses,and even passenger vehicles.To achieve accurate and reliable localization,we propose ...Localization along fixed routes is the fundamental function of transportation applications,including patrol vehicles,shuttles,buses,and even passenger vehicles.To achieve accurate and reliable localization,we propose a tightly coupled A Priori Map Simultaneous Localization and Mapping(APM-SLAM)system.APM-SLAM provides a comprehensive and heterogeneous framework,encompassing both mapping and localization processes.The mapping stage leverages Global Navigation Satellite System(GNSS)-aided Structure from Motion(SfM)to establish reliable a priori maps with coarse-and fine-level components.The localization process integrates coarse-to-fine matching with Maximum A Posteriori(MAP)Probability estimation to refine pose accuracy.By incorporating deep learning-based features and point descriptors,our system maintains robustness even in scenarios with significant visual variation.Unlike traditional map-based approaches,APM-SLAM models the a priori map’s point structures as probabilistic distributions and incorporates them into the optimization process.Extensive experiments on public datasets demonstrate the superiority of our method in both mapping precision and localization accuracy,achieving decimeter-level translation precision.Ablation studies further validate the effectiveness of each component within our system.This work contributes to establishing maps and utilizing a priori information for localization simultaneously.展开更多
This paper presents a hierarchical simultaneous localization and mapping（SLAM） system for a small unmanned aerial vehicle（UAV） using the output of an inertial measurement unit（IMU） and the bearing-only observati...This paper presents a hierarchical simultaneous localization and mapping（SLAM） system for a small unmanned aerial vehicle（UAV） using the output of an inertial measurement unit（IMU） and the bearing-only observations from an onboard monocular camera.A homography based approach is used to calculate the motion of the vehicle in 6 degrees of freedom by image feature match.This visual measurement is fused with the inertial outputs by an indirect extended Kalman filter（EKF） for attitude and velocity estimation.Then,another EKF is employed to estimate the position of the vehicle and the locations of the features in the map.Both simulations and experiments are carried out to test the performance of the proposed system.The result of the comparison with the referential global positioning system/inertial navigation system（GPS/INS） navigation indicates that the proposed SLAM can provide reliable and stable state estimation for small UAVs in GPS-denied environments.展开更多
In this paper,we present a novel algorithm for odometry estimation based on ceiling vision.The main contribution of this algorithm is the introduction of principal direction detection that can greatly reduce error acc...In this paper,we present a novel algorithm for odometry estimation based on ceiling vision.The main contribution of this algorithm is the introduction of principal direction detection that can greatly reduce error accumulation problem in most visual odometry estimation approaches.The principal direction is defned based on the fact that our ceiling is flled with artifcial vertical and horizontal lines which can be used as reference for the current robot s heading direction.The proposed approach can be operated in real-time and it performs well even with camera s disturbance.A moving low-cost RGB-D camera（Kinect）,mounted on a robot,is used to continuously acquire point clouds.Iterative closest point（ICP） is the common way to estimate the current camera position by registering the currently captured point cloud to the previous one.However,its performance sufers from data association problem or it requires pre-alignment information.The performance of the proposed principal direction detection approach does not rely on data association knowledge.Using this method,two point clouds are properly pre-aligned.Hence,we can use ICP to fne-tune the transformation parameters and minimize registration error.Experimental results demonstrate the performance and stability of the proposed system under disturbance in real-time.Several indoor tests are carried out to show that the proposed visual odometry estimation method can help to signifcantly improve the accuracy of simultaneous localization and mapping（SLAM）.展开更多
The extraction and description of image features are very important for visual simultaneous localization and mapping(V-SLAM).A rotated boosted efficient binary local image descriptor(BEBLID)SLAM(RB-SLAM)algorithm base...The extraction and description of image features are very important for visual simultaneous localization and mapping(V-SLAM).A rotated boosted efficient binary local image descriptor(BEBLID)SLAM(RB-SLAM)algorithm based on improved oriented fast and rotated brief(ORB)feature description is proposed in this paper,which can solve the problems of low localization accuracy and time efficiency of the current ORB-SLAM3 algorithm.Firstly,it uses the BEBLID to replace the feature point description algorithm of the original ORB to enhance the expressiveness and description efficiency of the image.Secondly,it adds rotational invariance to the BEBLID using the orientation information of the feature points.It also selects the rotationally stable bits in the BEBLID to further enhance the rotational invariance of the BEBLID.Finally,it retrains the binary visual dictionary based on the BEBLID to reduce the cumulative error of V-SLAM and improve the loading speed of the visual dictionary.Experiments show that the dictionary loading efficiency is improved by more than 10 times.The RB-SLAM algorithm improves the trajectory accuracy by 24.75%on the TUM dataset and 26.25%on the EuRoC dataset compared to the ORB-SLAM3 algorithm.展开更多
To use the benefits of Advanced Driver Assistance Systems(ADAS)-Tests in simulation and reality a new approach for using Augmented Reality(AR)in an automotive vehicle for testing ADAS is presented in this paper.Our pr...To use the benefits of Advanced Driver Assistance Systems(ADAS)-Tests in simulation and reality a new approach for using Augmented Reality(AR)in an automotive vehicle for testing ADAS is presented in this paper.Our procedure provides a link between simulation and reality and should enable a faster development process for future increasingly complex ADAS tests and future mobility solutions.Test fields for ADAS offer a small number of orientation points.Furthermore,these must be detected and processed at high vehicle speeds.That requires high computational power both for developing our method and its subsequent use in testing.Using image segmentation(IS),artificial intelligence(AI)for object recognition,and visual simultaneous localization and mapping(vSLAM),we aim to create a three-dimensional model with accurate information about the test site.It is expected that using AI and IS will significantly improve performance as computational speed and accuracy for AR applications in automobiles.展开更多
基金supported by the Project from Shenzhen Science and Technology Innovation Commission(KJZD20230923114810022).
文摘Localization along fixed routes is the fundamental function of transportation applications,including patrol vehicles,shuttles,buses,and even passenger vehicles.To achieve accurate and reliable localization,we propose a tightly coupled A Priori Map Simultaneous Localization and Mapping(APM-SLAM)system.APM-SLAM provides a comprehensive and heterogeneous framework,encompassing both mapping and localization processes.The mapping stage leverages Global Navigation Satellite System(GNSS)-aided Structure from Motion(SfM)to establish reliable a priori maps with coarse-and fine-level components.The localization process integrates coarse-to-fine matching with Maximum A Posteriori(MAP)Probability estimation to refine pose accuracy.By incorporating deep learning-based features and point descriptors,our system maintains robustness even in scenarios with significant visual variation.Unlike traditional map-based approaches,APM-SLAM models the a priori map’s point structures as probabilistic distributions and incorporates them into the optimization process.Extensive experiments on public datasets demonstrate the superiority of our method in both mapping precision and localization accuracy,achieving decimeter-level translation precision.Ablation studies further validate the effectiveness of each component within our system.This work contributes to establishing maps and utilizing a priori information for localization simultaneously.
基金supported by National High Technology Research Development Program of China (863 Program) (No.2011AA040202)National Science Foundation of China (No.51005008)
文摘This paper presents a hierarchical simultaneous localization and mapping（SLAM） system for a small unmanned aerial vehicle（UAV） using the output of an inertial measurement unit（IMU） and the bearing-only observations from an onboard monocular camera.A homography based approach is used to calculate the motion of the vehicle in 6 degrees of freedom by image feature match.This visual measurement is fused with the inertial outputs by an indirect extended Kalman filter（EKF） for attitude and velocity estimation.Then,another EKF is employed to estimate the position of the vehicle and the locations of the features in the map.Both simulations and experiments are carried out to test the performance of the proposed system.The result of the comparison with the referential global positioning system/inertial navigation system（GPS/INS） navigation indicates that the proposed SLAM can provide reliable and stable state estimation for small UAVs in GPS-denied environments.
文摘In this paper,we present a novel algorithm for odometry estimation based on ceiling vision.The main contribution of this algorithm is the introduction of principal direction detection that can greatly reduce error accumulation problem in most visual odometry estimation approaches.The principal direction is defned based on the fact that our ceiling is flled with artifcial vertical and horizontal lines which can be used as reference for the current robot s heading direction.The proposed approach can be operated in real-time and it performs well even with camera s disturbance.A moving low-cost RGB-D camera（Kinect）,mounted on a robot,is used to continuously acquire point clouds.Iterative closest point（ICP） is the common way to estimate the current camera position by registering the currently captured point cloud to the previous one.However,its performance sufers from data association problem or it requires pre-alignment information.The performance of the proposed principal direction detection approach does not rely on data association knowledge.Using this method,two point clouds are properly pre-aligned.Hence,we can use ICP to fne-tune the transformation parameters and minimize registration error.Experimental results demonstrate the performance and stability of the proposed system under disturbance in real-time.Several indoor tests are carried out to show that the proposed visual odometry estimation method can help to signifcantly improve the accuracy of simultaneous localization and mapping（SLAM）.
文摘The extraction and description of image features are very important for visual simultaneous localization and mapping(V-SLAM).A rotated boosted efficient binary local image descriptor(BEBLID)SLAM(RB-SLAM)algorithm based on improved oriented fast and rotated brief(ORB)feature description is proposed in this paper,which can solve the problems of low localization accuracy and time efficiency of the current ORB-SLAM3 algorithm.Firstly,it uses the BEBLID to replace the feature point description algorithm of the original ORB to enhance the expressiveness and description efficiency of the image.Secondly,it adds rotational invariance to the BEBLID using the orientation information of the feature points.It also selects the rotationally stable bits in the BEBLID to further enhance the rotational invariance of the BEBLID.Finally,it retrains the binary visual dictionary based on the BEBLID to reduce the cumulative error of V-SLAM and improve the loading speed of the visual dictionary.Experiments show that the dictionary loading efficiency is improved by more than 10 times.The RB-SLAM algorithm improves the trajectory accuracy by 24.75%on the TUM dataset and 26.25%on the EuRoC dataset compared to the ORB-SLAM3 algorithm.
文摘To use the benefits of Advanced Driver Assistance Systems(ADAS)-Tests in simulation and reality a new approach for using Augmented Reality(AR)in an automotive vehicle for testing ADAS is presented in this paper.Our procedure provides a link between simulation and reality and should enable a faster development process for future increasingly complex ADAS tests and future mobility solutions.Test fields for ADAS offer a small number of orientation points.Furthermore,these must be detected and processed at high vehicle speeds.That requires high computational power both for developing our method and its subsequent use in testing.Using image segmentation(IS),artificial intelligence(AI)for object recognition,and visual simultaneous localization and mapping(vSLAM),we aim to create a three-dimensional model with accurate information about the test site.It is expected that using AI and IS will significantly improve performance as computational speed and accuracy for AR applications in automobiles.
