Lunar Laser Ranging has extremely high requirements for the pointing accuracy of the telescopes used.To improve its pointing accuracy and solve the problem of insufficiently accurate telescope pointing correction achi...Lunar Laser Ranging has extremely high requirements for the pointing accuracy of the telescopes used.To improve its pointing accuracy and solve the problem of insufficiently accurate telescope pointing correction achieved by tracking stars in the all-sky region,we propose a processing scheme to select larger-sized lunar craters near the Lunar Corner Cube Retroreflector as reference features for telescope pointing bias computation.Accurately determining the position of the craters in the images is crucial for calculating the pointing bias;therefore,we propose a method for accurately calculating the crater position based on lunar surface feature matching.This method uses matched feature points obtained from image feature matching,using a deep learning method to solve the image transformation matrix.The known position of a crater in a reference image is mapped using this matrix to calculate the crater position in the target image.We validate this method using craters near the Lunar Corner Cube Retroreflectors of Apollo 15 and Luna 17 and find that the calculated position of a crater on the target image falls on the center of the crater,even for image features with large distortion near the lunar limb.The maximum image matching error is approximately 1″,and the minimum is only 0.47″,which meets the pointing requirements of Lunar Laser Ranging.This method provides a new technical means for the high-precision pointing bias calculation of the Lunar Laser Ranging system.展开更多
Augmented solar images were used to research the adaptability of four representative image extraction and matching algorithms in space weather domain.These include the scale-invariant feature transform algorithm,speed...Augmented solar images were used to research the adaptability of four representative image extraction and matching algorithms in space weather domain.These include the scale-invariant feature transform algorithm,speeded-up robust features algorithm,binary robust invariant scalable keypoints algorithm,and oriented fast and rotated brief algorithm.The performance of these algorithms was estimated in terms of matching accuracy,feature point richness,and running time.The experiment result showed that no algorithm achieved high accuracy while keeping low running time,and all algorithms are not suitable for image feature extraction and matching of augmented solar images.To solve this problem,an improved method was proposed by using two-frame matching to utilize the accuracy advantage of the scale-invariant feature transform algorithm and the speed advantage of the oriented fast and rotated brief algorithm.Furthermore,our method and the four representative algorithms were applied to augmented solar images.Our application experiments proved that our method achieved a similar high recognition rate to the scale-invariant feature transform algorithm which is significantly higher than other algorithms.Our method also obtained a similar low running time to the oriented fast and rotated brief algorithm,which is significantly lower than other algorithms.展开更多
The mean Hausdorff distance, though highly applicable in image registration, does not work well on partial matching images. An improvement upon traditional Hausdorff-distance-based image registration method is propose...The mean Hausdorff distance, though highly applicable in image registration, does not work well on partial matching images. An improvement upon traditional Hausdorff-distance-based image registration method is proposed, which consists of the following two aspects. One is to estimate transformation parameters between two images from the distributions of geometric property differences instead of establishing explicit feature correspondences. This procedure is treated as the pre-registration. The other aspect is that mean Hausdorff distance computation is replaced with the analysis of the second difference of generalized Hausdorff distance so as to eliminate the redundant points. Experimental results show that our registration method outperforms the method based on mean Hausdorff distance. The registration errors are noticeably reduced in the partial matching images.展开更多
An iterative algorithm to calculate mutual correlation using hierarchical key points and the search space mark principle is proposed. An effective algorithm is designed to improve the matching speed. By hi-erarchical ...An iterative algorithm to calculate mutual correlation using hierarchical key points and the search space mark principle is proposed. An effective algorithm is designed to improve the matching speed. By hi-erarchical key point algorithm and mutual correlation coefficients of the matching images, the important points can be iteratively calculated in the images hierarchically, and the correlation coefficient can be ob-tained with satisfactory precision. Massive spots in the parameter space which are impossible to match can be removed by the search space mark principle. Two approximate continuities in the correlation image matching process, the image gray level distribution continuity and the correlation coefficient value in the parameter space continuity, are considered in the method. The experiments show that the new algorithm can greatly enhance matching speed and achieve accurate matching results.展开更多
In the paper,a set of algorithms to construct synthetic aperture radar（SAR）matching suitable features are frstly proposed based on the evolutionary synthesis strategy.During the process,on the one hand,the indexes o...In the paper,a set of algorithms to construct synthetic aperture radar（SAR）matching suitable features are frstly proposed based on the evolutionary synthesis strategy.During the process,on the one hand,the indexes of primary matching suitable features（PMSFs）are designed based on the characteristics of image texture,SAR imaging and SAR matching algorithm,which is a process involving expertise;on the other hand,by designing a synthesized operation expression tree based on PMSFs,a much more flexible expression form of synthesized features is built,which greatly expands the construction space.Then,the genetic algorithm-based optimized searching process is employed to search the synthesized matching suitable feature（SMSF）with the highest effciency,largely improving the optimized searching effciency.In addition,the experimental results of the airborne synthetic aperture radar ortho-images of C-band and P-band show that the SMSFs gained via the algorithms can reflect the matching suitability of SAR images accurately and the matching probabilities of selected matching suitable areas of ortho-images could reach 99±0.5%.展开更多
This paper proposed an efficient method of image overlapping relationship analysis based on spatial index of KD tree fast search for disordered and large-scale asteroid images.In this study,the image data from asteroi...This paper proposed an efficient method of image overlapping relationship analysis based on spatial index of KD tree fast search for disordered and large-scale asteroid images.In this study,the image data from asteroid exploration missions such as Bennu,Vesta,and Ryugu were used for experiments,and the proposed image matching pairs determination algorithm was comprehensively compared with the corresponding modules of USGS ISIS in order to evaluate its performance in terms of efficiency and accuracy.The results show that when processing more than a thousand images,the proposed method greatly improves the efficiency of acquiring image matching pairs while ensuring the correctness of image overlapping relationships and accuracy of bundle adjustment.At the same time,according to the obtained image matching pairs,images that meet the requirements of Stereo Photoclinometry can be quickly selected,effectively improving the quality of 3D reconstruction models of asteroid images.展开更多
In order to obtain a large number of correct matches with high accuracy,this article proposes a robust wide baseline point matching method,which is based on Scott s proximity matrix and uses the scale invariant featur...In order to obtain a large number of correct matches with high accuracy,this article proposes a robust wide baseline point matching method,which is based on Scott s proximity matrix and uses the scale invariant feature transform (SIFT). First,the distance between SIFT features is included in the equations of the proximity matrix to measure the similarity between two feature points; then the normalized cross correlation (NCC) used in Scott s method,which has been modified with adaptive scale and orientation,...展开更多
Based on the inertial navigation system, the influences of the excursion of the inertial navigation system and the measurement error of the wireless pressure altimeter on the rotation and scale of the real image are q...Based on the inertial navigation system, the influences of the excursion of the inertial navigation system and the measurement error of the wireless pressure altimeter on the rotation and scale of the real image are quantitatively analyzed in scene matching. The log-polar transform （LPT） is utilized and an anti-rotation and anti- scale image matching algorithm is proposed based on the image edge feature point extraction. In the algorithm, the center point is combined with its four-neighbor points, and the corresponding computing process is put forward. Simulation results show that in the image rotation and scale variation range resulted from the navigation system error and the measurement error of the wireless pressure altimeter, the proposed image matching algo- rithm can satisfy the accuracy demands of the scene aided navigation system and provide the location error-correcting information of the system.展开更多
In feature based image matching,distinctive features in images are detected and represented by feature descriptors.Matching is then carried out by assessing the similarity of the descriptors of potentially conjugate p...In feature based image matching,distinctive features in images are detected and represented by feature descriptors.Matching is then carried out by assessing the similarity of the descriptors of potentially conjugate points.In this paper,we first shortly discuss the general frame-work.Then,we review feature detection as well as the determination of affine shape and orientation of local features,before analyzing feature description in more detail.In the feature description review,the general framework of local feature description is presented first.Then,the review discusses the evolution from hand-crafted feature descriptors,e.g.SIFT(Scale Invariant Feature Transform),to machine learning and deep learning based descriptors.The machine learning models,the training loss and the respective training data of learning-based algorithms are looked at in more detail;subsequently the various advantages and challenges of the different approaches are discussed.Finally,we present and assess some current research directions before concluding the paper.展开更多
Matching remote sensing images taken by an unmanned aerial vehicle(UAV) with satellite remote sensing images with geolocation information. Thus, the specific geographic location of the target object captured by the UA...Matching remote sensing images taken by an unmanned aerial vehicle(UAV) with satellite remote sensing images with geolocation information. Thus, the specific geographic location of the target object captured by the UAV is determined. Its main challenge is the considerable differences in the visual content of remote sensing images acquired by satellites and UAVs, such as dramatic changes in viewpoint, unknown orientations, etc. Much of the previous work has focused on image matching of homologous data. To overcome the difficulties caused by the difference between these two data modes and maintain robustness in visual positioning, a quality-aware template matching method based on scale-adaptive deep convolutional features is proposed by deeply mining their common features. The template size feature map and the reference image feature map are first obtained. The two feature maps obtained are used to measure the similarity. Finally, a heat map representing the probability of matching is generated to determine the best match in the reference image. The method is applied to the latest UAV-based geolocation dataset(University-1652 dataset) and the real-scene campus data we collected with UAVs. The experimental results demonstrate the effectiveness and superiority of the method.展开更多
Targeting at a reliable image matching of multiple remote sensing images for the generation of digital surface models,this paper presents a geometric-constrained multi-view image matching method,based on an energy min...Targeting at a reliable image matching of multiple remote sensing images for the generation of digital surface models,this paper presents a geometric-constrained multi-view image matching method,based on an energy minimization framework.By employing a geometrical constraint,the cost value of the energy function was calculated from multiple images,and the cost value was aggregated in an image space using a semi-global optimization approach.A homography transform parameter calculation method is proposed for fast calculation of projection pixel on each image when calculation cost values.It is based on the known interior orientation parameters,exterior orientation parameters,and a given elevation value.For an efficient and reliable processing of multiple remote sensing images,the proposed matching method was performed via a coarse-to-fine strategy through image pyramid.Three sets of airborne remote sensing images were used to evaluate the performance of the proposed method.Results reveal that the multi-view image matching can improve matching reliability.Moreover,the experimental results show that the proposed method performs better than traditional methods.展开更多
In view of the fact that the traditional Hausdorff image matching algorithm is very sensitive to the image size as well as the unsatisfactory real-time performance in practical applications,an image matching algorithm...In view of the fact that the traditional Hausdorff image matching algorithm is very sensitive to the image size as well as the unsatisfactory real-time performance in practical applications,an image matching algorithm is proposed based on the combination of Yolov3.Firstly,the features of the reference image are selected for pretraining,and then the training results are used to extract the features of the real images before the coordinates of the center points of the feature area are used to complete the coarse matching.Finally,the Hausdorff algorithm is used to complete the fine image matching.Experiments show that the proposed algorithm significantly improves the speed and accuracy of image matching.Also,it is robust to rotation changes.展开更多
A novel algorithm is presented to make the results of image matching more reliable and accurate based on SIFT (Scale Invariant Feature Transform). SIFT algorithm has been identified as the most resistant matching algo...A novel algorithm is presented to make the results of image matching more reliable and accurate based on SIFT (Scale Invariant Feature Transform). SIFT algorithm has been identified as the most resistant matching algorithm to common image deformations; however, if there are similar regions in images, SIFT algorithm still generates some analogical descriptors and provides many mismatches. This paper examines the local image descriptor used by SIFT and presents a new algorithm by integrating SIFT with two-dimensional moment invariants and disparity gradient to improve the matching results. In the new algorithm, decision tree is used, and the whole matching process is divided into three levels with different primitives. Matching points are considered as correct ones only when they satisfy all the three similarity measurements. Experiment results demonstrate that the new approach is more reliable and accurate.展开更多
Automatic Digital Orthophoto Map(DOM)generation plays an important role in many downstream works such as land use and cover detection,urban planning,and disaster assessment.Existing DOM generation methods can generate...Automatic Digital Orthophoto Map(DOM)generation plays an important role in many downstream works such as land use and cover detection,urban planning,and disaster assessment.Existing DOM generation methods can generate promising results but always need ground object filtered DEM generation before otho-rectification;this can consume much time and produce building facade contained results.To address this problem,a pixel-by-pixel digital differential rectification-based automatic DOM generation method is proposed in this paper.Firstly,3D point clouds with texture are generated by dense image matching based on an optical flow field for a stereo pair of images,respectively.Then,the grayscale of the digital differential rectification image is extracted directly from the point clouds element by element according to the nearest neighbor method for matched points.Subsequently,the elevation is repaired grid-by-grid using the multi-layer Locally Refined B-spline(LR-B)interpolation method with triangular mesh constraint for the point clouds void area,and the grayscale is obtained by the indirect scheme of digital differential rectification to generate the pixel-by-pixel digital differentially rectified image of a single image slice.Finally,a seamline network is automatically searched using a disparity map optimization algorithm,and DOM is smartly mosaicked.The qualitative and quantitative experimental results on three datasets were produced and evaluated,which confirmed the feasibility of the proposed method,and the DOM accuracy can reach 1 Ground Sample Distance(GSD)level.The comparison experiment with the state-of-the-art commercial softwares showed that the proposed method generated DOM has a better visual effect on building boundaries and roof completeness with comparable accuracy and computational efficiency.展开更多
Histogram of collinear gradient-enhanced coding （HCGEC）, a robust key point descriptor for multi-spectral image matching, is proposed. The HCGEC mainly encodes rough structures within an image and suppresses detaile...Histogram of collinear gradient-enhanced coding （HCGEC）, a robust key point descriptor for multi-spectral image matching, is proposed. The HCGEC mainly encodes rough structures within an image and suppresses detailed textural information, which is desirable in multi-spectral image matching. Experiments on two multi-spectral data sets demonstrate that the proposed descriptor can yield significantly better results than some state-of- the-art descriptors.展开更多
Image matching based on scale invariant feature transform（SIFT） is one of the most popular image matching algorithms, which exhibits high robustness and accuracy. Grayscale images rather than color images are genera...Image matching based on scale invariant feature transform（SIFT） is one of the most popular image matching algorithms, which exhibits high robustness and accuracy. Grayscale images rather than color images are generally used to get SIFT descriptors in order to reduce the complexity. The regions which have a similar grayscale level but different hues tend to produce wrong matching results in this case. Therefore, the loss of color information may result in decreasing of matching ratio. An image matching algorithm based on SIFT is proposed, which adds a color offset and an exposure offset when converting color images to grayscale images in order to enhance the matching ratio. Experimental results show that the proposed algorithm can effectively differentiate the regions with different colors but the similar grayscale level, and increase the matching ratio of image matching based on SIFT. Furthermore, it does not introduce much complexity than the traditional SIFT.展开更多
Multi-modal image matching is crucial in aerospace applications because it can fully exploit the complementary and valuable information contained in the amount and diversity of remote sensing images.However,it remains...Multi-modal image matching is crucial in aerospace applications because it can fully exploit the complementary and valuable information contained in the amount and diversity of remote sensing images.However,it remains a challenging task due to significant non-linear radiometric,geometric differences,and noise across different sensors.To improve the performance of heterologous image matching,this paper proposes a normalized self-similarity region descriptor to extract consistent structural information.We first construct the pointwise self-similarity region descriptor based on the Euclidean distance between adjacent image blocks to reflect the structural properties of multi-modal images.Then,a linear normalization approach is used to form Modality Independent Region Descriptor(MIRD),which can effectively distinguish structural features such as points,lines,corners,and flat between multi-modal images.To further improve the matching accuracy,the included angle cosine similarity metric is adopted to exploit the directional vector information of multi-dimensional feature descriptors.The experimental results show that the proposed MIRD has better matching accuracy and robustness for various multi-modal image matching than the state-of-the-art methods.MIRD can effectively extract consistent geometric structure features and suppress the influence of SAR speckle noise using non-local neighboring image blocks operation,effectively applied to various multi-modal image matching.展开更多
In photogrammetry and remote sensing,image matching is a basic and crucial process for automatic DEM generation.In this paper we presented a image relaxation matching method based on feature points.This method can be ...In photogrammetry and remote sensing,image matching is a basic and crucial process for automatic DEM generation.In this paper we presented a image relaxation matching method based on feature points.This method can be considered as an extention of regular grid point based matching.It avoids the shortcome of grid point based matching.For example,with this method,we can avoid low or even no texture area where errors frequently appear in cross correlaton matching.In the mean while,it makes full use of some mature techniques such as probability relaxation,image pyramid and the like which have already been successfully used in grid point matching process.Application of the technique to DEM generaton in different regions proved that it is more reasonable and reliable.展开更多
Exactly capturing three dimensional (3D) motion i nf ormation of an object is an essential and important task in computer vision, and is also one of the most difficult problems. In this paper, a binocular vision s yst...Exactly capturing three dimensional (3D) motion i nf ormation of an object is an essential and important task in computer vision, and is also one of the most difficult problems. In this paper, a binocular vision s ystem and a method for determining 3D motion parameters of an object from binocu lar sequence images are introduced. The main steps include camera calibration, t he matching of motion and stereo images, 3D feature point correspondences and re solving the motion parameters. Finally, the experimental results of acquiring th e motion parameters of the objects with uniform velocity and acceleration in the straight line based on the real binocular sequence images by the mentioned meth od are presented.展开更多
The scene matching navigation is a research focus in the field of autonomous navigation,but the real-time performance of image matching algorithm is difficult to meet the needs of real navigation systems.Therefore,thi...The scene matching navigation is a research focus in the field of autonomous navigation,but the real-time performance of image matching algorithm is difficult to meet the needs of real navigation systems.Therefore,this paper proposes a fast image matching algorithm.The algorithm improves the traditional line segment extraction algorithm and combines with the Delaunay triangulation method.By combining the geometric features of points and lines,the image feature redundancy is reduced.Then,the error with confidence criterion is analyzed and the matching process is completed.The simulation results show that the proposed algorithm can still work within 3°rotation and small scale variation.In addition,the matching time is less than 0.5 s when the image size is 256 pixel×256 pixel.The proposed algorithm is suitable for autonomous navigation systems with multiple feature distribution and higher real-time requirements.展开更多
基金funded by Natural Science Foundation of Jilin Province(20220101125JC)the National Natural Science Foundation of China(12273079).
文摘Lunar Laser Ranging has extremely high requirements for the pointing accuracy of the telescopes used.To improve its pointing accuracy and solve the problem of insufficiently accurate telescope pointing correction achieved by tracking stars in the all-sky region,we propose a processing scheme to select larger-sized lunar craters near the Lunar Corner Cube Retroreflector as reference features for telescope pointing bias computation.Accurately determining the position of the craters in the images is crucial for calculating the pointing bias;therefore,we propose a method for accurately calculating the crater position based on lunar surface feature matching.This method uses matched feature points obtained from image feature matching,using a deep learning method to solve the image transformation matrix.The known position of a crater in a reference image is mapped using this matrix to calculate the crater position in the target image.We validate this method using craters near the Lunar Corner Cube Retroreflectors of Apollo 15 and Luna 17 and find that the calculated position of a crater on the target image falls on the center of the crater,even for image features with large distortion near the lunar limb.The maximum image matching error is approximately 1″,and the minimum is only 0.47″,which meets the pointing requirements of Lunar Laser Ranging.This method provides a new technical means for the high-precision pointing bias calculation of the Lunar Laser Ranging system.
基金Supported by the Key Research Program of the Chinese Academy of Sciences(ZDRE-KT-2021-3)。
文摘Augmented solar images were used to research the adaptability of four representative image extraction and matching algorithms in space weather domain.These include the scale-invariant feature transform algorithm,speeded-up robust features algorithm,binary robust invariant scalable keypoints algorithm,and oriented fast and rotated brief algorithm.The performance of these algorithms was estimated in terms of matching accuracy,feature point richness,and running time.The experiment result showed that no algorithm achieved high accuracy while keeping low running time,and all algorithms are not suitable for image feature extraction and matching of augmented solar images.To solve this problem,an improved method was proposed by using two-frame matching to utilize the accuracy advantage of the scale-invariant feature transform algorithm and the speed advantage of the oriented fast and rotated brief algorithm.Furthermore,our method and the four representative algorithms were applied to augmented solar images.Our application experiments proved that our method achieved a similar high recognition rate to the scale-invariant feature transform algorithm which is significantly higher than other algorithms.Our method also obtained a similar low running time to the oriented fast and rotated brief algorithm,which is significantly lower than other algorithms.
基金Project(61070090)supported by the National Natural Science Foundation of ChinaProject(2012J4300030)supported by the GuangzhouScience and Technology Support Key Projects,China
文摘The mean Hausdorff distance, though highly applicable in image registration, does not work well on partial matching images. An improvement upon traditional Hausdorff-distance-based image registration method is proposed, which consists of the following two aspects. One is to estimate transformation parameters between two images from the distributions of geometric property differences instead of establishing explicit feature correspondences. This procedure is treated as the pre-registration. The other aspect is that mean Hausdorff distance computation is replaced with the analysis of the second difference of generalized Hausdorff distance so as to eliminate the redundant points. Experimental results show that our registration method outperforms the method based on mean Hausdorff distance. The registration errors are noticeably reduced in the partial matching images.
文摘An iterative algorithm to calculate mutual correlation using hierarchical key points and the search space mark principle is proposed. An effective algorithm is designed to improve the matching speed. By hi-erarchical key point algorithm and mutual correlation coefficients of the matching images, the important points can be iteratively calculated in the images hierarchically, and the correlation coefficient can be ob-tained with satisfactory precision. Massive spots in the parameter space which are impossible to match can be removed by the search space mark principle. Two approximate continuities in the correlation image matching process, the image gray level distribution continuity and the correlation coefficient value in the parameter space continuity, are considered in the method. The experiments show that the new algorithm can greatly enhance matching speed and achieve accurate matching results.
基金supported by National Natural Science Foundation of China (Grant No.41204026)Advanced Research Foundation (Grant No.9140A24060712KG13290)Open Fund of Key Laboratory of Science and Technology on Aerospace Flight Dynamics (Grant No.2012AFDL010)
文摘In the paper,a set of algorithms to construct synthetic aperture radar（SAR）matching suitable features are frstly proposed based on the evolutionary synthesis strategy.During the process,on the one hand,the indexes of primary matching suitable features（PMSFs）are designed based on the characteristics of image texture,SAR imaging and SAR matching algorithm,which is a process involving expertise;on the other hand,by designing a synthesized operation expression tree based on PMSFs,a much more flexible expression form of synthesized features is built,which greatly expands the construction space.Then,the genetic algorithm-based optimized searching process is employed to search the synthesized matching suitable feature（SMSF）with the highest effciency,largely improving the optimized searching effciency.In addition,the experimental results of the airborne synthetic aperture radar ortho-images of C-band and P-band show that the SMSFs gained via the algorithms can reflect the matching suitability of SAR images accurately and the matching probabilities of selected matching suitable areas of ortho-images could reach 99±0.5%.
基金Space Optoelectronic Measurement and Perception Lab(LabSOMP-2023-07)the National Natural Science Foundation ofChina(42241147)+1 种基金the State Key Laboratory of Geo-Information Engineering(SKLGIE2021-Z-3-1)and the Open Program of Collaborativeinnovation Center of Geo-information(2023C002)。
文摘This paper proposed an efficient method of image overlapping relationship analysis based on spatial index of KD tree fast search for disordered and large-scale asteroid images.In this study,the image data from asteroid exploration missions such as Bennu,Vesta,and Ryugu were used for experiments,and the proposed image matching pairs determination algorithm was comprehensively compared with the corresponding modules of USGS ISIS in order to evaluate its performance in terms of efficiency and accuracy.The results show that when processing more than a thousand images,the proposed method greatly improves the efficiency of acquiring image matching pairs while ensuring the correctness of image overlapping relationships and accuracy of bundle adjustment.At the same time,according to the obtained image matching pairs,images that meet the requirements of Stereo Photoclinometry can be quickly selected,effectively improving the quality of 3D reconstruction models of asteroid images.
基金National High-tech Research and Development Program (2007AA01Z314)National Natural Science Foundation of China (60873085)
文摘In order to obtain a large number of correct matches with high accuracy,this article proposes a robust wide baseline point matching method,which is based on Scott s proximity matrix and uses the scale invariant feature transform (SIFT). First,the distance between SIFT features is included in the equations of the proximity matrix to measure the similarity between two feature points; then the normalized cross correlation (NCC) used in Scott s method,which has been modified with adaptive scale and orientation,...
文摘Based on the inertial navigation system, the influences of the excursion of the inertial navigation system and the measurement error of the wireless pressure altimeter on the rotation and scale of the real image are quantitatively analyzed in scene matching. The log-polar transform （LPT） is utilized and an anti-rotation and anti- scale image matching algorithm is proposed based on the image edge feature point extraction. In the algorithm, the center point is combined with its four-neighbor points, and the corresponding computing process is put forward. Simulation results show that in the image rotation and scale variation range resulted from the navigation system error and the measurement error of the wireless pressure altimeter, the proposed image matching algo- rithm can satisfy the accuracy demands of the scene aided navigation system and provide the location error-correcting information of the system.
基金The authors would like to thank NVIDIA Corp.for donating the GPU used in this research through its GPU grant program.The first author Lin Chen would also like to thank the China Scholarship Council(CSC)for financially supporting his PhD study.
文摘In feature based image matching,distinctive features in images are detected and represented by feature descriptors.Matching is then carried out by assessing the similarity of the descriptors of potentially conjugate points.In this paper,we first shortly discuss the general frame-work.Then,we review feature detection as well as the determination of affine shape and orientation of local features,before analyzing feature description in more detail.In the feature description review,the general framework of local feature description is presented first.Then,the review discusses the evolution from hand-crafted feature descriptors,e.g.SIFT(Scale Invariant Feature Transform),to machine learning and deep learning based descriptors.The machine learning models,the training loss and the respective training data of learning-based algorithms are looked at in more detail;subsequently the various advantages and challenges of the different approaches are discussed.Finally,we present and assess some current research directions before concluding the paper.
基金co-supported by the National Natural Science Foundations of China(Nos.62175111 and 62001234)。
文摘Matching remote sensing images taken by an unmanned aerial vehicle(UAV) with satellite remote sensing images with geolocation information. Thus, the specific geographic location of the target object captured by the UAV is determined. Its main challenge is the considerable differences in the visual content of remote sensing images acquired by satellites and UAVs, such as dramatic changes in viewpoint, unknown orientations, etc. Much of the previous work has focused on image matching of homologous data. To overcome the difficulties caused by the difference between these two data modes and maintain robustness in visual positioning, a quality-aware template matching method based on scale-adaptive deep convolutional features is proposed by deeply mining their common features. The template size feature map and the reference image feature map are first obtained. The two feature maps obtained are used to measure the similarity. Finally, a heat map representing the probability of matching is generated to determine the best match in the reference image. The method is applied to the latest UAV-based geolocation dataset(University-1652 dataset) and the real-scene campus data we collected with UAVs. The experimental results demonstrate the effectiveness and superiority of the method.
基金This work was supported by the National Key Research and Development Program of China[grant number 2017YFC0803802]and the National Natural Science Foundation of China[grant number 41771486].
文摘Targeting at a reliable image matching of multiple remote sensing images for the generation of digital surface models,this paper presents a geometric-constrained multi-view image matching method,based on an energy minimization framework.By employing a geometrical constraint,the cost value of the energy function was calculated from multiple images,and the cost value was aggregated in an image space using a semi-global optimization approach.A homography transform parameter calculation method is proposed for fast calculation of projection pixel on each image when calculation cost values.It is based on the known interior orientation parameters,exterior orientation parameters,and a given elevation value.For an efficient and reliable processing of multiple remote sensing images,the proposed matching method was performed via a coarse-to-fine strategy through image pyramid.Three sets of airborne remote sensing images were used to evaluate the performance of the proposed method.Results reveal that the multi-view image matching can improve matching reliability.Moreover,the experimental results show that the proposed method performs better than traditional methods.
基金supported by the Foundation of Graduate Innovation Center in Nanjing University of Aeronautics and Astronautics(No.kfjj20191506)。
文摘In view of the fact that the traditional Hausdorff image matching algorithm is very sensitive to the image size as well as the unsatisfactory real-time performance in practical applications,an image matching algorithm is proposed based on the combination of Yolov3.Firstly,the features of the reference image are selected for pretraining,and then the training results are used to extract the features of the real images before the coordinates of the center points of the feature area are used to complete the coarse matching.Finally,the Hausdorff algorithm is used to complete the fine image matching.Experiments show that the proposed algorithm significantly improves the speed and accuracy of image matching.Also,it is robust to rotation changes.
文摘A novel algorithm is presented to make the results of image matching more reliable and accurate based on SIFT (Scale Invariant Feature Transform). SIFT algorithm has been identified as the most resistant matching algorithm to common image deformations; however, if there are similar regions in images, SIFT algorithm still generates some analogical descriptors and provides many mismatches. This paper examines the local image descriptor used by SIFT and presents a new algorithm by integrating SIFT with two-dimensional moment invariants and disparity gradient to improve the matching results. In the new algorithm, decision tree is used, and the whole matching process is divided into three levels with different primitives. Matching points are considered as correct ones only when they satisfy all the three similarity measurements. Experiment results demonstrate that the new approach is more reliable and accurate.
基金supported by the National Natural Science Foundation of China[Grant No.41771479]the National High-Resolution Earth Observation System(the Civil Part)[Grant No.50-H31D01-0508-13/15]the Japan Society for the Promotion of Science[Grant No.22H03573].
文摘Automatic Digital Orthophoto Map(DOM)generation plays an important role in many downstream works such as land use and cover detection,urban planning,and disaster assessment.Existing DOM generation methods can generate promising results but always need ground object filtered DEM generation before otho-rectification;this can consume much time and produce building facade contained results.To address this problem,a pixel-by-pixel digital differential rectification-based automatic DOM generation method is proposed in this paper.Firstly,3D point clouds with texture are generated by dense image matching based on an optical flow field for a stereo pair of images,respectively.Then,the grayscale of the digital differential rectification image is extracted directly from the point clouds element by element according to the nearest neighbor method for matched points.Subsequently,the elevation is repaired grid-by-grid using the multi-layer Locally Refined B-spline(LR-B)interpolation method with triangular mesh constraint for the point clouds void area,and the grayscale is obtained by the indirect scheme of digital differential rectification to generate the pixel-by-pixel digital differentially rectified image of a single image slice.Finally,a seamline network is automatically searched using a disparity map optimization algorithm,and DOM is smartly mosaicked.The qualitative and quantitative experimental results on three datasets were produced and evaluated,which confirmed the feasibility of the proposed method,and the DOM accuracy can reach 1 Ground Sample Distance(GSD)level.The comparison experiment with the state-of-the-art commercial softwares showed that the proposed method generated DOM has a better visual effect on building boundaries and roof completeness with comparable accuracy and computational efficiency.
文摘Histogram of collinear gradient-enhanced coding （HCGEC）, a robust key point descriptor for multi-spectral image matching, is proposed. The HCGEC mainly encodes rough structures within an image and suppresses detailed textural information, which is desirable in multi-spectral image matching. Experiments on two multi-spectral data sets demonstrate that the proposed descriptor can yield significantly better results than some state-of- the-art descriptors.
基金supported by the National Natural Science Foundation of China(61271315)the State Scholarship Fund of China
文摘Image matching based on scale invariant feature transform（SIFT） is one of the most popular image matching algorithms, which exhibits high robustness and accuracy. Grayscale images rather than color images are generally used to get SIFT descriptors in order to reduce the complexity. The regions which have a similar grayscale level but different hues tend to produce wrong matching results in this case. Therefore, the loss of color information may result in decreasing of matching ratio. An image matching algorithm based on SIFT is proposed, which adds a color offset and an exposure offset when converting color images to grayscale images in order to enhance the matching ratio. Experimental results show that the proposed algorithm can effectively differentiate the regions with different colors but the similar grayscale level, and increase the matching ratio of image matching based on SIFT. Furthermore, it does not introduce much complexity than the traditional SIFT.
基金supported by the National Natural Science Foundation of China,China(No.61801491)。
文摘Multi-modal image matching is crucial in aerospace applications because it can fully exploit the complementary and valuable information contained in the amount and diversity of remote sensing images.However,it remains a challenging task due to significant non-linear radiometric,geometric differences,and noise across different sensors.To improve the performance of heterologous image matching,this paper proposes a normalized self-similarity region descriptor to extract consistent structural information.We first construct the pointwise self-similarity region descriptor based on the Euclidean distance between adjacent image blocks to reflect the structural properties of multi-modal images.Then,a linear normalization approach is used to form Modality Independent Region Descriptor(MIRD),which can effectively distinguish structural features such as points,lines,corners,and flat between multi-modal images.To further improve the matching accuracy,the included angle cosine similarity metric is adopted to exploit the directional vector information of multi-dimensional feature descriptors.The experimental results show that the proposed MIRD has better matching accuracy and robustness for various multi-modal image matching than the state-of-the-art methods.MIRD can effectively extract consistent geometric structure features and suppress the influence of SAR speckle noise using non-local neighboring image blocks operation,effectively applied to various multi-modal image matching.
基金Funded by the Open Researeh Fund Program of the Geomatics and Applications Laboratory,Liaoning Technical University(No.2004010).
文摘In photogrammetry and remote sensing,image matching is a basic and crucial process for automatic DEM generation.In this paper we presented a image relaxation matching method based on feature points.This method can be considered as an extention of regular grid point based matching.It avoids the shortcome of grid point based matching.For example,with this method,we can avoid low or even no texture area where errors frequently appear in cross correlaton matching.In the mean while,it makes full use of some mature techniques such as probability relaxation,image pyramid and the like which have already been successfully used in grid point matching process.Application of the technique to DEM generaton in different regions proved that it is more reasonable and reliable.
文摘Exactly capturing three dimensional (3D) motion i nf ormation of an object is an essential and important task in computer vision, and is also one of the most difficult problems. In this paper, a binocular vision s ystem and a method for determining 3D motion parameters of an object from binocu lar sequence images are introduced. The main steps include camera calibration, t he matching of motion and stereo images, 3D feature point correspondences and re solving the motion parameters. Finally, the experimental results of acquiring th e motion parameters of the objects with uniform velocity and acceleration in the straight line based on the real binocular sequence images by the mentioned meth od are presented.
基金supported by the Fundation of Graduate Innovation Center in Nanjing University of Aeronautics and Astronautics (No.kfjj20191506)
文摘The scene matching navigation is a research focus in the field of autonomous navigation,but the real-time performance of image matching algorithm is difficult to meet the needs of real navigation systems.Therefore,this paper proposes a fast image matching algorithm.The algorithm improves the traditional line segment extraction algorithm and combines with the Delaunay triangulation method.By combining the geometric features of points and lines,the image feature redundancy is reduced.Then,the error with confidence criterion is analyzed and the matching process is completed.The simulation results show that the proposed algorithm can still work within 3°rotation and small scale variation.In addition,the matching time is less than 0.5 s when the image size is 256 pixel×256 pixel.The proposed algorithm is suitable for autonomous navigation systems with multiple feature distribution and higher real-time requirements.
