In feature based image matching,distinctive features in images are detected and represented by feature descriptors.Matching is then carried out by assessing the similarity of the descriptors of potentially conjugate p...In feature based image matching,distinctive features in images are detected and represented by feature descriptors.Matching is then carried out by assessing the similarity of the descriptors of potentially conjugate points.In this paper,we first shortly discuss the general frame-work.Then,we review feature detection as well as the determination of affine shape and orientation of local features,before analyzing feature description in more detail.In the feature description review,the general framework of local feature description is presented first.Then,the review discusses the evolution from hand-crafted feature descriptors,e.g.SIFT(Scale Invariant Feature Transform),to machine learning and deep learning based descriptors.The machine learning models,the training loss and the respective training data of learning-based algorithms are looked at in more detail;subsequently the various advantages and challenges of the different approaches are discussed.Finally,we present and assess some current research directions before concluding the paper.展开更多
During the last few years,artificial intelligence based on deep learning,and particularly based on convolutional neural networks,has acted as a game changer in just about all tasks related to photogrammetry and remote...During the last few years,artificial intelligence based on deep learning,and particularly based on convolutional neural networks,has acted as a game changer in just about all tasks related to photogrammetry and remote sensing.Results have shown partly significant improvements in many projects all across the photogrammetric processing chain from image orientation to surface reconstruction,scene classification as well as change detection,object extraction and object tracking and recognition in image sequences.This paper summarizes the foundations of deep learning for photogrammetry and remote sensing before illustrating,by way of example,different projects being carried out at the Institute of Photogrammetry and GeoInformation,Leibniz University Hannover,in this exciting and fast moving field of research and development.展开更多
基金The authors would like to thank NVIDIA Corp.for donating the GPU used in this research through its GPU grant program.The first author Lin Chen would also like to thank the China Scholarship Council(CSC)for financially supporting his PhD study.
文摘In feature based image matching,distinctive features in images are detected and represented by feature descriptors.Matching is then carried out by assessing the similarity of the descriptors of potentially conjugate points.In this paper,we first shortly discuss the general frame-work.Then,we review feature detection as well as the determination of affine shape and orientation of local features,before analyzing feature description in more detail.In the feature description review,the general framework of local feature description is presented first.Then,the review discusses the evolution from hand-crafted feature descriptors,e.g.SIFT(Scale Invariant Feature Transform),to machine learning and deep learning based descriptors.The machine learning models,the training loss and the respective training data of learning-based algorithms are looked at in more detail;subsequently the various advantages and challenges of the different approaches are discussed.Finally,we present and assess some current research directions before concluding the paper.
文摘During the last few years,artificial intelligence based on deep learning,and particularly based on convolutional neural networks,has acted as a game changer in just about all tasks related to photogrammetry and remote sensing.Results have shown partly significant improvements in many projects all across the photogrammetric processing chain from image orientation to surface reconstruction,scene classification as well as change detection,object extraction and object tracking and recognition in image sequences.This paper summarizes the foundations of deep learning for photogrammetry and remote sensing before illustrating,by way of example,different projects being carried out at the Institute of Photogrammetry and GeoInformation,Leibniz University Hannover,in this exciting and fast moving field of research and development.
