With the development of computer vision technology,panoramic image stitching has been widely used in fields such as scene reconstruction.A single traditional image cannot fully capture the panoramic view of the iconic...With the development of computer vision technology,panoramic image stitching has been widely used in fields such as scene reconstruction.A single traditional image cannot fully capture the panoramic view of the iconic East Gate of the South Campus of Shaanxi University of Technology.Therefore,this project aims to technically fuse multiple partial images into a complete panoramic image,enabling comprehensive recording and visual presentation of the architectural landscapes and spatial environments in this area.This report first introduces the technical background and application scenarios,clarifying the necessity of panoramic image stitching in campus landscape recording.It then elaborates on the core objectives and practical values,highlighting the role of technical solutions in improving image quality.Technically,a modular system design based on OpenCV is adopted,including modules such as image preprocessing,feature extraction and matching,image registration,fusion,and post-processing.Specifically,the SIFT algorithm is applied for feature extraction,KNN combined with ratio testing is used for feature matching,image registration is achieved by calculating the homography matrix,the fusion process utilizes multiband blending and Laplacian pyramid,and post-processing includes operations such as black area filling and CLAHE contrast enhancement.The experiment was conducted in a specific hardware and software environment using five overlapping images.After preprocessing,stitching,detail enhancement,and black edge repair,a panoramic image was successfully generated.The results show that the panoramic image fully presents the relevant scenery,with concealed seams,balanced exposure differences,and strong hierarchical details.This report provides a systematic description of the project’s technical implementation and achievement application.展开更多
Optical microscopes are essential tools for scientific research,but traditional microscopes are restricted to capturing only two-dimensional(2D)texture information,lacking comprehensive three-dimensional(3D)morphology...Optical microscopes are essential tools for scientific research,but traditional microscopes are restricted to capturing only two-dimensional(2D)texture information,lacking comprehensive three-dimensional(3D)morphology capabilities.Additionally,traditional microscopes are inherently constrained by the limited space-bandwidth product of optical systems,resulting in restricted depth of field(DOF)and field of view(FOV).Attempts to expand DOF and FOV typically come at the cost of diminished resolution.In this paper,we propose a texture-driven FOV stitching algorithm specifically designed for extended depth-of-field(EDOF)microscopy,allowing for the integration of 2D texture and 3D depth data to achieve high-resolution,high-throughput multimodal imaging.Experimental results demonstrate an 11-fold enhancement in DOF and an 8-fold expansion in FOV compared to traditional microscopes,while maintaining axial resolution after FOV extension.展开更多
Traditional feature-based image stitching techniques often encounter obstacles when dealing with images lackingunique attributes or suffering from quality degradation. The scarcity of annotated datasets in real-life s...Traditional feature-based image stitching techniques often encounter obstacles when dealing with images lackingunique attributes or suffering from quality degradation. The scarcity of annotated datasets in real-life scenesseverely undermines the reliability of supervised learning methods in image stitching. Furthermore, existing deeplearning architectures designed for image stitching are often too bulky to be deployed on mobile and peripheralcomputing devices. To address these challenges, this study proposes a novel unsupervised image stitching methodbased on the YOLOv8 (You Only Look Once version 8) framework that introduces deep homography networksand attentionmechanisms. Themethodology is partitioned into three distinct stages. The initial stage combines theattention mechanism with a pooling pyramid model to enhance the detection and recognition of compact objectsin images, the task of the deep homography networks module is to estimate the global homography of the inputimages consideringmultiple viewpoints. The second stage involves preliminary stitching of the masks generated inthe initial stage and further enhancement through weighted computation to eliminate common stitching artifacts.The final stage is characterized by adaptive reconstruction and careful refinement of the initial stitching results.Comprehensive experiments acrossmultiple datasets are executed tometiculously assess the proposed model. Ourmethod’s Peak Signal-to-Noise Ratio (PSNR) and Structure Similarity Index Measure (SSIM) improved by 10.6%and 6%. These experimental results confirm the efficacy and utility of the presented model in this paper.展开更多
Image/video stitching is a technology for solving the field of view(FOV)limitation of images/videos.It stitches multiple overlapping images/videos to generate a wide-FOV image/video,and has been used in various fields...Image/video stitching is a technology for solving the field of view(FOV)limitation of images/videos.It stitches multiple overlapping images/videos to generate a wide-FOV image/video,and has been used in various fields such as sports broadcasting,video surveillance,street view,and entertainment.This survey reviews image/video stitching algorithms,with a particular focus on those developed in recent years.Image stitching first calculates the corresponding relationships between multiple overlapping images,deforms and aligns the matched images,and then blends the aligned images to generate a wide-FOV image.A seamless method is always adopted to eliminate such potential flaws as ghosting and blurring caused by parallax or objects moving across the overlapping regions.Video stitching is the further extension of image stitching.It usually stitches selected frames of original videos to generate a stitching template by performing image stitching algorithms,and the subsequent frames can then be stitched according to the template.Video stitching is more complicated with moving objects or violent camera movement,because these factors introduce jitter,shakiness,ghosting,and blurring.Foreground detection technique is usually combined into stitching to eliminate ghosting and blurring,while video stabilization algorithms are adopted to solve the jitter and shakiness.This paper further discusses panoramic stitching as a special-extension of image/video stitching.Panoramic stitching is currently the most widely used application in stitching.This survey reviews the latest image/video stitching methods,and introduces the fundamental principles/advantages/weaknesses of image/video stitching algorithms.Image/video stitching faces long-term challenges such as wide baseline,large parallax,and low-texture problem in the overlapping region.New technologies may present new opportunities to address these issues,such as deep learning-based semantic correspondence,and 3D image stitching.Finally,this survey discusses the challenges of image/video stitching and proposes potential solutions.展开更多
Oral endoscope image stitching algorithm is studied to obtain wide-field oral images through regis-tration and stitching,which is of great significance for auxiliary diagnosis.Compared with natural images,oral images ...Oral endoscope image stitching algorithm is studied to obtain wide-field oral images through regis-tration and stitching,which is of great significance for auxiliary diagnosis.Compared with natural images,oral images have lower textures and fewer features.However,traditional feature-based image stitching methods rely heavily on feature extraction quality,often showing an unsatisfactory performance when stitching images with few features.Moreover,due to the hand-held shooting,there are large depth and perspective disparities between the captured images,which also pose a challenge to image stitching.To overcome the above problems,we propose an unsupervised oral endoscope image stitching algorithm based on the extraction of overlapping regions and the loss of deep features.In the registration stage,we extract the overlapping region of the input images by sketching polygon intersection for feature points screening and estimate homography from coarse to fine on a three-layer feature pyramid structure.Moreover,we calculate loss using deep features instead of pixel values to emphasize the importance of depth disparities in homography estimation.Finally,we reconstruct the stitched images from feature to pixel,which can eliminate artifacts caused by large parallax.Our method is compared with both feature-based and previous deep-based methods on the UDIS-D dataset and our oral endoscopy image dataset.The experimental results show that our algorithm can achieve higher homography estimation accuracy,and better visual quality,and can be effectively applied to oral endoscope image stitching.展开更多
A multi layer gridless area router is reported.Based on corner stitching,this router adopts tile expansion to explore path for each net.A heuristic method that penalizes nodes deviating from the destination is devise...A multi layer gridless area router is reported.Based on corner stitching,this router adopts tile expansion to explore path for each net.A heuristic method that penalizes nodes deviating from the destination is devised to accelerate the algorithm.Besides,an enhanced interval tree is used to manage the intermediate data structure.In order to improve the completion rate of routing,a new gridless rip up and rerouting algorithm is proposed.The experimental results indicate that the completion rate is improved after the rip up and reroute process and the speed of this algorithm is satisfactory.展开更多
According to the bio-characteristics of the lower and upper cavity surfaces of dental restoration, a stitching approach is proposed based on a virtual zipper working mechanism and a minimization of the surface total c...According to the bio-characteristics of the lower and upper cavity surfaces of dental restoration, a stitching approach is proposed based on a virtual zipper working mechanism and a minimization of the surface total curvature energy, which is used to resolve the stitching problems existing during computer-aided design for dental restorations. First, the two boundaries corresponding to the lower and upper surfaces are triangulated based on the zipper working mechanism to generate the initial stitching surface patch, of which the edges are distributed uniformly between the boundaries. Secondly, the initial stitching surface patch is subdivided and deformed to reconstruct an optimized surface patch according to the bio-characteristics of the teeth. The optimized surface patch is minimally distinguishable from the surrounding mesh in smoothness and density, and it can stitch the upper and lower cavity surfaces naturally. The experimental results show that the dental restorations obtained by the proposed method can satisfy both the shape aesthetic and the fitting accuracy, and meet the requirements of clinical oral medicine.展开更多
Experimental and analytical investigation is conducted to explore the effects of stitching on plain （without hole） and open-hole compressive and tensile strength of uniweave T300/QY9512 laminates under different env...Experimental and analytical investigation is conducted to explore the effects of stitching on plain （without hole） and open-hole compressive and tensile strength of uniweave T300/QY9512 laminates under different environmental conditions （20 ℃/dry and wet, 150 ℃/dry and wet）. Strength performance of stitched composite laminates is also studied using finite element analysis （FEA） model and compared with the experimental results to validate the model. It is found that under similar environmental conditions, the open-hole compressive strength of stitched laminate is decreased and open-hole tensile strength increased as compared to the unstitched laminates. Predicted tensile and compressive strengths are found to be in a good agreement with the test results and the relative error in all cases is less than 15%.展开更多
A novel automatic seamless stitching method is presented. Compared to the traditional method, it can speed the processing and minimize the utilization of human resources to produce global lunar map. Meanwhile, a new g...A novel automatic seamless stitching method is presented. Compared to the traditional method, it can speed the processing and minimize the utilization of human resources to produce global lunar map. Meanwhile, a new global image map of the Moon with spatial resolution of -120 m has been completed by the proposed method from Chang＇E-1 CCD image data.展开更多
Stripes are artifacts in satellite images caused by various factors such as hardware defects. In some cases, these artifacts are introduced by some mitigating algorithms like Landsat SLC-off （Scan Line Corrector） ga...Stripes are artifacts in satellite images caused by various factors such as hardware defects. In some cases, these artifacts are introduced by some mitigating algorithms like Landsat SLC-off （Scan Line Corrector） gap-filling methods of LLHM （Local Linear Histogram Matching） and AWLHM （Adaptive Window Linear Histogram Matching）, which leave stripes as a byproduct. To improve Landsat SLC-off images with stripes,we propose an algorithm involving some hypothetical stripe-crossing stitch lines using the mean pixel value of the stitch lines.展开更多
At present,underwater terrain images are all strip-shaped small fragment images preprocessed by the side-scan sonar imaging system.However,the processed underwater terrain images have inconspicuous and few feature poi...At present,underwater terrain images are all strip-shaped small fragment images preprocessed by the side-scan sonar imaging system.However,the processed underwater terrain images have inconspicuous and few feature points.In order to better realize the stitching of underwater terrain images and solve the problems of slow traditional image stitching speed,we proposed an improved algorithm for underwater terrain image stitching based on spatial gradient feature block.First,the spatial gradient fuzzy C-Means algorithm is used to divide the underwater terrain image into feature blocks with the fusion of spatial gradient information.The accelerated-KAZE(AKAZE)algorithm is used to combine the feature block information to match the reference image and the target image.Then,the random sample consensus(RANSAC)is applied to optimize the matching results.Finally,image fusion is performed with the global homography and the optimal seam-line method to improve the accuracy of image overlay fusion.The experimental results show that the proposed method in this paper effectively divides images into feature blocks by combining spatial information and gradient information,which not only solves the problem of stitching failure of underwater terrain images due to unobvious features,and further reduces the sensitivity to noise,but also effectively reduces the iterative calculation in the feature point matching process of the traditional method,and improves the stitching speed.Ghosting and shape warping are significantly eliminated by re-optimizing the overlap of the image.展开更多
The lunar map is a product of primary scientific objectives of lunar exploration. Aiming at the characteristics of the Chang＇E-2 CCD data, an automatic stitching method used for 2C level CCD data from Chang＇E-2 luna...The lunar map is a product of primary scientific objectives of lunar exploration. Aiming at the characteristics of the Chang＇E-2 CCD data, an automatic stitching method used for 2C level CCD data from Chang＇E-2 lunar mission is proposed. Combining with the image registration technique and the characteristics of Chang＇E CCD images, the fast method proposed not only can overcome the contradiction of the high spatial resolution of the CCD images and the low positioning accuracy of the location coordinates, but also can speed up the processing and minimize the utilization of human resources to produce lunar mosaic map. Meanwhile, a new lunar map from 70oN to 70oS with spatial resolution of less than 10 m has been completed by the proposed method. Its average relative location accuracy of the adjacent orbits CCD image data is less than 3 pixels.展开更多
This paper presents a new method for simultaneously eliminating visual artifacts caused by moving objects and structure misalignment in image stitching. Given that the input images are roughly aligned, our approach is...This paper presents a new method for simultaneously eliminating visual artifacts caused by moving objects and structure misalignment in image stitching. Given that the input images are roughly aligned, our approach is implemented in two stages. In the first stage, we discover motions between input images, and then extract their corresponding regions through a multi-seed based region growing algorithm. In the second stage, with prior information provided by the extracted regions, we perform a graph cut optimization in gradient-domain to determine which pixels to use from each image to achieve seamless stitching. Our method is simple to implement and effective. The experimental results illustrate that the proposed approach can produce comparable or superior results in comparison with state-of-the-art methods.展开更多
The looper drive mechanism is a main moving part in the blind stitching machine, which is aspatial 5 bar RRRSR linkage. In this paper, a dynamic analysis of the looper drive mechanism is made by means of the ma-trix m...The looper drive mechanism is a main moving part in the blind stitching machine, which is aspatial 5 bar RRRSR linkage. In this paper, a dynamic analysis of the looper drive mechanism is made by means of the ma-trix method. Two methods are adopted in the calculation of the shaking force and shaking moment, one isdone by the constraint reaction of the flame-connected kinematic parts; the other is the inertialforces of all moving links.展开更多
Branch identification technology is a key technology to achieve automated pruning of fruit tree branches, and one of its technical bottlenecks lies in the stitching of branch images. To this end, we propose a set of b...Branch identification technology is a key technology to achieve automated pruning of fruit tree branches, and one of its technical bottlenecks lies in the stitching of branch images. To this end, we propose a set of branch image stitching technology algorithms. The algorithm is based on the grey-scale prime centroid method to determine the detection feature points, and uses the coordinate transformation matrix H of the corresponding points of the image to carry out the image geometric transformation, and realises the feature matching through sample comparison and classification methods. The experimental results show that the matched point images are more correct and less time-consuming.展开更多
The proliferation of low-altitude economic activities has precipitated a significant expansion in the application domains of Unmanned Aerial Vehicle(UAV),transcending the constraints of singular platform operation.Mul...The proliferation of low-altitude economic activities has precipitated a significant expansion in the application domains of Unmanned Aerial Vehicle(UAV),transcending the constraints of singular platform operation.Multi-UAV cooperative online remote sensing image stitching involves several challenges,including image blurriness and deformation caused by platform vibrations,as well as managing vast amounts of data and addressing transmission delays.This paper introduces a real-time system for multi-UAV video stitching that integrates hardware acceleration,pose-guided ROI filtering,and temporal consistency constraints.Data from the onboard GPS and Inertial Measurement Unit(IMU)are used to estimate the overlap between two aerial images.Subsequently,the Graphics Processing Unit(GPU)within an edge computing platform is tasked with swiftly detecting SIFT features within the overlapping image sectors.Feature point matching is performed using a position-guided matching algorithm to compute the homography matrix.The results demonstrate that the RK3588-based edge computing platform exhibits rapid image decoding and stitching capabilities,with an average stitching latency of 36.43ms.Furthermore,this study developed a ground-based human-machine interaction system to present stitched video streams in realtime,thereby improving the operational efficiency and visual quality of multi-UAV aerial surveillance.展开更多
Various yarn-shaped flexible strain sensors have recently been developed.However,research is lacking on additive manufacturing for smart clothing for integrating yarn sensors with commercial garments.Herein,a strain-s...Various yarn-shaped flexible strain sensors have recently been developed.However,research is lacking on additive manufacturing for smart clothing for integrating yarn sensors with commercial garments.Herein,a strain-sensing yarn is sewn into a piece of fabric through a novel stitching technique,and the influence of the stitching method and needle pitch on the sensing performance is investigated using finite element analysis(FEA).The sensing performance could be improved when the sensing yarn is self-locked in the fabric at the needle eyes,and the needle pitch was reduced to 0.5 cm,which is attributed to the enhanced stress and strain concentration.Meanwhile,the composite sensing fabric featured outstanding performance,including a low detection limit(0.1%),rapid response(280 ms),excellent durability(10000 cycles),and high stability(negligible drift and frequency independence).In addition,the remarkable wear resistance,washability,and anti-interference to ambient humidity and perspiration were obtained.Therein,the optimal stitch trace lengths of sensing yarn for detecting elbow motion,breathing,and heartbeats are discussed.Finally,a smart clothing system composed of smart clothing,data acquisition unit,and mobile APP was developed to simultaneously detect human movement and physiological signals.This work provides a reference to produce intelligent garments based on yarn sensors for health monitoring.展开更多
Accurate watermelon yield estimation is crucial to the agricultural value chain,as it guides the allocation of agricultural resources as well as facilitates inventory and logistics planning.The conventional method of ...Accurate watermelon yield estimation is crucial to the agricultural value chain,as it guides the allocation of agricultural resources as well as facilitates inventory and logistics planning.The conventional method of watermelon yield estimation relies heavily onmanual labor,which is both time-consuming and labor-intensive.To address this,this work proposes an algorithmic pipeline that utilizes unmanned aerial vehicle(UAV)videos for detection and counting of watermelons.This pipeline uses You Only Look Once version 8 s(YOLOv8s)with panorama stitching and overlap partitioning,which facilitates the overall number estimation ofwatermelons in field.The watermelon detection model,based on YOLOv8s and obtained using transfer learning,achieved a detection accuracy of 99.20%,demonstrating its potential for application in yield estimation.The panorama stitching and overlap partitioning based detection and counting method uses panoramic images as input and effectively mitigates the duplications comparedwith the video tracking based detection and countingmethod.The counting accuracy reached over 96.61%,proving a promising application for yield estimation.The high accuracy demonstrates the feasibility of applying this method for overall yield estimation in large watermelon fields.展开更多
In the automated packaging production line of industrial systems, various stitching defects of packaging bags are inevitable hence the automated detection technology for stitching defects based on digital image proces...In the automated packaging production line of industrial systems, various stitching defects of packaging bags are inevitable hence the automated detection technology for stitching defects based on digital image processing plays a crucial role in improving the quality and reliability of the packaging production line. This paper proposes a novel stitching defect detection method based on Vision Transformers. image preprocessing procedures such as image correction and cropping recognition are performed to construct the raw stitching defect dataset. The pre-trained ViT_Base_Patch16_224_In21k and MobileViT-XXS networks are proposed by transfer learning methods to improve the recognition of stitching defects. Six sets of experiments are performed on image data taken on a packaging production line, and on the test set, the defect detection models' accuracy rates achieve 0.95 and 0.989, respectively. The experimental results reveal that the proposed method can be effectively applied for online automatic detection of stitching defects in packaging production lines and has industrial application significance.展开更多
Subaperture stitching （SAS） provides us with an attractive way of extending the effective aperture and dynamic range of phase measuring interferometers. Accuracy of stitching algorithm becomes the key factor in the ...Subaperture stitching （SAS） provides us with an attractive way of extending the effective aperture and dynamic range of phase measuring interferometers. Accuracy of stitching algorithm becomes the key factor in the SAS technology. In this paper, the basic principle of SAS was introduced and four modes of SAS were discussed. The stitching experiments were done through the SSI-300 workstation designed and developed indepen- dently. There were several comparisons between the four different stitching methods and the measurement of full aperture. The results suggest that the global error averaging mode with reference of subaperture near optic axis is of high precision.展开更多
文摘With the development of computer vision technology,panoramic image stitching has been widely used in fields such as scene reconstruction.A single traditional image cannot fully capture the panoramic view of the iconic East Gate of the South Campus of Shaanxi University of Technology.Therefore,this project aims to technically fuse multiple partial images into a complete panoramic image,enabling comprehensive recording and visual presentation of the architectural landscapes and spatial environments in this area.This report first introduces the technical background and application scenarios,clarifying the necessity of panoramic image stitching in campus landscape recording.It then elaborates on the core objectives and practical values,highlighting the role of technical solutions in improving image quality.Technically,a modular system design based on OpenCV is adopted,including modules such as image preprocessing,feature extraction and matching,image registration,fusion,and post-processing.Specifically,the SIFT algorithm is applied for feature extraction,KNN combined with ratio testing is used for feature matching,image registration is achieved by calculating the homography matrix,the fusion process utilizes multiband blending and Laplacian pyramid,and post-processing includes operations such as black area filling and CLAHE contrast enhancement.The experiment was conducted in a specific hardware and software environment using five overlapping images.After preprocessing,stitching,detail enhancement,and black edge repair,a panoramic image was successfully generated.The results show that the panoramic image fully presents the relevant scenery,with concealed seams,balanced exposure differences,and strong hierarchical details.This report provides a systematic description of the project’s technical implementation and achievement application.
基金supported by Science Foundation of Donghai Lab-oratory(No.DH-2022KF01001).
文摘Optical microscopes are essential tools for scientific research,but traditional microscopes are restricted to capturing only two-dimensional(2D)texture information,lacking comprehensive three-dimensional(3D)morphology capabilities.Additionally,traditional microscopes are inherently constrained by the limited space-bandwidth product of optical systems,resulting in restricted depth of field(DOF)and field of view(FOV).Attempts to expand DOF and FOV typically come at the cost of diminished resolution.In this paper,we propose a texture-driven FOV stitching algorithm specifically designed for extended depth-of-field(EDOF)microscopy,allowing for the integration of 2D texture and 3D depth data to achieve high-resolution,high-throughput multimodal imaging.Experimental results demonstrate an 11-fold enhancement in DOF and an 8-fold expansion in FOV compared to traditional microscopes,while maintaining axial resolution after FOV extension.
基金Science and Technology Research Project of the Henan Province(222102240014).
文摘Traditional feature-based image stitching techniques often encounter obstacles when dealing with images lackingunique attributes or suffering from quality degradation. The scarcity of annotated datasets in real-life scenesseverely undermines the reliability of supervised learning methods in image stitching. Furthermore, existing deeplearning architectures designed for image stitching are often too bulky to be deployed on mobile and peripheralcomputing devices. To address these challenges, this study proposes a novel unsupervised image stitching methodbased on the YOLOv8 (You Only Look Once version 8) framework that introduces deep homography networksand attentionmechanisms. Themethodology is partitioned into three distinct stages. The initial stage combines theattention mechanism with a pooling pyramid model to enhance the detection and recognition of compact objectsin images, the task of the deep homography networks module is to estimate the global homography of the inputimages consideringmultiple viewpoints. The second stage involves preliminary stitching of the masks generated inthe initial stage and further enhancement through weighted computation to eliminate common stitching artifacts.The final stage is characterized by adaptive reconstruction and careful refinement of the initial stitching results.Comprehensive experiments acrossmultiple datasets are executed tometiculously assess the proposed model. Ourmethod’s Peak Signal-to-Noise Ratio (PSNR) and Structure Similarity Index Measure (SSIM) improved by 10.6%and 6%. These experimental results confirm the efficacy and utility of the presented model in this paper.
基金the National Natural Science Foundation of China(61872023).
文摘Image/video stitching is a technology for solving the field of view(FOV)limitation of images/videos.It stitches multiple overlapping images/videos to generate a wide-FOV image/video,and has been used in various fields such as sports broadcasting,video surveillance,street view,and entertainment.This survey reviews image/video stitching algorithms,with a particular focus on those developed in recent years.Image stitching first calculates the corresponding relationships between multiple overlapping images,deforms and aligns the matched images,and then blends the aligned images to generate a wide-FOV image.A seamless method is always adopted to eliminate such potential flaws as ghosting and blurring caused by parallax or objects moving across the overlapping regions.Video stitching is the further extension of image stitching.It usually stitches selected frames of original videos to generate a stitching template by performing image stitching algorithms,and the subsequent frames can then be stitched according to the template.Video stitching is more complicated with moving objects or violent camera movement,because these factors introduce jitter,shakiness,ghosting,and blurring.Foreground detection technique is usually combined into stitching to eliminate ghosting and blurring,while video stabilization algorithms are adopted to solve the jitter and shakiness.This paper further discusses panoramic stitching as a special-extension of image/video stitching.Panoramic stitching is currently the most widely used application in stitching.This survey reviews the latest image/video stitching methods,and introduces the fundamental principles/advantages/weaknesses of image/video stitching algorithms.Image/video stitching faces long-term challenges such as wide baseline,large parallax,and low-texture problem in the overlapping region.New technologies may present new opportunities to address these issues,such as deep learning-based semantic correspondence,and 3D image stitching.Finally,this survey discusses the challenges of image/video stitching and proposes potential solutions.
基金the National Natural Science Foundation of China(No.61976091)。
文摘Oral endoscope image stitching algorithm is studied to obtain wide-field oral images through regis-tration and stitching,which is of great significance for auxiliary diagnosis.Compared with natural images,oral images have lower textures and fewer features.However,traditional feature-based image stitching methods rely heavily on feature extraction quality,often showing an unsatisfactory performance when stitching images with few features.Moreover,due to the hand-held shooting,there are large depth and perspective disparities between the captured images,which also pose a challenge to image stitching.To overcome the above problems,we propose an unsupervised oral endoscope image stitching algorithm based on the extraction of overlapping regions and the loss of deep features.In the registration stage,we extract the overlapping region of the input images by sketching polygon intersection for feature points screening and estimate homography from coarse to fine on a three-layer feature pyramid structure.Moreover,we calculate loss using deep features instead of pixel values to emphasize the importance of depth disparities in homography estimation.Finally,we reconstruct the stitched images from feature to pixel,which can eliminate artifacts caused by large parallax.Our method is compared with both feature-based and previous deep-based methods on the UDIS-D dataset and our oral endoscopy image dataset.The experimental results show that our algorithm can achieve higher homography estimation accuracy,and better visual quality,and can be effectively applied to oral endoscope image stitching.
文摘A multi layer gridless area router is reported.Based on corner stitching,this router adopts tile expansion to explore path for each net.A heuristic method that penalizes nodes deviating from the destination is devised to accelerate the algorithm.Besides,an enhanced interval tree is used to manage the intermediate data structure.In order to improve the completion rate of routing,a new gridless rip up and rerouting algorithm is proposed.The experimental results indicate that the completion rate is improved after the rip up and reroute process and the speed of this algorithm is satisfactory.
基金The National High Technology Research and Development Program of China(863 Program)(No.2005AA420240)the Key Science and Technology Program of Jiangsu Province (No.BE2005014)
文摘According to the bio-characteristics of the lower and upper cavity surfaces of dental restoration, a stitching approach is proposed based on a virtual zipper working mechanism and a minimization of the surface total curvature energy, which is used to resolve the stitching problems existing during computer-aided design for dental restorations. First, the two boundaries corresponding to the lower and upper surfaces are triangulated based on the zipper working mechanism to generate the initial stitching surface patch, of which the edges are distributed uniformly between the boundaries. Secondly, the initial stitching surface patch is subdivided and deformed to reconstruct an optimized surface patch according to the bio-characteristics of the teeth. The optimized surface patch is minimally distinguishable from the surrounding mesh in smoothness and density, and it can stitch the upper and lower cavity surfaces naturally. The experimental results show that the dental restorations obtained by the proposed method can satisfy both the shape aesthetic and the fitting accuracy, and meet the requirements of clinical oral medicine.
基金National Natural Science Foundation of China(10672009)Basic Science Foundation of Aviation(05B51044)"FanZhou" Youth Scientific Funds(20060501)
文摘Experimental and analytical investigation is conducted to explore the effects of stitching on plain （without hole） and open-hole compressive and tensile strength of uniweave T300/QY9512 laminates under different environmental conditions （20 ℃/dry and wet, 150 ℃/dry and wet）. Strength performance of stitched composite laminates is also studied using finite element analysis （FEA） model and compared with the experimental results to validate the model. It is found that under similar environmental conditions, the open-hole compressive strength of stitched laminate is decreased and open-hole tensile strength increased as compared to the unstitched laminates. Predicted tensile and compressive strengths are found to be in a good agreement with the test results and the relative error in all cases is less than 15%.
基金supported by the Science and Technology Development Fund of Macao (Nos. 004/2011/A1 and 015/2010/A)the National High Technology Research and Development Program (No. 2010AA122202)
文摘A novel automatic seamless stitching method is presented. Compared to the traditional method, it can speed the processing and minimize the utilization of human resources to produce global lunar map. Meanwhile, a new global image map of the Moon with spatial resolution of -120 m has been completed by the proposed method from Chang＇E-1 CCD image data.
文摘Stripes are artifacts in satellite images caused by various factors such as hardware defects. In some cases, these artifacts are introduced by some mitigating algorithms like Landsat SLC-off （Scan Line Corrector） gap-filling methods of LLHM （Local Linear Histogram Matching） and AWLHM （Adaptive Window Linear Histogram Matching）, which leave stripes as a byproduct. To improve Landsat SLC-off images with stripes,we propose an algorithm involving some hypothetical stripe-crossing stitch lines using the mean pixel value of the stitch lines.
基金This research was funded by College Student Innovation and Entrepreneurship Training Program,Grant Number 2021055Z and S202110082031the Special Project for Cultivating Scientific and Technological Innovation Ability of College and Middle School Students in Hebei Province,Grant Number 2021H011404.
文摘At present,underwater terrain images are all strip-shaped small fragment images preprocessed by the side-scan sonar imaging system.However,the processed underwater terrain images have inconspicuous and few feature points.In order to better realize the stitching of underwater terrain images and solve the problems of slow traditional image stitching speed,we proposed an improved algorithm for underwater terrain image stitching based on spatial gradient feature block.First,the spatial gradient fuzzy C-Means algorithm is used to divide the underwater terrain image into feature blocks with the fusion of spatial gradient information.The accelerated-KAZE(AKAZE)algorithm is used to combine the feature block information to match the reference image and the target image.Then,the random sample consensus(RANSAC)is applied to optimize the matching results.Finally,image fusion is performed with the global homography and the optimal seam-line method to improve the accuracy of image overlay fusion.The experimental results show that the proposed method in this paper effectively divides images into feature blocks by combining spatial information and gradient information,which not only solves the problem of stitching failure of underwater terrain images due to unobvious features,and further reduces the sensitivity to noise,but also effectively reduces the iterative calculation in the feature point matching process of the traditional method,and improves the stitching speed.Ghosting and shape warping are significantly eliminated by re-optimizing the overlap of the image.
基金supported in part by the Science and Technology Development Fund of Macao,China (Nos.048/2016/A2,110/2014/A3,091/2013/A3,084/2012/A3,and 048/2012/A2)the National Natural Science Foundation of China (Nos.61170320 and 61272364)the Open Project Program of the State Key Lab of CAD & CG of Zhejiang University (No.A1513)
文摘The lunar map is a product of primary scientific objectives of lunar exploration. Aiming at the characteristics of the Chang＇E-2 CCD data, an automatic stitching method used for 2C level CCD data from Chang＇E-2 lunar mission is proposed. Combining with the image registration technique and the characteristics of Chang＇E CCD images, the fast method proposed not only can overcome the contradiction of the high spatial resolution of the CCD images and the low positioning accuracy of the location coordinates, but also can speed up the processing and minimize the utilization of human resources to produce lunar mosaic map. Meanwhile, a new lunar map from 70oN to 70oS with spatial resolution of less than 10 m has been completed by the proposed method. Its average relative location accuracy of the adjacent orbits CCD image data is less than 3 pixels.
文摘This paper presents a new method for simultaneously eliminating visual artifacts caused by moving objects and structure misalignment in image stitching. Given that the input images are roughly aligned, our approach is implemented in two stages. In the first stage, we discover motions between input images, and then extract their corresponding regions through a multi-seed based region growing algorithm. In the second stage, with prior information provided by the extracted regions, we perform a graph cut optimization in gradient-domain to determine which pixels to use from each image to achieve seamless stitching. Our method is simple to implement and effective. The experimental results illustrate that the proposed approach can produce comparable or superior results in comparison with state-of-the-art methods.
文摘The looper drive mechanism is a main moving part in the blind stitching machine, which is aspatial 5 bar RRRSR linkage. In this paper, a dynamic analysis of the looper drive mechanism is made by means of the ma-trix method. Two methods are adopted in the calculation of the shaking force and shaking moment, one isdone by the constraint reaction of the flame-connected kinematic parts; the other is the inertialforces of all moving links.
文摘Branch identification technology is a key technology to achieve automated pruning of fruit tree branches, and one of its technical bottlenecks lies in the stitching of branch images. To this end, we propose a set of branch image stitching technology algorithms. The algorithm is based on the grey-scale prime centroid method to determine the detection feature points, and uses the coordinate transformation matrix H of the corresponding points of the image to carry out the image geometric transformation, and realises the feature matching through sample comparison and classification methods. The experimental results show that the matched point images are more correct and less time-consuming.
基金funded by Graduate innovation program of National University of Defense Technology,grant number:XJZH2024016.
文摘The proliferation of low-altitude economic activities has precipitated a significant expansion in the application domains of Unmanned Aerial Vehicle(UAV),transcending the constraints of singular platform operation.Multi-UAV cooperative online remote sensing image stitching involves several challenges,including image blurriness and deformation caused by platform vibrations,as well as managing vast amounts of data and addressing transmission delays.This paper introduces a real-time system for multi-UAV video stitching that integrates hardware acceleration,pose-guided ROI filtering,and temporal consistency constraints.Data from the onboard GPS and Inertial Measurement Unit(IMU)are used to estimate the overlap between two aerial images.Subsequently,the Graphics Processing Unit(GPU)within an edge computing platform is tasked with swiftly detecting SIFT features within the overlapping image sectors.Feature point matching is performed using a position-guided matching algorithm to compute the homography matrix.The results demonstrate that the RK3588-based edge computing platform exhibits rapid image decoding and stitching capabilities,with an average stitching latency of 36.43ms.Furthermore,this study developed a ground-based human-machine interaction system to present stitched video streams in realtime,thereby improving the operational efficiency and visual quality of multi-UAV aerial surveillance.
基金supported by the Qing Lan Projectthe Third-Priority Academic Program Development of Jiangsu Higher Education Institutions+1 种基金the Science and Technology Guidance Project of China National Textile and Apparel Council(Grant No.2020102)the Primary Research&Development Plan of Jiangsu Province(Grant No.BE2019045)。
文摘Various yarn-shaped flexible strain sensors have recently been developed.However,research is lacking on additive manufacturing for smart clothing for integrating yarn sensors with commercial garments.Herein,a strain-sensing yarn is sewn into a piece of fabric through a novel stitching technique,and the influence of the stitching method and needle pitch on the sensing performance is investigated using finite element analysis(FEA).The sensing performance could be improved when the sensing yarn is self-locked in the fabric at the needle eyes,and the needle pitch was reduced to 0.5 cm,which is attributed to the enhanced stress and strain concentration.Meanwhile,the composite sensing fabric featured outstanding performance,including a low detection limit(0.1%),rapid response(280 ms),excellent durability(10000 cycles),and high stability(negligible drift and frequency independence).In addition,the remarkable wear resistance,washability,and anti-interference to ambient humidity and perspiration were obtained.Therein,the optimal stitch trace lengths of sensing yarn for detecting elbow motion,breathing,and heartbeats are discussed.Finally,a smart clothing system composed of smart clothing,data acquisition unit,and mobile APP was developed to simultaneously detect human movement and physiological signals.This work provides a reference to produce intelligent garments based on yarn sensors for health monitoring.
基金supported by the National Natural Science Foundation of China(32371999)Science and Technology Program of Yulin City,China(2023-CXY-183)+1 种基金Open Project of Key Laboratory of Agricultural Equipment for Hilly and Mountainous Areas in Southeastern China(Co-construction by Ministry and Province),Ministry of Agriculture and Rural Affairs,China(QSKF2023002)National Foreign Expert Project,Ministry of Science and Technology,China(QN2022172006L,DL2022172003L).
文摘Accurate watermelon yield estimation is crucial to the agricultural value chain,as it guides the allocation of agricultural resources as well as facilitates inventory and logistics planning.The conventional method of watermelon yield estimation relies heavily onmanual labor,which is both time-consuming and labor-intensive.To address this,this work proposes an algorithmic pipeline that utilizes unmanned aerial vehicle(UAV)videos for detection and counting of watermelons.This pipeline uses You Only Look Once version 8 s(YOLOv8s)with panorama stitching and overlap partitioning,which facilitates the overall number estimation ofwatermelons in field.The watermelon detection model,based on YOLOv8s and obtained using transfer learning,achieved a detection accuracy of 99.20%,demonstrating its potential for application in yield estimation.The panorama stitching and overlap partitioning based detection and counting method uses panoramic images as input and effectively mitigates the duplications comparedwith the video tracking based detection and countingmethod.The counting accuracy reached over 96.61%,proving a promising application for yield estimation.The high accuracy demonstrates the feasibility of applying this method for overall yield estimation in large watermelon fields.
基金supported by the National Natural Science Foundation of China(Grant No.62176240)Beijing Natural Science Foundation(Grant No.4222038)+1 种基金the project of the Communication University of China(Grant No.HG23035)Public Computing Cloud,CUC
文摘In the automated packaging production line of industrial systems, various stitching defects of packaging bags are inevitable hence the automated detection technology for stitching defects based on digital image processing plays a crucial role in improving the quality and reliability of the packaging production line. This paper proposes a novel stitching defect detection method based on Vision Transformers. image preprocessing procedures such as image correction and cropping recognition are performed to construct the raw stitching defect dataset. The pre-trained ViT_Base_Patch16_224_In21k and MobileViT-XXS networks are proposed by transfer learning methods to improve the recognition of stitching defects. Six sets of experiments are performed on image data taken on a packaging production line, and on the test set, the defect detection models' accuracy rates achieve 0.95 and 0.989, respectively. The experimental results reveal that the proposed method can be effectively applied for online automatic detection of stitching defects in packaging production lines and has industrial application significance.
基金This work was supported by the National Natural Science Foundation of China （Grant Nos. 60978043, 61128012, 610611 60503, and 61222506）.
文摘Subaperture stitching （SAS） provides us with an attractive way of extending the effective aperture and dynamic range of phase measuring interferometers. Accuracy of stitching algorithm becomes the key factor in the SAS technology. In this paper, the basic principle of SAS was introduced and four modes of SAS were discussed. The stitching experiments were done through the SSI-300 workstation designed and developed indepen- dently. There were several comparisons between the four different stitching methods and the measurement of full aperture. The results suggest that the global error averaging mode with reference of subaperture near optic axis is of high precision.
