With the development of computer vision technology,panoramic image stitching has been widely used in fields such as scene reconstruction.A single traditional image cannot fully capture the panoramic view of the iconic...With the development of computer vision technology,panoramic image stitching has been widely used in fields such as scene reconstruction.A single traditional image cannot fully capture the panoramic view of the iconic East Gate of the South Campus of Shaanxi University of Technology.Therefore,this project aims to technically fuse multiple partial images into a complete panoramic image,enabling comprehensive recording and visual presentation of the architectural landscapes and spatial environments in this area.This report first introduces the technical background and application scenarios,clarifying the necessity of panoramic image stitching in campus landscape recording.It then elaborates on the core objectives and practical values,highlighting the role of technical solutions in improving image quality.Technically,a modular system design based on OpenCV is adopted,including modules such as image preprocessing,feature extraction and matching,image registration,fusion,and post-processing.Specifically,the SIFT algorithm is applied for feature extraction,KNN combined with ratio testing is used for feature matching,image registration is achieved by calculating the homography matrix,the fusion process utilizes multiband blending and Laplacian pyramid,and post-processing includes operations such as black area filling and CLAHE contrast enhancement.The experiment was conducted in a specific hardware and software environment using five overlapping images.After preprocessing,stitching,detail enhancement,and black edge repair,a panoramic image was successfully generated.The results show that the panoramic image fully presents the relevant scenery,with concealed seams,balanced exposure differences,and strong hierarchical details.This report provides a systematic description of the project’s technical implementation and achievement application.展开更多
Optical microscopes are essential tools for scientific research,but traditional microscopes are restricted to capturing only two-dimensional(2D)texture information,lacking comprehensive three-dimensional(3D)morphology...Optical microscopes are essential tools for scientific research,but traditional microscopes are restricted to capturing only two-dimensional(2D)texture information,lacking comprehensive three-dimensional(3D)morphology capabilities.Additionally,traditional microscopes are inherently constrained by the limited space-bandwidth product of optical systems,resulting in restricted depth of field(DOF)and field of view(FOV).Attempts to expand DOF and FOV typically come at the cost of diminished resolution.In this paper,we propose a texture-driven FOV stitching algorithm specifically designed for extended depth-of-field(EDOF)microscopy,allowing for the integration of 2D texture and 3D depth data to achieve high-resolution,high-throughput multimodal imaging.Experimental results demonstrate an 11-fold enhancement in DOF and an 8-fold expansion in FOV compared to traditional microscopes,while maintaining axial resolution after FOV extension.展开更多
The proliferation of low-altitude economic activities has precipitated a significant expansion in the application domains of Unmanned Aerial Vehicle(UAV),transcending the constraints of singular platform operation.Mul...The proliferation of low-altitude economic activities has precipitated a significant expansion in the application domains of Unmanned Aerial Vehicle(UAV),transcending the constraints of singular platform operation.Multi-UAV cooperative online remote sensing image stitching involves several challenges,including image blurriness and deformation caused by platform vibrations,as well as managing vast amounts of data and addressing transmission delays.This paper introduces a real-time system for multi-UAV video stitching that integrates hardware acceleration,pose-guided ROI filtering,and temporal consistency constraints.Data from the onboard GPS and Inertial Measurement Unit(IMU)are used to estimate the overlap between two aerial images.Subsequently,the Graphics Processing Unit(GPU)within an edge computing platform is tasked with swiftly detecting SIFT features within the overlapping image sectors.Feature point matching is performed using a position-guided matching algorithm to compute the homography matrix.The results demonstrate that the RK3588-based edge computing platform exhibits rapid image decoding and stitching capabilities,with an average stitching latency of 36.43ms.Furthermore,this study developed a ground-based human-machine interaction system to present stitched video streams in realtime,thereby improving the operational efficiency and visual quality of multi-UAV aerial surveillance.展开更多
Satellite image segmentation plays a crucial role in remote sensing,supporting applications such as environmental monitoring,land use analysis,and disaster management.However,traditional segmentation methods often rel...Satellite image segmentation plays a crucial role in remote sensing,supporting applications such as environmental monitoring,land use analysis,and disaster management.However,traditional segmentation methods often rely on large amounts of labeled data,which are costly and time-consuming to obtain,especially in largescale or dynamic environments.To address this challenge,we propose the Semi-Supervised Multi-View Picture Fuzzy Clustering(SS-MPFC)algorithm,which improves segmentation accuracy and robustness,particularly in complex and uncertain remote sensing scenarios.SS-MPFC unifies three paradigms:semi-supervised learning,multi-view clustering,and picture fuzzy set theory.This integration allows the model to effectively utilize a small number of labeled samples,fuse complementary information from multiple data views,and handle the ambiguity and uncertainty inherent in satellite imagery.We design a novel objective function that jointly incorporates picture fuzzy membership functions across multiple views of the data,and embeds pairwise semi-supervised constraints(must-link and cannot-link)directly into the clustering process to enhance segmentation accuracy.Experiments conducted on several benchmark satellite datasets demonstrate that SS-MPFC significantly outperforms existing state-of-the-art methods in segmentation accuracy,noise robustness,and semantic interpretability.On the Augsburg dataset,SS-MPFC achieves a Purity of 0.8158 and an Accuracy of 0.6860,highlighting its outstanding robustness and efficiency.These results demonstrate that SSMPFC offers a scalable and effective solution for real-world satellite-based monitoring systems,particularly in scenarios where rapid annotation is infeasible,such as wildfire tracking,agricultural monitoring,and dynamic urban mapping.展开更多
A multi layer gridless area router is reported.Based on corner stitching,this router adopts tile expansion to explore path for each net.A heuristic method that penalizes nodes deviating from the destination is devise...A multi layer gridless area router is reported.Based on corner stitching,this router adopts tile expansion to explore path for each net.A heuristic method that penalizes nodes deviating from the destination is devised to accelerate the algorithm.Besides,an enhanced interval tree is used to manage the intermediate data structure.In order to improve the completion rate of routing,a new gridless rip up and rerouting algorithm is proposed.The experimental results indicate that the completion rate is improved after the rip up and reroute process and the speed of this algorithm is satisfactory.展开更多
According to the bio-characteristics of the lower and upper cavity surfaces of dental restoration, a stitching approach is proposed based on a virtual zipper working mechanism and a minimization of the surface total c...According to the bio-characteristics of the lower and upper cavity surfaces of dental restoration, a stitching approach is proposed based on a virtual zipper working mechanism and a minimization of the surface total curvature energy, which is used to resolve the stitching problems existing during computer-aided design for dental restorations. First, the two boundaries corresponding to the lower and upper surfaces are triangulated based on the zipper working mechanism to generate the initial stitching surface patch, of which the edges are distributed uniformly between the boundaries. Secondly, the initial stitching surface patch is subdivided and deformed to reconstruct an optimized surface patch according to the bio-characteristics of the teeth. The optimized surface patch is minimally distinguishable from the surrounding mesh in smoothness and density, and it can stitch the upper and lower cavity surfaces naturally. The experimental results show that the dental restorations obtained by the proposed method can satisfy both the shape aesthetic and the fitting accuracy, and meet the requirements of clinical oral medicine.展开更多
Experimental and analytical investigation is conducted to explore the effects of stitching on plain （without hole） and open-hole compressive and tensile strength of uniweave T300/QY9512 laminates under different env...Experimental and analytical investigation is conducted to explore the effects of stitching on plain （without hole） and open-hole compressive and tensile strength of uniweave T300/QY9512 laminates under different environmental conditions （20 ℃/dry and wet, 150 ℃/dry and wet）. Strength performance of stitched composite laminates is also studied using finite element analysis （FEA） model and compared with the experimental results to validate the model. It is found that under similar environmental conditions, the open-hole compressive strength of stitched laminate is decreased and open-hole tensile strength increased as compared to the unstitched laminates. Predicted tensile and compressive strengths are found to be in a good agreement with the test results and the relative error in all cases is less than 15%.展开更多
A novel automatic seamless stitching method is presented. Compared to the traditional method, it can speed the processing and minimize the utilization of human resources to produce global lunar map. Meanwhile, a new g...A novel automatic seamless stitching method is presented. Compared to the traditional method, it can speed the processing and minimize the utilization of human resources to produce global lunar map. Meanwhile, a new global image map of the Moon with spatial resolution of -120 m has been completed by the proposed method from Chang＇E-1 CCD image data.展开更多
Stripes are artifacts in satellite images caused by various factors such as hardware defects. In some cases, these artifacts are introduced by some mitigating algorithms like Landsat SLC-off （Scan Line Corrector） ga...Stripes are artifacts in satellite images caused by various factors such as hardware defects. In some cases, these artifacts are introduced by some mitigating algorithms like Landsat SLC-off （Scan Line Corrector） gap-filling methods of LLHM （Local Linear Histogram Matching） and AWLHM （Adaptive Window Linear Histogram Matching）, which leave stripes as a byproduct. To improve Landsat SLC-off images with stripes,we propose an algorithm involving some hypothetical stripe-crossing stitch lines using the mean pixel value of the stitch lines.展开更多
The lunar map is a product of primary scientific objectives of lunar exploration. Aiming at the characteristics of the Chang＇E-2 CCD data, an automatic stitching method used for 2C level CCD data from Chang＇E-2 luna...The lunar map is a product of primary scientific objectives of lunar exploration. Aiming at the characteristics of the Chang＇E-2 CCD data, an automatic stitching method used for 2C level CCD data from Chang＇E-2 lunar mission is proposed. Combining with the image registration technique and the characteristics of Chang＇E CCD images, the fast method proposed not only can overcome the contradiction of the high spatial resolution of the CCD images and the low positioning accuracy of the location coordinates, but also can speed up the processing and minimize the utilization of human resources to produce lunar mosaic map. Meanwhile, a new lunar map from 70oN to 70oS with spatial resolution of less than 10 m has been completed by the proposed method. Its average relative location accuracy of the adjacent orbits CCD image data is less than 3 pixels.展开更多
At present,underwater terrain images are all strip-shaped small fragment images preprocessed by the side-scan sonar imaging system.However,the processed underwater terrain images have inconspicuous and few feature poi...At present,underwater terrain images are all strip-shaped small fragment images preprocessed by the side-scan sonar imaging system.However,the processed underwater terrain images have inconspicuous and few feature points.In order to better realize the stitching of underwater terrain images and solve the problems of slow traditional image stitching speed,we proposed an improved algorithm for underwater terrain image stitching based on spatial gradient feature block.First,the spatial gradient fuzzy C-Means algorithm is used to divide the underwater terrain image into feature blocks with the fusion of spatial gradient information.The accelerated-KAZE(AKAZE)algorithm is used to combine the feature block information to match the reference image and the target image.Then,the random sample consensus(RANSAC)is applied to optimize the matching results.Finally,image fusion is performed with the global homography and the optimal seam-line method to improve the accuracy of image overlay fusion.The experimental results show that the proposed method in this paper effectively divides images into feature blocks by combining spatial information and gradient information,which not only solves the problem of stitching failure of underwater terrain images due to unobvious features,and further reduces the sensitivity to noise,but also effectively reduces the iterative calculation in the feature point matching process of the traditional method,and improves the stitching speed.Ghosting and shape warping are significantly eliminated by re-optimizing the overlap of the image.展开更多
Traditional feature-based image stitching techniques often encounter obstacles when dealing with images lackingunique attributes or suffering from quality degradation. The scarcity of annotated datasets in real-life s...Traditional feature-based image stitching techniques often encounter obstacles when dealing with images lackingunique attributes or suffering from quality degradation. The scarcity of annotated datasets in real-life scenesseverely undermines the reliability of supervised learning methods in image stitching. Furthermore, existing deeplearning architectures designed for image stitching are often too bulky to be deployed on mobile and peripheralcomputing devices. To address these challenges, this study proposes a novel unsupervised image stitching methodbased on the YOLOv8 (You Only Look Once version 8) framework that introduces deep homography networksand attentionmechanisms. Themethodology is partitioned into three distinct stages. The initial stage combines theattention mechanism with a pooling pyramid model to enhance the detection and recognition of compact objectsin images, the task of the deep homography networks module is to estimate the global homography of the inputimages consideringmultiple viewpoints. The second stage involves preliminary stitching of the masks generated inthe initial stage and further enhancement through weighted computation to eliminate common stitching artifacts.The final stage is characterized by adaptive reconstruction and careful refinement of the initial stitching results.Comprehensive experiments acrossmultiple datasets are executed tometiculously assess the proposed model. Ourmethod’s Peak Signal-to-Noise Ratio (PSNR) and Structure Similarity Index Measure (SSIM) improved by 10.6%and 6%. These experimental results confirm the efficacy and utility of the presented model in this paper.展开更多
Image/video stitching is a technology for solving the field of view(FOV)limitation of images/videos.It stitches multiple overlapping images/videos to generate a wide-FOV image/video,and has been used in various fields...Image/video stitching is a technology for solving the field of view(FOV)limitation of images/videos.It stitches multiple overlapping images/videos to generate a wide-FOV image/video,and has been used in various fields such as sports broadcasting,video surveillance,street view,and entertainment.This survey reviews image/video stitching algorithms,with a particular focus on those developed in recent years.Image stitching first calculates the corresponding relationships between multiple overlapping images,deforms and aligns the matched images,and then blends the aligned images to generate a wide-FOV image.A seamless method is always adopted to eliminate such potential flaws as ghosting and blurring caused by parallax or objects moving across the overlapping regions.Video stitching is the further extension of image stitching.It usually stitches selected frames of original videos to generate a stitching template by performing image stitching algorithms,and the subsequent frames can then be stitched according to the template.Video stitching is more complicated with moving objects or violent camera movement,because these factors introduce jitter,shakiness,ghosting,and blurring.Foreground detection technique is usually combined into stitching to eliminate ghosting and blurring,while video stabilization algorithms are adopted to solve the jitter and shakiness.This paper further discusses panoramic stitching as a special-extension of image/video stitching.Panoramic stitching is currently the most widely used application in stitching.This survey reviews the latest image/video stitching methods,and introduces the fundamental principles/advantages/weaknesses of image/video stitching algorithms.Image/video stitching faces long-term challenges such as wide baseline,large parallax,and low-texture problem in the overlapping region.New technologies may present new opportunities to address these issues,such as deep learning-based semantic correspondence,and 3D image stitching.Finally,this survey discusses the challenges of image/video stitching and proposes potential solutions.展开更多
This paper presents a new method for simultaneously eliminating visual artifacts caused by moving objects and structure misalignment in image stitching. Given that the input images are roughly aligned, our approach is...This paper presents a new method for simultaneously eliminating visual artifacts caused by moving objects and structure misalignment in image stitching. Given that the input images are roughly aligned, our approach is implemented in two stages. In the first stage, we discover motions between input images, and then extract their corresponding regions through a multi-seed based region growing algorithm. In the second stage, with prior information provided by the extracted regions, we perform a graph cut optimization in gradient-domain to determine which pixels to use from each image to achieve seamless stitching. Our method is simple to implement and effective. The experimental results illustrate that the proposed approach can produce comparable or superior results in comparison with state-of-the-art methods.展开更多
The looper drive mechanism is a main moving part in the blind stitching machine, which is aspatial 5 bar RRRSR linkage. In this paper, a dynamic analysis of the looper drive mechanism is made by means of the ma-trix m...The looper drive mechanism is a main moving part in the blind stitching machine, which is aspatial 5 bar RRRSR linkage. In this paper, a dynamic analysis of the looper drive mechanism is made by means of the ma-trix method. Two methods are adopted in the calculation of the shaking force and shaking moment, one isdone by the constraint reaction of the flame-connected kinematic parts; the other is the inertialforces of all moving links.展开更多
Oral endoscope image stitching algorithm is studied to obtain wide-field oral images through regis-tration and stitching,which is of great significance for auxiliary diagnosis.Compared with natural images,oral images ...Oral endoscope image stitching algorithm is studied to obtain wide-field oral images through regis-tration and stitching,which is of great significance for auxiliary diagnosis.Compared with natural images,oral images have lower textures and fewer features.However,traditional feature-based image stitching methods rely heavily on feature extraction quality,often showing an unsatisfactory performance when stitching images with few features.Moreover,due to the hand-held shooting,there are large depth and perspective disparities between the captured images,which also pose a challenge to image stitching.To overcome the above problems,we propose an unsupervised oral endoscope image stitching algorithm based on the extraction of overlapping regions and the loss of deep features.In the registration stage,we extract the overlapping region of the input images by sketching polygon intersection for feature points screening and estimate homography from coarse to fine on a three-layer feature pyramid structure.Moreover,we calculate loss using deep features instead of pixel values to emphasize the importance of depth disparities in homography estimation.Finally,we reconstruct the stitched images from feature to pixel,which can eliminate artifacts caused by large parallax.Our method is compared with both feature-based and previous deep-based methods on the UDIS-D dataset and our oral endoscopy image dataset.The experimental results show that our algorithm can achieve higher homography estimation accuracy,and better visual quality,and can be effectively applied to oral endoscope image stitching.展开更多
Branch identification technology is a key technology to achieve automated pruning of fruit tree branches, and one of its technical bottlenecks lies in the stitching of branch images. To this end, we propose a set of b...Branch identification technology is a key technology to achieve automated pruning of fruit tree branches, and one of its technical bottlenecks lies in the stitching of branch images. To this end, we propose a set of branch image stitching technology algorithms. The algorithm is based on the grey-scale prime centroid method to determine the detection feature points, and uses the coordinate transformation matrix H of the corresponding points of the image to carry out the image geometric transformation, and realises the feature matching through sample comparison and classification methods. The experimental results show that the matched point images are more correct and less time-consuming.展开更多
Multi-view clustering is a critical research area in computer science aimed at effectively extracting meaningful patterns from complex,high-dimensional data that single-view methods cannot capture.Traditional fuzzy cl...Multi-view clustering is a critical research area in computer science aimed at effectively extracting meaningful patterns from complex,high-dimensional data that single-view methods cannot capture.Traditional fuzzy clustering techniques,such as Fuzzy C-Means(FCM),face significant challenges in handling uncertainty and the dependencies between different views.To overcome these limitations,we introduce a new multi-view fuzzy clustering approach that integrates picture fuzzy sets with a dual-anchor graph method for multi-view data,aiming to enhance clustering accuracy and robustness,termed Multi-view Picture Fuzzy Clustering(MPFC).In particular,the picture fuzzy set theory extends the capability to represent uncertainty by modeling three membership levels:membership degrees,neutral degrees,and refusal degrees.This allows for a more flexible representation of uncertain and conflicting data than traditional fuzzy models.Meanwhile,dual-anchor graphs exploit the similarity relationships between data points and integrate information across views.This combination improves stability,scalability,and robustness when handling noisy and heterogeneous data.Experimental results on several benchmark datasets demonstrate significant improvements in clustering accuracy and efficiency,outperforming traditional methods.Specifically,the MPFC algorithm demonstrates outstanding clustering performance on a variety of datasets,attaining a Purity(PUR)score of 0.6440 and an Accuracy(ACC)score of 0.6213 for the 3 Sources dataset,underscoring its robustness and efficiency.The proposed approach significantly contributes to fields such as pattern recognition,multi-view relational data analysis,and large-scale clustering problems.Future work will focus on extending the method for semi-supervised multi-view clustering,aiming to enhance adaptability,scalability,and performance in real-world applications.展开更多
The accurate prediction of drug absorption,distribution,metabolism,excretion,and toxicity(ADMET)properties represents a crucial step in early drug development for reducing failure risk.Current deep learning approaches...The accurate prediction of drug absorption,distribution,metabolism,excretion,and toxicity(ADMET)properties represents a crucial step in early drug development for reducing failure risk.Current deep learning approaches face challenges with data sparsity and information loss due to single-molecule representation limitations and isolated predictive tasks.This research proposes molecular properties prediction with parallel-view and collaborative learning(MolP-PC),a multi-view fusion and multi-task deep learning framework that integrates 1D molecular fingerprints(MFs),2D molecular graphs,and 3D geometric representations,incorporating an attention-gated fusion mechanism and multi-task adaptive learning strategy for precise ADMET property predictions.Experimental results demonstrate that MolP-PC achieves optimal performance in 27 of 54 tasks,with its multi-task learning(MTL)mechanism significantly enhancing predictive performance on small-scale datasets and surpassing single-task models in 41 of 54 tasks.Additional ablation studies and interpretability analyses confirm the significance of multi-view fusion in capturing multi-dimensional molecular information and enhancing model generalization.A case study examining the anticancer compound Oroxylin A demonstrates MolP-PC’s effective generalization in predicting key pharmacokinetic parameters such as half-life(T0.5)and clearance(CL),indicating its practical utility in drug modeling.However,the model exhibits a tendency to underestimate volume of distribution(VD),indicating potential for improvement in analyzing compounds with high tissue distribution.This study presents an efficient and interpretable approach for ADMET property prediction,establishing a novel framework for molecular optimization and risk assessment in drug development.展开更多
Phenotypic prediction is a promising strategy for accelerating plant breeding.Data from multiple sources(called multi-view data)can provide complementary information to characterize a biological object from various as...Phenotypic prediction is a promising strategy for accelerating plant breeding.Data from multiple sources(called multi-view data)can provide complementary information to characterize a biological object from various aspects.By integrating multi-view information into phenotypic prediction,a multi-view best linear unbiased prediction(MVBLUP)method is proposed in this paper.To measure the importance of multiple data views,the differential evolution algorithm with an early stopping mechanism is used,by which we obtain a multi-view kinship matrix and then incorporate it into the BLUP model for phenotypic prediction.To further illustrate the characteristics of MVBLUP,we perform the empirical experiments on four multi-view datasets in different crops.Compared to the single-view method,the prediction accuracy of the MVBLUP method has improved by 0.038–0.201 on average.The results demonstrate that the MVBLUP is an effective integrative prediction method for multi-view data.展开更多
文摘With the development of computer vision technology,panoramic image stitching has been widely used in fields such as scene reconstruction.A single traditional image cannot fully capture the panoramic view of the iconic East Gate of the South Campus of Shaanxi University of Technology.Therefore,this project aims to technically fuse multiple partial images into a complete panoramic image,enabling comprehensive recording and visual presentation of the architectural landscapes and spatial environments in this area.This report first introduces the technical background and application scenarios,clarifying the necessity of panoramic image stitching in campus landscape recording.It then elaborates on the core objectives and practical values,highlighting the role of technical solutions in improving image quality.Technically,a modular system design based on OpenCV is adopted,including modules such as image preprocessing,feature extraction and matching,image registration,fusion,and post-processing.Specifically,the SIFT algorithm is applied for feature extraction,KNN combined with ratio testing is used for feature matching,image registration is achieved by calculating the homography matrix,the fusion process utilizes multiband blending and Laplacian pyramid,and post-processing includes operations such as black area filling and CLAHE contrast enhancement.The experiment was conducted in a specific hardware and software environment using five overlapping images.After preprocessing,stitching,detail enhancement,and black edge repair,a panoramic image was successfully generated.The results show that the panoramic image fully presents the relevant scenery,with concealed seams,balanced exposure differences,and strong hierarchical details.This report provides a systematic description of the project’s technical implementation and achievement application.
基金supported by Science Foundation of Donghai Lab-oratory(No.DH-2022KF01001).
文摘Optical microscopes are essential tools for scientific research,but traditional microscopes are restricted to capturing only two-dimensional(2D)texture information,lacking comprehensive three-dimensional(3D)morphology capabilities.Additionally,traditional microscopes are inherently constrained by the limited space-bandwidth product of optical systems,resulting in restricted depth of field(DOF)and field of view(FOV).Attempts to expand DOF and FOV typically come at the cost of diminished resolution.In this paper,we propose a texture-driven FOV stitching algorithm specifically designed for extended depth-of-field(EDOF)microscopy,allowing for the integration of 2D texture and 3D depth data to achieve high-resolution,high-throughput multimodal imaging.Experimental results demonstrate an 11-fold enhancement in DOF and an 8-fold expansion in FOV compared to traditional microscopes,while maintaining axial resolution after FOV extension.
基金funded by Graduate innovation program of National University of Defense Technology,grant number:XJZH2024016.
文摘The proliferation of low-altitude economic activities has precipitated a significant expansion in the application domains of Unmanned Aerial Vehicle(UAV),transcending the constraints of singular platform operation.Multi-UAV cooperative online remote sensing image stitching involves several challenges,including image blurriness and deformation caused by platform vibrations,as well as managing vast amounts of data and addressing transmission delays.This paper introduces a real-time system for multi-UAV video stitching that integrates hardware acceleration,pose-guided ROI filtering,and temporal consistency constraints.Data from the onboard GPS and Inertial Measurement Unit(IMU)are used to estimate the overlap between two aerial images.Subsequently,the Graphics Processing Unit(GPU)within an edge computing platform is tasked with swiftly detecting SIFT features within the overlapping image sectors.Feature point matching is performed using a position-guided matching algorithm to compute the homography matrix.The results demonstrate that the RK3588-based edge computing platform exhibits rapid image decoding and stitching capabilities,with an average stitching latency of 36.43ms.Furthermore,this study developed a ground-based human-machine interaction system to present stitched video streams in realtime,thereby improving the operational efficiency and visual quality of multi-UAV aerial surveillance.
基金funded by the Research Project:THTETN.05/24-25,VietnamAcademy of Science and Technology.
文摘Satellite image segmentation plays a crucial role in remote sensing,supporting applications such as environmental monitoring,land use analysis,and disaster management.However,traditional segmentation methods often rely on large amounts of labeled data,which are costly and time-consuming to obtain,especially in largescale or dynamic environments.To address this challenge,we propose the Semi-Supervised Multi-View Picture Fuzzy Clustering(SS-MPFC)algorithm,which improves segmentation accuracy and robustness,particularly in complex and uncertain remote sensing scenarios.SS-MPFC unifies three paradigms:semi-supervised learning,multi-view clustering,and picture fuzzy set theory.This integration allows the model to effectively utilize a small number of labeled samples,fuse complementary information from multiple data views,and handle the ambiguity and uncertainty inherent in satellite imagery.We design a novel objective function that jointly incorporates picture fuzzy membership functions across multiple views of the data,and embeds pairwise semi-supervised constraints(must-link and cannot-link)directly into the clustering process to enhance segmentation accuracy.Experiments conducted on several benchmark satellite datasets demonstrate that SS-MPFC significantly outperforms existing state-of-the-art methods in segmentation accuracy,noise robustness,and semantic interpretability.On the Augsburg dataset,SS-MPFC achieves a Purity of 0.8158 and an Accuracy of 0.6860,highlighting its outstanding robustness and efficiency.These results demonstrate that SSMPFC offers a scalable and effective solution for real-world satellite-based monitoring systems,particularly in scenarios where rapid annotation is infeasible,such as wildfire tracking,agricultural monitoring,and dynamic urban mapping.
文摘A multi layer gridless area router is reported.Based on corner stitching,this router adopts tile expansion to explore path for each net.A heuristic method that penalizes nodes deviating from the destination is devised to accelerate the algorithm.Besides,an enhanced interval tree is used to manage the intermediate data structure.In order to improve the completion rate of routing,a new gridless rip up and rerouting algorithm is proposed.The experimental results indicate that the completion rate is improved after the rip up and reroute process and the speed of this algorithm is satisfactory.
基金The National High Technology Research and Development Program of China(863 Program)(No.2005AA420240)the Key Science and Technology Program of Jiangsu Province (No.BE2005014)
文摘According to the bio-characteristics of the lower and upper cavity surfaces of dental restoration, a stitching approach is proposed based on a virtual zipper working mechanism and a minimization of the surface total curvature energy, which is used to resolve the stitching problems existing during computer-aided design for dental restorations. First, the two boundaries corresponding to the lower and upper surfaces are triangulated based on the zipper working mechanism to generate the initial stitching surface patch, of which the edges are distributed uniformly between the boundaries. Secondly, the initial stitching surface patch is subdivided and deformed to reconstruct an optimized surface patch according to the bio-characteristics of the teeth. The optimized surface patch is minimally distinguishable from the surrounding mesh in smoothness and density, and it can stitch the upper and lower cavity surfaces naturally. The experimental results show that the dental restorations obtained by the proposed method can satisfy both the shape aesthetic and the fitting accuracy, and meet the requirements of clinical oral medicine.
基金National Natural Science Foundation of China(10672009)Basic Science Foundation of Aviation(05B51044)"FanZhou" Youth Scientific Funds(20060501)
文摘Experimental and analytical investigation is conducted to explore the effects of stitching on plain （without hole） and open-hole compressive and tensile strength of uniweave T300/QY9512 laminates under different environmental conditions （20 ℃/dry and wet, 150 ℃/dry and wet）. Strength performance of stitched composite laminates is also studied using finite element analysis （FEA） model and compared with the experimental results to validate the model. It is found that under similar environmental conditions, the open-hole compressive strength of stitched laminate is decreased and open-hole tensile strength increased as compared to the unstitched laminates. Predicted tensile and compressive strengths are found to be in a good agreement with the test results and the relative error in all cases is less than 15%.
基金supported by the Science and Technology Development Fund of Macao (Nos. 004/2011/A1 and 015/2010/A)the National High Technology Research and Development Program (No. 2010AA122202)
文摘A novel automatic seamless stitching method is presented. Compared to the traditional method, it can speed the processing and minimize the utilization of human resources to produce global lunar map. Meanwhile, a new global image map of the Moon with spatial resolution of -120 m has been completed by the proposed method from Chang＇E-1 CCD image data.
文摘Stripes are artifacts in satellite images caused by various factors such as hardware defects. In some cases, these artifacts are introduced by some mitigating algorithms like Landsat SLC-off （Scan Line Corrector） gap-filling methods of LLHM （Local Linear Histogram Matching） and AWLHM （Adaptive Window Linear Histogram Matching）, which leave stripes as a byproduct. To improve Landsat SLC-off images with stripes,we propose an algorithm involving some hypothetical stripe-crossing stitch lines using the mean pixel value of the stitch lines.
基金supported in part by the Science and Technology Development Fund of Macao,China (Nos.048/2016/A2,110/2014/A3,091/2013/A3,084/2012/A3,and 048/2012/A2)the National Natural Science Foundation of China (Nos.61170320 and 61272364)the Open Project Program of the State Key Lab of CAD & CG of Zhejiang University (No.A1513)
文摘The lunar map is a product of primary scientific objectives of lunar exploration. Aiming at the characteristics of the Chang＇E-2 CCD data, an automatic stitching method used for 2C level CCD data from Chang＇E-2 lunar mission is proposed. Combining with the image registration technique and the characteristics of Chang＇E CCD images, the fast method proposed not only can overcome the contradiction of the high spatial resolution of the CCD images and the low positioning accuracy of the location coordinates, but also can speed up the processing and minimize the utilization of human resources to produce lunar mosaic map. Meanwhile, a new lunar map from 70oN to 70oS with spatial resolution of less than 10 m has been completed by the proposed method. Its average relative location accuracy of the adjacent orbits CCD image data is less than 3 pixels.
基金This research was funded by College Student Innovation and Entrepreneurship Training Program,Grant Number 2021055Z and S202110082031the Special Project for Cultivating Scientific and Technological Innovation Ability of College and Middle School Students in Hebei Province,Grant Number 2021H011404.
文摘At present,underwater terrain images are all strip-shaped small fragment images preprocessed by the side-scan sonar imaging system.However,the processed underwater terrain images have inconspicuous and few feature points.In order to better realize the stitching of underwater terrain images and solve the problems of slow traditional image stitching speed,we proposed an improved algorithm for underwater terrain image stitching based on spatial gradient feature block.First,the spatial gradient fuzzy C-Means algorithm is used to divide the underwater terrain image into feature blocks with the fusion of spatial gradient information.The accelerated-KAZE(AKAZE)algorithm is used to combine the feature block information to match the reference image and the target image.Then,the random sample consensus(RANSAC)is applied to optimize the matching results.Finally,image fusion is performed with the global homography and the optimal seam-line method to improve the accuracy of image overlay fusion.The experimental results show that the proposed method in this paper effectively divides images into feature blocks by combining spatial information and gradient information,which not only solves the problem of stitching failure of underwater terrain images due to unobvious features,and further reduces the sensitivity to noise,but also effectively reduces the iterative calculation in the feature point matching process of the traditional method,and improves the stitching speed.Ghosting and shape warping are significantly eliminated by re-optimizing the overlap of the image.
基金Science and Technology Research Project of the Henan Province(222102240014).
文摘Traditional feature-based image stitching techniques often encounter obstacles when dealing with images lackingunique attributes or suffering from quality degradation. The scarcity of annotated datasets in real-life scenesseverely undermines the reliability of supervised learning methods in image stitching. Furthermore, existing deeplearning architectures designed for image stitching are often too bulky to be deployed on mobile and peripheralcomputing devices. To address these challenges, this study proposes a novel unsupervised image stitching methodbased on the YOLOv8 (You Only Look Once version 8) framework that introduces deep homography networksand attentionmechanisms. Themethodology is partitioned into three distinct stages. The initial stage combines theattention mechanism with a pooling pyramid model to enhance the detection and recognition of compact objectsin images, the task of the deep homography networks module is to estimate the global homography of the inputimages consideringmultiple viewpoints. The second stage involves preliminary stitching of the masks generated inthe initial stage and further enhancement through weighted computation to eliminate common stitching artifacts.The final stage is characterized by adaptive reconstruction and careful refinement of the initial stitching results.Comprehensive experiments acrossmultiple datasets are executed tometiculously assess the proposed model. Ourmethod’s Peak Signal-to-Noise Ratio (PSNR) and Structure Similarity Index Measure (SSIM) improved by 10.6%and 6%. These experimental results confirm the efficacy and utility of the presented model in this paper.
基金the National Natural Science Foundation of China(61872023).
文摘Image/video stitching is a technology for solving the field of view(FOV)limitation of images/videos.It stitches multiple overlapping images/videos to generate a wide-FOV image/video,and has been used in various fields such as sports broadcasting,video surveillance,street view,and entertainment.This survey reviews image/video stitching algorithms,with a particular focus on those developed in recent years.Image stitching first calculates the corresponding relationships between multiple overlapping images,deforms and aligns the matched images,and then blends the aligned images to generate a wide-FOV image.A seamless method is always adopted to eliminate such potential flaws as ghosting and blurring caused by parallax or objects moving across the overlapping regions.Video stitching is the further extension of image stitching.It usually stitches selected frames of original videos to generate a stitching template by performing image stitching algorithms,and the subsequent frames can then be stitched according to the template.Video stitching is more complicated with moving objects or violent camera movement,because these factors introduce jitter,shakiness,ghosting,and blurring.Foreground detection technique is usually combined into stitching to eliminate ghosting and blurring,while video stabilization algorithms are adopted to solve the jitter and shakiness.This paper further discusses panoramic stitching as a special-extension of image/video stitching.Panoramic stitching is currently the most widely used application in stitching.This survey reviews the latest image/video stitching methods,and introduces the fundamental principles/advantages/weaknesses of image/video stitching algorithms.Image/video stitching faces long-term challenges such as wide baseline,large parallax,and low-texture problem in the overlapping region.New technologies may present new opportunities to address these issues,such as deep learning-based semantic correspondence,and 3D image stitching.Finally,this survey discusses the challenges of image/video stitching and proposes potential solutions.
文摘This paper presents a new method for simultaneously eliminating visual artifacts caused by moving objects and structure misalignment in image stitching. Given that the input images are roughly aligned, our approach is implemented in two stages. In the first stage, we discover motions between input images, and then extract their corresponding regions through a multi-seed based region growing algorithm. In the second stage, with prior information provided by the extracted regions, we perform a graph cut optimization in gradient-domain to determine which pixels to use from each image to achieve seamless stitching. Our method is simple to implement and effective. The experimental results illustrate that the proposed approach can produce comparable or superior results in comparison with state-of-the-art methods.
文摘The looper drive mechanism is a main moving part in the blind stitching machine, which is aspatial 5 bar RRRSR linkage. In this paper, a dynamic analysis of the looper drive mechanism is made by means of the ma-trix method. Two methods are adopted in the calculation of the shaking force and shaking moment, one isdone by the constraint reaction of the flame-connected kinematic parts; the other is the inertialforces of all moving links.
基金the National Natural Science Foundation of China(No.61976091)。
文摘Oral endoscope image stitching algorithm is studied to obtain wide-field oral images through regis-tration and stitching,which is of great significance for auxiliary diagnosis.Compared with natural images,oral images have lower textures and fewer features.However,traditional feature-based image stitching methods rely heavily on feature extraction quality,often showing an unsatisfactory performance when stitching images with few features.Moreover,due to the hand-held shooting,there are large depth and perspective disparities between the captured images,which also pose a challenge to image stitching.To overcome the above problems,we propose an unsupervised oral endoscope image stitching algorithm based on the extraction of overlapping regions and the loss of deep features.In the registration stage,we extract the overlapping region of the input images by sketching polygon intersection for feature points screening and estimate homography from coarse to fine on a three-layer feature pyramid structure.Moreover,we calculate loss using deep features instead of pixel values to emphasize the importance of depth disparities in homography estimation.Finally,we reconstruct the stitched images from feature to pixel,which can eliminate artifacts caused by large parallax.Our method is compared with both feature-based and previous deep-based methods on the UDIS-D dataset and our oral endoscopy image dataset.The experimental results show that our algorithm can achieve higher homography estimation accuracy,and better visual quality,and can be effectively applied to oral endoscope image stitching.
文摘Branch identification technology is a key technology to achieve automated pruning of fruit tree branches, and one of its technical bottlenecks lies in the stitching of branch images. To this end, we propose a set of branch image stitching technology algorithms. The algorithm is based on the grey-scale prime centroid method to determine the detection feature points, and uses the coordinate transformation matrix H of the corresponding points of the image to carry out the image geometric transformation, and realises the feature matching through sample comparison and classification methods. The experimental results show that the matched point images are more correct and less time-consuming.
基金funded by the Research Project:THTETN.05/24-25,VietnamAcademy of Science and Technology.
文摘Multi-view clustering is a critical research area in computer science aimed at effectively extracting meaningful patterns from complex,high-dimensional data that single-view methods cannot capture.Traditional fuzzy clustering techniques,such as Fuzzy C-Means(FCM),face significant challenges in handling uncertainty and the dependencies between different views.To overcome these limitations,we introduce a new multi-view fuzzy clustering approach that integrates picture fuzzy sets with a dual-anchor graph method for multi-view data,aiming to enhance clustering accuracy and robustness,termed Multi-view Picture Fuzzy Clustering(MPFC).In particular,the picture fuzzy set theory extends the capability to represent uncertainty by modeling three membership levels:membership degrees,neutral degrees,and refusal degrees.This allows for a more flexible representation of uncertain and conflicting data than traditional fuzzy models.Meanwhile,dual-anchor graphs exploit the similarity relationships between data points and integrate information across views.This combination improves stability,scalability,and robustness when handling noisy and heterogeneous data.Experimental results on several benchmark datasets demonstrate significant improvements in clustering accuracy and efficiency,outperforming traditional methods.Specifically,the MPFC algorithm demonstrates outstanding clustering performance on a variety of datasets,attaining a Purity(PUR)score of 0.6440 and an Accuracy(ACC)score of 0.6213 for the 3 Sources dataset,underscoring its robustness and efficiency.The proposed approach significantly contributes to fields such as pattern recognition,multi-view relational data analysis,and large-scale clustering problems.Future work will focus on extending the method for semi-supervised multi-view clustering,aiming to enhance adaptability,scalability,and performance in real-world applications.
基金supported by the research on key technologies for monitoring and identifying drug abuse of anesthetic drugs and psychotropic drugs,and intervention for addiction(No.2023YFC3304200)the program of a study on the diagnosis of addiction to synthetic cannabinoids and methods of assessing the risk of abuse(No.2022YFC3300905)+1 种基金the program of Ab initio design and generation of AI models for small molecule ligands based on target structures(No.2022PE0AC03)ZHIJIANG LAB.
文摘The accurate prediction of drug absorption,distribution,metabolism,excretion,and toxicity(ADMET)properties represents a crucial step in early drug development for reducing failure risk.Current deep learning approaches face challenges with data sparsity and information loss due to single-molecule representation limitations and isolated predictive tasks.This research proposes molecular properties prediction with parallel-view and collaborative learning(MolP-PC),a multi-view fusion and multi-task deep learning framework that integrates 1D molecular fingerprints(MFs),2D molecular graphs,and 3D geometric representations,incorporating an attention-gated fusion mechanism and multi-task adaptive learning strategy for precise ADMET property predictions.Experimental results demonstrate that MolP-PC achieves optimal performance in 27 of 54 tasks,with its multi-task learning(MTL)mechanism significantly enhancing predictive performance on small-scale datasets and surpassing single-task models in 41 of 54 tasks.Additional ablation studies and interpretability analyses confirm the significance of multi-view fusion in capturing multi-dimensional molecular information and enhancing model generalization.A case study examining the anticancer compound Oroxylin A demonstrates MolP-PC’s effective generalization in predicting key pharmacokinetic parameters such as half-life(T0.5)and clearance(CL),indicating its practical utility in drug modeling.However,the model exhibits a tendency to underestimate volume of distribution(VD),indicating potential for improvement in analyzing compounds with high tissue distribution.This study presents an efficient and interpretable approach for ADMET property prediction,establishing a novel framework for molecular optimization and risk assessment in drug development.
基金supported by National Natural Science Foundation of China(32122066,32201855)STI2030—Major Projects(2023ZD04076).
文摘Phenotypic prediction is a promising strategy for accelerating plant breeding.Data from multiple sources(called multi-view data)can provide complementary information to characterize a biological object from various aspects.By integrating multi-view information into phenotypic prediction,a multi-view best linear unbiased prediction(MVBLUP)method is proposed in this paper.To measure the importance of multiple data views,the differential evolution algorithm with an early stopping mechanism is used,by which we obtain a multi-view kinship matrix and then incorporate it into the BLUP model for phenotypic prediction.To further illustrate the characteristics of MVBLUP,we perform the empirical experiments on four multi-view datasets in different crops.Compared to the single-view method,the prediction accuracy of the MVBLUP method has improved by 0.038–0.201 on average.The results demonstrate that the MVBLUP is an effective integrative prediction method for multi-view data.
