With the development of computer vision technology,panoramic image stitching has been widely used in fields such as scene reconstruction.A single traditional image cannot fully capture the panoramic view of the iconic...With the development of computer vision technology,panoramic image stitching has been widely used in fields such as scene reconstruction.A single traditional image cannot fully capture the panoramic view of the iconic East Gate of the South Campus of Shaanxi University of Technology.Therefore,this project aims to technically fuse multiple partial images into a complete panoramic image,enabling comprehensive recording and visual presentation of the architectural landscapes and spatial environments in this area.This report first introduces the technical background and application scenarios,clarifying the necessity of panoramic image stitching in campus landscape recording.It then elaborates on the core objectives and practical values,highlighting the role of technical solutions in improving image quality.Technically,a modular system design based on OpenCV is adopted,including modules such as image preprocessing,feature extraction and matching,image registration,fusion,and post-processing.Specifically,the SIFT algorithm is applied for feature extraction,KNN combined with ratio testing is used for feature matching,image registration is achieved by calculating the homography matrix,the fusion process utilizes multiband blending and Laplacian pyramid,and post-processing includes operations such as black area filling and CLAHE contrast enhancement.The experiment was conducted in a specific hardware and software environment using five overlapping images.After preprocessing,stitching,detail enhancement,and black edge repair,a panoramic image was successfully generated.The results show that the panoramic image fully presents the relevant scenery,with concealed seams,balanced exposure differences,and strong hierarchical details.This report provides a systematic description of the project’s technical implementation and achievement application.展开更多
Panoramic images, offering a 360-degree view, are essential in virtual reality(VR) and augmented reality(AR), enhancing realism with high-quality textures. However, acquiring complete and high-quality panoramic textur...Panoramic images, offering a 360-degree view, are essential in virtual reality(VR) and augmented reality(AR), enhancing realism with high-quality textures. However, acquiring complete and high-quality panoramic textures is challenging. This paper introduces a method using generative adversarial networks(GANs) and the contrastive language-image pretraining(CLIP) model to restore and control texture in panoramic images. The GAN model captures complex structures and maintains consistency, while CLIP enables fine-grained texture control via semantic text-image associations. GAN inversion optimizes latent codes for precise texture details. The resulting low dynamic range(LDR) images are converted to high dynamic range(HDR) using the Blender engine for seamless texture blending. Experimental results demonstrate the effectiveness and flexibility of this method in panoramic texture restoration and generation.展开更多
The instance segmentation of impacted teeth in the oral panoramic X-ray images is hotly researched.However,due to the complex structure,low contrast,and complex background of teeth in panoramic X-ray images,the task o...The instance segmentation of impacted teeth in the oral panoramic X-ray images is hotly researched.However,due to the complex structure,low contrast,and complex background of teeth in panoramic X-ray images,the task of instance segmentation is technically tricky.In this study,the contrast between impacted Teeth and periodontal tissues such as gingiva,periodontalmembrane,and alveolar bone is low,resulting in fuzzy boundaries of impacted teeth.Amodel based on Teeth YOLACT is proposed to provide amore efficient and accurate solution for the segmentation of impacted teeth in oral panoramic X-ray films.Firstly,a Multi-scale Res-Transformer Module(MRTM)is designed.In the module,depthwise separable convolutions with different receptive fields are used to enhance the sensitivity of the model to lesion size.Additionally,the Vision Transformer is integrated to improve the model’s ability to perceive global features.Secondly,the Context Interaction-awareness Module(CIaM)is designed to fuse deep and shallow features.The deep semantic features guide the shallow spatial features.Then,the shallow spatial features are embedded into the deep semantic features,and the cross-weighted attention mechanism is used to aggregate the deep and shallow features efficiently,and richer context information is obtained.Thirdly,the Edge-preserving perceptionModule(E2PM)is designed to enhance the teeth edge features.The first-order differential operator is used to get the tooth edge weight,and the perception ability of tooth edge features is improved.The shallow spatial feature is fused by linear mapping,weight concatenation,and matrix multiplication operations to preserve the tooth edge information.Finally,comparison experiments and ablation experiments are conducted on the oral panoramic X-ray image datasets.The results show that the APdet,APseg,ARdet,ARseg,mAPdet,and mAPseg indicators of the proposed model are 89.9%,91.9%,77.4%,77.6%,72.8%,and 73.5%,respectively.This study further verifies the application potential of the method combining multi-scale feature extraction,multi-scale feature fusion,and edge perception enhancement in medical image segmentation,which provides a valuable reference for future related research.展开更多
BACKGROUND The objective of this study was to evaluate the use of combined parallax-free panoramic X-ray imaging during surgery by enabling the mobile C-arm with minimally invasive plate osteosynthesis(MIPO)in the man...BACKGROUND The objective of this study was to evaluate the use of combined parallax-free panoramic X-ray imaging during surgery by enabling the mobile C-arm with minimally invasive plate osteosynthesis(MIPO)in the management of proximal humeral shaft fractures.AIM To evaluate parallax-free panoramic X-ray images during surgery.METHODS A retrospective series of 17 proximal humeral shaft fractures were treated using combined parallax-free panoramic X-ray imaging during surgery by enabling the mobile C-arm with MIPO.The operating time and radiation exposure time were recorded,and early postoperative physical therapy and partial weight bearing were encouraged.Patients were followed at regular intervals and evaluated radiographically and clinically.RESULTS The mean operating time and radiation time were 73(range,49-95)minutes and 57(range:36-98)seconds,respectively.No complications occurred during the operation.All fractures healed at an average of 16.9(range:15-23)weeks.The average Constant-Murley score for all the patients was 89.5(range:75-100)points.None of the patients showed symptoms of vascular or nerve damage or wound infection.Three months after the operation,none of the patients developed subacromial impingement syndrome.No loosening or fracture of the implants occurred.The frontal and lateral radiographs showed good alignment.CONCLUSION We consider that MIPO with combined parallax-free panoramic X-ray imaging during surgery is an efficient method for treating proximal humeral shaft fractures,and could significantly reduce operative morbidity as well as lower the rate of intra-and postoperative complications.展开更多
The existing panoramic image matching methods are difficult to overcome the non-uniform features of the projection transformation of the target object,and hence the issue of unstable corresponding points matching is u...The existing panoramic image matching methods are difficult to overcome the non-uniform features of the projection transformation of the target object,and hence the issue of unstable corresponding points matching is usually induced.This paper aims to solve the difficulty by proposing a sparse depth point set matching method based on panoramic disparity.By constructing a panoramic disparity model of stereo panoramic images,the disparity between corresponding points can be precisely estimated,and the robustness and effectiveness of corresponding points matching between stereo panoramic images is improved under the epipolar geometric constraints.Firstly,by defining the panoramic disparity,the corresponding angle of panoramic disparity is derived,and the matching areas of corresponding points based on the disparity corresponding angle difference are partitioned.Secondly,the optimization strategy in the matching process of corresponding points is constructed to provide stable matching results for generating sparse depth maps based on the disparity region range and epipolar geometric relationship.Experiments show that the proposed method can not only obtain more stable matching results but also exhibit higher computational efficiency than existing algorithms.展开更多
In panoramic images,the geometric distortion caused by wide-angle lenses makes traditional semantic segmentation methods difficult to accurately segment the glass areas.To address the challenges of capturing spatial f...In panoramic images,the geometric distortion caused by wide-angle lenses makes traditional semantic segmentation methods difficult to accurately segment the glass areas.To address the challenges of capturing spatial features and integrating context information,we propose the Panoramic Glass Image Segmentation Network(PGISNet).This network integrates the Matrix Decomposition Base Module(MDBM),the Transparent Perception Consistency Module(TACM),the Context and Texture Compensation Module(CTCM),and the Multi-scale Gated Context Attention Module(MGCA),constructing a progressive feature processing flow.Experimental results on the PanoGlassV2 benchmark test show that PGISNet achieved 90.03%IoU,94.76%F-score,and 94.0%PA,significantly outperforming existing methods,verifying its effectiveness and advancement in the panoramic image glass segmentation task.展开更多
To satisfy the requirements of real-time and high quality mosaics, a bionic compound eye visual system was designed by simulating the visual mechanism of a fly compound eye. Several CCD cameras were used in this syste...To satisfy the requirements of real-time and high quality mosaics, a bionic compound eye visual system was designed by simulating the visual mechanism of a fly compound eye. Several CCD cameras were used in this system to imitate the small eyes of a compound eye. Based on the optical analysis of this system, a direct panoramic image mosaic algorithm was proposed. Several sub-images were collected by the bionic compound eye visual system, and then the system obtained the overlapping proportions of these sub-images and cut the overlap sections of the neighboring images. Thus, a panoramic image with a large field of view was directly mosaicked, which expanded the field and guaranteed the high resolution. The experimental results show that the time consumed by the direct mosaic algorithm is only 2.2% of that by the traditional image mosaic algorithm while guaranteeing mosaic quality. Furthermore, the proposed method effectively solved the problem of misalignment of the mosaic image and eliminated mosaic cracks as a result of the illumination factor and other factors. This method has better real-time properties compared to other methods.展开更多
Abstract： Based on digital signal processor（DSP） and field programmable gate array（FPGA） techniques, the architecture of super large view field（SLVF） panoramic night vision image processing hardware platform wa...Abstract： Based on digital signal processor（DSP） and field programmable gate array（FPGA） techniques, the architecture of super large view field（SLVF） panoramic night vision image processing hardware platform was established. The panoramic unwrapping and correcting algorithm, up to a full 360°, based on coordinate rotation digital computer （CORDIC） and night vision image enhancement algorithm, based on histogram equalization theory and edge detection theory, was presented in this paper, with the purpose of processing night vision dynamic panoramic annular image. The annular image can be unwrapped and corrected to conventional rectangular panorama by the panoramic image processing algorithm, which uses the pipelined CORDIC configuration to realize a trigonometric function generator with high speed and high precision. Histogram equalization algorithm can perfectly enhance the contrast of the night vision image. Edge detection algorithm can be propitious to find and detect small dim dynamic targets in night vision circumstances. After abundant experiment, the al- gorithm for panoramic image processing and night vision image enhancement is successfully implemented in FPGA and DSP. The panoramic night vision image system is a compact device, with no external rotating parts. And the system can reliably and dynamically detect 360＊ SLVF panoramic night vision image.展开更多
In the visual positioning of Unmanned Ground Vehicle(UGV),the visual odometer based on direct sparse method(DSO) has the advantages of small amount of calculation,high real-time performance and high robustness,so it i...In the visual positioning of Unmanned Ground Vehicle(UGV),the visual odometer based on direct sparse method(DSO) has the advantages of small amount of calculation,high real-time performance and high robustness,so it is more widely used than the visual odometer based on feature point method.Ordinary vision sensors have a narrower viewing angle than panoramic vision sensors,and there are fewer road signs in a single frame of image,resulting in poor road sign tracking and positioning capabilities,and severely restricting the development of visual odometry.Based on these considerations,this paper proposes a binocular stereo panoramic vision positioning algorithm based on extended DSO,which can solve these problems well.The experimental results show that the binocular stereo panoramic vision positioning algorithm based on the extended DSO can directly obtain the panoramic depth image around the UGV,which greatly improves the accuracy and robustness of the visual positioning compared with other ordinary visual odometers.It will have widely application prospects in the UGV field in the future.展开更多
Inpainting has been continuously studied in the field of computer vision.As artificial intelligence technology developed,deep learning technology was introduced in inpainting research,helping to improve performance.Cu...Inpainting has been continuously studied in the field of computer vision.As artificial intelligence technology developed,deep learning technology was introduced in inpainting research,helping to improve performance.Currently,the input target of an inpainting algorithm using deep learning has been studied from a single image to a video.However,deep learning-based inpainting technology for panoramic images has not been actively studied.We propose a 360-degree panoramic image inpainting method using generative adversarial networks(GANs).The proposed network inputs a 360-degree equirectangular format panoramic image converts it into a cube map format,which has relatively little distortion and uses it as a training network.Since the cube map format is used,the correlation of the six sides of the cube map should be considered.Therefore,all faces of the cube map are used as input for the whole discriminative network,and each face of the cube map is used as input for the slice discriminative network to determine the authenticity of the generated image.The proposed network performed qualitatively better than existing single-image inpainting algorithms and baseline algorithms.展开更多
The recent advancements in the field of Virtual Reality(VR)and Augmented Reality(AR)have a substantial impact on modern day technology by digitizing each and everything related to human life and open the doors to the ...The recent advancements in the field of Virtual Reality(VR)and Augmented Reality(AR)have a substantial impact on modern day technology by digitizing each and everything related to human life and open the doors to the next generation Software Technology(Soft Tech).VR and AR technology provide astonishing immersive contents with the help of high quality stitched panoramic contents and 360°imagery that widely used in the education,gaming,entertainment,and production sector.The immersive quality of VR and AR contents are greatly dependent on the perceptual quality of panoramic or 360°images,in fact a minor visual distortion can significantly degrade the overall quality.Thus,to ensure the quality of constructed panoramic contents for VR and AR applications,numerous Stitched Image Quality Assessment(SIQA)methods have been proposed to assess the quality of panoramic contents before using in VR and AR.In this survey,we provide a detailed overview of the SIQA literature and exclusively focus on objective SIQA methods presented till date.For better understanding,the objective SIQA methods are classified into two classes namely Full-Reference SIQA and No-Reference SIQA approaches.Each class is further categorized into traditional and deep learning-based methods and examined their performance for SIQA task.Further,we shortlist the publicly available benchmark SIQA datasets and evaluation metrices used for quality assessment of panoramic contents.In last,we highlight the current challenges in this area based on the existing SIQA methods and suggest future research directions that need to be target for further improvement in SIQA domain.展开更多
Inspired by the unique structure of insect compound eyes,a multi-channel image acquisition system is designed to photograph a cylindrical panorama of its surroundings with one shot. The hardware structure consists of ...Inspired by the unique structure of insect compound eyes,a multi-channel image acquisition system is designed to photograph a cylindrical panorama of its surroundings with one shot. The hardware structure consists of an embedded ARM system and one array of 16 micro-image sensors. The system achieves the synchronization of captured photos in 10 ms,as well as 10 f /s video capture. The software architecture includes the TCP /IP protocol,video capture procedures in"Poll/Read"or"video streaming"modes,thread pool monitoring in multi-threading mutex,synchronization control with the"event""mutex signal"and"critical region"functions,and a synthetic image algorithm characterized by its portability,modularity,and remote transmission. The panoramic imaging system is expected to be a vision sensor for mobile robotics.展开更多
Introduction Primary liver cancer, the second most common cause of cancer related death worldwide, presents ethnic, etiological, sex, and geographical diversity2 （Figure 1A）. At the histological level, liver cancer ...Introduction Primary liver cancer, the second most common cause of cancer related death worldwide, presents ethnic, etiological, sex, and geographical diversity2 （Figure 1A）. At the histological level, liver cancer includes two major types： hepatocellular carcinoma （HCC, about 80%） and cholangiocarcinoma （CCA, about 15%）. Many etiological factors contribute to HCC development, such as hepatitis B virus （HBV）, hepatitis C virus （HCV）, aflatoxin B1 （AFB1）, alcohol, and metabolic diseases3. By contrast, the major risk factors for CCA are liver flukes （Opisthorchis viverrini and Clonorchis sinensis） and primary sclerosing cholangitis4,展开更多
BACKGROUND The diagnosis of coronoid process hyperplasia(CPH)is usually based on symptoms and radiological imaging.Because of its similar symptoms,it can be confused with temporomandibular joint diseases.Therefore,an ...BACKGROUND The diagnosis of coronoid process hyperplasia(CPH)is usually based on symptoms and radiological imaging.Because of its similar symptoms,it can be confused with temporomandibular joint diseases.Therefore,an objective and reproducible way of diagnosis should be determined.AIM To investigate CPH using Levandoski analysis on panoramic radiographs to determine its prevalence.METHODS A total of 300 panoramic radiograph images(600 coronoid processes)were examined.Having measured the Condyle-Gonion(Cd-Go)and Coronoid-Gonion(Cor-Go)distances,the Cor-Go:Cd-Go ratio was calculated for the left and right sides of each image.RESULTS There was a statistically significant difference in Cd-Go and Cor-Go distances between male and female participants(P<0.001).There was no statistically significant relationship between Cor-Go:Cd-Go ratios and gender(P>0.05).CONCLUSION Cd-Go and Cor-Go distances were statistically significantly increased in males on both the left and right sides.The ratio of Cor-Go:Cd-Go was preserved in both genders.The prevalence of CPH was found to be 0.3%.展开更多
In light of the limited efficacy of conventional methods for identifying pavement cracks and the absence of comprehensive depth and location data in two-dimensional photographs,this study presents an intelligent strat...In light of the limited efficacy of conventional methods for identifying pavement cracks and the absence of comprehensive depth and location data in two-dimensional photographs,this study presents an intelligent strategy for extracting road cracks.This methodology involves the integration of laser point cloud data obtained from a vehicle-mounted system and a panoramic sequence of images.The study employs a vehicle-mounted LiDAR measurement system to acquire laser point cloud and panoramic sequence image data simultaneously.A convolutional neural network is utilized to extract cracks from the panoramic sequence image.The extracted sequence image is then aligned with the laser point cloud,enabling the assignment of RGB information to the vehicle-mounted three dimensional(3D)point cloud and location information to the two dimensional(2D)panoramic image.Additionally,a threshold value is set based on the crack elevation change to extract the aligned roadway point cloud.The three-dimensional data pertaining to the cracks can be acquired.The experimental findings demonstrate that the use of convolutional neural networks has yielded noteworthy outcomes in the extraction of road cracks.The utilization of point cloud and image alignment techniques enables the extraction of precise location data pertaining to road cracks.This approach exhibits superior accuracy when compared to conventional methods.Moreover,it facilitates rapid and accurate identification and localization of road cracks,thereby playing a crucial role in ensuring road maintenance and traffic safety.Consequently,this technique finds extensive application in the domains of intelligent transportation and urbanization development.The technology exhibits significant promise for use in the domains of intelligent transportation and city development.展开更多
An overall bi-directional panoramic solar system exploration activity,not just looking at the solar system at a macro level and helping to build a simulation model for the solar system,but the probe will also be able ...An overall bi-directional panoramic solar system exploration activity,not just looking at the solar system at a macro level and helping to build a simulation model for the solar system,but the probe will also be able to explore the Milky Way and the vast universe from a much wider perspective.By observing the characteristics of the solar system,solar wind,ionization envelope and other parameters from a bi-directional panorama on both sides of the solar ecliptic plane,it will assist the scientific community and human kind to understand the solar system in a more extensive,deeper and systematic way than before.The exploration can be done in two steps.The first step is to launch a solar polar probe.Secondly to launch a bi-directional probe orbiting the galaxy in sync with the sun.展开更多
In this paper,we propose a novel approach to visualizing global geographical information:a panoramic sphere in an immersive environment.The whole geographical surface can be observed through the rotating of heads as t...In this paper,we propose a novel approach to visualizing global geographical information:a panoramic sphere in an immersive environment.The whole geographical surface can be observed through the rotating of heads as the viewpoint of the panoramic sphere is inside the sphere.We compared three approaches to visualizing the earth for rendering the geographical information in a virtual reality environment.On the tasks of terrestrial and marine geographical information,we compare the visualization effects on a)a globe,b)a flat map and c)a panoramic sphere.Terrestrial geographical information tasks include the area comparison and direction determination.Marine geographical information tasks contain the visualization of sea surface temperature and sea surface currents.For terrestrial geographical information tasks,the experimental results show that the panoramic sphere outperforms the globe and the flat map,with a higher average accuracy and a shorter time.On marine geographical information task,the panoramic sphere visualization is also superior to the flat map and the globe in an immersive environment for the sea surface temperature data and the sea surface current fields.In all three visualization experiments,the panoramic sphere is most preferred by the participants,particularly for global,transcontinental and transoceanic needs.展开更多
An effective algorithm of electronic image stabilization （EIS） of catadioptric panoramic imaging system for track robots is presented. The key techniques of this algorithm are as follows：① A model of electronic im...An effective algorithm of electronic image stabilization （EIS） of catadioptric panoramic imaging system for track robots is presented. The key techniques of this algorithm are as follows：① A model of electronic image stabilization is built by analyzing the imaging theory and the principle of EIS, and the image shift function of unwrapped panoramic image is deduced;② The relationship equation between motion estimation parameters of annular panoramic image and motion estimation parameters of unwrapped panoramic image is developed according to the constrained aspect ratio of real objects, motion parameters of annular panoramic image are firstly estimated, and then motion parameters among the image shift function are carried out according to the relationship equation;③ An excessive stabilization threshold is presented to prevent the phenomena of excessive stabilization, and the Kalman filtering is adopted to smooth the image sequences. Numerical experimental results show that this algorithm can effectively smooth out the unwanted motion and follow the intentional camera movement under certain resolutions.展开更多
The computer evaluation of weld X-ray film is an attractive technique for weld seam NDT （ nondestructive testing）. To achieve this target, digitalization of film is the first step and automatic defect identification...The computer evaluation of weld X-ray film is an attractive technique for weld seam NDT （ nondestructive testing）. To achieve this target, digitalization of film is the first step and automatic defect identification is another key technique. In this paper, a weld X-ray film digitalizing system has been established with linear array CCD and highlight LED light source. Its space resolution can reach 0. 04 mm/pixel and scanning speed can reach 100 mm/s for an industrial film. The transfer function curves of the system have been measured and the results indicate that its image gray resolution can reach 88 G/D at 4. 5D, and its dynamic range can be wider than 2. OD. In order to facilitate the evaluation of large welded structure, a panoramic evaluation algorithm is developed also. The algorithm includes image matching, image fusion and panoramic evaluation of the long linked film image.展开更多
Complex terrain and working equipment in coal mine underground need a way to ensure coal mine safety. In this paper, the way to monitor the real-time status of underground equipment was put forward, and it was proved ...Complex terrain and working equipment in coal mine underground need a way to ensure coal mine safety. In this paper, the way to monitor the real-time status of underground equipment was put forward, and it was proved to be effective as commanding and dispatching system. Monitoring system for underground equipment based on panoramic images was effectively combined with real-time sensor data and static panoramic images of underground surrounding, which not only realizes real-time status monitoring for underground equipment, but also gets a direct scene for underground surrounding. B/S mode was applied in the monitoring system and this is convenient for users to monitor the equipment. Meantime, it can reduce the waste of the data resource.展开更多
文摘With the development of computer vision technology,panoramic image stitching has been widely used in fields such as scene reconstruction.A single traditional image cannot fully capture the panoramic view of the iconic East Gate of the South Campus of Shaanxi University of Technology.Therefore,this project aims to technically fuse multiple partial images into a complete panoramic image,enabling comprehensive recording and visual presentation of the architectural landscapes and spatial environments in this area.This report first introduces the technical background and application scenarios,clarifying the necessity of panoramic image stitching in campus landscape recording.It then elaborates on the core objectives and practical values,highlighting the role of technical solutions in improving image quality.Technically,a modular system design based on OpenCV is adopted,including modules such as image preprocessing,feature extraction and matching,image registration,fusion,and post-processing.Specifically,the SIFT algorithm is applied for feature extraction,KNN combined with ratio testing is used for feature matching,image registration is achieved by calculating the homography matrix,the fusion process utilizes multiband blending and Laplacian pyramid,and post-processing includes operations such as black area filling and CLAHE contrast enhancement.The experiment was conducted in a specific hardware and software environment using five overlapping images.After preprocessing,stitching,detail enhancement,and black edge repair,a panoramic image was successfully generated.The results show that the panoramic image fully presents the relevant scenery,with concealed seams,balanced exposure differences,and strong hierarchical details.This report provides a systematic description of the project’s technical implementation and achievement application.
文摘Panoramic images, offering a 360-degree view, are essential in virtual reality(VR) and augmented reality(AR), enhancing realism with high-quality textures. However, acquiring complete and high-quality panoramic textures is challenging. This paper introduces a method using generative adversarial networks(GANs) and the contrastive language-image pretraining(CLIP) model to restore and control texture in panoramic images. The GAN model captures complex structures and maintains consistency, while CLIP enables fine-grained texture control via semantic text-image associations. GAN inversion optimizes latent codes for precise texture details. The resulting low dynamic range(LDR) images are converted to high dynamic range(HDR) using the Blender engine for seamless texture blending. Experimental results demonstrate the effectiveness and flexibility of this method in panoramic texture restoration and generation.
基金supported in part by the National Natural Science Foundation of China(Grant No.62062003)Natural Science Foundation of Ningxia(Grant No.2023AAC03293).
文摘The instance segmentation of impacted teeth in the oral panoramic X-ray images is hotly researched.However,due to the complex structure,low contrast,and complex background of teeth in panoramic X-ray images,the task of instance segmentation is technically tricky.In this study,the contrast between impacted Teeth and periodontal tissues such as gingiva,periodontalmembrane,and alveolar bone is low,resulting in fuzzy boundaries of impacted teeth.Amodel based on Teeth YOLACT is proposed to provide amore efficient and accurate solution for the segmentation of impacted teeth in oral panoramic X-ray films.Firstly,a Multi-scale Res-Transformer Module(MRTM)is designed.In the module,depthwise separable convolutions with different receptive fields are used to enhance the sensitivity of the model to lesion size.Additionally,the Vision Transformer is integrated to improve the model’s ability to perceive global features.Secondly,the Context Interaction-awareness Module(CIaM)is designed to fuse deep and shallow features.The deep semantic features guide the shallow spatial features.Then,the shallow spatial features are embedded into the deep semantic features,and the cross-weighted attention mechanism is used to aggregate the deep and shallow features efficiently,and richer context information is obtained.Thirdly,the Edge-preserving perceptionModule(E2PM)is designed to enhance the teeth edge features.The first-order differential operator is used to get the tooth edge weight,and the perception ability of tooth edge features is improved.The shallow spatial feature is fused by linear mapping,weight concatenation,and matrix multiplication operations to preserve the tooth edge information.Finally,comparison experiments and ablation experiments are conducted on the oral panoramic X-ray image datasets.The results show that the APdet,APseg,ARdet,ARseg,mAPdet,and mAPseg indicators of the proposed model are 89.9%,91.9%,77.4%,77.6%,72.8%,and 73.5%,respectively.This study further verifies the application potential of the method combining multi-scale feature extraction,multi-scale feature fusion,and edge perception enhancement in medical image segmentation,which provides a valuable reference for future related research.
基金Supported by Wuhu Municipal Science and Technology Bureau of Anhui Province,No.2022cg43.
文摘BACKGROUND The objective of this study was to evaluate the use of combined parallax-free panoramic X-ray imaging during surgery by enabling the mobile C-arm with minimally invasive plate osteosynthesis(MIPO)in the management of proximal humeral shaft fractures.AIM To evaluate parallax-free panoramic X-ray images during surgery.METHODS A retrospective series of 17 proximal humeral shaft fractures were treated using combined parallax-free panoramic X-ray imaging during surgery by enabling the mobile C-arm with MIPO.The operating time and radiation exposure time were recorded,and early postoperative physical therapy and partial weight bearing were encouraged.Patients were followed at regular intervals and evaluated radiographically and clinically.RESULTS The mean operating time and radiation time were 73(range,49-95)minutes and 57(range:36-98)seconds,respectively.No complications occurred during the operation.All fractures healed at an average of 16.9(range:15-23)weeks.The average Constant-Murley score for all the patients was 89.5(range:75-100)points.None of the patients showed symptoms of vascular or nerve damage or wound infection.Three months after the operation,none of the patients developed subacromial impingement syndrome.No loosening or fracture of the implants occurred.The frontal and lateral radiographs showed good alignment.CONCLUSION We consider that MIPO with combined parallax-free panoramic X-ray imaging during surgery is an efficient method for treating proximal humeral shaft fractures,and could significantly reduce operative morbidity as well as lower the rate of intra-and postoperative complications.
基金National Natural Science Foundation of China(No.41761079)Top Young Talent Project of Yunnan Province in China.
文摘The existing panoramic image matching methods are difficult to overcome the non-uniform features of the projection transformation of the target object,and hence the issue of unstable corresponding points matching is usually induced.This paper aims to solve the difficulty by proposing a sparse depth point set matching method based on panoramic disparity.By constructing a panoramic disparity model of stereo panoramic images,the disparity between corresponding points can be precisely estimated,and the robustness and effectiveness of corresponding points matching between stereo panoramic images is improved under the epipolar geometric constraints.Firstly,by defining the panoramic disparity,the corresponding angle of panoramic disparity is derived,and the matching areas of corresponding points based on the disparity corresponding angle difference are partitioned.Secondly,the optimization strategy in the matching process of corresponding points is constructed to provide stable matching results for generating sparse depth maps based on the disparity region range and epipolar geometric relationship.Experiments show that the proposed method can not only obtain more stable matching results but also exhibit higher computational efficiency than existing algorithms.
基金supported by the National Key Research and Development Program of China under Grant No.2022YFA1602003,entitled"Intelligent Monitoring of Taishan Neutrino Detector".
文摘In panoramic images,the geometric distortion caused by wide-angle lenses makes traditional semantic segmentation methods difficult to accurately segment the glass areas.To address the challenges of capturing spatial features and integrating context information,we propose the Panoramic Glass Image Segmentation Network(PGISNet).This network integrates the Matrix Decomposition Base Module(MDBM),the Transparent Perception Consistency Module(TACM),the Context and Texture Compensation Module(CTCM),and the Multi-scale Gated Context Attention Module(MGCA),constructing a progressive feature processing flow.Experimental results on the PanoGlassV2 benchmark test show that PGISNet achieved 90.03%IoU,94.76%F-score,and 94.0%PA,significantly outperforming existing methods,verifying its effectiveness and advancement in the panoramic image glass segmentation task.
文摘To satisfy the requirements of real-time and high quality mosaics, a bionic compound eye visual system was designed by simulating the visual mechanism of a fly compound eye. Several CCD cameras were used in this system to imitate the small eyes of a compound eye. Based on the optical analysis of this system, a direct panoramic image mosaic algorithm was proposed. Several sub-images were collected by the bionic compound eye visual system, and then the system obtained the overlapping proportions of these sub-images and cut the overlap sections of the neighboring images. Thus, a panoramic image with a large field of view was directly mosaicked, which expanded the field and guaranteed the high resolution. The experimental results show that the time consumed by the direct mosaic algorithm is only 2.2% of that by the traditional image mosaic algorithm while guaranteeing mosaic quality. Furthermore, the proposed method effectively solved the problem of misalignment of the mosaic image and eliminated mosaic cracks as a result of the illumination factor and other factors. This method has better real-time properties compared to other methods.
文摘Abstract： Based on digital signal processor（DSP） and field programmable gate array（FPGA） techniques, the architecture of super large view field（SLVF） panoramic night vision image processing hardware platform was established. The panoramic unwrapping and correcting algorithm, up to a full 360°, based on coordinate rotation digital computer （CORDIC） and night vision image enhancement algorithm, based on histogram equalization theory and edge detection theory, was presented in this paper, with the purpose of processing night vision dynamic panoramic annular image. The annular image can be unwrapped and corrected to conventional rectangular panorama by the panoramic image processing algorithm, which uses the pipelined CORDIC configuration to realize a trigonometric function generator with high speed and high precision. Histogram equalization algorithm can perfectly enhance the contrast of the night vision image. Edge detection algorithm can be propitious to find and detect small dim dynamic targets in night vision circumstances. After abundant experiment, the al- gorithm for panoramic image processing and night vision image enhancement is successfully implemented in FPGA and DSP. The panoramic night vision image system is a compact device, with no external rotating parts. And the system can reliably and dynamically detect 360＊ SLVF panoramic night vision image.
基金the Project of National Natural Science Foundation of China(Grant No.61773059)the Project of National Defense Technology Foundation Program of China(Grant No.20230028) to provide fund for conducting experiments。
文摘In the visual positioning of Unmanned Ground Vehicle(UGV),the visual odometer based on direct sparse method(DSO) has the advantages of small amount of calculation,high real-time performance and high robustness,so it is more widely used than the visual odometer based on feature point method.Ordinary vision sensors have a narrower viewing angle than panoramic vision sensors,and there are fewer road signs in a single frame of image,resulting in poor road sign tracking and positioning capabilities,and severely restricting the development of visual odometry.Based on these considerations,this paper proposes a binocular stereo panoramic vision positioning algorithm based on extended DSO,which can solve these problems well.The experimental results show that the binocular stereo panoramic vision positioning algorithm based on the extended DSO can directly obtain the panoramic depth image around the UGV,which greatly improves the accuracy and robustness of the visual positioning compared with other ordinary visual odometers.It will have widely application prospects in the UGV field in the future.
基金Korea Electric Power Corporation(Grant No.R18XA02).
文摘Inpainting has been continuously studied in the field of computer vision.As artificial intelligence technology developed,deep learning technology was introduced in inpainting research,helping to improve performance.Currently,the input target of an inpainting algorithm using deep learning has been studied from a single image to a video.However,deep learning-based inpainting technology for panoramic images has not been actively studied.We propose a 360-degree panoramic image inpainting method using generative adversarial networks(GANs).The proposed network inputs a 360-degree equirectangular format panoramic image converts it into a cube map format,which has relatively little distortion and uses it as a training network.Since the cube map format is used,the correlation of the six sides of the cube map should be considered.Therefore,all faces of the cube map are used as input for the whole discriminative network,and each face of the cube map is used as input for the slice discriminative network to determine the authenticity of the generated image.The proposed network performed qualitatively better than existing single-image inpainting algorithms and baseline algorithms.
文摘The recent advancements in the field of Virtual Reality(VR)and Augmented Reality(AR)have a substantial impact on modern day technology by digitizing each and everything related to human life and open the doors to the next generation Software Technology(Soft Tech).VR and AR technology provide astonishing immersive contents with the help of high quality stitched panoramic contents and 360°imagery that widely used in the education,gaming,entertainment,and production sector.The immersive quality of VR and AR contents are greatly dependent on the perceptual quality of panoramic or 360°images,in fact a minor visual distortion can significantly degrade the overall quality.Thus,to ensure the quality of constructed panoramic contents for VR and AR applications,numerous Stitched Image Quality Assessment(SIQA)methods have been proposed to assess the quality of panoramic contents before using in VR and AR.In this survey,we provide a detailed overview of the SIQA literature and exclusively focus on objective SIQA methods presented till date.For better understanding,the objective SIQA methods are classified into two classes namely Full-Reference SIQA and No-Reference SIQA approaches.Each class is further categorized into traditional and deep learning-based methods and examined their performance for SIQA task.Further,we shortlist the publicly available benchmark SIQA datasets and evaluation metrices used for quality assessment of panoramic contents.In last,we highlight the current challenges in this area based on the existing SIQA methods and suggest future research directions that need to be target for further improvement in SIQA domain.
基金Supported by the National Natural Science Foundation of China(61233014)the China Postdoctoral Science Foundation(2012M5210711,20123218110031)the National Natural Science Major International Cooperation Projects(61161120323)
文摘Inspired by the unique structure of insect compound eyes,a multi-channel image acquisition system is designed to photograph a cylindrical panorama of its surroundings with one shot. The hardware structure consists of an embedded ARM system and one array of 16 micro-image sensors. The system achieves the synchronization of captured photos in 10 ms,as well as 10 f /s video capture. The software architecture includes the TCP /IP protocol,video capture procedures in"Poll/Read"or"video streaming"modes,thread pool monitoring in multi-threading mutex,synchronization control with the"event""mutex signal"and"critical region"functions,and a synthetic image algorithm characterized by its portability,modularity,and remote transmission. The panoramic imaging system is expected to be a vision sensor for mobile robotics.
基金supported,in part,by the Precision Medical Research Program from Ministry of Science and Technology of China(Grant No.YL 2017YFC0908400)National Science and Technology Major Project for Infectious Disease and Funding(Grant No.YL 17-163-12-ZT-005-095-01)+2 种基金Science and Technology Commission in Ministry of National Defense of China(Grant No.YL 17-163-12-ZT-005-095-01)Xinwei Wang was supported by the intramural research program of the Center for Cancer Research,National Cancer Institute of the United StatesJunfang Ji was supported by the Thousand Young Talents Plan of China,National Natural Science Foundation of China(Grant No.81672905)
文摘Introduction Primary liver cancer, the second most common cause of cancer related death worldwide, presents ethnic, etiological, sex, and geographical diversity2 （Figure 1A）. At the histological level, liver cancer includes two major types： hepatocellular carcinoma （HCC, about 80%） and cholangiocarcinoma （CCA, about 15%）. Many etiological factors contribute to HCC development, such as hepatitis B virus （HBV）, hepatitis C virus （HCV）, aflatoxin B1 （AFB1）, alcohol, and metabolic diseases3. By contrast, the major risk factors for CCA are liver flukes （Opisthorchis viverrini and Clonorchis sinensis） and primary sclerosing cholangitis4,
文摘BACKGROUND The diagnosis of coronoid process hyperplasia(CPH)is usually based on symptoms and radiological imaging.Because of its similar symptoms,it can be confused with temporomandibular joint diseases.Therefore,an objective and reproducible way of diagnosis should be determined.AIM To investigate CPH using Levandoski analysis on panoramic radiographs to determine its prevalence.METHODS A total of 300 panoramic radiograph images(600 coronoid processes)were examined.Having measured the Condyle-Gonion(Cd-Go)and Coronoid-Gonion(Cor-Go)distances,the Cor-Go:Cd-Go ratio was calculated for the left and right sides of each image.RESULTS There was a statistically significant difference in Cd-Go and Cor-Go distances between male and female participants(P<0.001).There was no statistically significant relationship between Cor-Go:Cd-Go ratios and gender(P>0.05).CONCLUSION Cd-Go and Cor-Go distances were statistically significantly increased in males on both the left and right sides.The ratio of Cor-Go:Cd-Go was preserved in both genders.The prevalence of CPH was found to be 0.3%.
基金founded by National Key R&D Program of China (No.2021YFB2601200)National Natural Science Foundation of China (No.42171416)Teacher Support Program for Pyramid Talent Training Project of Beijing University of Civil Engineering and Architecture (No.JDJQ20200307).
文摘In light of the limited efficacy of conventional methods for identifying pavement cracks and the absence of comprehensive depth and location data in two-dimensional photographs,this study presents an intelligent strategy for extracting road cracks.This methodology involves the integration of laser point cloud data obtained from a vehicle-mounted system and a panoramic sequence of images.The study employs a vehicle-mounted LiDAR measurement system to acquire laser point cloud and panoramic sequence image data simultaneously.A convolutional neural network is utilized to extract cracks from the panoramic sequence image.The extracted sequence image is then aligned with the laser point cloud,enabling the assignment of RGB information to the vehicle-mounted three dimensional(3D)point cloud and location information to the two dimensional(2D)panoramic image.Additionally,a threshold value is set based on the crack elevation change to extract the aligned roadway point cloud.The three-dimensional data pertaining to the cracks can be acquired.The experimental findings demonstrate that the use of convolutional neural networks has yielded noteworthy outcomes in the extraction of road cracks.The utilization of point cloud and image alignment techniques enables the extraction of precise location data pertaining to road cracks.This approach exhibits superior accuracy when compared to conventional methods.Moreover,it facilitates rapid and accurate identification and localization of road cracks,thereby playing a crucial role in ensuring road maintenance and traffic safety.Consequently,this technique finds extensive application in the domains of intelligent transportation and urbanization development.The technology exhibits significant promise for use in the domains of intelligent transportation and city development.
文摘An overall bi-directional panoramic solar system exploration activity,not just looking at the solar system at a macro level and helping to build a simulation model for the solar system,but the probe will also be able to explore the Milky Way and the vast universe from a much wider perspective.By observing the characteristics of the solar system,solar wind,ionization envelope and other parameters from a bi-directional panorama on both sides of the solar ecliptic plane,it will assist the scientific community and human kind to understand the solar system in a more extensive,deeper and systematic way than before.The exploration can be done in two steps.The first step is to launch a solar polar probe.Secondly to launch a bi-directional probe orbiting the galaxy in sync with the sun.
基金This research was funded by the Science and Technology Innovation Project for Laoshan Laboratory(No.LSKJ202204303)the National Natural Science Foundation of China(No.42030406)+1 种基金the Fundamental Research Funds for the Central Universities(No.202261006)the ESANRSCC Scientific Cooperation Project on Earth Observation Science and Applications:Dragon 5(No.58393).
文摘In this paper,we propose a novel approach to visualizing global geographical information:a panoramic sphere in an immersive environment.The whole geographical surface can be observed through the rotating of heads as the viewpoint of the panoramic sphere is inside the sphere.We compared three approaches to visualizing the earth for rendering the geographical information in a virtual reality environment.On the tasks of terrestrial and marine geographical information,we compare the visualization effects on a)a globe,b)a flat map and c)a panoramic sphere.Terrestrial geographical information tasks include the area comparison and direction determination.Marine geographical information tasks contain the visualization of sea surface temperature and sea surface currents.For terrestrial geographical information tasks,the experimental results show that the panoramic sphere outperforms the globe and the flat map,with a higher average accuracy and a shorter time.On marine geographical information task,the panoramic sphere visualization is also superior to the flat map and the globe in an immersive environment for the sea surface temperature data and the sea surface current fields.In all three visualization experiments,the panoramic sphere is most preferred by the participants,particularly for global,transcontinental and transoceanic needs.
基金Supported by State Key Laboratory of Explosion Science and Technology Foundation(ZDKT08-05)
文摘An effective algorithm of electronic image stabilization （EIS） of catadioptric panoramic imaging system for track robots is presented. The key techniques of this algorithm are as follows：① A model of electronic image stabilization is built by analyzing the imaging theory and the principle of EIS, and the image shift function of unwrapped panoramic image is deduced;② The relationship equation between motion estimation parameters of annular panoramic image and motion estimation parameters of unwrapped panoramic image is developed according to the constrained aspect ratio of real objects, motion parameters of annular panoramic image are firstly estimated, and then motion parameters among the image shift function are carried out according to the relationship equation;③ An excessive stabilization threshold is presented to prevent the phenomena of excessive stabilization, and the Kalman filtering is adopted to smooth the image sequences. Numerical experimental results show that this algorithm can effectively smooth out the unwanted motion and follow the intentional camera movement under certain resolutions.
文摘The computer evaluation of weld X-ray film is an attractive technique for weld seam NDT （ nondestructive testing）. To achieve this target, digitalization of film is the first step and automatic defect identification is another key technique. In this paper, a weld X-ray film digitalizing system has been established with linear array CCD and highlight LED light source. Its space resolution can reach 0. 04 mm/pixel and scanning speed can reach 100 mm/s for an industrial film. The transfer function curves of the system have been measured and the results indicate that its image gray resolution can reach 88 G/D at 4. 5D, and its dynamic range can be wider than 2. OD. In order to facilitate the evaluation of large welded structure, a panoramic evaluation algorithm is developed also. The algorithm includes image matching, image fusion and panoramic evaluation of the long linked film image.
基金Supported by the National Natural Science Foundation of China （51075029）
文摘Complex terrain and working equipment in coal mine underground need a way to ensure coal mine safety. In this paper, the way to monitor the real-time status of underground equipment was put forward, and it was proved to be effective as commanding and dispatching system. Monitoring system for underground equipment based on panoramic images was effectively combined with real-time sensor data and static panoramic images of underground surrounding, which not only realizes real-time status monitoring for underground equipment, but also gets a direct scene for underground surrounding. B/S mode was applied in the monitoring system and this is convenient for users to monitor the equipment. Meantime, it can reduce the waste of the data resource.
