With the development of computer vision technology,panoramic image stitching has been widely used in fields such as scene reconstruction.A single traditional image cannot fully capture the panoramic view of the iconic...With the development of computer vision technology,panoramic image stitching has been widely used in fields such as scene reconstruction.A single traditional image cannot fully capture the panoramic view of the iconic East Gate of the South Campus of Shaanxi University of Technology.Therefore,this project aims to technically fuse multiple partial images into a complete panoramic image,enabling comprehensive recording and visual presentation of the architectural landscapes and spatial environments in this area.This report first introduces the technical background and application scenarios,clarifying the necessity of panoramic image stitching in campus landscape recording.It then elaborates on the core objectives and practical values,highlighting the role of technical solutions in improving image quality.Technically,a modular system design based on OpenCV is adopted,including modules such as image preprocessing,feature extraction and matching,image registration,fusion,and post-processing.Specifically,the SIFT algorithm is applied for feature extraction,KNN combined with ratio testing is used for feature matching,image registration is achieved by calculating the homography matrix,the fusion process utilizes multiband blending and Laplacian pyramid,and post-processing includes operations such as black area filling and CLAHE contrast enhancement.The experiment was conducted in a specific hardware and software environment using five overlapping images.After preprocessing,stitching,detail enhancement,and black edge repair,a panoramic image was successfully generated.The results show that the panoramic image fully presents the relevant scenery,with concealed seams,balanced exposure differences,and strong hierarchical details.This report provides a systematic description of the project’s technical implementation and achievement application.展开更多
Panoramic images, offering a 360-degree view, are essential in virtual reality(VR) and augmented reality(AR), enhancing realism with high-quality textures. However, acquiring complete and high-quality panoramic textur...Panoramic images, offering a 360-degree view, are essential in virtual reality(VR) and augmented reality(AR), enhancing realism with high-quality textures. However, acquiring complete and high-quality panoramic textures is challenging. This paper introduces a method using generative adversarial networks(GANs) and the contrastive language-image pretraining(CLIP) model to restore and control texture in panoramic images. The GAN model captures complex structures and maintains consistency, while CLIP enables fine-grained texture control via semantic text-image associations. GAN inversion optimizes latent codes for precise texture details. The resulting low dynamic range(LDR) images are converted to high dynamic range(HDR) using the Blender engine for seamless texture blending. Experimental results demonstrate the effectiveness and flexibility of this method in panoramic texture restoration and generation.展开更多
The instance segmentation of impacted teeth in the oral panoramic X-ray images is hotly researched.However,due to the complex structure,low contrast,and complex background of teeth in panoramic X-ray images,the task o...The instance segmentation of impacted teeth in the oral panoramic X-ray images is hotly researched.However,due to the complex structure,low contrast,and complex background of teeth in panoramic X-ray images,the task of instance segmentation is technically tricky.In this study,the contrast between impacted Teeth and periodontal tissues such as gingiva,periodontalmembrane,and alveolar bone is low,resulting in fuzzy boundaries of impacted teeth.Amodel based on Teeth YOLACT is proposed to provide amore efficient and accurate solution for the segmentation of impacted teeth in oral panoramic X-ray films.Firstly,a Multi-scale Res-Transformer Module(MRTM)is designed.In the module,depthwise separable convolutions with different receptive fields are used to enhance the sensitivity of the model to lesion size.Additionally,the Vision Transformer is integrated to improve the model’s ability to perceive global features.Secondly,the Context Interaction-awareness Module(CIaM)is designed to fuse deep and shallow features.The deep semantic features guide the shallow spatial features.Then,the shallow spatial features are embedded into the deep semantic features,and the cross-weighted attention mechanism is used to aggregate the deep and shallow features efficiently,and richer context information is obtained.Thirdly,the Edge-preserving perceptionModule(E2PM)is designed to enhance the teeth edge features.The first-order differential operator is used to get the tooth edge weight,and the perception ability of tooth edge features is improved.The shallow spatial feature is fused by linear mapping,weight concatenation,and matrix multiplication operations to preserve the tooth edge information.Finally,comparison experiments and ablation experiments are conducted on the oral panoramic X-ray image datasets.The results show that the APdet,APseg,ARdet,ARseg,mAPdet,and mAPseg indicators of the proposed model are 89.9%,91.9%,77.4%,77.6%,72.8%,and 73.5%,respectively.This study further verifies the application potential of the method combining multi-scale feature extraction,multi-scale feature fusion,and edge perception enhancement in medical image segmentation,which provides a valuable reference for future related research.展开更多
BACKGROUND The objective of this study was to evaluate the use of combined parallax-free panoramic X-ray imaging during surgery by enabling the mobile C-arm with minimally invasive plate osteosynthesis(MIPO)in the man...BACKGROUND The objective of this study was to evaluate the use of combined parallax-free panoramic X-ray imaging during surgery by enabling the mobile C-arm with minimally invasive plate osteosynthesis(MIPO)in the management of proximal humeral shaft fractures.AIM To evaluate parallax-free panoramic X-ray images during surgery.METHODS A retrospective series of 17 proximal humeral shaft fractures were treated using combined parallax-free panoramic X-ray imaging during surgery by enabling the mobile C-arm with MIPO.The operating time and radiation exposure time were recorded,and early postoperative physical therapy and partial weight bearing were encouraged.Patients were followed at regular intervals and evaluated radiographically and clinically.RESULTS The mean operating time and radiation time were 73(range,49-95)minutes and 57(range:36-98)seconds,respectively.No complications occurred during the operation.All fractures healed at an average of 16.9(range:15-23)weeks.The average Constant-Murley score for all the patients was 89.5(range:75-100)points.None of the patients showed symptoms of vascular or nerve damage or wound infection.Three months after the operation,none of the patients developed subacromial impingement syndrome.No loosening or fracture of the implants occurred.The frontal and lateral radiographs showed good alignment.CONCLUSION We consider that MIPO with combined parallax-free panoramic X-ray imaging during surgery is an efficient method for treating proximal humeral shaft fractures,and could significantly reduce operative morbidity as well as lower the rate of intra-and postoperative complications.展开更多
In light of the limited efficacy of conventional methods for identifying pavement cracks and the absence of comprehensive depth and location data in two-dimensional photographs,this study presents an intelligent strat...In light of the limited efficacy of conventional methods for identifying pavement cracks and the absence of comprehensive depth and location data in two-dimensional photographs,this study presents an intelligent strategy for extracting road cracks.This methodology involves the integration of laser point cloud data obtained from a vehicle-mounted system and a panoramic sequence of images.The study employs a vehicle-mounted LiDAR measurement system to acquire laser point cloud and panoramic sequence image data simultaneously.A convolutional neural network is utilized to extract cracks from the panoramic sequence image.The extracted sequence image is then aligned with the laser point cloud,enabling the assignment of RGB information to the vehicle-mounted three dimensional(3D)point cloud and location information to the two dimensional(2D)panoramic image.Additionally,a threshold value is set based on the crack elevation change to extract the aligned roadway point cloud.The three-dimensional data pertaining to the cracks can be acquired.The experimental findings demonstrate that the use of convolutional neural networks has yielded noteworthy outcomes in the extraction of road cracks.The utilization of point cloud and image alignment techniques enables the extraction of precise location data pertaining to road cracks.This approach exhibits superior accuracy when compared to conventional methods.Moreover,it facilitates rapid and accurate identification and localization of road cracks,thereby playing a crucial role in ensuring road maintenance and traffic safety.Consequently,this technique finds extensive application in the domains of intelligent transportation and urbanization development.The technology exhibits significant promise for use in the domains of intelligent transportation and city development.展开更多
In response to the challenges posed by insufficient real-time performance and suboptimal matching accuracy of traditional feature matching algorithms within automotive panoramic surround view systems,this paper has pr...In response to the challenges posed by insufficient real-time performance and suboptimal matching accuracy of traditional feature matching algorithms within automotive panoramic surround view systems,this paper has proposed a high-performance dimension reduction parallel matching algorithm that integrates Principal Component Analysis(PCA)and Dual-Heap Filtering(DHF).The algorithm employs PCA to map the feature points into the lower-dimensional space and employs the square of Euclidean distance for feature matching,which significantly reduces computational complexity.To ensure the accuracy of feature matching,the algorithm utilizes Dual-Heap Filtering to filter and refine matched point pairs.To further enhance matching speed and make optimal use of computational resources,the algorithm introduces a multi-core parallel matching strategy,greatly elevating the efficiency of feature matching.Compared to Scale-Invariant Feature Transform(SIFT)and Speeded Up Robust Features(SURF),the proposed algorithm reduces matching time by 77%to 80%and concurrently enhances matching accuracy by 5%to 15%.Experimental results demonstrate that the proposed algorithmexhibits outstanding real-time matching performance and accuracy,effectivelymeeting the feature-matching requirements of automotive panoramic surround view systems.展开更多
In dentistry, panoramic X-ray images are extensively used by dentists for tooth structure analysis and disease diagnosis. However, the manual analysis of these images is time-consuming and prone to misdiagnosis or ove...In dentistry, panoramic X-ray images are extensively used by dentists for tooth structure analysis and disease diagnosis. However, the manual analysis of these images is time-consuming and prone to misdiagnosis or overlooked. While deep learning techniques have been employed to segment teeth in panoramic X-ray images, accurate segmentation of individual teeth remains an underexplored area. In this study, we propose an end-to-end deep learning method that effectively addresses this challenge by employing an improved combinatorial loss function to separate the boundaries of adjacent teeth, enabling precise segmentation of individual teeth in panoramic X-ray images. We validate the feasibility of our approach using a challenging dataset. By training our segmentation network on 115 panoramic X-ray images, we achieve an intersection over union (IoU) of 86.56% for tooth segmentation and an accuracy of 65.52% in tooth counting on 87 test set images. Experimental results demonstrate the significant improvement of our proposed method in single tooth segmentation compared to existing methods.展开更多
The project discusses the development of a deep learning model to detect osteoporosis from dental panoramic X-Ray images. It provides an in-depth understanding of human bone structure, osteoporosis, its symptoms, caus...The project discusses the development of a deep learning model to detect osteoporosis from dental panoramic X-Ray images. It provides an in-depth understanding of human bone structure, osteoporosis, its symptoms, causes, prevalence, and risk factors. The project also explains bone density measurement using dual-energy X-ray absorptiometry (DEXA) and the application of artificial intelligence (AI) and machine learning (ML) in medical imaging. The study uses panoramic dental X-rays to evaluate AI technology in dental imaging and classification of mandible inferior cortical based on Klemetti and Kolmakow criteria. The model architecture consists of convolutional, pooling, fully connected, ReLU, and Softmax layers. Dropout and early stopping are added to the model. The training process uses the train-test approach with 100 epochs and a batch size of 32, and performance evaluation measures such as accuracy, sensitivity, specificity, and F1-score are used to assess the classifier’s performance. The findings and methodology provide a comprehensive understanding of the application of deep learning in the detection of osteoporosis from dental panoramic X-Ray images, and the study demonstrates a robust approach to implementing AI in medical imaging for osteoporosis detection.展开更多
The purpose of this study is to investigate the effect of Panoramic Virtual Reality(PVR)applied to online earth science classes on students’learning flow.To this end,a PVR learning material was made with a geology le...The purpose of this study is to investigate the effect of Panoramic Virtual Reality(PVR)applied to online earth science classes on students’learning flow.To this end,a PVR learning material was made with a geology learning site,which contains a core geologic concept contained in a high school curriculum in Korea.To this end,a PVR learning material was made at a geologic field site to provide an interactive and engaging way for students to grasp core geologic concepts according to the high school curriculum in Korea.The PVR was applied to online earth science classes with 45 high school students.In order to examine the effect of the PVR on students'learning flow,pre-post learning flow test papers were used,then matchedsample t-test analysis and students'responses were analyzed.The result shows online classes with PVR have positive effects on learning flow(p<0.05).And it was possible for the students to observe three-dimensional geologic structures effectively in online classes as in offline field trips.And the students'responded with positive feedbacks.These suggest that PVR in online classes can be used as an effective teaching method,which can improve students'flow and eventually understanding subjects.展开更多
To satisfy the requirements of real-time and high quality mosaics, a bionic compound eye visual system was designed by simulating the visual mechanism of a fly compound eye. Several CCD cameras were used in this syste...To satisfy the requirements of real-time and high quality mosaics, a bionic compound eye visual system was designed by simulating the visual mechanism of a fly compound eye. Several CCD cameras were used in this system to imitate the small eyes of a compound eye. Based on the optical analysis of this system, a direct panoramic image mosaic algorithm was proposed. Several sub-images were collected by the bionic compound eye visual system, and then the system obtained the overlapping proportions of these sub-images and cut the overlap sections of the neighboring images. Thus, a panoramic image with a large field of view was directly mosaicked, which expanded the field and guaranteed the high resolution. The experimental results show that the time consumed by the direct mosaic algorithm is only 2.2% of that by the traditional image mosaic algorithm while guaranteeing mosaic quality. Furthermore, the proposed method effectively solved the problem of misalignment of the mosaic image and eliminated mosaic cracks as a result of the illumination factor and other factors. This method has better real-time properties compared to other methods.展开更多
Abstract： Based on digital signal processor（DSP） and field programmable gate array（FPGA） techniques, the architecture of super large view field（SLVF） panoramic night vision image processing hardware platform wa...Abstract： Based on digital signal processor（DSP） and field programmable gate array（FPGA） techniques, the architecture of super large view field（SLVF） panoramic night vision image processing hardware platform was established. The panoramic unwrapping and correcting algorithm, up to a full 360°, based on coordinate rotation digital computer （CORDIC） and night vision image enhancement algorithm, based on histogram equalization theory and edge detection theory, was presented in this paper, with the purpose of processing night vision dynamic panoramic annular image. The annular image can be unwrapped and corrected to conventional rectangular panorama by the panoramic image processing algorithm, which uses the pipelined CORDIC configuration to realize a trigonometric function generator with high speed and high precision. Histogram equalization algorithm can perfectly enhance the contrast of the night vision image. Edge detection algorithm can be propitious to find and detect small dim dynamic targets in night vision circumstances. After abundant experiment, the al- gorithm for panoramic image processing and night vision image enhancement is successfully implemented in FPGA and DSP. The panoramic night vision image system is a compact device, with no external rotating parts. And the system can reliably and dynamically detect 360＊ SLVF panoramic night vision image.展开更多
In the visual positioning of Unmanned Ground Vehicle(UGV),the visual odometer based on direct sparse method(DSO) has the advantages of small amount of calculation,high real-time performance and high robustness,so it i...In the visual positioning of Unmanned Ground Vehicle(UGV),the visual odometer based on direct sparse method(DSO) has the advantages of small amount of calculation,high real-time performance and high robustness,so it is more widely used than the visual odometer based on feature point method.Ordinary vision sensors have a narrower viewing angle than panoramic vision sensors,and there are fewer road signs in a single frame of image,resulting in poor road sign tracking and positioning capabilities,and severely restricting the development of visual odometry.Based on these considerations,this paper proposes a binocular stereo panoramic vision positioning algorithm based on extended DSO,which can solve these problems well.The experimental results show that the binocular stereo panoramic vision positioning algorithm based on the extended DSO can directly obtain the panoramic depth image around the UGV,which greatly improves the accuracy and robustness of the visual positioning compared with other ordinary visual odometers.It will have widely application prospects in the UGV field in the future.展开更多
Inpainting has been continuously studied in the field of computer vision.As artificial intelligence technology developed,deep learning technology was introduced in inpainting research,helping to improve performance.Cu...Inpainting has been continuously studied in the field of computer vision.As artificial intelligence technology developed,deep learning technology was introduced in inpainting research,helping to improve performance.Currently,the input target of an inpainting algorithm using deep learning has been studied from a single image to a video.However,deep learning-based inpainting technology for panoramic images has not been actively studied.We propose a 360-degree panoramic image inpainting method using generative adversarial networks(GANs).The proposed network inputs a 360-degree equirectangular format panoramic image converts it into a cube map format,which has relatively little distortion and uses it as a training network.Since the cube map format is used,the correlation of the six sides of the cube map should be considered.Therefore,all faces of the cube map are used as input for the whole discriminative network,and each face of the cube map is used as input for the slice discriminative network to determine the authenticity of the generated image.The proposed network performed qualitatively better than existing single-image inpainting algorithms and baseline algorithms.展开更多
Inspired by the unique structure of insect compound eyes,a multi-channel image acquisition system is designed to photograph a cylindrical panorama of its surroundings with one shot. The hardware structure consists of ...Inspired by the unique structure of insect compound eyes,a multi-channel image acquisition system is designed to photograph a cylindrical panorama of its surroundings with one shot. The hardware structure consists of an embedded ARM system and one array of 16 micro-image sensors. The system achieves the synchronization of captured photos in 10 ms,as well as 10 f /s video capture. The software architecture includes the TCP /IP protocol,video capture procedures in"Poll/Read"or"video streaming"modes,thread pool monitoring in multi-threading mutex,synchronization control with the"event""mutex signal"and"critical region"functions,and a synthetic image algorithm characterized by its portability,modularity,and remote transmission. The panoramic imaging system is expected to be a vision sensor for mobile robotics.展开更多
Introduction Primary liver cancer, the second most common cause of cancer related death worldwide, presents ethnic, etiological, sex, and geographical diversity2 （Figure 1A）. At the histological level, liver cancer ...Introduction Primary liver cancer, the second most common cause of cancer related death worldwide, presents ethnic, etiological, sex, and geographical diversity2 （Figure 1A）. At the histological level, liver cancer includes two major types： hepatocellular carcinoma （HCC, about 80%） and cholangiocarcinoma （CCA, about 15%）. Many etiological factors contribute to HCC development, such as hepatitis B virus （HBV）, hepatitis C virus （HCV）, aflatoxin B1 （AFB1）, alcohol, and metabolic diseases3. By contrast, the major risk factors for CCA are liver flukes （Opisthorchis viverrini and Clonorchis sinensis） and primary sclerosing cholangitis4,展开更多
The recent advancements in the field of Virtual Reality(VR)and Augmented Reality(AR)have a substantial impact on modern day technology by digitizing each and everything related to human life and open the doors to the ...The recent advancements in the field of Virtual Reality(VR)and Augmented Reality(AR)have a substantial impact on modern day technology by digitizing each and everything related to human life and open the doors to the next generation Software Technology(Soft Tech).VR and AR technology provide astonishing immersive contents with the help of high quality stitched panoramic contents and 360°imagery that widely used in the education,gaming,entertainment,and production sector.The immersive quality of VR and AR contents are greatly dependent on the perceptual quality of panoramic or 360°images,in fact a minor visual distortion can significantly degrade the overall quality.Thus,to ensure the quality of constructed panoramic contents for VR and AR applications,numerous Stitched Image Quality Assessment(SIQA)methods have been proposed to assess the quality of panoramic contents before using in VR and AR.In this survey,we provide a detailed overview of the SIQA literature and exclusively focus on objective SIQA methods presented till date.For better understanding,the objective SIQA methods are classified into two classes namely Full-Reference SIQA and No-Reference SIQA approaches.Each class is further categorized into traditional and deep learning-based methods and examined their performance for SIQA task.Further,we shortlist the publicly available benchmark SIQA datasets and evaluation metrices used for quality assessment of panoramic contents.In last,we highlight the current challenges in this area based on the existing SIQA methods and suggest future research directions that need to be target for further improvement in SIQA domain.展开更多
BACKGROUND The diagnosis of coronoid process hyperplasia(CPH)is usually based on symptoms and radiological imaging.Because of its similar symptoms,it can be confused with temporomandibular joint diseases.Therefore,an ...BACKGROUND The diagnosis of coronoid process hyperplasia(CPH)is usually based on symptoms and radiological imaging.Because of its similar symptoms,it can be confused with temporomandibular joint diseases.Therefore,an objective and reproducible way of diagnosis should be determined.AIM To investigate CPH using Levandoski analysis on panoramic radiographs to determine its prevalence.METHODS A total of 300 panoramic radiograph images(600 coronoid processes)were examined.Having measured the Condyle-Gonion(Cd-Go)and Coronoid-Gonion(Cor-Go)distances,the Cor-Go:Cd-Go ratio was calculated for the left and right sides of each image.RESULTS There was a statistically significant difference in Cd-Go and Cor-Go distances between male and female participants(P<0.001).There was no statistically significant relationship between Cor-Go:Cd-Go ratios and gender(P>0.05).CONCLUSION Cd-Go and Cor-Go distances were statistically significantly increased in males on both the left and right sides.The ratio of Cor-Go:Cd-Go was preserved in both genders.The prevalence of CPH was found to be 0.3%.展开更多
An overall bi-directional panoramic solar system exploration activity,not just looking at the solar system at a macro level and helping to build a simulation model for the solar system,but the probe will also be able ...An overall bi-directional panoramic solar system exploration activity,not just looking at the solar system at a macro level and helping to build a simulation model for the solar system,but the probe will also be able to explore the Milky Way and the vast universe from a much wider perspective.By observing the characteristics of the solar system,solar wind,ionization envelope and other parameters from a bi-directional panorama on both sides of the solar ecliptic plane,it will assist the scientific community and human kind to understand the solar system in a more extensive,deeper and systematic way than before.The exploration can be done in two steps.The first step is to launch a solar polar probe.Secondly to launch a bi-directional probe orbiting the galaxy in sync with the sun.展开更多
In this paper,we propose a novel approach to visualizing global geographical information:a panoramic sphere in an immersive environment.The whole geographical surface can be observed through the rotating of heads as t...In this paper,we propose a novel approach to visualizing global geographical information:a panoramic sphere in an immersive environment.The whole geographical surface can be observed through the rotating of heads as the viewpoint of the panoramic sphere is inside the sphere.We compared three approaches to visualizing the earth for rendering the geographical information in a virtual reality environment.On the tasks of terrestrial and marine geographical information,we compare the visualization effects on a)a globe,b)a flat map and c)a panoramic sphere.Terrestrial geographical information tasks include the area comparison and direction determination.Marine geographical information tasks contain the visualization of sea surface temperature and sea surface currents.For terrestrial geographical information tasks,the experimental results show that the panoramic sphere outperforms the globe and the flat map,with a higher average accuracy and a shorter time.On marine geographical information task,the panoramic sphere visualization is also superior to the flat map and the globe in an immersive environment for the sea surface temperature data and the sea surface current fields.In all three visualization experiments,the panoramic sphere is most preferred by the participants,particularly for global,transcontinental and transoceanic needs.展开更多
An effective algorithm of electronic image stabilization （EIS） of catadioptric panoramic imaging system for track robots is presented. The key techniques of this algorithm are as follows：① A model of electronic im...An effective algorithm of electronic image stabilization （EIS） of catadioptric panoramic imaging system for track robots is presented. The key techniques of this algorithm are as follows：① A model of electronic image stabilization is built by analyzing the imaging theory and the principle of EIS, and the image shift function of unwrapped panoramic image is deduced;② The relationship equation between motion estimation parameters of annular panoramic image and motion estimation parameters of unwrapped panoramic image is developed according to the constrained aspect ratio of real objects, motion parameters of annular panoramic image are firstly estimated, and then motion parameters among the image shift function are carried out according to the relationship equation;③ An excessive stabilization threshold is presented to prevent the phenomena of excessive stabilization, and the Kalman filtering is adopted to smooth the image sequences. Numerical experimental results show that this algorithm can effectively smooth out the unwanted motion and follow the intentional camera movement under certain resolutions.展开更多
文摘With the development of computer vision technology,panoramic image stitching has been widely used in fields such as scene reconstruction.A single traditional image cannot fully capture the panoramic view of the iconic East Gate of the South Campus of Shaanxi University of Technology.Therefore,this project aims to technically fuse multiple partial images into a complete panoramic image,enabling comprehensive recording and visual presentation of the architectural landscapes and spatial environments in this area.This report first introduces the technical background and application scenarios,clarifying the necessity of panoramic image stitching in campus landscape recording.It then elaborates on the core objectives and practical values,highlighting the role of technical solutions in improving image quality.Technically,a modular system design based on OpenCV is adopted,including modules such as image preprocessing,feature extraction and matching,image registration,fusion,and post-processing.Specifically,the SIFT algorithm is applied for feature extraction,KNN combined with ratio testing is used for feature matching,image registration is achieved by calculating the homography matrix,the fusion process utilizes multiband blending and Laplacian pyramid,and post-processing includes operations such as black area filling and CLAHE contrast enhancement.The experiment was conducted in a specific hardware and software environment using five overlapping images.After preprocessing,stitching,detail enhancement,and black edge repair,a panoramic image was successfully generated.The results show that the panoramic image fully presents the relevant scenery,with concealed seams,balanced exposure differences,and strong hierarchical details.This report provides a systematic description of the project’s technical implementation and achievement application.
文摘Panoramic images, offering a 360-degree view, are essential in virtual reality(VR) and augmented reality(AR), enhancing realism with high-quality textures. However, acquiring complete and high-quality panoramic textures is challenging. This paper introduces a method using generative adversarial networks(GANs) and the contrastive language-image pretraining(CLIP) model to restore and control texture in panoramic images. The GAN model captures complex structures and maintains consistency, while CLIP enables fine-grained texture control via semantic text-image associations. GAN inversion optimizes latent codes for precise texture details. The resulting low dynamic range(LDR) images are converted to high dynamic range(HDR) using the Blender engine for seamless texture blending. Experimental results demonstrate the effectiveness and flexibility of this method in panoramic texture restoration and generation.
基金supported in part by the National Natural Science Foundation of China(Grant No.62062003)Natural Science Foundation of Ningxia(Grant No.2023AAC03293).
文摘The instance segmentation of impacted teeth in the oral panoramic X-ray images is hotly researched.However,due to the complex structure,low contrast,and complex background of teeth in panoramic X-ray images,the task of instance segmentation is technically tricky.In this study,the contrast between impacted Teeth and periodontal tissues such as gingiva,periodontalmembrane,and alveolar bone is low,resulting in fuzzy boundaries of impacted teeth.Amodel based on Teeth YOLACT is proposed to provide amore efficient and accurate solution for the segmentation of impacted teeth in oral panoramic X-ray films.Firstly,a Multi-scale Res-Transformer Module(MRTM)is designed.In the module,depthwise separable convolutions with different receptive fields are used to enhance the sensitivity of the model to lesion size.Additionally,the Vision Transformer is integrated to improve the model’s ability to perceive global features.Secondly,the Context Interaction-awareness Module(CIaM)is designed to fuse deep and shallow features.The deep semantic features guide the shallow spatial features.Then,the shallow spatial features are embedded into the deep semantic features,and the cross-weighted attention mechanism is used to aggregate the deep and shallow features efficiently,and richer context information is obtained.Thirdly,the Edge-preserving perceptionModule(E2PM)is designed to enhance the teeth edge features.The first-order differential operator is used to get the tooth edge weight,and the perception ability of tooth edge features is improved.The shallow spatial feature is fused by linear mapping,weight concatenation,and matrix multiplication operations to preserve the tooth edge information.Finally,comparison experiments and ablation experiments are conducted on the oral panoramic X-ray image datasets.The results show that the APdet,APseg,ARdet,ARseg,mAPdet,and mAPseg indicators of the proposed model are 89.9%,91.9%,77.4%,77.6%,72.8%,and 73.5%,respectively.This study further verifies the application potential of the method combining multi-scale feature extraction,multi-scale feature fusion,and edge perception enhancement in medical image segmentation,which provides a valuable reference for future related research.
基金Supported by Wuhu Municipal Science and Technology Bureau of Anhui Province,No.2022cg43.
文摘BACKGROUND The objective of this study was to evaluate the use of combined parallax-free panoramic X-ray imaging during surgery by enabling the mobile C-arm with minimally invasive plate osteosynthesis(MIPO)in the management of proximal humeral shaft fractures.AIM To evaluate parallax-free panoramic X-ray images during surgery.METHODS A retrospective series of 17 proximal humeral shaft fractures were treated using combined parallax-free panoramic X-ray imaging during surgery by enabling the mobile C-arm with MIPO.The operating time and radiation exposure time were recorded,and early postoperative physical therapy and partial weight bearing were encouraged.Patients were followed at regular intervals and evaluated radiographically and clinically.RESULTS The mean operating time and radiation time were 73(range,49-95)minutes and 57(range:36-98)seconds,respectively.No complications occurred during the operation.All fractures healed at an average of 16.9(range:15-23)weeks.The average Constant-Murley score for all the patients was 89.5(range:75-100)points.None of the patients showed symptoms of vascular or nerve damage or wound infection.Three months after the operation,none of the patients developed subacromial impingement syndrome.No loosening or fracture of the implants occurred.The frontal and lateral radiographs showed good alignment.CONCLUSION We consider that MIPO with combined parallax-free panoramic X-ray imaging during surgery is an efficient method for treating proximal humeral shaft fractures,and could significantly reduce operative morbidity as well as lower the rate of intra-and postoperative complications.
基金founded by National Key R&D Program of China (No.2021YFB2601200)National Natural Science Foundation of China (No.42171416)Teacher Support Program for Pyramid Talent Training Project of Beijing University of Civil Engineering and Architecture (No.JDJQ20200307).
文摘In light of the limited efficacy of conventional methods for identifying pavement cracks and the absence of comprehensive depth and location data in two-dimensional photographs,this study presents an intelligent strategy for extracting road cracks.This methodology involves the integration of laser point cloud data obtained from a vehicle-mounted system and a panoramic sequence of images.The study employs a vehicle-mounted LiDAR measurement system to acquire laser point cloud and panoramic sequence image data simultaneously.A convolutional neural network is utilized to extract cracks from the panoramic sequence image.The extracted sequence image is then aligned with the laser point cloud,enabling the assignment of RGB information to the vehicle-mounted three dimensional(3D)point cloud and location information to the two dimensional(2D)panoramic image.Additionally,a threshold value is set based on the crack elevation change to extract the aligned roadway point cloud.The three-dimensional data pertaining to the cracks can be acquired.The experimental findings demonstrate that the use of convolutional neural networks has yielded noteworthy outcomes in the extraction of road cracks.The utilization of point cloud and image alignment techniques enables the extraction of precise location data pertaining to road cracks.This approach exhibits superior accuracy when compared to conventional methods.Moreover,it facilitates rapid and accurate identification and localization of road cracks,thereby playing a crucial role in ensuring road maintenance and traffic safety.Consequently,this technique finds extensive application in the domains of intelligent transportation and urbanization development.The technology exhibits significant promise for use in the domains of intelligent transportation and city development.
基金the National Natural Science Foundation of China(61803206)the Key R&D Program of Jiangsu Province(BE2022053-2)the Nanjing Forestry University Youth Science and Technology Innovation Fund(CX2018004)for partly funding this project.
文摘In response to the challenges posed by insufficient real-time performance and suboptimal matching accuracy of traditional feature matching algorithms within automotive panoramic surround view systems,this paper has proposed a high-performance dimension reduction parallel matching algorithm that integrates Principal Component Analysis(PCA)and Dual-Heap Filtering(DHF).The algorithm employs PCA to map the feature points into the lower-dimensional space and employs the square of Euclidean distance for feature matching,which significantly reduces computational complexity.To ensure the accuracy of feature matching,the algorithm utilizes Dual-Heap Filtering to filter and refine matched point pairs.To further enhance matching speed and make optimal use of computational resources,the algorithm introduces a multi-core parallel matching strategy,greatly elevating the efficiency of feature matching.Compared to Scale-Invariant Feature Transform(SIFT)and Speeded Up Robust Features(SURF),the proposed algorithm reduces matching time by 77%to 80%and concurrently enhances matching accuracy by 5%to 15%.Experimental results demonstrate that the proposed algorithmexhibits outstanding real-time matching performance and accuracy,effectivelymeeting the feature-matching requirements of automotive panoramic surround view systems.
文摘In dentistry, panoramic X-ray images are extensively used by dentists for tooth structure analysis and disease diagnosis. However, the manual analysis of these images is time-consuming and prone to misdiagnosis or overlooked. While deep learning techniques have been employed to segment teeth in panoramic X-ray images, accurate segmentation of individual teeth remains an underexplored area. In this study, we propose an end-to-end deep learning method that effectively addresses this challenge by employing an improved combinatorial loss function to separate the boundaries of adjacent teeth, enabling precise segmentation of individual teeth in panoramic X-ray images. We validate the feasibility of our approach using a challenging dataset. By training our segmentation network on 115 panoramic X-ray images, we achieve an intersection over union (IoU) of 86.56% for tooth segmentation and an accuracy of 65.52% in tooth counting on 87 test set images. Experimental results demonstrate the significant improvement of our proposed method in single tooth segmentation compared to existing methods.
文摘The project discusses the development of a deep learning model to detect osteoporosis from dental panoramic X-Ray images. It provides an in-depth understanding of human bone structure, osteoporosis, its symptoms, causes, prevalence, and risk factors. The project also explains bone density measurement using dual-energy X-ray absorptiometry (DEXA) and the application of artificial intelligence (AI) and machine learning (ML) in medical imaging. The study uses panoramic dental X-rays to evaluate AI technology in dental imaging and classification of mandible inferior cortical based on Klemetti and Kolmakow criteria. The model architecture consists of convolutional, pooling, fully connected, ReLU, and Softmax layers. Dropout and early stopping are added to the model. The training process uses the train-test approach with 100 epochs and a batch size of 32, and performance evaluation measures such as accuracy, sensitivity, specificity, and F1-score are used to assess the classifier’s performance. The findings and methodology provide a comprehensive understanding of the application of deep learning in the detection of osteoporosis from dental panoramic X-Ray images, and the study demonstrates a robust approach to implementing AI in medical imaging for osteoporosis detection.
基金supported by the research grant of the Kongju National University in 2023.
文摘The purpose of this study is to investigate the effect of Panoramic Virtual Reality(PVR)applied to online earth science classes on students’learning flow.To this end,a PVR learning material was made with a geology learning site,which contains a core geologic concept contained in a high school curriculum in Korea.To this end,a PVR learning material was made at a geologic field site to provide an interactive and engaging way for students to grasp core geologic concepts according to the high school curriculum in Korea.The PVR was applied to online earth science classes with 45 high school students.In order to examine the effect of the PVR on students'learning flow,pre-post learning flow test papers were used,then matchedsample t-test analysis and students'responses were analyzed.The result shows online classes with PVR have positive effects on learning flow(p<0.05).And it was possible for the students to observe three-dimensional geologic structures effectively in online classes as in offline field trips.And the students'responded with positive feedbacks.These suggest that PVR in online classes can be used as an effective teaching method,which can improve students'flow and eventually understanding subjects.
文摘To satisfy the requirements of real-time and high quality mosaics, a bionic compound eye visual system was designed by simulating the visual mechanism of a fly compound eye. Several CCD cameras were used in this system to imitate the small eyes of a compound eye. Based on the optical analysis of this system, a direct panoramic image mosaic algorithm was proposed. Several sub-images were collected by the bionic compound eye visual system, and then the system obtained the overlapping proportions of these sub-images and cut the overlap sections of the neighboring images. Thus, a panoramic image with a large field of view was directly mosaicked, which expanded the field and guaranteed the high resolution. The experimental results show that the time consumed by the direct mosaic algorithm is only 2.2% of that by the traditional image mosaic algorithm while guaranteeing mosaic quality. Furthermore, the proposed method effectively solved the problem of misalignment of the mosaic image and eliminated mosaic cracks as a result of the illumination factor and other factors. This method has better real-time properties compared to other methods.
文摘Abstract： Based on digital signal processor（DSP） and field programmable gate array（FPGA） techniques, the architecture of super large view field（SLVF） panoramic night vision image processing hardware platform was established. The panoramic unwrapping and correcting algorithm, up to a full 360°, based on coordinate rotation digital computer （CORDIC） and night vision image enhancement algorithm, based on histogram equalization theory and edge detection theory, was presented in this paper, with the purpose of processing night vision dynamic panoramic annular image. The annular image can be unwrapped and corrected to conventional rectangular panorama by the panoramic image processing algorithm, which uses the pipelined CORDIC configuration to realize a trigonometric function generator with high speed and high precision. Histogram equalization algorithm can perfectly enhance the contrast of the night vision image. Edge detection algorithm can be propitious to find and detect small dim dynamic targets in night vision circumstances. After abundant experiment, the al- gorithm for panoramic image processing and night vision image enhancement is successfully implemented in FPGA and DSP. The panoramic night vision image system is a compact device, with no external rotating parts. And the system can reliably and dynamically detect 360＊ SLVF panoramic night vision image.
基金the Project of National Natural Science Foundation of China(Grant No.61773059)the Project of National Defense Technology Foundation Program of China(Grant No.20230028) to provide fund for conducting experiments。
文摘In the visual positioning of Unmanned Ground Vehicle(UGV),the visual odometer based on direct sparse method(DSO) has the advantages of small amount of calculation,high real-time performance and high robustness,so it is more widely used than the visual odometer based on feature point method.Ordinary vision sensors have a narrower viewing angle than panoramic vision sensors,and there are fewer road signs in a single frame of image,resulting in poor road sign tracking and positioning capabilities,and severely restricting the development of visual odometry.Based on these considerations,this paper proposes a binocular stereo panoramic vision positioning algorithm based on extended DSO,which can solve these problems well.The experimental results show that the binocular stereo panoramic vision positioning algorithm based on the extended DSO can directly obtain the panoramic depth image around the UGV,which greatly improves the accuracy and robustness of the visual positioning compared with other ordinary visual odometers.It will have widely application prospects in the UGV field in the future.
基金Korea Electric Power Corporation(Grant No.R18XA02).
文摘Inpainting has been continuously studied in the field of computer vision.As artificial intelligence technology developed,deep learning technology was introduced in inpainting research,helping to improve performance.Currently,the input target of an inpainting algorithm using deep learning has been studied from a single image to a video.However,deep learning-based inpainting technology for panoramic images has not been actively studied.We propose a 360-degree panoramic image inpainting method using generative adversarial networks(GANs).The proposed network inputs a 360-degree equirectangular format panoramic image converts it into a cube map format,which has relatively little distortion and uses it as a training network.Since the cube map format is used,the correlation of the six sides of the cube map should be considered.Therefore,all faces of the cube map are used as input for the whole discriminative network,and each face of the cube map is used as input for the slice discriminative network to determine the authenticity of the generated image.The proposed network performed qualitatively better than existing single-image inpainting algorithms and baseline algorithms.
基金Supported by the National Natural Science Foundation of China(61233014)the China Postdoctoral Science Foundation(2012M5210711,20123218110031)the National Natural Science Major International Cooperation Projects(61161120323)
文摘Inspired by the unique structure of insect compound eyes,a multi-channel image acquisition system is designed to photograph a cylindrical panorama of its surroundings with one shot. The hardware structure consists of an embedded ARM system and one array of 16 micro-image sensors. The system achieves the synchronization of captured photos in 10 ms,as well as 10 f /s video capture. The software architecture includes the TCP /IP protocol,video capture procedures in"Poll/Read"or"video streaming"modes,thread pool monitoring in multi-threading mutex,synchronization control with the"event""mutex signal"and"critical region"functions,and a synthetic image algorithm characterized by its portability,modularity,and remote transmission. The panoramic imaging system is expected to be a vision sensor for mobile robotics.
基金supported,in part,by the Precision Medical Research Program from Ministry of Science and Technology of China(Grant No.YL 2017YFC0908400)National Science and Technology Major Project for Infectious Disease and Funding(Grant No.YL 17-163-12-ZT-005-095-01)+2 种基金Science and Technology Commission in Ministry of National Defense of China(Grant No.YL 17-163-12-ZT-005-095-01)Xinwei Wang was supported by the intramural research program of the Center for Cancer Research,National Cancer Institute of the United StatesJunfang Ji was supported by the Thousand Young Talents Plan of China,National Natural Science Foundation of China(Grant No.81672905)
文摘Introduction Primary liver cancer, the second most common cause of cancer related death worldwide, presents ethnic, etiological, sex, and geographical diversity2 （Figure 1A）. At the histological level, liver cancer includes two major types： hepatocellular carcinoma （HCC, about 80%） and cholangiocarcinoma （CCA, about 15%）. Many etiological factors contribute to HCC development, such as hepatitis B virus （HBV）, hepatitis C virus （HCV）, aflatoxin B1 （AFB1）, alcohol, and metabolic diseases3. By contrast, the major risk factors for CCA are liver flukes （Opisthorchis viverrini and Clonorchis sinensis） and primary sclerosing cholangitis4,
文摘The recent advancements in the field of Virtual Reality(VR)and Augmented Reality(AR)have a substantial impact on modern day technology by digitizing each and everything related to human life and open the doors to the next generation Software Technology(Soft Tech).VR and AR technology provide astonishing immersive contents with the help of high quality stitched panoramic contents and 360°imagery that widely used in the education,gaming,entertainment,and production sector.The immersive quality of VR and AR contents are greatly dependent on the perceptual quality of panoramic or 360°images,in fact a minor visual distortion can significantly degrade the overall quality.Thus,to ensure the quality of constructed panoramic contents for VR and AR applications,numerous Stitched Image Quality Assessment(SIQA)methods have been proposed to assess the quality of panoramic contents before using in VR and AR.In this survey,we provide a detailed overview of the SIQA literature and exclusively focus on objective SIQA methods presented till date.For better understanding,the objective SIQA methods are classified into two classes namely Full-Reference SIQA and No-Reference SIQA approaches.Each class is further categorized into traditional and deep learning-based methods and examined their performance for SIQA task.Further,we shortlist the publicly available benchmark SIQA datasets and evaluation metrices used for quality assessment of panoramic contents.In last,we highlight the current challenges in this area based on the existing SIQA methods and suggest future research directions that need to be target for further improvement in SIQA domain.
文摘BACKGROUND The diagnosis of coronoid process hyperplasia(CPH)is usually based on symptoms and radiological imaging.Because of its similar symptoms,it can be confused with temporomandibular joint diseases.Therefore,an objective and reproducible way of diagnosis should be determined.AIM To investigate CPH using Levandoski analysis on panoramic radiographs to determine its prevalence.METHODS A total of 300 panoramic radiograph images(600 coronoid processes)were examined.Having measured the Condyle-Gonion(Cd-Go)and Coronoid-Gonion(Cor-Go)distances,the Cor-Go:Cd-Go ratio was calculated for the left and right sides of each image.RESULTS There was a statistically significant difference in Cd-Go and Cor-Go distances between male and female participants(P<0.001).There was no statistically significant relationship between Cor-Go:Cd-Go ratios and gender(P>0.05).CONCLUSION Cd-Go and Cor-Go distances were statistically significantly increased in males on both the left and right sides.The ratio of Cor-Go:Cd-Go was preserved in both genders.The prevalence of CPH was found to be 0.3%.
文摘An overall bi-directional panoramic solar system exploration activity,not just looking at the solar system at a macro level and helping to build a simulation model for the solar system,but the probe will also be able to explore the Milky Way and the vast universe from a much wider perspective.By observing the characteristics of the solar system,solar wind,ionization envelope and other parameters from a bi-directional panorama on both sides of the solar ecliptic plane,it will assist the scientific community and human kind to understand the solar system in a more extensive,deeper and systematic way than before.The exploration can be done in two steps.The first step is to launch a solar polar probe.Secondly to launch a bi-directional probe orbiting the galaxy in sync with the sun.
基金This research was funded by the Science and Technology Innovation Project for Laoshan Laboratory(No.LSKJ202204303)the National Natural Science Foundation of China(No.42030406)+1 种基金the Fundamental Research Funds for the Central Universities(No.202261006)the ESANRSCC Scientific Cooperation Project on Earth Observation Science and Applications:Dragon 5(No.58393).
文摘In this paper,we propose a novel approach to visualizing global geographical information:a panoramic sphere in an immersive environment.The whole geographical surface can be observed through the rotating of heads as the viewpoint of the panoramic sphere is inside the sphere.We compared three approaches to visualizing the earth for rendering the geographical information in a virtual reality environment.On the tasks of terrestrial and marine geographical information,we compare the visualization effects on a)a globe,b)a flat map and c)a panoramic sphere.Terrestrial geographical information tasks include the area comparison and direction determination.Marine geographical information tasks contain the visualization of sea surface temperature and sea surface currents.For terrestrial geographical information tasks,the experimental results show that the panoramic sphere outperforms the globe and the flat map,with a higher average accuracy and a shorter time.On marine geographical information task,the panoramic sphere visualization is also superior to the flat map and the globe in an immersive environment for the sea surface temperature data and the sea surface current fields.In all three visualization experiments,the panoramic sphere is most preferred by the participants,particularly for global,transcontinental and transoceanic needs.
基金Supported by State Key Laboratory of Explosion Science and Technology Foundation(ZDKT08-05)
文摘An effective algorithm of electronic image stabilization （EIS） of catadioptric panoramic imaging system for track robots is presented. The key techniques of this algorithm are as follows：① A model of electronic image stabilization is built by analyzing the imaging theory and the principle of EIS, and the image shift function of unwrapped panoramic image is deduced;② The relationship equation between motion estimation parameters of annular panoramic image and motion estimation parameters of unwrapped panoramic image is developed according to the constrained aspect ratio of real objects, motion parameters of annular panoramic image are firstly estimated, and then motion parameters among the image shift function are carried out according to the relationship equation;③ An excessive stabilization threshold is presented to prevent the phenomena of excessive stabilization, and the Kalman filtering is adopted to smooth the image sequences. Numerical experimental results show that this algorithm can effectively smooth out the unwanted motion and follow the intentional camera movement under certain resolutions.
