This study proposes an image-based three-dimensional(3D)vector reconstruction of industrial parts that can gener-ate non-uniform rational B-splines(NURBS)surfaces with high fidelity and flexibility.The contributions o...This study proposes an image-based three-dimensional(3D)vector reconstruction of industrial parts that can gener-ate non-uniform rational B-splines(NURBS)surfaces with high fidelity and flexibility.The contributions of this study include three parts:first,a dataset of two-dimensional images is constructed for typical industrial parts,including hex-agonal head bolts,cylindrical gears,shoulder rings,hexagonal nuts,and cylindrical roller bearings;second,a deep learning algorithm is developed for parameter extraction of 3D industrial parts,which can determine the final 3D parameters and pose information of the reconstructed model using two new nets,CAD-ClassNet and CAD-ReconNet;and finally,a 3D vector shape reconstruction of mechanical parts is presented to generate NURBS from the obtained shape parameters.The final reconstructed models show that the proposed approach is highly accurate,efficient,and practical.展开更多
Image super-resolution reconstruction technology is currently widely used in medical imaging,video surveillance,and industrial quality inspection.It not only enhances image quality but also improves details and visual...Image super-resolution reconstruction technology is currently widely used in medical imaging,video surveillance,and industrial quality inspection.It not only enhances image quality but also improves details and visual perception,significantly increasing the utility of low-resolution images.In this study,an improved image superresolution reconstruction model based on Generative Adversarial Networks(SRGAN)was proposed.This model introduced a channel and spatial attention mechanism(CSAB)in the generator,allowing it to effectively leverage the information from the input image to enhance feature representations and capture important details.The discriminator was designed with an improved PatchGAN architecture,which more accurately captured local details and texture information of the image.With these enhanced generator and discriminator architectures and an optimized loss function design,this method demonstrated superior performance in image quality assessment metrics.Experimental results showed that this model outperforms traditional methods,presenting more detailed and realistic image details in the visual effects.展开更多
As a form of discrete representation learning,Vector Quantized Variational Autoencoders(VQ-VAE)have increasingly been applied to generative and multimodal tasks due to their ease of embedding and representative capaci...As a form of discrete representation learning,Vector Quantized Variational Autoencoders(VQ-VAE)have increasingly been applied to generative and multimodal tasks due to their ease of embedding and representative capacity.However,existing VQ-VAEs often perform quantization in the spatial domain,ignoring global structural information and potentially suffering from codebook collapse and information coupling issues.This paper proposes a frequency quantized variational autoencoder(FQ-VAE)to address these issues.The proposed method transforms image features into linear combinations in the frequency domain using a 2D fast Fourier transform(2D-FFT)and performs adaptive quantization on these frequency components to preserve image’s global relationships.The codebook is dynamically optimized to avoid collapse and information coupling issue by considering the usage frequency and dependency of code vectors.Furthermore,we introduce a post-processing module based on graph convolutional networks to further improve reconstruction quality.Experimental results on four public datasets demonstrate that the proposed method outperforms state-of-the-art approaches in terms of Structural Similarity Index(SSIM),Learned Perceptual Image Patch Similarity(LPIPS),and Reconstruction Fréchet Inception Distance(rFID).In the experiments on the CIFAR-10 dataset,compared to the baselinemethod VQ-VAE,the proposedmethod improves the abovemetrics by 4.9%,36.4%,and 52.8%,respectively.展开更多
BACKGROUND Inguinal hernias are common after surgery.Tension-free repair is widely accepted as the main method for managing inguinal hernias.Adequate exposure,coverage,and repair of the myopectineal orifice(MPO)are ne...BACKGROUND Inguinal hernias are common after surgery.Tension-free repair is widely accepted as the main method for managing inguinal hernias.Adequate exposure,coverage,and repair of the myopectineal orifice(MPO)are necessary.However,due to differences in race and sex,people’s body shapes vary.According to European guidelines,the patch should measure 10 cm×15 cm.If any part of the MPO is dissected,injury to the nerves,vascular network,or organs may occur during surgery,thereby leading to inguinal discomfort,pain,and seroma formation after surgery.Therefore,accurate localization and measurement of the boundary of the MPO are crucial for selecting the optimal patch for inguinal hernia repair.AIM To compare the size of the MPO measured on three-dimensional multislice spiral computed tomography(CT)with that measured via laparoscopy and explore the relevant factors influencing the size of the MPO.METHODS Clinical data from 74 patients who underwent laparoscopic tension-free inguinal hernia repair at the General Surgery Department of the First Affiliated Hospital of Anhui University of Science and Technology between September 2022 and July 2024 were collected and analyzed retrospectively.Transabdominal preperitoneal was performed.Sixty-four males and 10 females,with an average age of 58.30±12.32 years,were included.The clinical data of the patients were collected.The boundary of the MPO was measured on three-dimensional CT images before surgery and then again during transabdominal preperitoneal.All the preoperative and intraoperative data were analyzed via paired t-tests.A t-test was used for comparisons of age,body mass index,and sex between the groups.In the comparative analysis,a P value less than 0.05 indicated a significant difference.RESULTS The boundaries of the MPO on 3-dimensional CT images measured 7.05±0.47 cm and 6.27±0.61 cm,and the area of the MPO was 19.54±3.33 cm^(2).The boundaries of the MPO during surgery were 7.18±0.51 cm and 6.17±0.40 cm.The errors were not statistically significant.However,the intraoperative BD(the width of the MPO,P=0.024,P<0.05)and preoperative AC(the length of the MPO,P=0.045,P<0.05)significantly differed according to sex.The AC and BD measurements before and during surgery were not significantly different according to age,body mass index,hernia side or hernia type(P>0.05).CONCLUSION The application of this technology can aid in determining the most appropriate dissection range and patch size.展开更多
BACKGROUND Percutaneous transhepatic biliary drainage(PTBD)is one of the primary clinical treatment options for patients with obstructive jaundice.In recent years,PTBD assisted by three-dimensional(3D)reconstruction t...BACKGROUND Percutaneous transhepatic biliary drainage(PTBD)is one of the primary clinical treatment options for patients with obstructive jaundice.In recent years,PTBD assisted by three-dimensional(3D)reconstruction technology has been widely implemented,but its advantages over traditional methods remains inconclusive.Thus,a discussion is warranted.AIM To explore the safety and efficacy of 3D reconstruction technology-assisted PTBD.METHODS We systematically searched the databases including the Cochrane Library,PubMed,EMBASE,Web of Science and China National Knowledge Infrastructure.The search period extended from the establishment of each database to November,2024.We screened the literature according to predefined inclusion and exclusion criteria,assessed the quality of the studies,and extracted data.Meta-analysis was performed using Revman 5.4.1 software.RESULTS A total of 15 studies were included,involving 1434 patients.The results of the meta-analysis showed that compared with the traditional group,the overall post-operative complications rate in the 3D reconstruction technology group was significantly lower[odds ratio=0.25;95%confidence interval(CI):0.17-0.36,P<0.00001].The overall puncture success rate in the 3D reconstruction group was better than those in the traditional group(odds ratio=3.61;95%CI:1.98-6.55,P<0.0001).However,there was no significant difference between the two groups in the reduction levels of postoperative total bilirubin(mean difference=-1.38;95%CI:-3.29 to 0.53,P=0.16).Subgroup analysis were conducted on the surgery time according to guidance stages of the 3D reconstruction,3D reconstruction imaging modalities,and types of studies.The results were stable,with no significant changes observed.CONCLUSION 3D reconstruction technology significantly improves the puncture success rate and safety of PTBD.However,it has no significant advantage in bile drainage effectiveness.Continued research is warranted to further explore its clinical value and optimize its application.展开更多
Among hyperspectral imaging technologies, interferometric spectral imaging is widely used in remote sening due to advantages of large luminous flux and high resolution. However, with complicated mechanism, interferome...Among hyperspectral imaging technologies, interferometric spectral imaging is widely used in remote sening due to advantages of large luminous flux and high resolution. However, with complicated mechanism, interferometric imaging faces the impact of multi-stage degradation. Most exsiting interferometric spectrum reconstruction methods are based on tradition model-based framework with multiple steps, showing poor efficiency and restricted performance. Thus, we propose an interferometric spectrum reconstruction method based on degradation synthesis and deep learning.Firstly, based on imaging mechanism, we proposed an mathematical model of interferometric imaging to analyse the degradation components as noises and trends during imaging. The model consists of three stages, namely instrument degradation, sensing degradation, and signal-independent degradation process. Then, we designed calibration-based method to estimate parameters in the model, of which the results are used for synthesizing realistic dataset for learning-based algorithms.In addition, we proposed a dual-stage interferogram spectrum reconstruction framework, which supports pre-training and integration of denoising DNNs. Experiments exhibits the reliability of our degradation model and synthesized data, and the effectiveness of the proposed reconstruction method.展开更多
Deep learning(DL)-based image reconstruction methods have garnered increasing interest in the last few years.Numerous studies demonstrate that DL-based reconstruction methods function admirably in optical tomographic ...Deep learning(DL)-based image reconstruction methods have garnered increasing interest in the last few years.Numerous studies demonstrate that DL-based reconstruction methods function admirably in optical tomographic imaging techniques,such as bioluminescence tomography(BLT).Nevertheless,nearly every existing DL-based method utilizes an explicit neural representation for the reconstruction problem,which either consumes much memory space or requires various complicated computations.In this paper,we present a neural field(NF)-based image reconstruction scheme for BLT that uses an implicit neural representation.The proposed NFbased method establishes a transformation between the coordinate of an arbitrary spatial point and the source value of the point with a relatively light-weight multilayer perceptron,which has remarkable computational efficiency.Another simple neural network composed of two fully connected layers and a 1D convolutional layer is used to generate the neural features.Results of simulations and experiments show that the proposed NF-based method has similar performance to the photon density complement network and the two-stage network,while consuming fewer floating point operations with fewer model parameters.展开更多
BACKGROUND Hepatobiliary surgery is complex and requires a thorough understanding of the liver’s anatomy,biliary system,and vasculature.Traditional imaging methods such as computed tomography(CT)and magnetic resonanc...BACKGROUND Hepatobiliary surgery is complex and requires a thorough understanding of the liver’s anatomy,biliary system,and vasculature.Traditional imaging methods such as computed tomography(CT)and magnetic resonance imaging(MRI),although helpful,fail to provide three-dimensional(3D)relationships of these structures,which are critical for planning and executing complicated surgeries.AIM To explore the use of 3D imaging and virtual surgical planning(VSP)technologies to improve surgical accuracy,reduce complications,and enhance patient recovery in hepatobiliary surgeries.METHODS A comprehensive review of studies published between 2017 and 2024 was conducted through PubMed,Scopus,Google Scholar,and Web of Science.Studies selected focused on 3D imaging and VSP applications in hepatobiliary surgery,assessing surgical precision,complications,and patient outcomes.Thirty studies,including randomized controlled trials,cohort studies,and case reports,were included in the final analysis.RESULTS Various 3D imaging modalities,including multidetector CT,MRI,and 3D rotational angiography,provide high-resolution views of the liver’s vascular and biliary anatomy.VSP allows surgeons to simulate complex surgeries,improving preoperative planning and reducing complications like bleeding and bile leaks.Several studies have demonstrated improved surgical precision,reduced complications,and faster recovery times when 3D imaging and VSP were used in complex surgeries.CONCLUSION 3D imaging and VSP technologies significantly enhance the accuracy and outcomes of hepatobiliary surgeries by providing individualized preoperative planning.While promising,further research,particularly randomized controlled trials,is needed to standardize protocols and evaluate long-term efficacy.展开更多
Purpose:To assess the clinical efficacy of integrating deep learning reconstruction(DLR)with contrast-enhancement-boost(CE-boost)in 80 kVp head and neck CT angiography(CTA)using substantially lowered radiation and con...Purpose:To assess the clinical efficacy of integrating deep learning reconstruction(DLR)with contrast-enhancement-boost(CE-boost)in 80 kVp head and neck CT angiography(CTA)using substantially lowered radiation and contrast medium(CM)doses,compared to the standard 100 kVp protocol using hybrid iterative reconstruction(HIR).Methods:Sixty-six patients were prospectively enrolled and randomly assigned to one of two groups:the low-dose group(n=33),receiving 80 kVp and 28 mL contrast medium(CM)with a noise index(NI)of 15;and the regular-dose group(n=33),receiving 100 kVp and 40 mL CM with an NI of 10.For the lowdose group,images underwent reconstruction using both hybrid iterative reconstruction(HIR)and deep learning reconstruction(DLR)at mild-,standard-,and strong-strength levels,both before and after combination with contrast enhancement-boost(CE-boost).This generated eight distinct datasets:L-HIR,L-DLR_(mild),L-DLR_(standard),L-DLR_(strong),L-HIR-CE,L-DLR_(mild)-CE,L-DLR_(standard)-CE,and L-DLR_(strong)-CE.Images for the regular-dose group were reconstructed solely with HIR(R-HIR).Quantitative analysis involved calculating and comparing CT attenuation,image noise,signal-to-noise ratio(SNR),and contrast-to-noise ratio(CNR)within six key vessels:the aortic arch(AA),internal carotid artery(ICA),external carotid artery(ECA),vertebral arteries(VA),basilar artery(BA),and middle cerebral artery(MCA).Two radiologists independently assessed subjective image quality using a 5-point scale,with statistical significance defined as P<0.05.Results:Compared to the regular-dose group,the low-dose protocol achieved a substantial reduction in contrast media volume(28 mL versus 40 mL,a 30%decrease)and radiation exposure((0.41±0.08)mSv versus(1.18±0.12)mSv,a 65%reduction).Both L-DLR_(standard) and L-DLR_(strong) delivered comparable or superior SNR and CNR across all vascular segments relative to R-HIR.However,subjective image quality scores for L-DLR at all strength levels fell below those for R-HIR(all P<0.05 for both readers).Combining CE-boost with the low-dose protocol significantly enhanced the objective image performance of L-DLR_(strong)-CE(all P<0.05)and produced subjective image scores comparable to R-HIR(reader 1:P=0.15;reader 2:P=0.06).Conclusion:When compared to the standard 100 kVp head and neck CTA,the combination of the DLR and CE-boost techniques at 80 kVp can achieve a 30%reduction in contrast dose and a 65%reduction in radiation dose,while maintaining both objective and subjective image quality.展开更多
In Hyperspectral Imaging(HSI),the detrimental influence of noise and distortions on data quality is profound,which has severely affected the following-on analytics and decisionmaking such as land mapping.This study pr...In Hyperspectral Imaging(HSI),the detrimental influence of noise and distortions on data quality is profound,which has severely affected the following-on analytics and decisionmaking such as land mapping.This study presents an innovative framework for assessing HSI band quality and reconstructing the low-quality bands,based on the Prophet model.By introducing a comprehensive quality metric to start,the authors approach factors in both spatial and spectral characteristics across local and global scales.This metric effectively captures the intricate noise and distortions inherent in the HSI data.Subsequently,the authors employ the Prophet model to forecast information within the low-quality bands,leveraging insights from neighbouring high-quality bands.To validate the effectiveness of the authors’proposed model,extensive experiments on three publicly available uncorrected datasets are conducted.In a head-to-head comparison,the framework against six state-ofthe-art band reconstruction algorithms including three spectral methods,two spatialspectral methods and one deep learning method is benchmarked.The authors’experiments also delve into strategies for band selection based on quality metrics and the quality evaluation of the reconstructed bands.In addition,the authors assess the classification accuracy utilising these reconstructed bands.In various experiments,the results consistently affirm the efficacy of the authors’method in HSI quality assessment and band reconstruction.Notably,the authors’approach obviates the need for manually prefiltering of noisy bands.This comprehensive framework holds promise in addressing HSI data quality concerns whilst enhancing the overall utility of HSI.展开更多
This study introduces a novel method for reconstructing the 3D model of aluminum foam using cross-sectional sequence images.Combining precision milling and image acquisition,high-qual-ity cross-sectional images are ob...This study introduces a novel method for reconstructing the 3D model of aluminum foam using cross-sectional sequence images.Combining precision milling and image acquisition,high-qual-ity cross-sectional images are obtained.Pore structures are segmented by the U-shaped network(U-Net)neural network integrated with the Canny edge detection operator,ensuring accurate pore delineation and edge extraction.The trained U-Net achieves 98.55%accuracy.The 2D data are superimposed and processed into 3D point clouds,enabling reconstruction of the pore structure and aluminum skeleton.Analysis of pore 01 shows the cross-sectional area initially increases,and then decreases with milling depth,with a uniform point distribution of 40 per layer.The reconstructed model exhibits a porosity of 77.5%,with section overlap rates between the 2D pore segmentation and the reconstructed model exceeding 96%,confirming high fidelity.Equivalent sphere diameters decrease with size,averaging 1.95 mm.Compression simulations reveal that the stress-strain curve of the 3D reconstruction model of aluminum foam exhibits fluctuations,and the stresses in the reconstruction model concentrate on thin cell walls,leading to localized deformations.This method accurately restores the aluminum foam’s complex internal structure,improving reconstruction preci-sion and simulation reliability.The approach offers a cost-efficient,high-precision technique for optimizing material performance in engineering applications.展开更多
Accurate segmentation of camouflage objects in aerial imagery is vital for improving the efficiency of UAV-based reconnaissance and rescue missions.However,camouflage object segmentation is increasingly challenging du...Accurate segmentation of camouflage objects in aerial imagery is vital for improving the efficiency of UAV-based reconnaissance and rescue missions.However,camouflage object segmentation is increasingly challenging due to advances in both camouflage materials and biological mimicry.Although multispectral-RGB based technology shows promise,conventional dual-aperture multispectral-RGB imaging systems are constrained by imprecise and time-consuming registration and fusion across different modalities,limiting their performance.Here,we propose the Reconstructed Multispectral-RGB Fusion Network(RMRF-Net),which reconstructs RGB images into multispectral ones,enabling efficient multimodal segmentation using only an RGB camera.Specifically,RMRF-Net employs a divergentsimilarity feature correction strategy to minimize reconstruction errors and includes an efficient boundary-aware decoder to enhance object contours.Notably,we establish the first real-world aerial multispectral-RGB semantic segmentation of camouflage objects dataset,including 11 object categories.Experimental results demonstrate that RMRF-Net outperforms existing methods,achieving 17.38 FPS on the NVIDIA Jetson AGX Orin,with only a 0.96%drop in mIoU compared to the RTX 3090,showing its practical applicability in multimodal remote sensing.展开更多
In order to obtain a better sandstone three-dimensional （3D） reconstruction result which is more similar to the original sample, an algorithm based on stationarity for a two-dimensional （2D） training image is prop...In order to obtain a better sandstone three-dimensional （3D） reconstruction result which is more similar to the original sample, an algorithm based on stationarity for a two-dimensional （2D） training image is proposed. The second-order statistics based on texture features are analyzed to evaluate the scale stationarity of the training image. The multiple-point statistics of the training image are applied to obtain the multiple-point statistics stationarity estimation by the multi-point density function. The results show that the reconstructed 3D structures are closer to reality when the training image has better scale stationarity and multiple-point statistics stationarity by the indications of local percolation probability and two-point probability. Moreover, training images with higher multiple-point statistics stationarity and lower scale stationarity are likely to obtain closer results to the real 3D structure, and vice versa. Thus, stationarity analysis of the training image has far-reaching significance in choosing a better 2D thin section image for the 3D reconstruction of porous media. Especially, high-order statistics perform better than low-order statistics.展开更多
A method and procedure is presented to reconstruct three-dimensional(3D) positions of scattering centers from multiple synthetic aperture radar(SAR) images. Firstly, two-dimensional(2D) attribute scattering centers of...A method and procedure is presented to reconstruct three-dimensional(3D) positions of scattering centers from multiple synthetic aperture radar(SAR) images. Firstly, two-dimensional(2D) attribute scattering centers of targets are extracted from 2D SAR images. Secondly, similarity measure is developed based on 2D attributed scatter centers' location, type, and radargrammetry principle between multiple SAR images. By this similarity, we can associate 2D scatter centers and then obtain candidate 3D scattering centers. Thirdly, these candidate scattering centers are clustered in 3D space to reconstruct final 3D positions. Compared with presented methods, the proposed method has a capability of describing distributed scattering center, reduces false and missing 3D scattering centers, and has fewer restrictionson modeling data. Finally, results of experiments have demonstrated the effectiveness of the proposed method.展开更多
A novel technique of three-dimensional (3D) reconstruction, segmentation, display and analysis of series slices of images including microscopic wide field optical sectioning by deconvolution method, cryo-electron micr...A novel technique of three-dimensional (3D) reconstruction, segmentation, display and analysis of series slices of images including microscopic wide field optical sectioning by deconvolution method, cryo-electron microscope slices by Fou-rier-Bessel synthesis and electron tomography (ET), and a series of computed tomography (CT) was developed to perform si-multaneous measurement on the structure and function of biomedical samples. The paper presents the 3D reconstruction seg-mentation display and analysis results of pollen spore, chaperonin, virus, head, cervical bone, tibia and carpus. At the same time, it also puts forward some potential applications of the new technique in the biomedical realm.展开更多
The three-dimensional(3D)model is of great significance to analyze the performance of nonwovens.However,the existing modelling methods could not reconstruct the 3D structure of nonwovens at low cost.A new method based...The three-dimensional(3D)model is of great significance to analyze the performance of nonwovens.However,the existing modelling methods could not reconstruct the 3D structure of nonwovens at low cost.A new method based on deep learning was proposed to reconstruct 3D models of nonwovens from multi-focus images.A convolutional neural network was trained to extract clear fibers from sequence images.Image processing algorithms were used to obtain the radius,the central axis,and depth information of fibers from the extraction results.Based on this information,3D models were built in 3D space.Furthermore,self-developed algorithms optimized the central axis and depth of fibers,which made fibers more realistic and continuous.The method with lower cost could reconstruct 3D models of nonwovens conveniently.展开更多
A new medical image fusion technique is presented.The method is based on three-dimensional reconstruction.After reconstruction,the three-dimensional volume data is normalized by three-dimensional coordinate conversion...A new medical image fusion technique is presented.The method is based on three-dimensional reconstruction.After reconstruction,the three-dimensional volume data is normalized by three-dimensional coordinate conversion in the same way and intercepted through setting up cutting plane including anatomical structure,as a result two images in entire registration on space and geometry are obtained and the images are fused at last.Compared with traditional two-dimensional fusion technique,three-dimensional fusion technique can not only resolve the different problems existed in the two kinds of images,but also avoid the registration error of the two kinds of images when they have different scan and imaging parameter.The research proves this fusion technique is more exact and has no registration,so it is more adapt to arbitrary medical image fusion with different equipments.展开更多
Three-dimensional(3D)reconstruction of human organs has gained attention in recent years due to advances in the Internet and graphics processing units.In the coming years,most patient care will shift toward this new p...Three-dimensional(3D)reconstruction of human organs has gained attention in recent years due to advances in the Internet and graphics processing units.In the coming years,most patient care will shift toward this new paradigm.However,development of fast and accurate 3D models from medical images or a set of medical scans remains a daunting task due to the number of pre-processing steps involved,most of which are dependent on human expertise.In this review,a survey of pre-processing steps was conducted,and reconstruction techniques for several organs in medical diagnosis were studied.Various methods and principles related to 3D reconstruction were highlighted.The usefulness of 3D reconstruction of organs in medical diagnosis was also highlighted.展开更多
Numerical simulation is the most powerful computational and analysis tool for a large variety of engineering and physical problems.For a complex problem relating to multi-field,multi-process and multi-scale,different ...Numerical simulation is the most powerful computational and analysis tool for a large variety of engineering and physical problems.For a complex problem relating to multi-field,multi-process and multi-scale,different computing tools have to be developed so as to solve particular fields at different scales and for different processes.Therefore,the integration of different types of software is inevitable.However,it is difficult to perform the transfer of the meshes and simulated results among software packages because of the lack of shared data formats or encrypted data formats.An image processing based method for three-dimensional model reconstruction for numerical simulation was proposed,which presents a solution to the integration problem by a series of slice or projection images obtained by the post-processing modules of the numerical simulation software.By means of mapping image pixels to meshes of either finite difference or finite element models,the geometry contour can be extracted to export the stereolithography model.The values of results,represented by color,can be deduced and assigned to the meshes.All the models with data can be directly or indirectly integrated into other software as a continued or new numerical simulation.The three-dimensional reconstruction method has been validated in numerical simulation of castings and case studies were provided in this study.展开更多
In high-resolution cone-beam computed tomography （CBCT） using the flat-panel detector, imperfect or defect detector elements cause ring artifacts due to the none-uniformity of their X-ray response. They often distur...In high-resolution cone-beam computed tomography （CBCT） using the flat-panel detector, imperfect or defect detector elements cause ring artifacts due to the none-uniformity of their X-ray response. They often disturb the image quality. A dedicated fitting correction method for high-resolution micro-CT is presented. The method converts each elementary X-ray response curve to an average one, and eliminates response inconsistency among pixels. Other factors of the method are discussed, such as the correction factor variability by different sampling frames and nonlinear factors over the whole spectrum. Results show that the noise and artifacts are both reduced in reconstructed images展开更多
基金supported by the Aeronautical Science Foundation of China,No.2023Z0680510022021 Special Scientific Research on Civil Aircraft Project+1 种基金the Natural Science Foundation of China,Nos.61572056 and 61872347the Special Plan for the Development of Distinguished Young Scientists of ISCAS,No.Y8RC535018.
文摘This study proposes an image-based three-dimensional(3D)vector reconstruction of industrial parts that can gener-ate non-uniform rational B-splines(NURBS)surfaces with high fidelity and flexibility.The contributions of this study include three parts:first,a dataset of two-dimensional images is constructed for typical industrial parts,including hex-agonal head bolts,cylindrical gears,shoulder rings,hexagonal nuts,and cylindrical roller bearings;second,a deep learning algorithm is developed for parameter extraction of 3D industrial parts,which can determine the final 3D parameters and pose information of the reconstructed model using two new nets,CAD-ClassNet and CAD-ReconNet;and finally,a 3D vector shape reconstruction of mechanical parts is presented to generate NURBS from the obtained shape parameters.The final reconstructed models show that the proposed approach is highly accurate,efficient,and practical.
文摘Image super-resolution reconstruction technology is currently widely used in medical imaging,video surveillance,and industrial quality inspection.It not only enhances image quality but also improves details and visual perception,significantly increasing the utility of low-resolution images.In this study,an improved image superresolution reconstruction model based on Generative Adversarial Networks(SRGAN)was proposed.This model introduced a channel and spatial attention mechanism(CSAB)in the generator,allowing it to effectively leverage the information from the input image to enhance feature representations and capture important details.The discriminator was designed with an improved PatchGAN architecture,which more accurately captured local details and texture information of the image.With these enhanced generator and discriminator architectures and an optimized loss function design,this method demonstrated superior performance in image quality assessment metrics.Experimental results showed that this model outperforms traditional methods,presenting more detailed and realistic image details in the visual effects.
基金supported by the Interdisciplinary project of Dalian University DLUXK-2023-ZD-001.
文摘As a form of discrete representation learning,Vector Quantized Variational Autoencoders(VQ-VAE)have increasingly been applied to generative and multimodal tasks due to their ease of embedding and representative capacity.However,existing VQ-VAEs often perform quantization in the spatial domain,ignoring global structural information and potentially suffering from codebook collapse and information coupling issues.This paper proposes a frequency quantized variational autoencoder(FQ-VAE)to address these issues.The proposed method transforms image features into linear combinations in the frequency domain using a 2D fast Fourier transform(2D-FFT)and performs adaptive quantization on these frequency components to preserve image’s global relationships.The codebook is dynamically optimized to avoid collapse and information coupling issue by considering the usage frequency and dependency of code vectors.Furthermore,we introduce a post-processing module based on graph convolutional networks to further improve reconstruction quality.Experimental results on four public datasets demonstrate that the proposed method outperforms state-of-the-art approaches in terms of Structural Similarity Index(SSIM),Learned Perceptual Image Patch Similarity(LPIPS),and Reconstruction Fréchet Inception Distance(rFID).In the experiments on the CIFAR-10 dataset,compared to the baselinemethod VQ-VAE,the proposedmethod improves the abovemetrics by 4.9%,36.4%,and 52.8%,respectively.
基金Supported by the 2022 Provincial Quality Engineering Project for Higher Education Institutions,No.2022sx031the 2023 Provincial Quality Engineering Project for Higher Education Institutions,No.2023jyxm1071.
文摘BACKGROUND Inguinal hernias are common after surgery.Tension-free repair is widely accepted as the main method for managing inguinal hernias.Adequate exposure,coverage,and repair of the myopectineal orifice(MPO)are necessary.However,due to differences in race and sex,people’s body shapes vary.According to European guidelines,the patch should measure 10 cm×15 cm.If any part of the MPO is dissected,injury to the nerves,vascular network,or organs may occur during surgery,thereby leading to inguinal discomfort,pain,and seroma formation after surgery.Therefore,accurate localization and measurement of the boundary of the MPO are crucial for selecting the optimal patch for inguinal hernia repair.AIM To compare the size of the MPO measured on three-dimensional multislice spiral computed tomography(CT)with that measured via laparoscopy and explore the relevant factors influencing the size of the MPO.METHODS Clinical data from 74 patients who underwent laparoscopic tension-free inguinal hernia repair at the General Surgery Department of the First Affiliated Hospital of Anhui University of Science and Technology between September 2022 and July 2024 were collected and analyzed retrospectively.Transabdominal preperitoneal was performed.Sixty-four males and 10 females,with an average age of 58.30±12.32 years,were included.The clinical data of the patients were collected.The boundary of the MPO was measured on three-dimensional CT images before surgery and then again during transabdominal preperitoneal.All the preoperative and intraoperative data were analyzed via paired t-tests.A t-test was used for comparisons of age,body mass index,and sex between the groups.In the comparative analysis,a P value less than 0.05 indicated a significant difference.RESULTS The boundaries of the MPO on 3-dimensional CT images measured 7.05±0.47 cm and 6.27±0.61 cm,and the area of the MPO was 19.54±3.33 cm^(2).The boundaries of the MPO during surgery were 7.18±0.51 cm and 6.17±0.40 cm.The errors were not statistically significant.However,the intraoperative BD(the width of the MPO,P=0.024,P<0.05)and preoperative AC(the length of the MPO,P=0.045,P<0.05)significantly differed according to sex.The AC and BD measurements before and during surgery were not significantly different according to age,body mass index,hernia side or hernia type(P>0.05).CONCLUSION The application of this technology can aid in determining the most appropriate dissection range and patch size.
基金Supported by the Natural Science Foundation of Fujian Province,No.2022J011442.
文摘BACKGROUND Percutaneous transhepatic biliary drainage(PTBD)is one of the primary clinical treatment options for patients with obstructive jaundice.In recent years,PTBD assisted by three-dimensional(3D)reconstruction technology has been widely implemented,but its advantages over traditional methods remains inconclusive.Thus,a discussion is warranted.AIM To explore the safety and efficacy of 3D reconstruction technology-assisted PTBD.METHODS We systematically searched the databases including the Cochrane Library,PubMed,EMBASE,Web of Science and China National Knowledge Infrastructure.The search period extended from the establishment of each database to November,2024.We screened the literature according to predefined inclusion and exclusion criteria,assessed the quality of the studies,and extracted data.Meta-analysis was performed using Revman 5.4.1 software.RESULTS A total of 15 studies were included,involving 1434 patients.The results of the meta-analysis showed that compared with the traditional group,the overall post-operative complications rate in the 3D reconstruction technology group was significantly lower[odds ratio=0.25;95%confidence interval(CI):0.17-0.36,P<0.00001].The overall puncture success rate in the 3D reconstruction group was better than those in the traditional group(odds ratio=3.61;95%CI:1.98-6.55,P<0.0001).However,there was no significant difference between the two groups in the reduction levels of postoperative total bilirubin(mean difference=-1.38;95%CI:-3.29 to 0.53,P=0.16).Subgroup analysis were conducted on the surgery time according to guidance stages of the 3D reconstruction,3D reconstruction imaging modalities,and types of studies.The results were stable,with no significant changes observed.CONCLUSION 3D reconstruction technology significantly improves the puncture success rate and safety of PTBD.However,it has no significant advantage in bile drainage effectiveness.Continued research is warranted to further explore its clinical value and optimize its application.
文摘Among hyperspectral imaging technologies, interferometric spectral imaging is widely used in remote sening due to advantages of large luminous flux and high resolution. However, with complicated mechanism, interferometric imaging faces the impact of multi-stage degradation. Most exsiting interferometric spectrum reconstruction methods are based on tradition model-based framework with multiple steps, showing poor efficiency and restricted performance. Thus, we propose an interferometric spectrum reconstruction method based on degradation synthesis and deep learning.Firstly, based on imaging mechanism, we proposed an mathematical model of interferometric imaging to analyse the degradation components as noises and trends during imaging. The model consists of three stages, namely instrument degradation, sensing degradation, and signal-independent degradation process. Then, we designed calibration-based method to estimate parameters in the model, of which the results are used for synthesizing realistic dataset for learning-based algorithms.In addition, we proposed a dual-stage interferogram spectrum reconstruction framework, which supports pre-training and integration of denoising DNNs. Experiments exhibits the reliability of our degradation model and synthesized data, and the effectiveness of the proposed reconstruction method.
基金supported in part by the National Natural Science Foundation of China(62101278,62001379,62271023)Beijing Natural Science Foundation(7242269).
文摘Deep learning(DL)-based image reconstruction methods have garnered increasing interest in the last few years.Numerous studies demonstrate that DL-based reconstruction methods function admirably in optical tomographic imaging techniques,such as bioluminescence tomography(BLT).Nevertheless,nearly every existing DL-based method utilizes an explicit neural representation for the reconstruction problem,which either consumes much memory space or requires various complicated computations.In this paper,we present a neural field(NF)-based image reconstruction scheme for BLT that uses an implicit neural representation.The proposed NFbased method establishes a transformation between the coordinate of an arbitrary spatial point and the source value of the point with a relatively light-weight multilayer perceptron,which has remarkable computational efficiency.Another simple neural network composed of two fully connected layers and a 1D convolutional layer is used to generate the neural features.Results of simulations and experiments show that the proposed NF-based method has similar performance to the photon density complement network and the two-stage network,while consuming fewer floating point operations with fewer model parameters.
文摘BACKGROUND Hepatobiliary surgery is complex and requires a thorough understanding of the liver’s anatomy,biliary system,and vasculature.Traditional imaging methods such as computed tomography(CT)and magnetic resonance imaging(MRI),although helpful,fail to provide three-dimensional(3D)relationships of these structures,which are critical for planning and executing complicated surgeries.AIM To explore the use of 3D imaging and virtual surgical planning(VSP)technologies to improve surgical accuracy,reduce complications,and enhance patient recovery in hepatobiliary surgeries.METHODS A comprehensive review of studies published between 2017 and 2024 was conducted through PubMed,Scopus,Google Scholar,and Web of Science.Studies selected focused on 3D imaging and VSP applications in hepatobiliary surgery,assessing surgical precision,complications,and patient outcomes.Thirty studies,including randomized controlled trials,cohort studies,and case reports,were included in the final analysis.RESULTS Various 3D imaging modalities,including multidetector CT,MRI,and 3D rotational angiography,provide high-resolution views of the liver’s vascular and biliary anatomy.VSP allows surgeons to simulate complex surgeries,improving preoperative planning and reducing complications like bleeding and bile leaks.Several studies have demonstrated improved surgical precision,reduced complications,and faster recovery times when 3D imaging and VSP were used in complex surgeries.CONCLUSION 3D imaging and VSP technologies significantly enhance the accuracy and outcomes of hepatobiliary surgeries by providing individualized preoperative planning.While promising,further research,particularly randomized controlled trials,is needed to standardize protocols and evaluate long-term efficacy.
基金National Natural Science Foundation of China(82001814)National High Level Hospital Clinical Research Funding(grant number 2022-PUMCH-B-067)+1 种基金National High Level Hospital Clinical Research Funding(grant number 2022-PUMCH-B-068)2021 SKY Imaging Research Fund of the Chinese Internatinal Medical Foundation(Z-2014-07-2101).
文摘Purpose:To assess the clinical efficacy of integrating deep learning reconstruction(DLR)with contrast-enhancement-boost(CE-boost)in 80 kVp head and neck CT angiography(CTA)using substantially lowered radiation and contrast medium(CM)doses,compared to the standard 100 kVp protocol using hybrid iterative reconstruction(HIR).Methods:Sixty-six patients were prospectively enrolled and randomly assigned to one of two groups:the low-dose group(n=33),receiving 80 kVp and 28 mL contrast medium(CM)with a noise index(NI)of 15;and the regular-dose group(n=33),receiving 100 kVp and 40 mL CM with an NI of 10.For the lowdose group,images underwent reconstruction using both hybrid iterative reconstruction(HIR)and deep learning reconstruction(DLR)at mild-,standard-,and strong-strength levels,both before and after combination with contrast enhancement-boost(CE-boost).This generated eight distinct datasets:L-HIR,L-DLR_(mild),L-DLR_(standard),L-DLR_(strong),L-HIR-CE,L-DLR_(mild)-CE,L-DLR_(standard)-CE,and L-DLR_(strong)-CE.Images for the regular-dose group were reconstructed solely with HIR(R-HIR).Quantitative analysis involved calculating and comparing CT attenuation,image noise,signal-to-noise ratio(SNR),and contrast-to-noise ratio(CNR)within six key vessels:the aortic arch(AA),internal carotid artery(ICA),external carotid artery(ECA),vertebral arteries(VA),basilar artery(BA),and middle cerebral artery(MCA).Two radiologists independently assessed subjective image quality using a 5-point scale,with statistical significance defined as P<0.05.Results:Compared to the regular-dose group,the low-dose protocol achieved a substantial reduction in contrast media volume(28 mL versus 40 mL,a 30%decrease)and radiation exposure((0.41±0.08)mSv versus(1.18±0.12)mSv,a 65%reduction).Both L-DLR_(standard) and L-DLR_(strong) delivered comparable or superior SNR and CNR across all vascular segments relative to R-HIR.However,subjective image quality scores for L-DLR at all strength levels fell below those for R-HIR(all P<0.05 for both readers).Combining CE-boost with the low-dose protocol significantly enhanced the objective image performance of L-DLR_(strong)-CE(all P<0.05)and produced subjective image scores comparable to R-HIR(reader 1:P=0.15;reader 2:P=0.06).Conclusion:When compared to the standard 100 kVp head and neck CTA,the combination of the DLR and CE-boost techniques at 80 kVp can achieve a 30%reduction in contrast dose and a 65%reduction in radiation dose,while maintaining both objective and subjective image quality.
基金National Natural Science Foundation Major Project of China,Grant/Award Number:42192580Guangdong Province Key Construction Discipline Scientific Research Ability Promotion Project,Grant/Award Number:2022ZDJS015。
文摘In Hyperspectral Imaging(HSI),the detrimental influence of noise and distortions on data quality is profound,which has severely affected the following-on analytics and decisionmaking such as land mapping.This study presents an innovative framework for assessing HSI band quality and reconstructing the low-quality bands,based on the Prophet model.By introducing a comprehensive quality metric to start,the authors approach factors in both spatial and spectral characteristics across local and global scales.This metric effectively captures the intricate noise and distortions inherent in the HSI data.Subsequently,the authors employ the Prophet model to forecast information within the low-quality bands,leveraging insights from neighbouring high-quality bands.To validate the effectiveness of the authors’proposed model,extensive experiments on three publicly available uncorrected datasets are conducted.In a head-to-head comparison,the framework against six state-ofthe-art band reconstruction algorithms including three spectral methods,two spatialspectral methods and one deep learning method is benchmarked.The authors’experiments also delve into strategies for band selection based on quality metrics and the quality evaluation of the reconstructed bands.In addition,the authors assess the classification accuracy utilising these reconstructed bands.In various experiments,the results consistently affirm the efficacy of the authors’method in HSI quality assessment and band reconstruction.Notably,the authors’approach obviates the need for manually prefiltering of noisy bands.This comprehensive framework holds promise in addressing HSI data quality concerns whilst enhancing the overall utility of HSI.
基金supported by the Key Research and DevelopmentPlan in Shanxi Province of China(No.201803D421045)the Natural Science Foundation of Shanxi Province(No.2021-0302-123104)。
文摘This study introduces a novel method for reconstructing the 3D model of aluminum foam using cross-sectional sequence images.Combining precision milling and image acquisition,high-qual-ity cross-sectional images are obtained.Pore structures are segmented by the U-shaped network(U-Net)neural network integrated with the Canny edge detection operator,ensuring accurate pore delineation and edge extraction.The trained U-Net achieves 98.55%accuracy.The 2D data are superimposed and processed into 3D point clouds,enabling reconstruction of the pore structure and aluminum skeleton.Analysis of pore 01 shows the cross-sectional area initially increases,and then decreases with milling depth,with a uniform point distribution of 40 per layer.The reconstructed model exhibits a porosity of 77.5%,with section overlap rates between the 2D pore segmentation and the reconstructed model exceeding 96%,confirming high fidelity.Equivalent sphere diameters decrease with size,averaging 1.95 mm.Compression simulations reveal that the stress-strain curve of the 3D reconstruction model of aluminum foam exhibits fluctuations,and the stresses in the reconstruction model concentrate on thin cell walls,leading to localized deformations.This method accurately restores the aluminum foam’s complex internal structure,improving reconstruction preci-sion and simulation reliability.The approach offers a cost-efficient,high-precision technique for optimizing material performance in engineering applications.
基金National Natural Science Foundation of China(Grant Nos.62005049 and 62072110)Natural Science Foundation of Fujian Province(Grant No.2020J01451).
文摘Accurate segmentation of camouflage objects in aerial imagery is vital for improving the efficiency of UAV-based reconnaissance and rescue missions.However,camouflage object segmentation is increasingly challenging due to advances in both camouflage materials and biological mimicry.Although multispectral-RGB based technology shows promise,conventional dual-aperture multispectral-RGB imaging systems are constrained by imprecise and time-consuming registration and fusion across different modalities,limiting their performance.Here,we propose the Reconstructed Multispectral-RGB Fusion Network(RMRF-Net),which reconstructs RGB images into multispectral ones,enabling efficient multimodal segmentation using only an RGB camera.Specifically,RMRF-Net employs a divergentsimilarity feature correction strategy to minimize reconstruction errors and includes an efficient boundary-aware decoder to enhance object contours.Notably,we establish the first real-world aerial multispectral-RGB semantic segmentation of camouflage objects dataset,including 11 object categories.Experimental results demonstrate that RMRF-Net outperforms existing methods,achieving 17.38 FPS on the NVIDIA Jetson AGX Orin,with only a 0.96%drop in mIoU compared to the RTX 3090,showing its practical applicability in multimodal remote sensing.
基金The National Natural Science Foundation of China(No.60972130)
文摘In order to obtain a better sandstone three-dimensional （3D） reconstruction result which is more similar to the original sample, an algorithm based on stationarity for a two-dimensional （2D） training image is proposed. The second-order statistics based on texture features are analyzed to evaluate the scale stationarity of the training image. The multiple-point statistics of the training image are applied to obtain the multiple-point statistics stationarity estimation by the multi-point density function. The results show that the reconstructed 3D structures are closer to reality when the training image has better scale stationarity and multiple-point statistics stationarity by the indications of local percolation probability and two-point probability. Moreover, training images with higher multiple-point statistics stationarity and lower scale stationarity are likely to obtain closer results to the real 3D structure, and vice versa. Thus, stationarity analysis of the training image has far-reaching significance in choosing a better 2D thin section image for the 3D reconstruction of porous media. Especially, high-order statistics perform better than low-order statistics.
文摘A method and procedure is presented to reconstruct three-dimensional(3D) positions of scattering centers from multiple synthetic aperture radar(SAR) images. Firstly, two-dimensional(2D) attribute scattering centers of targets are extracted from 2D SAR images. Secondly, similarity measure is developed based on 2D attributed scatter centers' location, type, and radargrammetry principle between multiple SAR images. By this similarity, we can associate 2D scatter centers and then obtain candidate 3D scattering centers. Thirdly, these candidate scattering centers are clustered in 3D space to reconstruct final 3D positions. Compared with presented methods, the proposed method has a capability of describing distributed scattering center, reduces false and missing 3D scattering centers, and has fewer restrictionson modeling data. Finally, results of experiments have demonstrated the effectiveness of the proposed method.
文摘A novel technique of three-dimensional (3D) reconstruction, segmentation, display and analysis of series slices of images including microscopic wide field optical sectioning by deconvolution method, cryo-electron microscope slices by Fou-rier-Bessel synthesis and electron tomography (ET), and a series of computed tomography (CT) was developed to perform si-multaneous measurement on the structure and function of biomedical samples. The paper presents the 3D reconstruction seg-mentation display and analysis results of pollen spore, chaperonin, virus, head, cervical bone, tibia and carpus. At the same time, it also puts forward some potential applications of the new technique in the biomedical realm.
基金National Natural Science Foundation of China(No.61771123)。
文摘The three-dimensional(3D)model is of great significance to analyze the performance of nonwovens.However,the existing modelling methods could not reconstruct the 3D structure of nonwovens at low cost.A new method based on deep learning was proposed to reconstruct 3D models of nonwovens from multi-focus images.A convolutional neural network was trained to extract clear fibers from sequence images.Image processing algorithms were used to obtain the radius,the central axis,and depth information of fibers from the extraction results.Based on this information,3D models were built in 3D space.Furthermore,self-developed algorithms optimized the central axis and depth of fibers,which made fibers more realistic and continuous.The method with lower cost could reconstruct 3D models of nonwovens conveniently.
文摘A new medical image fusion technique is presented.The method is based on three-dimensional reconstruction.After reconstruction,the three-dimensional volume data is normalized by three-dimensional coordinate conversion in the same way and intercepted through setting up cutting plane including anatomical structure,as a result two images in entire registration on space and geometry are obtained and the images are fused at last.Compared with traditional two-dimensional fusion technique,three-dimensional fusion technique can not only resolve the different problems existed in the two kinds of images,but also avoid the registration error of the two kinds of images when they have different scan and imaging parameter.The research proves this fusion technique is more exact and has no registration,so it is more adapt to arbitrary medical image fusion with different equipments.
文摘Three-dimensional(3D)reconstruction of human organs has gained attention in recent years due to advances in the Internet and graphics processing units.In the coming years,most patient care will shift toward this new paradigm.However,development of fast and accurate 3D models from medical images or a set of medical scans remains a daunting task due to the number of pre-processing steps involved,most of which are dependent on human expertise.In this review,a survey of pre-processing steps was conducted,and reconstruction techniques for several organs in medical diagnosis were studied.Various methods and principles related to 3D reconstruction were highlighted.The usefulness of 3D reconstruction of organs in medical diagnosis was also highlighted.
基金funded by National Key R&D Program of China(No.2021YFB3401200)the National Natural Science Foundation of China(No.51875308)the Beijing Nature Sciences Fund-Haidian Originality Cooperation Project(L212002).
文摘Numerical simulation is the most powerful computational and analysis tool for a large variety of engineering and physical problems.For a complex problem relating to multi-field,multi-process and multi-scale,different computing tools have to be developed so as to solve particular fields at different scales and for different processes.Therefore,the integration of different types of software is inevitable.However,it is difficult to perform the transfer of the meshes and simulated results among software packages because of the lack of shared data formats or encrypted data formats.An image processing based method for three-dimensional model reconstruction for numerical simulation was proposed,which presents a solution to the integration problem by a series of slice or projection images obtained by the post-processing modules of the numerical simulation software.By means of mapping image pixels to meshes of either finite difference or finite element models,the geometry contour can be extracted to export the stereolithography model.The values of results,represented by color,can be deduced and assigned to the meshes.All the models with data can be directly or indirectly integrated into other software as a continued or new numerical simulation.The three-dimensional reconstruction method has been validated in numerical simulation of castings and case studies were provided in this study.
基金Supported by the National Basic Research Program of China ("973"Program)(2006CB601201)~~
文摘In high-resolution cone-beam computed tomography （CBCT） using the flat-panel detector, imperfect or defect detector elements cause ring artifacts due to the none-uniformity of their X-ray response. They often disturb the image quality. A dedicated fitting correction method for high-resolution micro-CT is presented. The method converts each elementary X-ray response curve to an average one, and eliminates response inconsistency among pixels. Other factors of the method are discussed, such as the correction factor variability by different sampling frames and nonlinear factors over the whole spectrum. Results show that the noise and artifacts are both reduced in reconstructed images
