In order to improve the reconstruction accuracy of magnetic resonance imaging(MRI),an accurate natural image compressed sensing(CS)reconstruction network is proposed,which combines the advantages of model-based and de...In order to improve the reconstruction accuracy of magnetic resonance imaging(MRI),an accurate natural image compressed sensing(CS)reconstruction network is proposed,which combines the advantages of model-based and deep learning-based CS-MRI methods.In theory,enhancing geometric texture details in linear reconstruction is possible.First,the optimization problem is decomposed into two problems:linear approximation and geometric compensation.Aimed at the problem of image linear approximation,the data consistency module is used to deal with it.Since the processing process will lose texture details,a neural network layer that explicitly combines image and frequency feature representation is proposed,which is named butterfly dilated geometric distillation network.The network introduces the idea of butterfly operation,skillfully integrates the features of image domain and frequency domain,and avoids the loss of texture details when extracting features in a single domain.Finally,a channel feature fusion module is designed by combining channel attention mechanism and dilated convolution.The attention of the channel makes the final output feature map focus on the more important part,thus improving the feature representation ability.The dilated convolution enlarges the receptive field,thereby obtaining more dense image feature data.The experimental results show that the peak signal-to-noise ratio of the network is 5.43 dB,5.24 dB and 3.89 dB higher than that of ISTA-Net+,FISTA and DGDN networks on the brain data set with a Cartesian sampling mask CS ratio of 10%.展开更多
Microwave diffraction tomography is a process to infer the internal structure of an objectfrom multiple angle views of microwave diffraction shadow. Being sensitive to variations in refractive index of the object, the...Microwave diffraction tomography is a process to infer the internal structure of an objectfrom multiple angle views of microwave diffraction shadow. Being sensitive to variations in refractive index of the object, the procedure can be used to measure permittivity distributions within dielectric objects and to image soft tissues for biomedical applications. The optimal resolution distance obtainable is half a wavelength, but this can rarely be achieved because of practical limitations. Some procedures, however, are available to improve the practical resolution. One, which is suitable for microwave tomography, is to use multiple angle views data and to combine the resulting images. The other, which is suitable for improving the image reconstruction resolution, is to use the digital filtering technique and the filtered backpropagation algorithm. A system operating over the X-band microwave frequency is described and some experimental results for objects in air are given.展开更多
Image super-resolution reconstruction technology is currently widely used in medical imaging,video surveillance,and industrial quality inspection.It not only enhances image quality but also improves details and visual...Image super-resolution reconstruction technology is currently widely used in medical imaging,video surveillance,and industrial quality inspection.It not only enhances image quality but also improves details and visual perception,significantly increasing the utility of low-resolution images.In this study,an improved image superresolution reconstruction model based on Generative Adversarial Networks(SRGAN)was proposed.This model introduced a channel and spatial attention mechanism(CSAB)in the generator,allowing it to effectively leverage the information from the input image to enhance feature representations and capture important details.The discriminator was designed with an improved PatchGAN architecture,which more accurately captured local details and texture information of the image.With these enhanced generator and discriminator architectures and an optimized loss function design,this method demonstrated superior performance in image quality assessment metrics.Experimental results showed that this model outperforms traditional methods,presenting more detailed and realistic image details in the visual effects.展开更多
Background:Quantum-enhanced medical imaging algorithms–quantum entanglement reconstruction,quantum noise suppression,and quantum beamforming–propose possible remedies for significant constraints in traditional diagn...Background:Quantum-enhanced medical imaging algorithms–quantum entanglement reconstruction,quantum noise suppression,and quantum beamforming–propose possible remedies for significant constraints in traditional diagnostic imaging,such as resolution,radiation efficiency,and real-time processing.Methods:This work used a mixed-methods strategy,including controlled phantom experiments,retrospective multi-center clinical data analysis,and quantum-classical hybrid processing to assess enhancements in resolution,dosage efficiency,and diagnostic confidence.Statistical validation included analysis of variance(ANOVA)and receiver-operating characteristic curve analysis,juxtaposing quantum-enhanced methodologies with conventional and deep learning approaches.Results:Quantum entanglement reconstruction enhanced magnetic resonance imaging spatial resolution by 33.2%(P<0.01),quantum noise suppression facilitated computed tomography scans with a 60%reduction in radiation,and quantum beamforming improved ultrasound contrast by 27%while preserving real-time processing(<2 ms delay).Inter-reader variability(12%in Diagnostic Confidence Scores)showed that systematic training is needed,even if the performance was better.The research presented(1)a reusable clinical quantum imaging framework,(2)enhanced hardware processes(field-programmable gate array/graphics processing unit acceleration),and(3)cost-benefit analyses demonstrating a 22-month return on investment breakeven point.Conclusion:Quantum-enhanced imaging has a lot of promise for use in medicine,especially in neurology and cancer.Future research should focus on multi-modal integration(e.g.,positron emission tomography–magnetic resonance imaging),cloud-based quantum simulations for enhanced accessibility,and extensive trials to confirm long-term diagnostic accuracy.This breakthrough gives healthcare systems a technology roadmap and a reason to spend money on quantum-enhanced diagnostics.展开更多
As a form of discrete representation learning,Vector Quantized Variational Autoencoders(VQ-VAE)have increasingly been applied to generative and multimodal tasks due to their ease of embedding and representative capaci...As a form of discrete representation learning,Vector Quantized Variational Autoencoders(VQ-VAE)have increasingly been applied to generative and multimodal tasks due to their ease of embedding and representative capacity.However,existing VQ-VAEs often perform quantization in the spatial domain,ignoring global structural information and potentially suffering from codebook collapse and information coupling issues.This paper proposes a frequency quantized variational autoencoder(FQ-VAE)to address these issues.The proposed method transforms image features into linear combinations in the frequency domain using a 2D fast Fourier transform(2D-FFT)and performs adaptive quantization on these frequency components to preserve image’s global relationships.The codebook is dynamically optimized to avoid collapse and information coupling issue by considering the usage frequency and dependency of code vectors.Furthermore,we introduce a post-processing module based on graph convolutional networks to further improve reconstruction quality.Experimental results on four public datasets demonstrate that the proposed method outperforms state-of-the-art approaches in terms of Structural Similarity Index(SSIM),Learned Perceptual Image Patch Similarity(LPIPS),and Reconstruction Fréchet Inception Distance(rFID).In the experiments on the CIFAR-10 dataset,compared to the baselinemethod VQ-VAE,the proposedmethod improves the abovemetrics by 4.9%,36.4%,and 52.8%,respectively.展开更多
Super-resolution structured illumination microscopy(SR-SIM)relies heavily on post-processing reconstruction to obtain high-quality SR images from raw data.Although many SIM reconstruction algorithms have been develope...Super-resolution structured illumination microscopy(SR-SIM)relies heavily on post-processing reconstruction to obtain high-quality SR images from raw data.Although many SIM reconstruction algorithms have been developed to recover fine cellular structures with high fidelity even from the noisy data,whether the pixel intensities of reconstructed SR images are still proportional to the original fluorescence intensity has been less explored.The linearity between the intensity before and after reconstruction is de fined as the intensity fidelity.Here,we proposed a method to evaluate the reconstructed SR image intensity fidelity at different spatial frequencies.With the proposed metric,we systematically investigated the impact of the key factors on the intensity fidelity in the standard Wiener-SIM reconstructions with simulated data,then evaluated the intensity fidelity of the SR images reconstructed by representative open-source packages.Our work provides a reference for SR-SIM image intensity fidelity improvement.展开更多
Deep learning(DL)-based image reconstruction methods have garnered increasing interest in the last few years.Numerous studies demonstrate that DL-based reconstruction methods function admirably in optical tomographic ...Deep learning(DL)-based image reconstruction methods have garnered increasing interest in the last few years.Numerous studies demonstrate that DL-based reconstruction methods function admirably in optical tomographic imaging techniques,such as bioluminescence tomography(BLT).Nevertheless,nearly every existing DL-based method utilizes an explicit neural representation for the reconstruction problem,which either consumes much memory space or requires various complicated computations.In this paper,we present a neural field(NF)-based image reconstruction scheme for BLT that uses an implicit neural representation.The proposed NFbased method establishes a transformation between the coordinate of an arbitrary spatial point and the source value of the point with a relatively light-weight multilayer perceptron,which has remarkable computational efficiency.Another simple neural network composed of two fully connected layers and a 1D convolutional layer is used to generate the neural features.Results of simulations and experiments show that the proposed NF-based method has similar performance to the photon density complement network and the two-stage network,while consuming fewer floating point operations with fewer model parameters.展开更多
In this paper, we improve traditional generative adversarial networks (GAN) with reference to residual networks and convolutional neural networks to facilitate the reconstruction of complex objects that cannot be reco...In this paper, we improve traditional generative adversarial networks (GAN) with reference to residual networks and convolutional neural networks to facilitate the reconstruction of complex objects that cannot be reconstructed by traditional associative imaging methods. Unlike traditional ghost imaging to reconstruct objects from bucket signals, our proposed method can use simple objects (such as EMNIST) as a training set for GAN, and then recognize objects (such as faces) of completely different complexity than the training set. We use traditional ghost imaging and neural network to reconstruct target objects respectively. According to the research results in this paper, the method based on neural network can reconstruct complex objects very well, but the method based on traditional ghost imaging cannot reconstruct complex objects. The research scheme in this paper is of great significance for the reconstruction of complex object-related imaging under low sampling conditions.展开更多
Structured illumination microscopy(SIM)achieves super-resolution(SR)by modulating the high-frequency information of the sample into the passband of the optical system and subsequent image reconstruction.The traditiona...Structured illumination microscopy(SIM)achieves super-resolution(SR)by modulating the high-frequency information of the sample into the passband of the optical system and subsequent image reconstruction.The traditional Wiener-filtering-based reconstruction algorithm operates in the Fourier domain,it requires prior knowledge of the sinusoidal illumination patterns which makes the time-consuming procedure of parameter estimation to raw datasets necessary,besides,the parameter estimation is sensitive to noise or aberration-induced pattern distortion which leads to reconstruction artifacts.Here,we propose a spatial-domain image reconstruction method that does not require parameter estimation but calculates patterns from raw datasets,and a reconstructed image can be obtained just by calculating the spatial covariance of differential calculated patterns and differential filtered datasets(the notch filtering operation is performed to the raw datasets for attenuating and compensating the optical transfer function(OTF)).Experiments on reconstructing raw datasets including nonbiological,biological,and simulated samples demonstrate that our method has SR capability,high reconstruction speed,and high robustness to aberration and noise.展开更多
For the nonuniform microscan system where the interframe translation is no longer equivalent to accurate halfpixel, a 2-dimension non-interpolated subpixel algorithm is proposed to consider arhitrary value of microsca...For the nonuniform microscan system where the interframe translation is no longer equivalent to accurate halfpixel, a 2-dimension non-interpolated subpixel algorithm is proposed to consider arhitrary value of microscanning. The aim of the proposed algorithm is to restore double resolution from 2 × 2 undersampled frames. To solve the ill-posed problem in the process of image reconstruction, the prior boundary condition is introduced, and the proposed subpixel reconstruction algorithm is reformulated into the form of line-by-line backward propagation iteration for reducing the calculation complexity. Since the direction of movement offset relative to the accurate halfpixel determines the transfer matrix of the image degradation process, the recon- struction is classified into 4 types when 2 × 2 mieroscan model is applied. All the simulation results and experiment data demonstrate the double resolution improvement compared with the undersampled images. The focus problem, scarcely any possibility of the operation with accurate halfpixel micromotion, is figured out for en-hancing the feasibility of subpixel reconstruction used in practice.展开更多
By obtaining a feasible filter function,reconstructed images can be got with linear interpolation and liftered backprojection techniques.Considering the gray and spstial correlation neighbour informations of each pixe...By obtaining a feasible filter function,reconstructed images can be got with linear interpolation and liftered backprojection techniques.Considering the gray and spstial correlation neighbour informations of each pixel,a new supervised classification method is put forward for the reconstructed images,and an experiment with noise image is done,the result shows that the method is feasible and accurate compared with ideal phantoms.展开更多
Magnetic particle imaging(MPI)is an emerging molecular imaging technique with high sensitivity and temporal-spatial resolution.Image reconstruction is an important research topic in MPI,which converts an induced volta...Magnetic particle imaging(MPI)is an emerging molecular imaging technique with high sensitivity and temporal-spatial resolution.Image reconstruction is an important research topic in MPI,which converts an induced voltage signal into the image of superparamagnetic iron oxide particles concentration distribution.MPI reconstruction primarily involves system matrix-and x-space-based methods.In this review,we provide a detailed overview of the research status and future research trends of these two methods.In addition,we review the application of deep learning methods in MPI reconstruction and the current open sources of MPI.Finally,research opinions on MPI reconstruction are presented.We hope this review promotes the use of MPI in clinical applications.展开更多
The state-of-the-art approaches for image reconstruction using under-sampled k-space data are compressed sensing based.They are iterative algorithms that optimize objective functions with spatial and/or temporal const...The state-of-the-art approaches for image reconstruction using under-sampled k-space data are compressed sensing based.They are iterative algorithms that optimize objective functions with spatial and/or temporal constraints.This paper proposes a non-iterative algorithm to estimate the un-measured data and then to reconstruct the image with the efficient filtered backprojection algorithm.The feasibility of the proposed method is demonstrated with a patient magnetic resonance imaging study.The proposed method is also compared with the state-of-the-art iterative compressed-sensing image reconstruction method using the total-variation optimization norm.展开更多
Electrical Impedance Tomography (EIT) is a medical imaging technique which can be used to monitor the regional ventilation in patients utilizing voltage measurements made at the thorax. Several reconstruction algorith...Electrical Impedance Tomography (EIT) is a medical imaging technique which can be used to monitor the regional ventilation in patients utilizing voltage measurements made at the thorax. Several reconstruction algorithms have been developed during the last few years. In this manuscript we compare a well-established algorithm and a re-cently developed method for image reconstruction regarding EIT indices derived from the differently reconstructed images.展开更多
Based on a strong inter-diagonal matrix and Taylor series expansions,an oversample reconstruction method was proposed to calibrate the optical micro-scanning error. The technique can obtain regular 2 ×2 microscan...Based on a strong inter-diagonal matrix and Taylor series expansions,an oversample reconstruction method was proposed to calibrate the optical micro-scanning error. The technique can obtain regular 2 ×2 microscanning undersampling images from the real irregular undersampling images,and can then obtain a high spatial oversample resolution image. Simulations and experiments show that the proposed technique can reduce optical micro-scanning error and improve the system＇s spatial resolution. The algorithm is simple,fast and has low computational complexity. It can also be applied to other electro-optical imaging systems to improve their spatial resolution and has a widespread application prospect.展开更多
Photoacoustic imaging(PAI)is a noninvasive emerging imaging method based on the photoacoustic effect,which provides necessary assistance for medical diagnosis.It has the characteristics of large imaging depth and high...Photoacoustic imaging(PAI)is a noninvasive emerging imaging method based on the photoacoustic effect,which provides necessary assistance for medical diagnosis.It has the characteristics of large imaging depth and high contrast.However,limited by the equipment cost and reconstruction time requirements,the existing PAI systems distributed with annular array transducers are difficult to take into account both the image quality and the imaging speed.In this paper,a triple-path feature transform network(TFT-Net)for ring-array photoacoustic tomography is proposed to enhance the imaging quality from limited-view and sparse measurement data.Specifically,the network combines the raw photoacoustic pressure signals and conventional linear reconstruction images as input data,and takes the photoacoustic physical model as a prior information to guide the reconstruction process.In addition,to enhance the ability of extracting signal features,the residual block and squeeze and excitation block are introduced into the TFT-Net.For further efficient reconstruction,the final output of photoacoustic signals uses‘filter-then-upsample’operation with a pixel-shuffle multiplexer and a max out module.Experiment results on simulated and in-vivo data demonstrate that the constructed TFT-Net can restore the target boundary clearly,reduce background noise,and realize fast and high-quality photoacoustic image reconstruction of limited view with sparse sampling.展开更多
In this paper,we introduce an accelerating algorithm based on the Taylor series for reconstructing target images in the spectral digital image correlation method(SDIC).The Taylor series image reconstruction method is ...In this paper,we introduce an accelerating algorithm based on the Taylor series for reconstructing target images in the spectral digital image correlation method(SDIC).The Taylor series image reconstruction method is employed instead of the previous direct Fourier transform(DFT)image reconstruction method,which consumes the majority of the computational time for target image reconstruction.The partial derivatives in the Taylor series are computed using the fast Fourier transform(FFT)of the entire image,following the principles of Fourier transform theory.To examine the impact of different orders of Taylor series expansion on accuracy and efficiency,we employ third-and fourth-order Taylor series image reconstruction methods and compare them with the DFT image reconstruction method through simulated experiments.As a result of these enhancements,the computational efficiency using the third-and fourth-order Taylor series improves by factors of 57 and 46,respectively,compared to the previous method.In terms of analysis accuracy,within a strain range of 0–0.1 and without the addition of image noise,the accuracy of the proposed method increases with higher expansion orders,surpassing that of the DFT image reconstruction method when the fourth order is utilized.However,when different levels of Gaussian noise are applied to simulated images individually,the accuracy of the third-or fourth-order Taylor series expansion method is superior to that of the DFT reconstruction method.Finally,we present the analyzed experimental results of a silicone rubber plate specimen with bilateral cracks under uniaxial tension.展开更多
In this editorial,we review recent progress on the applications of artificial intelligence(AI)in image reconstruction for biomedical imaging.Because it abandons prior information of traditional artificial design and a...In this editorial,we review recent progress on the applications of artificial intelligence(AI)in image reconstruction for biomedical imaging.Because it abandons prior information of traditional artificial design and adopts a completely data-driven mode to obtain deeper prior information via learning,AI technology plays an increasingly important role in biomedical image reconstruction.The combination of AI technology and the biomedical image reconstruction method has become a hotspot in the field.Favoring AI,the performance of biomedical image reconstruction has been improved in terms of accuracy,resolution,imaging speed,etc.We specifically focus on how to use AI technology to improve the performance of biomedical image reconstruction,and propose possible future directions in this field.展开更多
Early diagnosis and accurate prognosis of colorectal cancer is critical for determining optimal treatment plans and maximizing patient outcomes,especially as the disease progresses into liver metastases.Computed tomog...Early diagnosis and accurate prognosis of colorectal cancer is critical for determining optimal treatment plans and maximizing patient outcomes,especially as the disease progresses into liver metastases.Computed tomography(CT)is a frontline tool for this task;however,the preservation of predictive radiomic features is highly dependent on the scanning protocol and reconstruction algorithm.We hypothesized that image reconstruction with a highfrequency kernel could result in a better characterization of liver metastases features via deep neural networks.This kernel produces images that appear noisier but preserve more sinogram information.A simulation pipeline was developed to study the effects of imaging parameters on the ability to characterize the features of liver metastases.This pipeline utilizes a fractal approach to generate a diverse population of shapes representing virtual metastases,and then it superimposes them on a realistic CT liver region to perform a virtual CT scan using CatSim.Datasets of 10,000 liver metastases were generated,scanned,and reconstructed using either standard or high-frequency kernels.These data were used to train and validate deep neural networks to recover crafted metastases characteristics,such as internal heterogeneity,edge sharpness,and edge fractal dimension.In the absence of noise,models scored,on average,12.2%(α=0.012)and 7.5%(α=0.049)lower squared error for characterizing edge sharpness and fractal dimension,respectively,when using high-frequency reconstructions compared to standard.However,the differences in performance were statistically insignificant when a typical level of CT noise was simulated in the clinical scan.Our results suggest that high-frequency reconstruction kernels can better preserve information for downstream artificial intelligence-based radiomic characterization,provided that noise is limited.Future work should investigate the informationpreserving kernels in datasets with clinical labels.展开更多
The image reconstruction of electrical impedance tomography(EIT)is a nonlinear and ill-posed inverse problem and the imaging results are easily affected by measurement noise,which needs to be solved by using regulariz...The image reconstruction of electrical impedance tomography(EIT)is a nonlinear and ill-posed inverse problem and the imaging results are easily affected by measurement noise,which needs to be solved by using regularization methods.The iterative regularization method has become a focus of the research due to its ease of implementation.To deal with the ill-posed and ill-conditional problems in image reconstruction,the inexact Newton-Landweber iterative method is considered and the Nesterov’s acceleration strategy is introduced.One Nesterov-type accelerated version of the inexact Newton-Landweber iteration is presented to determine the conductivity distributions inside an object from electrical measurements made on the surface.In order to further optimize the acceleration,both the steepest descent step-length and the minimal error step-length are exploited during the iterative image reconstruction process.Landweber iteration and its accelerated version are also implemented for comparison.All algorithms are terminated by the discrepancy principle.Finally,the performance is tested by reporting numerical simulations to verify the remarkable acceleration efficiency of the proposed method.展开更多
基金the National Natural Science Foundation of China(No.61962032)。
文摘In order to improve the reconstruction accuracy of magnetic resonance imaging(MRI),an accurate natural image compressed sensing(CS)reconstruction network is proposed,which combines the advantages of model-based and deep learning-based CS-MRI methods.In theory,enhancing geometric texture details in linear reconstruction is possible.First,the optimization problem is decomposed into two problems:linear approximation and geometric compensation.Aimed at the problem of image linear approximation,the data consistency module is used to deal with it.Since the processing process will lose texture details,a neural network layer that explicitly combines image and frequency feature representation is proposed,which is named butterfly dilated geometric distillation network.The network introduces the idea of butterfly operation,skillfully integrates the features of image domain and frequency domain,and avoids the loss of texture details when extracting features in a single domain.Finally,a channel feature fusion module is designed by combining channel attention mechanism and dilated convolution.The attention of the channel makes the final output feature map focus on the more important part,thus improving the feature representation ability.The dilated convolution enlarges the receptive field,thereby obtaining more dense image feature data.The experimental results show that the peak signal-to-noise ratio of the network is 5.43 dB,5.24 dB and 3.89 dB higher than that of ISTA-Net+,FISTA and DGDN networks on the brain data set with a Cartesian sampling mask CS ratio of 10%.
文摘Microwave diffraction tomography is a process to infer the internal structure of an objectfrom multiple angle views of microwave diffraction shadow. Being sensitive to variations in refractive index of the object, the procedure can be used to measure permittivity distributions within dielectric objects and to image soft tissues for biomedical applications. The optimal resolution distance obtainable is half a wavelength, but this can rarely be achieved because of practical limitations. Some procedures, however, are available to improve the practical resolution. One, which is suitable for microwave tomography, is to use multiple angle views data and to combine the resulting images. The other, which is suitable for improving the image reconstruction resolution, is to use the digital filtering technique and the filtered backpropagation algorithm. A system operating over the X-band microwave frequency is described and some experimental results for objects in air are given.
文摘Image super-resolution reconstruction technology is currently widely used in medical imaging,video surveillance,and industrial quality inspection.It not only enhances image quality but also improves details and visual perception,significantly increasing the utility of low-resolution images.In this study,an improved image superresolution reconstruction model based on Generative Adversarial Networks(SRGAN)was proposed.This model introduced a channel and spatial attention mechanism(CSAB)in the generator,allowing it to effectively leverage the information from the input image to enhance feature representations and capture important details.The discriminator was designed with an improved PatchGAN architecture,which more accurately captured local details and texture information of the image.With these enhanced generator and discriminator architectures and an optimized loss function design,this method demonstrated superior performance in image quality assessment metrics.Experimental results showed that this model outperforms traditional methods,presenting more detailed and realistic image details in the visual effects.
文摘Background:Quantum-enhanced medical imaging algorithms–quantum entanglement reconstruction,quantum noise suppression,and quantum beamforming–propose possible remedies for significant constraints in traditional diagnostic imaging,such as resolution,radiation efficiency,and real-time processing.Methods:This work used a mixed-methods strategy,including controlled phantom experiments,retrospective multi-center clinical data analysis,and quantum-classical hybrid processing to assess enhancements in resolution,dosage efficiency,and diagnostic confidence.Statistical validation included analysis of variance(ANOVA)and receiver-operating characteristic curve analysis,juxtaposing quantum-enhanced methodologies with conventional and deep learning approaches.Results:Quantum entanglement reconstruction enhanced magnetic resonance imaging spatial resolution by 33.2%(P<0.01),quantum noise suppression facilitated computed tomography scans with a 60%reduction in radiation,and quantum beamforming improved ultrasound contrast by 27%while preserving real-time processing(<2 ms delay).Inter-reader variability(12%in Diagnostic Confidence Scores)showed that systematic training is needed,even if the performance was better.The research presented(1)a reusable clinical quantum imaging framework,(2)enhanced hardware processes(field-programmable gate array/graphics processing unit acceleration),and(3)cost-benefit analyses demonstrating a 22-month return on investment breakeven point.Conclusion:Quantum-enhanced imaging has a lot of promise for use in medicine,especially in neurology and cancer.Future research should focus on multi-modal integration(e.g.,positron emission tomography–magnetic resonance imaging),cloud-based quantum simulations for enhanced accessibility,and extensive trials to confirm long-term diagnostic accuracy.This breakthrough gives healthcare systems a technology roadmap and a reason to spend money on quantum-enhanced diagnostics.
基金supported by the Interdisciplinary project of Dalian University DLUXK-2023-ZD-001.
文摘As a form of discrete representation learning,Vector Quantized Variational Autoencoders(VQ-VAE)have increasingly been applied to generative and multimodal tasks due to their ease of embedding and representative capacity.However,existing VQ-VAEs often perform quantization in the spatial domain,ignoring global structural information and potentially suffering from codebook collapse and information coupling issues.This paper proposes a frequency quantized variational autoencoder(FQ-VAE)to address these issues.The proposed method transforms image features into linear combinations in the frequency domain using a 2D fast Fourier transform(2D-FFT)and performs adaptive quantization on these frequency components to preserve image’s global relationships.The codebook is dynamically optimized to avoid collapse and information coupling issue by considering the usage frequency and dependency of code vectors.Furthermore,we introduce a post-processing module based on graph convolutional networks to further improve reconstruction quality.Experimental results on four public datasets demonstrate that the proposed method outperforms state-of-the-art approaches in terms of Structural Similarity Index(SSIM),Learned Perceptual Image Patch Similarity(LPIPS),and Reconstruction Fréchet Inception Distance(rFID).In the experiments on the CIFAR-10 dataset,compared to the baselinemethod VQ-VAE,the proposedmethod improves the abovemetrics by 4.9%,36.4%,and 52.8%,respectively.
基金supported by the National Natural Science Foundation of China[Grant Nos.62205367 and 62141506]Suzhou Basic Research Pilot Project[Grant Nos.SSD2023006 and SJC2021013]Jiangsu Provincial Key Research and Development Program[Grant No.BE2020664].
文摘Super-resolution structured illumination microscopy(SR-SIM)relies heavily on post-processing reconstruction to obtain high-quality SR images from raw data.Although many SIM reconstruction algorithms have been developed to recover fine cellular structures with high fidelity even from the noisy data,whether the pixel intensities of reconstructed SR images are still proportional to the original fluorescence intensity has been less explored.The linearity between the intensity before and after reconstruction is de fined as the intensity fidelity.Here,we proposed a method to evaluate the reconstructed SR image intensity fidelity at different spatial frequencies.With the proposed metric,we systematically investigated the impact of the key factors on the intensity fidelity in the standard Wiener-SIM reconstructions with simulated data,then evaluated the intensity fidelity of the SR images reconstructed by representative open-source packages.Our work provides a reference for SR-SIM image intensity fidelity improvement.
基金supported in part by the National Natural Science Foundation of China(62101278,62001379,62271023)Beijing Natural Science Foundation(7242269).
文摘Deep learning(DL)-based image reconstruction methods have garnered increasing interest in the last few years.Numerous studies demonstrate that DL-based reconstruction methods function admirably in optical tomographic imaging techniques,such as bioluminescence tomography(BLT).Nevertheless,nearly every existing DL-based method utilizes an explicit neural representation for the reconstruction problem,which either consumes much memory space or requires various complicated computations.In this paper,we present a neural field(NF)-based image reconstruction scheme for BLT that uses an implicit neural representation.The proposed NFbased method establishes a transformation between the coordinate of an arbitrary spatial point and the source value of the point with a relatively light-weight multilayer perceptron,which has remarkable computational efficiency.Another simple neural network composed of two fully connected layers and a 1D convolutional layer is used to generate the neural features.Results of simulations and experiments show that the proposed NF-based method has similar performance to the photon density complement network and the two-stage network,while consuming fewer floating point operations with fewer model parameters.
文摘In this paper, we improve traditional generative adversarial networks (GAN) with reference to residual networks and convolutional neural networks to facilitate the reconstruction of complex objects that cannot be reconstructed by traditional associative imaging methods. Unlike traditional ghost imaging to reconstruct objects from bucket signals, our proposed method can use simple objects (such as EMNIST) as a training set for GAN, and then recognize objects (such as faces) of completely different complexity than the training set. We use traditional ghost imaging and neural network to reconstruct target objects respectively. According to the research results in this paper, the method based on neural network can reconstruct complex objects very well, but the method based on traditional ghost imaging cannot reconstruct complex objects. The research scheme in this paper is of great significance for the reconstruction of complex object-related imaging under low sampling conditions.
基金funded by the National Natural Science Foundation of China(62125504,61827825,and 31901059)Zhejiang Provincial Ten Thousand Plan for Young Top Talents(2020R52001)Open Project Program of Wuhan National Laboratory for Optoelectronics(2021WNLOKF007).
文摘Structured illumination microscopy(SIM)achieves super-resolution(SR)by modulating the high-frequency information of the sample into the passband of the optical system and subsequent image reconstruction.The traditional Wiener-filtering-based reconstruction algorithm operates in the Fourier domain,it requires prior knowledge of the sinusoidal illumination patterns which makes the time-consuming procedure of parameter estimation to raw datasets necessary,besides,the parameter estimation is sensitive to noise or aberration-induced pattern distortion which leads to reconstruction artifacts.Here,we propose a spatial-domain image reconstruction method that does not require parameter estimation but calculates patterns from raw datasets,and a reconstructed image can be obtained just by calculating the spatial covariance of differential calculated patterns and differential filtered datasets(the notch filtering operation is performed to the raw datasets for attenuating and compensating the optical transfer function(OTF)).Experiments on reconstructing raw datasets including nonbiological,biological,and simulated samples demonstrate that our method has SR capability,high reconstruction speed,and high robustness to aberration and noise.
基金Sponsored by the Ministerial Level Advanced Research Foundation (A1120060884)
文摘For the nonuniform microscan system where the interframe translation is no longer equivalent to accurate halfpixel, a 2-dimension non-interpolated subpixel algorithm is proposed to consider arhitrary value of microscanning. The aim of the proposed algorithm is to restore double resolution from 2 × 2 undersampled frames. To solve the ill-posed problem in the process of image reconstruction, the prior boundary condition is introduced, and the proposed subpixel reconstruction algorithm is reformulated into the form of line-by-line backward propagation iteration for reducing the calculation complexity. Since the direction of movement offset relative to the accurate halfpixel determines the transfer matrix of the image degradation process, the recon- struction is classified into 4 types when 2 × 2 mieroscan model is applied. All the simulation results and experiment data demonstrate the double resolution improvement compared with the undersampled images. The focus problem, scarcely any possibility of the operation with accurate halfpixel micromotion, is figured out for en-hancing the feasibility of subpixel reconstruction used in practice.
文摘By obtaining a feasible filter function,reconstructed images can be got with linear interpolation and liftered backprojection techniques.Considering the gray and spstial correlation neighbour informations of each pixel,a new supervised classification method is put forward for the reconstructed images,and an experiment with noise image is done,the result shows that the method is feasible and accurate compared with ideal phantoms.
基金This work was supported in part by the National Key Research and Development Program of China,Nos.2017YFA0700401 and 2017YFA0205200the National Natural Science Foundation of China,Nos.62027901,81827808,81527805,and 81671851+2 种基金the CAS Youth Innovation Promotion Association,No.2018167the CAS Key Technology Talent Programand the Project of High-Level Talents Team Introduction in Zhuhai City,No.Zhuhai HLHPTP201703。
文摘Magnetic particle imaging(MPI)is an emerging molecular imaging technique with high sensitivity and temporal-spatial resolution.Image reconstruction is an important research topic in MPI,which converts an induced voltage signal into the image of superparamagnetic iron oxide particles concentration distribution.MPI reconstruction primarily involves system matrix-and x-space-based methods.In this review,we provide a detailed overview of the research status and future research trends of these two methods.In addition,we review the application of deep learning methods in MPI reconstruction and the current open sources of MPI.Finally,research opinions on MPI reconstruction are presented.We hope this review promotes the use of MPI in clinical applications.
基金supported by American Heart Association,No.18AJML34280074.
文摘The state-of-the-art approaches for image reconstruction using under-sampled k-space data are compressed sensing based.They are iterative algorithms that optimize objective functions with spatial and/or temporal constraints.This paper proposes a non-iterative algorithm to estimate the un-measured data and then to reconstruct the image with the efficient filtered backprojection algorithm.The feasibility of the proposed method is demonstrated with a patient magnetic resonance imaging study.The proposed method is also compared with the state-of-the-art iterative compressed-sensing image reconstruction method using the total-variation optimization norm.
文摘Electrical Impedance Tomography (EIT) is a medical imaging technique which can be used to monitor the regional ventilation in patients utilizing voltage measurements made at the thorax. Several reconstruction algorithms have been developed during the last few years. In this manuscript we compare a well-established algorithm and a re-cently developed method for image reconstruction regarding EIT indices derived from the differently reconstructed images.
基金Supported by the National Natural Science Foundation of China(NSFC 61501396)the Colleges and Universities under the Science and Technology Research Projects of Hebei Province(QN2015021)
文摘Based on a strong inter-diagonal matrix and Taylor series expansions,an oversample reconstruction method was proposed to calibrate the optical micro-scanning error. The technique can obtain regular 2 ×2 microscanning undersampling images from the real irregular undersampling images,and can then obtain a high spatial oversample resolution image. Simulations and experiments show that the proposed technique can reduce optical micro-scanning error and improve the system＇s spatial resolution. The algorithm is simple,fast and has low computational complexity. It can also be applied to other electro-optical imaging systems to improve their spatial resolution and has a widespread application prospect.
基金supported by National Key R&D Program of China[2022YFC2402400]the National Natural Science Foundation of China[Grant No.62275062]Guangdong Provincial Key Laboratory of Biomedical Optical Imaging Technology[Grant No.2020B121201010-4].
文摘Photoacoustic imaging(PAI)is a noninvasive emerging imaging method based on the photoacoustic effect,which provides necessary assistance for medical diagnosis.It has the characteristics of large imaging depth and high contrast.However,limited by the equipment cost and reconstruction time requirements,the existing PAI systems distributed with annular array transducers are difficult to take into account both the image quality and the imaging speed.In this paper,a triple-path feature transform network(TFT-Net)for ring-array photoacoustic tomography is proposed to enhance the imaging quality from limited-view and sparse measurement data.Specifically,the network combines the raw photoacoustic pressure signals and conventional linear reconstruction images as input data,and takes the photoacoustic physical model as a prior information to guide the reconstruction process.In addition,to enhance the ability of extracting signal features,the residual block and squeeze and excitation block are introduced into the TFT-Net.For further efficient reconstruction,the final output of photoacoustic signals uses‘filter-then-upsample’operation with a pixel-shuffle multiplexer and a max out module.Experiment results on simulated and in-vivo data demonstrate that the constructed TFT-Net can restore the target boundary clearly,reduce background noise,and realize fast and high-quality photoacoustic image reconstruction of limited view with sparse sampling.
基金supported by the National Natural Science Foundation of China(Grant Nos.12272145 and 11972013)the Ministry of Science and Technology of China(Grant No.2018YFF01014200)Hubei Provincial Natural Science Foundation of China(Grant No.2022CFB288).
文摘In this paper,we introduce an accelerating algorithm based on the Taylor series for reconstructing target images in the spectral digital image correlation method(SDIC).The Taylor series image reconstruction method is employed instead of the previous direct Fourier transform(DFT)image reconstruction method,which consumes the majority of the computational time for target image reconstruction.The partial derivatives in the Taylor series are computed using the fast Fourier transform(FFT)of the entire image,following the principles of Fourier transform theory.To examine the impact of different orders of Taylor series expansion on accuracy and efficiency,we employ third-and fourth-order Taylor series image reconstruction methods and compare them with the DFT image reconstruction method through simulated experiments.As a result of these enhancements,the computational efficiency using the third-and fourth-order Taylor series improves by factors of 57 and 46,respectively,compared to the previous method.In terms of analysis accuracy,within a strain range of 0–0.1 and without the addition of image noise,the accuracy of the proposed method increases with higher expansion orders,surpassing that of the DFT image reconstruction method when the fourth order is utilized.However,when different levels of Gaussian noise are applied to simulated images individually,the accuracy of the third-or fourth-order Taylor series expansion method is superior to that of the DFT reconstruction method.Finally,we present the analyzed experimental results of a silicone rubber plate specimen with bilateral cracks under uniaxial tension.
基金Supported by The National Key R&D Program of China,No.2018YFC0910600the National Natural Science Foundation of China No.81627807 and 11727813+2 种基金Shaanxi Science Funds for Distinguished Young Scholars,No.2020JC-27the Fok Ying Tung Education Foundation,No.161104and Program for the Young Topnotch Talent of Shaanxi Province.
文摘In this editorial,we review recent progress on the applications of artificial intelligence(AI)in image reconstruction for biomedical imaging.Because it abandons prior information of traditional artificial design and adopts a completely data-driven mode to obtain deeper prior information via learning,AI technology plays an increasingly important role in biomedical image reconstruction.The combination of AI technology and the biomedical image reconstruction method has become a hotspot in the field.Favoring AI,the performance of biomedical image reconstruction has been improved in terms of accuracy,resolution,imaging speed,etc.We specifically focus on how to use AI technology to improve the performance of biomedical image reconstruction,and propose possible future directions in this field.
基金Research reported in this publication was supported by the NIH/NCI,No.R01CA233888the National Science Foundation Graduate Research Fellowship,No.DGE2147721.
文摘Early diagnosis and accurate prognosis of colorectal cancer is critical for determining optimal treatment plans and maximizing patient outcomes,especially as the disease progresses into liver metastases.Computed tomography(CT)is a frontline tool for this task;however,the preservation of predictive radiomic features is highly dependent on the scanning protocol and reconstruction algorithm.We hypothesized that image reconstruction with a highfrequency kernel could result in a better characterization of liver metastases features via deep neural networks.This kernel produces images that appear noisier but preserve more sinogram information.A simulation pipeline was developed to study the effects of imaging parameters on the ability to characterize the features of liver metastases.This pipeline utilizes a fractal approach to generate a diverse population of shapes representing virtual metastases,and then it superimposes them on a realistic CT liver region to perform a virtual CT scan using CatSim.Datasets of 10,000 liver metastases were generated,scanned,and reconstructed using either standard or high-frequency kernels.These data were used to train and validate deep neural networks to recover crafted metastases characteristics,such as internal heterogeneity,edge sharpness,and edge fractal dimension.In the absence of noise,models scored,on average,12.2%(α=0.012)and 7.5%(α=0.049)lower squared error for characterizing edge sharpness and fractal dimension,respectively,when using high-frequency reconstructions compared to standard.However,the differences in performance were statistically insignificant when a typical level of CT noise was simulated in the clinical scan.Our results suggest that high-frequency reconstruction kernels can better preserve information for downstream artificial intelligence-based radiomic characterization,provided that noise is limited.Future work should investigate the informationpreserving kernels in datasets with clinical labels.
基金National Natural Science Foundation of China(12101204,12261021)Heilongjiang Provincial Natural Science Foundation of China(LH2023A018)Modern Numerical Method Course for Research Program on Teaching Reform of Degree and Postgraduate Education of Heilongjiang University(2024)。
文摘The image reconstruction of electrical impedance tomography(EIT)is a nonlinear and ill-posed inverse problem and the imaging results are easily affected by measurement noise,which needs to be solved by using regularization methods.The iterative regularization method has become a focus of the research due to its ease of implementation.To deal with the ill-posed and ill-conditional problems in image reconstruction,the inexact Newton-Landweber iterative method is considered and the Nesterov’s acceleration strategy is introduced.One Nesterov-type accelerated version of the inexact Newton-Landweber iteration is presented to determine the conductivity distributions inside an object from electrical measurements made on the surface.In order to further optimize the acceleration,both the steepest descent step-length and the minimal error step-length are exploited during the iterative image reconstruction process.Landweber iteration and its accelerated version are also implemented for comparison.All algorithms are terminated by the discrepancy principle.Finally,the performance is tested by reporting numerical simulations to verify the remarkable acceleration efficiency of the proposed method.
