The rapid development of super-resolution microscopy has made it possible to observe subcellular structures and dynamic behaviors in living cells with nanoscale spatial resolution, greatly advancing progress in life s...The rapid development of super-resolution microscopy has made it possible to observe subcellular structures and dynamic behaviors in living cells with nanoscale spatial resolution, greatly advancing progress in life sciences. As hardware technology continues to evolve, the availability of new fluorescent probes with superior performance is becoming increasingly important. In recent years, fluorescent nanoprobes (FNPs) have emerged as highly promising fluorescent probes for bioimaging due to their high brightness and excellent photostability. This paper focuses on the development and applications of FNPs as probes for live-cell super-resolution imaging. It provides an overview of different super-resolution methods, discusses the performance requirements for FNPs in these methods, and reviews the latest applications of FNPs in the super-resolution imaging of living cells. Finally, it addresses the challenges and future outlook in this field.展开更多
Image super-resolution reconstruction technology is currently widely used in medical imaging,video surveillance,and industrial quality inspection.It not only enhances image quality but also improves details and visual...Image super-resolution reconstruction technology is currently widely used in medical imaging,video surveillance,and industrial quality inspection.It not only enhances image quality but also improves details and visual perception,significantly increasing the utility of low-resolution images.In this study,an improved image superresolution reconstruction model based on Generative Adversarial Networks(SRGAN)was proposed.This model introduced a channel and spatial attention mechanism(CSAB)in the generator,allowing it to effectively leverage the information from the input image to enhance feature representations and capture important details.The discriminator was designed with an improved PatchGAN architecture,which more accurately captured local details and texture information of the image.With these enhanced generator and discriminator architectures and an optimized loss function design,this method demonstrated superior performance in image quality assessment metrics.Experimental results showed that this model outperforms traditional methods,presenting more detailed and realistic image details in the visual effects.展开更多
Significant advancements have been achieved in the field of Single Image Super-Resolution(SISR)through the utilization of Convolutional Neural Networks(CNNs)to attain state-of-the-art performance.Recent efforts have e...Significant advancements have been achieved in the field of Single Image Super-Resolution(SISR)through the utilization of Convolutional Neural Networks(CNNs)to attain state-of-the-art performance.Recent efforts have explored the incorporation of Transformers to augment network performance in SISR.However,the high computational cost of Transformers makes them less suitable for deployment on lightweight devices.Moreover,the majority of enhancements for CNNs rely predominantly on small spatial convolutions,thereby neglecting the potential advantages of large kernel convolution.In this paper,the authors propose a Multi-Perception Large Kernel convNet(MPLKN)which delves into the exploration of large kernel convolution.Specifically,the authors have architected a Multi-Perception Large Kernel(MPLK)module aimed at extracting multi-scale features and employ a stepwise feature fusion strategy to seamlessly integrate these features.In addition,to enhance the network's capacity for nonlinear spatial information processing,the authors have designed a Spatial-Channel Gated Feed-forward Network(SCGFN)that is capable of adapting to feature interactions across both spatial and channel dimensions.Experimental results demonstrate that MPLKN outperforms other lightweight image super-resolution models while maintaining a minimal number of parameters and FLOPs.展开更多
This study proposes a new component of the composite loss function minimised during training of the Super-Resolution(SR)algorithms—the normalised structural similarity index loss LSSIMN,which has the potential to imp...This study proposes a new component of the composite loss function minimised during training of the Super-Resolution(SR)algorithms—the normalised structural similarity index loss LSSIMN,which has the potential to improve the natural appearance of reconstructed images.Deep learning-based super-resolution(SR)algorithms reconstruct high-resolution images from low-resolution inputs,offering a practical means to enhance image quality without requiring superior imaging hardware,which is particularly important in medical applications where diagnostic accuracy is critical.Although recent SR methods employing convolutional and generative adversarial networks achieve high pixel fidelity,visual artefacts may persist,making the design of the loss function during training essential for ensuring reliable and naturalistic image reconstruction.Our research shows on two models—SR and Invertible Rescaling Neural Network(IRN)—trained on multiple benchmark datasets that the function LSSIMN significantly contributes to the visual quality,preserving the structural fidelity on the reference datasets.The quantitative analysis of results while incorporating LSSIMN shows that including this loss function component has a mean 2.88%impact on the improvement of the final structural similarity of the reconstructed images in the validation set,in comparison to leaving it out and 0.218%in comparison when this component is non-normalised.展开更多
Existing imaging techniques cannot simultaneously achieve high resolution and a wide field of view,and manual multi-mineral segmentation in shale lacks precision.To address these limitations,we propose a comprehensive...Existing imaging techniques cannot simultaneously achieve high resolution and a wide field of view,and manual multi-mineral segmentation in shale lacks precision.To address these limitations,we propose a comprehensive framework based on generative adversarial network(GAN)for characterizing pore structure properties of shale,which incorporates image augmentation,super-resolution reconstruction,and multi-mineral auto-segmentation.Using real 2D and 3D shale images,the framework was assessed through correlation function,entropy,porosity,pore size distribution,and permeability.The application results show that this framework enables the enhancement of 3D low-resolution digital cores by a scale factor of 8,without paired shale images,effectively reconstructing the unresolved fine-scale pores under a low resolution,rather than merely denoising,deblurring,and edge clarification.The trained GAN-based segmentation model effectively improves manual multi-mineral segmentation results,resulting in a strong resemblance to real samples in terms of pore size distribution and permeability.This framework significantly improves the characterization of complex shale microstructures and can be expanded to other heterogeneous porous media,such as carbonate,coal,and tight sandstone reservoirs.展开更多
The evaluation of adsorption states and shale gas content in shale fractures and pores relies on the analysis of these fractures and pores.Scanning electron microscopy images are commonly used for shale analysis;howev...The evaluation of adsorption states and shale gas content in shale fractures and pores relies on the analysis of these fractures and pores.Scanning electron microscopy images are commonly used for shale analysis;however,their low resolution,particularly the loss of high-frequency information at pore edges,presents challenges in analyzing fractures and pores in shale gas reservoirs.This study introduced a novel neural network called the spatial-spectral domain attention network(SSDAN),which employed spatial and spectral domain attention mechanisms to extract features and restore information in parallel.The network generated super-resolution images through a fusion module that included CNN-based spatial blocks for pixel-level image information recovery,spectral blocks to process Fourier transform information of images and enhance high-frequency recovery,and an adaptive vision transformer to process Fourier transform block information,eliminating the need for a preset image size.The SSDAN model demonstrated exceptional performance in comparative experiments on marine shale and marine continental shale datasets,achieving optimal performance on key indicators such as peak signal-to-noise ratio,structural similarity,learned perceptual image patch similarity,and Frechet inception distance while also exhibiting superior visual performance in pore recovery.Ablation experiments further confirmed the effectiveness of the spatial blocks,channel attention,spectral blocks,and frequency loss function in the model.The SSDAN model showed remarkable capability in enhancing the resolution of shale gas reservoir images and restoring high-frequency information at pore edges,thereby validating its effectiveness in unconventional natural gas reservoir analyses.展开更多
Infrared imaging technology has been widely adopted in various fields,such as military reconnaissance,medical diagnosis,and security monitoring,due to its excellent ability to penetrate smoke and fog.However,the preva...Infrared imaging technology has been widely adopted in various fields,such as military reconnaissance,medical diagnosis,and security monitoring,due to its excellent ability to penetrate smoke and fog.However,the prevalent low resolution of infrared images severely limits the accurate interpretation of their contents.In addition,deploying super-resolution models on resource-constrained devices faces significant challenges.To address these issues,this study proposes a lightweight super-resolution network for infrared images based on an adaptive attention mechanism.The network’s dynamic weighting module automatically adjusts the weights of the attention and nonattention branch outputs based on the network’s characteristics at different levels.Among them,the attention branch is further subdivided into pixel attention and brightness-texture attention,which are specialized for extracting the most informative features in infrared images.Meanwhile,the non-attention branch supplements the extraction of those neglected features to enhance the comprehensiveness of the features.Through ablation experiments,we verify the effectiveness of the proposed module.Finally,through experiments on two datasets,FLIR and Thermal101,qualitative and quantitative results demonstrate that the model can effectively recover high-frequency details of infrared images and significantly improve image resolution.In detail,compared with the suboptimal method,we have reduced the number of parameters by 30%and improved the model performance.When the scale factor is 2,the peak signal-tonoise ratio of the test datasets FLIR and Thermal101 is improved by 0.09 and 0.15 dB,respectively.When the scale factor is 4,it is improved by 0.05 and 0.09 dB,respectively.In addition,due to the lightweight design of the network structure,it has a low computational cost.It is suitable for deployment on edge devices,thus effectively enhancing the sensing performance of infrared imaging devices.展开更多
BACKGROUND Deep learning-based super-resolution(SR)reconstruction can obtain high-quality images with more detailed information.AIM To compare multiparametric normal-resolution(NR)and SR magnetic resonance imaging(MRI...BACKGROUND Deep learning-based super-resolution(SR)reconstruction can obtain high-quality images with more detailed information.AIM To compare multiparametric normal-resolution(NR)and SR magnetic resonance imaging(MRI)in predicting the histopathologic grade in hepatocellular carcinoma.METHODS We retrospectively analyzed a total of 826 patients from two medical centers(training 459;validation 196;test 171).T2-weighted imaging,diffusion-weighted imaging,and portal venous phases were collected.Tumor segmentations were conducted automatically by 3D U-Net.Based on generative adversarial network,we utilized 3D SR reconstruction to produce SR MRI.Radiomics models were developed and validated by XGBoost and Catboost.The predictive efficiency was demonstrated by calibration curves,decision curve analysis,area under the curve(AUC)and net reclassification index(NRI).RESULTS We extracted 3045 radiomic features from both NR and SR MRI,retaining 29 and 28 features,respectively.For XGBoost models,SR MRI yielded higher AUC value than NR MRI in the validation and test cohorts(0.83 vs 0.79;0.80 vs 0.78),respectively.Consistent trends were seen in CatBoost models:SR MRI achieved AUCs of 0.89 and 0.80 compared to NR MRI’s 0.81 and 0.76.NRI indicated that the SR MRI models could improve the prediction accuracy by-1.6%to 20.9%compared to the NR MRI models.CONCLUSION Deep learning-based SR MRI could improve the predictive performance of histopathologic grade in HCC.It may be a powerful tool for better stratification management for patients with operable HCC.展开更多
Monitoring the dynamics of cellular pseudopodia at nanoscale has become essential for understanding their diverse and complex functions in living cells.This is made possible by combining single-molecule localization m...Monitoring the dynamics of cellular pseudopodia at nanoscale has become essential for understanding their diverse and complex functions in living cells.This is made possible by combining single-molecule localization microscopy(SMLM)with self-blinking dyes.However,existing self-blinking dyes often face limitations,such as nonspecific blinking and low photostability,which can bring background noise and yield erroneous localization signals,hindering their effectiveness for nanoscale visualization.Here,we present a method for long-term SMLM imaging of cellular pseudopodia dynamics using a blinkogenic probe that exhibits self-blinking activation upon molecular recognition.This approach enabled the precise tracking of various pseudopodia structures,including filopodia,lamellipodia,and(tunneling nanotubes)-nanoscale(TNTs),in living cells.We monitored the growth and fusion of filopodia,as well as the extension and shrinkage of lamellipodia,in real-time.Additionally,we identified two distinct fusion modes between filopodia and lamellipodia and captured the formation of TNTs and their interactions with filopodia,demonstrating the probe's utility in visualizing real-time pseudopodia dynamics at nanoscale.展开更多
With the growing demand for high-precision flow field simulations in computational science and engineering,the super-resolution reconstruction of physical fields has attracted considerable research interest.However,tr...With the growing demand for high-precision flow field simulations in computational science and engineering,the super-resolution reconstruction of physical fields has attracted considerable research interest.However,tradi-tional numerical methods often entail high computational costs,involve complex data processing,and struggle to capture fine-scale high-frequency details.To address these challenges,we propose an innovative super-resolution reconstruction framework that integrates a Fourier neural operator(FNO)with an enhanced diffusion model.The framework employs an adaptively weighted FNO to process low-resolution flow field inputs,effectively capturing global dependencies and high-frequency features.Furthermore,a residual-guided diffusion model is introduced to further improve reconstruction performance.This model uses a Markov chain for noise injection in phys-ical fields and integrates a reverse denoising procedure,efficiently solved by an adaptive time-step ordinary differential equation solver,thereby ensuring both stability and computational efficiency.Experimental results demonstrate that the proposed framework significantly outperforms existing methods in terms of accuracy and efficiency,offering a promising solution for fine-grained data reconstruction in scientific simulations.展开更多
Ultrasonic Lamb waves undergo complex mode conversion and diffraction at non-penetrating defects, such as plate corrosion and cracks. Lamb wave imaging has a resolution limit due to the guided wave dispersion characte...Ultrasonic Lamb waves undergo complex mode conversion and diffraction at non-penetrating defects, such as plate corrosion and cracks. Lamb wave imaging has a resolution limit due to the guided wave dispersion characteristics and Rayleigh criterion limitations. In this paper, a full convolutional network is designed to segment and reconstruct the received signals, enabling the automatic identification of target modalities. This approach eliminates clutter and mode conversion interference when calculating direct and accompanying acoustic fields in time-domain topological energy(TDTE) imaging.Subsequently, the measured accompanying acoustic field is reversed for adaptive focusing on defects and enhance the imaging quality. To circumvent the limitations of the Rayleigh criterion, the direct acoustic field and the accompanying acoustic field were fused to characterize the pixel distribution in the imaging region, achieving Lamb wave super-resolution imaging. Experimental results indicate that compared to the sign coherence factor-total focusing method(SCF-TFM),the proposed method achieves a 31.41% improvement in lateral resolution and a 29.53% increase in signal-to-noise ratio for single-blind-hole defects. In the case of multiple-blind-hole defects with spacings greater than the Rayleigh criterion resolution limit, it exhibits a 27.23% enhancement in signal-to-noise ratio. On the contrary, when the defect spacings are relatively smaller than the limit, this method has a higher resolution limit than SCF-TFM in super-resolution imaging.展开更多
Blood cells are the most integral part of the body,which are made up of erythrocytes,platelets and white blood cells.The examination of subcellular structures and proteins within blood cells at the nanoscale can provi...Blood cells are the most integral part of the body,which are made up of erythrocytes,platelets and white blood cells.The examination of subcellular structures and proteins within blood cells at the nanoscale can provide valuable insights into the health status of an individual,accurate diagnosis,and efficient treatment strategies for diseases.Super-resolution microscopy(SRM)has recently emerged as a cutting-edge tool for the study of blood cells,providing numerous advantages over traditional methods for examining subcellular structures and proteins.In this paper,we focus on outlining the fundamental principles of various SRM techniques and their applications in both normal and diseased states of blood cells.Furthermore,future prospects of SRM techniques in the analysis of blood cells are also discussed.展开更多
The application of image super-resolution(SR)has brought significant assistance in the medical field,aiding doctors to make more precise diagnoses.However,solely relying on a convolutional neural network(CNN)for image...The application of image super-resolution(SR)has brought significant assistance in the medical field,aiding doctors to make more precise diagnoses.However,solely relying on a convolutional neural network(CNN)for image SR may lead to issues such as blurry details and excessive smoothness.To address the limitations,we proposed an algorithm based on the generative adversarial network(GAN)framework.In the generator network,three different sizes of convolutions connected by a residual dense structure were used to extract detailed features,and an attention mechanism combined with dual channel and spatial information was applied to concentrate the computing power on crucial areas.In the discriminator network,using InstanceNorm to normalize tensors sped up the training process while retaining feature information.The experimental results demonstrate that our algorithm achieves higher peak signal-to-noise ratio(PSNR)and structural similarity index measure(SSIM)compared to other methods,resulting in an improved visual quality.展开更多
A new scheme of super-resolution optical fluctuation imaging(SOFI)is proposed to broaden its application in the high-order cumulant reconstruction by optimizing blinking characteristics,eliminating noise in raw data a...A new scheme of super-resolution optical fluctuation imaging(SOFI)is proposed to broaden its application in the high-order cumulant reconstruction by optimizing blinking characteristics,eliminating noise in raw data and applying multi-resolution analysis in cumulant reconstruction.A motor-driven rotating mask optical modulation system is designed to adjust the excitation lightfield and allows for fast deployment.Active-modulated fluorescence fluctuation superresolution microscopy with multi-resolution analysis(AMF-MRA-SOFI)demonstrates enhanced resolution ability and reconstruction quality in experiments performed on sample of conventional dyes,achieving a resolution of 100 nm in the fourth order compared to conventional SOFI reconstruction.Furthermore,our approach combining expansion super-resolution achieved a resolution at-57 nm.展开更多
Deep convolutional neural networks(CNNs)have demonstrated remarkable performance in video super-resolution(VSR).However,the ability of most existing methods to recover fine details in complex scenes is often hindered ...Deep convolutional neural networks(CNNs)have demonstrated remarkable performance in video super-resolution(VSR).However,the ability of most existing methods to recover fine details in complex scenes is often hindered by the loss of shallow texture information during feature extraction.To address this limitation,we propose a 3D Convolutional Enhanced Residual Video Super-Resolution Network(3D-ERVSNet).This network employs a forward and backward bidirectional propagation module(FBBPM)that aligns features across frames using explicit optical flow through lightweight SPyNet.By incorporating an enhanced residual structure(ERS)with skip connections,shallow and deep features are effectively integrated,enhancing texture restoration capabilities.Furthermore,3D convolution module(3DCM)is applied after the backward propagation module to implicitly capture spatio-temporal dependencies.The architecture synergizes these components where FBBPM extracts aligned features,ERS fuses hierarchical representations,and 3DCM refines temporal coherence.Finally,a deep feature aggregation module(DFAM)fuses the processed features,and a pixel-upsampling module(PUM)reconstructs the high-resolution(HR)video frames.Comprehensive evaluations on REDS,Vid4,UDM10,and Vim4 benchmarks demonstrate well performance including 30.95 dB PSNR/0.8822 SSIM on REDS and 32.78 dB/0.8987 on Vim4.3D-ERVSNet achieves significant gains over baselines while maintaining high efficiency with only 6.3M parameters and 77ms/frame runtime(i.e.,20×faster than RBPN).The network’s effectiveness stems from its task-specific asymmetric design that balances explicit alignment and implicit fusion.展开更多
Neutron capture event imaging is a novel technique that has the potential to substantially enhance the resolution of existing imaging systems.This study provides a measurement method for neutron capture event distribu...Neutron capture event imaging is a novel technique that has the potential to substantially enhance the resolution of existing imaging systems.This study provides a measurement method for neutron capture event distribution along with multiple reconstruction methods for super-resolution imaging.The proposed technology reduces the point-spread function of an imag-ing system through single-neutron detection and event reconstruction,thereby significantly improving imaging resolution.A single-neutron detection experiment was conducted using a highly practical and efficient^(6)LiF-ZnS scintillation screen of a cold neutron imaging device in the research reactor.In milliseconds of exposure time,a large number of weak light clusters and their distribution in the scintillation screen were recorded frame by frame,to complete single-neutron detection.Several reconstruction algorithms were proposed for the calculations.The location of neutron capture was calculated using several processing methods such as noise removal,filtering,spot segmentation,contour analysis,and local positioning.The proposed algorithm achieved a higher imaging resolution and faster reconstruction speed,and single-neutron super-resolution imaging was realized by combining single-neutron detection experiments and reconstruction calculations.The results show that the resolution of the 100μm thick^(6)LiF-ZnS scintillation screen can be improved from 125 to 40 microns.This indicates that the proposed single-neutron detection and calculation method is effective and can significantly improve imaging resolution.展开更多
In order to effectively improve the quality of recovered images, a single frame super-resolution reconstruction method based on sparse representation is proposed. The combination method of local orientation estimation...In order to effectively improve the quality of recovered images, a single frame super-resolution reconstruction method based on sparse representation is proposed. The combination method of local orientation estimation-based image patch clustering and principal component analysis is used to obtain a series of geometric dictionaries of different orientations in the dictionary learning process. Subsequently, the dictionary of the nearest orientation is adaptively assigned to each of the input patches that need to be represented in the sparse coding process. Moreover, the consistency of gradients is further incorporated into the basic framework to make more substantial progress in preserving more fine edges and producing sharper results. Two groups of experiments on different types of natural images indicate that the proposed method outperforms some state-of- the-art counterparts in terms of both numerical indicators and visual quality.展开更多
Previous deep learning-based super-resolution(SR)methods rely on the assumption that the degradation process is predefined(e.g.,bicubic downsampling).Thus,their performance would suffer from deterioration if the real ...Previous deep learning-based super-resolution(SR)methods rely on the assumption that the degradation process is predefined(e.g.,bicubic downsampling).Thus,their performance would suffer from deterioration if the real degradation is not consistent with the assumption.To deal with real-world scenarios,existing blind SR methods are committed to estimating both the degradation and the super-resolved image with an extra loss or iterative scheme.However,degradation estimation that requires more computation would result in limited SR performance due to the accumulated estimation errors.In this paper,we propose a contrastive regularization built upon contrastive learning to exploit both the information of blurry images and clear images as negative and positive samples,respectively.Contrastive regularization ensures that the restored image is pulled closer to the clear image and pushed far away from the blurry image in the representation space.Furthermore,instead of estimating the degradation,we extract global statistical prior information to capture the character of the distortion.Considering the coupling between the degradation and the low-resolution image,we embed the global prior into the distortion-specific SR network to make our method adaptive to the changes of distortions.We term our distortion-specific network with contrastive regularization as CRDNet.The extensive experiments on synthetic and realworld scenes demonstrate that our lightweight CRDNet surpasses state-of-the-art blind super-resolution approaches.展开更多
Single image super-resolution(SISR)is a fundamentally challenging problem because a low-resolution(LR)image can correspond to a set of high-resolution(HR)images,while most are not expected.Recently,SISR can be achieve...Single image super-resolution(SISR)is a fundamentally challenging problem because a low-resolution(LR)image can correspond to a set of high-resolution(HR)images,while most are not expected.Recently,SISR can be achieved by a deep learning-based method.By constructing a very deep super-resolution convolutional neural network(VDSRCNN),the LR images can be improved to HR images.This study mainly achieves two objectives:image super-resolution(ISR)and deblurring the image from VDSRCNN.Firstly,by analyzing ISR,we modify different training parameters to test the performance of VDSRCNN.Secondly,we add the motion blurred images to the training set to optimize the performance of VDSRCNN.Finally,we use image quality indexes to evaluate the difference between the images from classical methods and VDSRCNN.The results indicate that the VDSRCNN performs better in generating HR images from LR images using the optimized VDSRCNN in a proper method.展开更多
A novel reconstruction method to improve the recognition of license plate texts of moving vehicles in real traffic videos is proposed, which fuses complimentary information among low resolution （LR） images to yield ...A novel reconstruction method to improve the recognition of license plate texts of moving vehicles in real traffic videos is proposed, which fuses complimentary information among low resolution （LR） images to yield a high resolution （HR） image. Based on the regularization super-resolution （SR） reconstruction schemes, this paper first introduces a residual gradient （RG） term as a new regularization term to improve the quality of the reconstructed image. Moreover, L1 norm is used to measure the residual data （RD） term and the RG term in order to improve the robustness of the proposed method. Finally, the steepest descent method is exploited to solve the energy functional. Simulated and real acquired video sequence experiments show the effectiveness and practicability of the proposed method and demonstrate its superiority over the bi-cubic interpolation and discontinuity adaptive Markov random field （DAMRF） SR method in both signal to noise ratios （SNR） and visual effects.展开更多
基金supported by the following grants:National Natural Science Foundation of China(grant nos.92354305,32271428,and 32201132)National Key R&D Program of China(grant no.2022YFC3401100)+1 种基金Fund for Knowledge Innovation of Wuhan Science and Technology Bureau(grant no.2022020801010558)Director Fund of WNLO.
文摘The rapid development of super-resolution microscopy has made it possible to observe subcellular structures and dynamic behaviors in living cells with nanoscale spatial resolution, greatly advancing progress in life sciences. As hardware technology continues to evolve, the availability of new fluorescent probes with superior performance is becoming increasingly important. In recent years, fluorescent nanoprobes (FNPs) have emerged as highly promising fluorescent probes for bioimaging due to their high brightness and excellent photostability. This paper focuses on the development and applications of FNPs as probes for live-cell super-resolution imaging. It provides an overview of different super-resolution methods, discusses the performance requirements for FNPs in these methods, and reviews the latest applications of FNPs in the super-resolution imaging of living cells. Finally, it addresses the challenges and future outlook in this field.
文摘Image super-resolution reconstruction technology is currently widely used in medical imaging,video surveillance,and industrial quality inspection.It not only enhances image quality but also improves details and visual perception,significantly increasing the utility of low-resolution images.In this study,an improved image superresolution reconstruction model based on Generative Adversarial Networks(SRGAN)was proposed.This model introduced a channel and spatial attention mechanism(CSAB)in the generator,allowing it to effectively leverage the information from the input image to enhance feature representations and capture important details.The discriminator was designed with an improved PatchGAN architecture,which more accurately captured local details and texture information of the image.With these enhanced generator and discriminator architectures and an optimized loss function design,this method demonstrated superior performance in image quality assessment metrics.Experimental results showed that this model outperforms traditional methods,presenting more detailed and realistic image details in the visual effects.
文摘Significant advancements have been achieved in the field of Single Image Super-Resolution(SISR)through the utilization of Convolutional Neural Networks(CNNs)to attain state-of-the-art performance.Recent efforts have explored the incorporation of Transformers to augment network performance in SISR.However,the high computational cost of Transformers makes them less suitable for deployment on lightweight devices.Moreover,the majority of enhancements for CNNs rely predominantly on small spatial convolutions,thereby neglecting the potential advantages of large kernel convolution.In this paper,the authors propose a Multi-Perception Large Kernel convNet(MPLKN)which delves into the exploration of large kernel convolution.Specifically,the authors have architected a Multi-Perception Large Kernel(MPLK)module aimed at extracting multi-scale features and employ a stepwise feature fusion strategy to seamlessly integrate these features.In addition,to enhance the network's capacity for nonlinear spatial information processing,the authors have designed a Spatial-Channel Gated Feed-forward Network(SCGFN)that is capable of adapting to feature interactions across both spatial and channel dimensions.Experimental results demonstrate that MPLKN outperforms other lightweight image super-resolution models while maintaining a minimal number of parameters and FLOPs.
基金support from the following institutional grant.Internal Grant Agency of the Faculty of Economics and Management,Czech University of Life Sciences Prague,grant no.2023A0004(https://iga.pef.czu.cz/,accessed on 6 June 2025).
文摘This study proposes a new component of the composite loss function minimised during training of the Super-Resolution(SR)algorithms—the normalised structural similarity index loss LSSIMN,which has the potential to improve the natural appearance of reconstructed images.Deep learning-based super-resolution(SR)algorithms reconstruct high-resolution images from low-resolution inputs,offering a practical means to enhance image quality without requiring superior imaging hardware,which is particularly important in medical applications where diagnostic accuracy is critical.Although recent SR methods employing convolutional and generative adversarial networks achieve high pixel fidelity,visual artefacts may persist,making the design of the loss function during training essential for ensuring reliable and naturalistic image reconstruction.Our research shows on two models—SR and Invertible Rescaling Neural Network(IRN)—trained on multiple benchmark datasets that the function LSSIMN significantly contributes to the visual quality,preserving the structural fidelity on the reference datasets.The quantitative analysis of results while incorporating LSSIMN shows that including this loss function component has a mean 2.88%impact on the improvement of the final structural similarity of the reconstructed images in the validation set,in comparison to leaving it out and 0.218%in comparison when this component is non-normalised.
基金Supported by the National Natural Science Foundation of China(U23A20595,52034010,52288101)National Key Research and Development Program of China(2022YFE0203400)+1 种基金Shandong Provincial Natural Science Foundation(ZR2024ZD17)Fundamental Research Funds for the Central Universities(23CX10004A).
文摘Existing imaging techniques cannot simultaneously achieve high resolution and a wide field of view,and manual multi-mineral segmentation in shale lacks precision.To address these limitations,we propose a comprehensive framework based on generative adversarial network(GAN)for characterizing pore structure properties of shale,which incorporates image augmentation,super-resolution reconstruction,and multi-mineral auto-segmentation.Using real 2D and 3D shale images,the framework was assessed through correlation function,entropy,porosity,pore size distribution,and permeability.The application results show that this framework enables the enhancement of 3D low-resolution digital cores by a scale factor of 8,without paired shale images,effectively reconstructing the unresolved fine-scale pores under a low resolution,rather than merely denoising,deblurring,and edge clarification.The trained GAN-based segmentation model effectively improves manual multi-mineral segmentation results,resulting in a strong resemblance to real samples in terms of pore size distribution and permeability.This framework significantly improves the characterization of complex shale microstructures and can be expanded to other heterogeneous porous media,such as carbonate,coal,and tight sandstone reservoirs.
基金the National Natural Science Foundation(NNSF)of China under Grant 41927801.
文摘The evaluation of adsorption states and shale gas content in shale fractures and pores relies on the analysis of these fractures and pores.Scanning electron microscopy images are commonly used for shale analysis;however,their low resolution,particularly the loss of high-frequency information at pore edges,presents challenges in analyzing fractures and pores in shale gas reservoirs.This study introduced a novel neural network called the spatial-spectral domain attention network(SSDAN),which employed spatial and spectral domain attention mechanisms to extract features and restore information in parallel.The network generated super-resolution images through a fusion module that included CNN-based spatial blocks for pixel-level image information recovery,spectral blocks to process Fourier transform information of images and enhance high-frequency recovery,and an adaptive vision transformer to process Fourier transform block information,eliminating the need for a preset image size.The SSDAN model demonstrated exceptional performance in comparative experiments on marine shale and marine continental shale datasets,achieving optimal performance on key indicators such as peak signal-to-noise ratio,structural similarity,learned perceptual image patch similarity,and Frechet inception distance while also exhibiting superior visual performance in pore recovery.Ablation experiments further confirmed the effectiveness of the spatial blocks,channel attention,spectral blocks,and frequency loss function in the model.The SSDAN model showed remarkable capability in enhancing the resolution of shale gas reservoir images and restoring high-frequency information at pore edges,thereby validating its effectiveness in unconventional natural gas reservoir analyses.
基金funded in part by theHenan ProvinceKeyR&DProgramProject,“Research and Application Demonstration of Class Ⅱ Superlattice Medium Wave High Temperature Infrared Detector Technology”under Grant No.231111210400.
文摘Infrared imaging technology has been widely adopted in various fields,such as military reconnaissance,medical diagnosis,and security monitoring,due to its excellent ability to penetrate smoke and fog.However,the prevalent low resolution of infrared images severely limits the accurate interpretation of their contents.In addition,deploying super-resolution models on resource-constrained devices faces significant challenges.To address these issues,this study proposes a lightweight super-resolution network for infrared images based on an adaptive attention mechanism.The network’s dynamic weighting module automatically adjusts the weights of the attention and nonattention branch outputs based on the network’s characteristics at different levels.Among them,the attention branch is further subdivided into pixel attention and brightness-texture attention,which are specialized for extracting the most informative features in infrared images.Meanwhile,the non-attention branch supplements the extraction of those neglected features to enhance the comprehensiveness of the features.Through ablation experiments,we verify the effectiveness of the proposed module.Finally,through experiments on two datasets,FLIR and Thermal101,qualitative and quantitative results demonstrate that the model can effectively recover high-frequency details of infrared images and significantly improve image resolution.In detail,compared with the suboptimal method,we have reduced the number of parameters by 30%and improved the model performance.When the scale factor is 2,the peak signal-tonoise ratio of the test datasets FLIR and Thermal101 is improved by 0.09 and 0.15 dB,respectively.When the scale factor is 4,it is improved by 0.05 and 0.09 dB,respectively.In addition,due to the lightweight design of the network structure,it has a low computational cost.It is suitable for deployment on edge devices,thus effectively enhancing the sensing performance of infrared imaging devices.
基金Supported by AI+Health Collaborative Innovation Cultivation Project of Beijing City,No.Z221100003522005.
文摘BACKGROUND Deep learning-based super-resolution(SR)reconstruction can obtain high-quality images with more detailed information.AIM To compare multiparametric normal-resolution(NR)and SR magnetic resonance imaging(MRI)in predicting the histopathologic grade in hepatocellular carcinoma.METHODS We retrospectively analyzed a total of 826 patients from two medical centers(training 459;validation 196;test 171).T2-weighted imaging,diffusion-weighted imaging,and portal venous phases were collected.Tumor segmentations were conducted automatically by 3D U-Net.Based on generative adversarial network,we utilized 3D SR reconstruction to produce SR MRI.Radiomics models were developed and validated by XGBoost and Catboost.The predictive efficiency was demonstrated by calibration curves,decision curve analysis,area under the curve(AUC)and net reclassification index(NRI).RESULTS We extracted 3045 radiomic features from both NR and SR MRI,retaining 29 and 28 features,respectively.For XGBoost models,SR MRI yielded higher AUC value than NR MRI in the validation and test cohorts(0.83 vs 0.79;0.80 vs 0.78),respectively.Consistent trends were seen in CatBoost models:SR MRI achieved AUCs of 0.89 and 0.80 compared to NR MRI’s 0.81 and 0.76.NRI indicated that the SR MRI models could improve the prediction accuracy by-1.6%to 20.9%compared to the NR MRI models.CONCLUSION Deep learning-based SR MRI could improve the predictive performance of histopathologic grade in HCC.It may be a powerful tool for better stratification management for patients with operable HCC.
基金supported by the National Natural Science Foundation of China(Nos.22225806,22078314,22278394,22378385)Dalian Institute of Chemical Physics(Nos.DICPI202227,DICPI202436)。
文摘Monitoring the dynamics of cellular pseudopodia at nanoscale has become essential for understanding their diverse and complex functions in living cells.This is made possible by combining single-molecule localization microscopy(SMLM)with self-blinking dyes.However,existing self-blinking dyes often face limitations,such as nonspecific blinking and low photostability,which can bring background noise and yield erroneous localization signals,hindering their effectiveness for nanoscale visualization.Here,we present a method for long-term SMLM imaging of cellular pseudopodia dynamics using a blinkogenic probe that exhibits self-blinking activation upon molecular recognition.This approach enabled the precise tracking of various pseudopodia structures,including filopodia,lamellipodia,and(tunneling nanotubes)-nanoscale(TNTs),in living cells.We monitored the growth and fusion of filopodia,as well as the extension and shrinkage of lamellipodia,in real-time.Additionally,we identified two distinct fusion modes between filopodia and lamellipodia and captured the formation of TNTs and their interactions with filopodia,demonstrating the probe's utility in visualizing real-time pseudopodia dynamics at nanoscale.
基金supported by the National Natural Science Foundation of China(Grant Nos.42005003 and 41475094)National Key R&D Program of China(Grant No.2018YFC1506704).
文摘With the growing demand for high-precision flow field simulations in computational science and engineering,the super-resolution reconstruction of physical fields has attracted considerable research interest.However,tradi-tional numerical methods often entail high computational costs,involve complex data processing,and struggle to capture fine-scale high-frequency details.To address these challenges,we propose an innovative super-resolution reconstruction framework that integrates a Fourier neural operator(FNO)with an enhanced diffusion model.The framework employs an adaptively weighted FNO to process low-resolution flow field inputs,effectively capturing global dependencies and high-frequency features.Furthermore,a residual-guided diffusion model is introduced to further improve reconstruction performance.This model uses a Markov chain for noise injection in phys-ical fields and integrates a reverse denoising procedure,efficiently solved by an adaptive time-step ordinary differential equation solver,thereby ensuring both stability and computational efficiency.Experimental results demonstrate that the proposed framework significantly outperforms existing methods in terms of accuracy and efficiency,offering a promising solution for fine-grained data reconstruction in scientific simulations.
基金Project supported by the National Natural Science Foundation of China (Grant No. 12174085)the Key Research and Development Project of Changzhou, Jiangsu Province, China (Grant No. CE20235054)the Postgraduate Research and Practice Innovation Program of Jiangsu Province, China (Grant No. KYCX24 0833)。
文摘Ultrasonic Lamb waves undergo complex mode conversion and diffraction at non-penetrating defects, such as plate corrosion and cracks. Lamb wave imaging has a resolution limit due to the guided wave dispersion characteristics and Rayleigh criterion limitations. In this paper, a full convolutional network is designed to segment and reconstruct the received signals, enabling the automatic identification of target modalities. This approach eliminates clutter and mode conversion interference when calculating direct and accompanying acoustic fields in time-domain topological energy(TDTE) imaging.Subsequently, the measured accompanying acoustic field is reversed for adaptive focusing on defects and enhance the imaging quality. To circumvent the limitations of the Rayleigh criterion, the direct acoustic field and the accompanying acoustic field were fused to characterize the pixel distribution in the imaging region, achieving Lamb wave super-resolution imaging. Experimental results indicate that compared to the sign coherence factor-total focusing method(SCF-TFM),the proposed method achieves a 31.41% improvement in lateral resolution and a 29.53% increase in signal-to-noise ratio for single-blind-hole defects. In the case of multiple-blind-hole defects with spacings greater than the Rayleigh criterion resolution limit, it exhibits a 27.23% enhancement in signal-to-noise ratio. On the contrary, when the defect spacings are relatively smaller than the limit, this method has a higher resolution limit than SCF-TFM in super-resolution imaging.
基金supported by the following grants:National Key R&D Program of China(Grant no.2022YFC3401100)National Natural Science Foundation of China(Grant nos.32271428,92054110,32201132 and 31600692).
文摘Blood cells are the most integral part of the body,which are made up of erythrocytes,platelets and white blood cells.The examination of subcellular structures and proteins within blood cells at the nanoscale can provide valuable insights into the health status of an individual,accurate diagnosis,and efficient treatment strategies for diseases.Super-resolution microscopy(SRM)has recently emerged as a cutting-edge tool for the study of blood cells,providing numerous advantages over traditional methods for examining subcellular structures and proteins.In this paper,we focus on outlining the fundamental principles of various SRM techniques and their applications in both normal and diseased states of blood cells.Furthermore,future prospects of SRM techniques in the analysis of blood cells are also discussed.
文摘The application of image super-resolution(SR)has brought significant assistance in the medical field,aiding doctors to make more precise diagnoses.However,solely relying on a convolutional neural network(CNN)for image SR may lead to issues such as blurry details and excessive smoothness.To address the limitations,we proposed an algorithm based on the generative adversarial network(GAN)framework.In the generator network,three different sizes of convolutions connected by a residual dense structure were used to extract detailed features,and an attention mechanism combined with dual channel and spatial information was applied to concentrate the computing power on crucial areas.In the discriminator network,using InstanceNorm to normalize tensors sped up the training process while retaining feature information.The experimental results demonstrate that our algorithm achieves higher peak signal-to-noise ratio(PSNR)and structural similarity index measure(SSIM)compared to other methods,resulting in an improved visual quality.
基金supported by the National Natural Science Foundation of China(62175034,62175036,32271510)the National Key R&D Program of China(2021YFF0502900)+2 种基金the Science and Technology Research Program of Shanghai(Grant No.19DZ2282100)the Shanghai Key Laboratory of Metasurfaces for Light Manipulation(23dz2260100)the Shanghai Engineering Technology Research Center of Hair Medicine(19DZ2250500).
文摘A new scheme of super-resolution optical fluctuation imaging(SOFI)is proposed to broaden its application in the high-order cumulant reconstruction by optimizing blinking characteristics,eliminating noise in raw data and applying multi-resolution analysis in cumulant reconstruction.A motor-driven rotating mask optical modulation system is designed to adjust the excitation lightfield and allows for fast deployment.Active-modulated fluorescence fluctuation superresolution microscopy with multi-resolution analysis(AMF-MRA-SOFI)demonstrates enhanced resolution ability and reconstruction quality in experiments performed on sample of conventional dyes,achieving a resolution of 100 nm in the fourth order compared to conventional SOFI reconstruction.Furthermore,our approach combining expansion super-resolution achieved a resolution at-57 nm.
基金supported in part by the Basic and Applied Basic Research Foundation of Guangdong Province[2025A1515011566]in part by the State Key Laboratory for Novel Software Technology,Nanjing University[KFKT2024B08]+1 种基金in part by Leading Talents in Gusu Innovation and Entrepreneurship[ZXL2023170]in part by the Basic Research Programs of Taicang 2024,[TC2024JC32].
文摘Deep convolutional neural networks(CNNs)have demonstrated remarkable performance in video super-resolution(VSR).However,the ability of most existing methods to recover fine details in complex scenes is often hindered by the loss of shallow texture information during feature extraction.To address this limitation,we propose a 3D Convolutional Enhanced Residual Video Super-Resolution Network(3D-ERVSNet).This network employs a forward and backward bidirectional propagation module(FBBPM)that aligns features across frames using explicit optical flow through lightweight SPyNet.By incorporating an enhanced residual structure(ERS)with skip connections,shallow and deep features are effectively integrated,enhancing texture restoration capabilities.Furthermore,3D convolution module(3DCM)is applied after the backward propagation module to implicitly capture spatio-temporal dependencies.The architecture synergizes these components where FBBPM extracts aligned features,ERS fuses hierarchical representations,and 3DCM refines temporal coherence.Finally,a deep feature aggregation module(DFAM)fuses the processed features,and a pixel-upsampling module(PUM)reconstructs the high-resolution(HR)video frames.Comprehensive evaluations on REDS,Vid4,UDM10,and Vim4 benchmarks demonstrate well performance including 30.95 dB PSNR/0.8822 SSIM on REDS and 32.78 dB/0.8987 on Vim4.3D-ERVSNet achieves significant gains over baselines while maintaining high efficiency with only 6.3M parameters and 77ms/frame runtime(i.e.,20×faster than RBPN).The network’s effectiveness stems from its task-specific asymmetric design that balances explicit alignment and implicit fusion.
基金supported by the National Natural Science Foundation of China(Nos.12205271,12075217,U20B2011,and 51978218)Sichuan Science and Technology Program(No.2019ZDZX0010)the National Key R&D Program of China(No.2022YFA1604002).
文摘Neutron capture event imaging is a novel technique that has the potential to substantially enhance the resolution of existing imaging systems.This study provides a measurement method for neutron capture event distribution along with multiple reconstruction methods for super-resolution imaging.The proposed technology reduces the point-spread function of an imag-ing system through single-neutron detection and event reconstruction,thereby significantly improving imaging resolution.A single-neutron detection experiment was conducted using a highly practical and efficient^(6)LiF-ZnS scintillation screen of a cold neutron imaging device in the research reactor.In milliseconds of exposure time,a large number of weak light clusters and their distribution in the scintillation screen were recorded frame by frame,to complete single-neutron detection.Several reconstruction algorithms were proposed for the calculations.The location of neutron capture was calculated using several processing methods such as noise removal,filtering,spot segmentation,contour analysis,and local positioning.The proposed algorithm achieved a higher imaging resolution and faster reconstruction speed,and single-neutron super-resolution imaging was realized by combining single-neutron detection experiments and reconstruction calculations.The results show that the resolution of the 100μm thick^(6)LiF-ZnS scintillation screen can be improved from 125 to 40 microns.This indicates that the proposed single-neutron detection and calculation method is effective and can significantly improve imaging resolution.
基金The National Natural Science Foundation of China(No.61374194,No.61403081)the National Key Science&Technology Pillar Program of China(No.2014BAG01B03)+1 种基金the Natural Science Foundation of Jiangsu Province(No.BK20140638)Priority Academic Program Development of Jiangsu Higher Education Institutions
文摘In order to effectively improve the quality of recovered images, a single frame super-resolution reconstruction method based on sparse representation is proposed. The combination method of local orientation estimation-based image patch clustering and principal component analysis is used to obtain a series of geometric dictionaries of different orientations in the dictionary learning process. Subsequently, the dictionary of the nearest orientation is adaptively assigned to each of the input patches that need to be represented in the sparse coding process. Moreover, the consistency of gradients is further incorporated into the basic framework to make more substantial progress in preserving more fine edges and producing sharper results. Two groups of experiments on different types of natural images indicate that the proposed method outperforms some state-of- the-art counterparts in terms of both numerical indicators and visual quality.
基金supported by the National Natural Science Foundation of China(61971165)the Key Research and Development Program of Hubei Province(2020BAB113)。
文摘Previous deep learning-based super-resolution(SR)methods rely on the assumption that the degradation process is predefined(e.g.,bicubic downsampling).Thus,their performance would suffer from deterioration if the real degradation is not consistent with the assumption.To deal with real-world scenarios,existing blind SR methods are committed to estimating both the degradation and the super-resolved image with an extra loss or iterative scheme.However,degradation estimation that requires more computation would result in limited SR performance due to the accumulated estimation errors.In this paper,we propose a contrastive regularization built upon contrastive learning to exploit both the information of blurry images and clear images as negative and positive samples,respectively.Contrastive regularization ensures that the restored image is pulled closer to the clear image and pushed far away from the blurry image in the representation space.Furthermore,instead of estimating the degradation,we extract global statistical prior information to capture the character of the distortion.Considering the coupling between the degradation and the low-resolution image,we embed the global prior into the distortion-specific SR network to make our method adaptive to the changes of distortions.We term our distortion-specific network with contrastive regularization as CRDNet.The extensive experiments on synthetic and realworld scenes demonstrate that our lightweight CRDNet surpasses state-of-the-art blind super-resolution approaches.
文摘Single image super-resolution(SISR)is a fundamentally challenging problem because a low-resolution(LR)image can correspond to a set of high-resolution(HR)images,while most are not expected.Recently,SISR can be achieved by a deep learning-based method.By constructing a very deep super-resolution convolutional neural network(VDSRCNN),the LR images can be improved to HR images.This study mainly achieves two objectives:image super-resolution(ISR)and deblurring the image from VDSRCNN.Firstly,by analyzing ISR,we modify different training parameters to test the performance of VDSRCNN.Secondly,we add the motion blurred images to the training set to optimize the performance of VDSRCNN.Finally,we use image quality indexes to evaluate the difference between the images from classical methods and VDSRCNN.The results indicate that the VDSRCNN performs better in generating HR images from LR images using the optimized VDSRCNN in a proper method.
基金The National Natural Science Foundation of China (No.60972001)the National Key Technology R&D Program of China duringthe 11th Five-Year Plan Period (No.2009BAG13A06)
文摘A novel reconstruction method to improve the recognition of license plate texts of moving vehicles in real traffic videos is proposed, which fuses complimentary information among low resolution （LR） images to yield a high resolution （HR） image. Based on the regularization super-resolution （SR） reconstruction schemes, this paper first introduces a residual gradient （RG） term as a new regularization term to improve the quality of the reconstructed image. Moreover, L1 norm is used to measure the residual data （RD） term and the RG term in order to improve the robustness of the proposed method. Finally, the steepest descent method is exploited to solve the energy functional. Simulated and real acquired video sequence experiments show the effectiveness and practicability of the proposed method and demonstrate its superiority over the bi-cubic interpolation and discontinuity adaptive Markov random field （DAMRF） SR method in both signal to noise ratios （SNR） and visual effects.
