Image super-resolution reconstruction technology is currently widely used in medical imaging,video surveillance,and industrial quality inspection.It not only enhances image quality but also improves details and visual...Image super-resolution reconstruction technology is currently widely used in medical imaging,video surveillance,and industrial quality inspection.It not only enhances image quality but also improves details and visual perception,significantly increasing the utility of low-resolution images.In this study,an improved image superresolution reconstruction model based on Generative Adversarial Networks(SRGAN)was proposed.This model introduced a channel and spatial attention mechanism(CSAB)in the generator,allowing it to effectively leverage the information from the input image to enhance feature representations and capture important details.The discriminator was designed with an improved PatchGAN architecture,which more accurately captured local details and texture information of the image.With these enhanced generator and discriminator architectures and an optimized loss function design,this method demonstrated superior performance in image quality assessment metrics.Experimental results showed that this model outperforms traditional methods,presenting more detailed and realistic image details in the visual effects.展开更多
Significant advancements have been achieved in the field of Single Image Super-Resolution(SISR)through the utilization of Convolutional Neural Networks(CNNs)to attain state-of-the-art performance.Recent efforts have e...Significant advancements have been achieved in the field of Single Image Super-Resolution(SISR)through the utilization of Convolutional Neural Networks(CNNs)to attain state-of-the-art performance.Recent efforts have explored the incorporation of Transformers to augment network performance in SISR.However,the high computational cost of Transformers makes them less suitable for deployment on lightweight devices.Moreover,the majority of enhancements for CNNs rely predominantly on small spatial convolutions,thereby neglecting the potential advantages of large kernel convolution.In this paper,the authors propose a Multi-Perception Large Kernel convNet(MPLKN)which delves into the exploration of large kernel convolution.Specifically,the authors have architected a Multi-Perception Large Kernel(MPLK)module aimed at extracting multi-scale features and employ a stepwise feature fusion strategy to seamlessly integrate these features.In addition,to enhance the network's capacity for nonlinear spatial information processing,the authors have designed a Spatial-Channel Gated Feed-forward Network(SCGFN)that is capable of adapting to feature interactions across both spatial and channel dimensions.Experimental results demonstrate that MPLKN outperforms other lightweight image super-resolution models while maintaining a minimal number of parameters and FLOPs.展开更多
Infrared imaging technology has been widely adopted in various fields,such as military reconnaissance,medical diagnosis,and security monitoring,due to its excellent ability to penetrate smoke and fog.However,the preva...Infrared imaging technology has been widely adopted in various fields,such as military reconnaissance,medical diagnosis,and security monitoring,due to its excellent ability to penetrate smoke and fog.However,the prevalent low resolution of infrared images severely limits the accurate interpretation of their contents.In addition,deploying super-resolution models on resource-constrained devices faces significant challenges.To address these issues,this study proposes a lightweight super-resolution network for infrared images based on an adaptive attention mechanism.The network’s dynamic weighting module automatically adjusts the weights of the attention and nonattention branch outputs based on the network’s characteristics at different levels.Among them,the attention branch is further subdivided into pixel attention and brightness-texture attention,which are specialized for extracting the most informative features in infrared images.Meanwhile,the non-attention branch supplements the extraction of those neglected features to enhance the comprehensiveness of the features.Through ablation experiments,we verify the effectiveness of the proposed module.Finally,through experiments on two datasets,FLIR and Thermal101,qualitative and quantitative results demonstrate that the model can effectively recover high-frequency details of infrared images and significantly improve image resolution.In detail,compared with the suboptimal method,we have reduced the number of parameters by 30%and improved the model performance.When the scale factor is 2,the peak signal-tonoise ratio of the test datasets FLIR and Thermal101 is improved by 0.09 and 0.15 dB,respectively.When the scale factor is 4,it is improved by 0.05 and 0.09 dB,respectively.In addition,due to the lightweight design of the network structure,it has a low computational cost.It is suitable for deployment on edge devices,thus effectively enhancing the sensing performance of infrared imaging devices.展开更多
Remote sensing image super-resolution technology is pivotal for enhancing image quality in critical applications including environmental monitoring,urban planning,and disaster assessment.However,traditional methods ex...Remote sensing image super-resolution technology is pivotal for enhancing image quality in critical applications including environmental monitoring,urban planning,and disaster assessment.However,traditional methods exhibit deficiencies in detail recovery and noise suppression,particularly when processing complex landscapes(e.g.,forests,farmlands),leading to artifacts and spectral distortions that limit practical utility.To address this,we propose an enhanced Super-Resolution Generative Adversarial Network(SRGAN)framework featuring three key innovations:(1)Replacement of L1/L2 loss with a robust Charbonnier loss to suppress noise while preserving edge details via adaptive gradient balancing;(2)A multi-loss joint optimization strategy dynamically weighting Charbonnier loss(β=0.5),Visual Geometry Group(VGG)perceptual loss(α=1),and adversarial loss(γ=0.1)to synergize pixel-level accuracy and perceptual quality;(3)A multi-scale residual network(MSRN)capturing cross-scale texture features(e.g.,forest canopies,mountain contours).Validated on Sentinel-2(10 m)and SPOT-6/7(2.5 m)datasets covering 904 km2 in Motuo County,Xizang,our method outperforms the SRGAN baseline(SR4RS)with Peak Signal-to-Noise Ratio(PSNR)gains of 0.29 dB and Structural Similarity Index(SSIM)improvements of 3.08%on forest imagery.Visual comparisons confirm enhanced texture continuity despite marginal Learned Perceptual Image Patch Similarity(LPIPS)increases.The method significantly improves noise robustness and edge retention in complex geomorphology,demonstrating 18%faster response in forest fire early warning and providing high-resolution support for agricultural/urban monitoring.Future work will integrate spectral constraints and lightweight architectures.展开更多
The application of image super-resolution(SR)has brought significant assistance in the medical field,aiding doctors to make more precise diagnoses.However,solely relying on a convolutional neural network(CNN)for image...The application of image super-resolution(SR)has brought significant assistance in the medical field,aiding doctors to make more precise diagnoses.However,solely relying on a convolutional neural network(CNN)for image SR may lead to issues such as blurry details and excessive smoothness.To address the limitations,we proposed an algorithm based on the generative adversarial network(GAN)framework.In the generator network,three different sizes of convolutions connected by a residual dense structure were used to extract detailed features,and an attention mechanism combined with dual channel and spatial information was applied to concentrate the computing power on crucial areas.In the discriminator network,using InstanceNorm to normalize tensors sped up the training process while retaining feature information.The experimental results demonstrate that our algorithm achieves higher peak signal-to-noise ratio(PSNR)and structural similarity index measure(SSIM)compared to other methods,resulting in an improved visual quality.展开更多
The rapid development of super-resolution microscopy has made it possible to observe subcellular structures and dynamic behaviors in living cells with nanoscale spatial resolution, greatly advancing progress in life s...The rapid development of super-resolution microscopy has made it possible to observe subcellular structures and dynamic behaviors in living cells with nanoscale spatial resolution, greatly advancing progress in life sciences. As hardware technology continues to evolve, the availability of new fluorescent probes with superior performance is becoming increasingly important. In recent years, fluorescent nanoprobes (FNPs) have emerged as highly promising fluorescent probes for bioimaging due to their high brightness and excellent photostability. This paper focuses on the development and applications of FNPs as probes for live-cell super-resolution imaging. It provides an overview of different super-resolution methods, discusses the performance requirements for FNPs in these methods, and reviews the latest applications of FNPs in the super-resolution imaging of living cells. Finally, it addresses the challenges and future outlook in this field.展开更多
Blood cells are the most integral part of the body,which are made up of erythrocytes,platelets and white blood cells.The examination of subcellular structures and proteins within blood cells at the nanoscale can provi...Blood cells are the most integral part of the body,which are made up of erythrocytes,platelets and white blood cells.The examination of subcellular structures and proteins within blood cells at the nanoscale can provide valuable insights into the health status of an individual,accurate diagnosis,and efficient treatment strategies for diseases.Super-resolution microscopy(SRM)has recently emerged as a cutting-edge tool for the study of blood cells,providing numerous advantages over traditional methods for examining subcellular structures and proteins.In this paper,we focus on outlining the fundamental principles of various SRM techniques and their applications in both normal and diseased states of blood cells.Furthermore,future prospects of SRM techniques in the analysis of blood cells are also discussed.展开更多
BACKGROUND Deep learning-based super-resolution(SR)reconstruction can obtain high-quality images with more detailed information.AIM To compare multiparametric normal-resolution(NR)and SR magnetic resonance imaging(MRI...BACKGROUND Deep learning-based super-resolution(SR)reconstruction can obtain high-quality images with more detailed information.AIM To compare multiparametric normal-resolution(NR)and SR magnetic resonance imaging(MRI)in predicting the histopathologic grade in hepatocellular carcinoma.METHODS We retrospectively analyzed a total of 826 patients from two medical centers(training 459;validation 196;test 171).T2-weighted imaging,diffusion-weighted imaging,and portal venous phases were collected.Tumor segmentations were conducted automatically by 3D U-Net.Based on generative adversarial network,we utilized 3D SR reconstruction to produce SR MRI.Radiomics models were developed and validated by XGBoost and Catboost.The predictive efficiency was demonstrated by calibration curves,decision curve analysis,area under the curve(AUC)and net reclassification index(NRI).RESULTS We extracted 3045 radiomic features from both NR and SR MRI,retaining 29 and 28 features,respectively.For XGBoost models,SR MRI yielded higher AUC value than NR MRI in the validation and test cohorts(0.83 vs 0.79;0.80 vs 0.78),respectively.Consistent trends were seen in CatBoost models:SR MRI achieved AUCs of 0.89 and 0.80 compared to NR MRI’s 0.81 and 0.76.NRI indicated that the SR MRI models could improve the prediction accuracy by-1.6%to 20.9%compared to the NR MRI models.CONCLUSION Deep learning-based SR MRI could improve the predictive performance of histopathologic grade in HCC.It may be a powerful tool for better stratification management for patients with operable HCC.展开更多
Neutron capture event imaging is a novel technique that has the potential to substantially enhance the resolution of existing imaging systems.This study provides a measurement method for neutron capture event distribu...Neutron capture event imaging is a novel technique that has the potential to substantially enhance the resolution of existing imaging systems.This study provides a measurement method for neutron capture event distribution along with multiple reconstruction methods for super-resolution imaging.The proposed technology reduces the point-spread function of an imag-ing system through single-neutron detection and event reconstruction,thereby significantly improving imaging resolution.A single-neutron detection experiment was conducted using a highly practical and efficient^(6)LiF-ZnS scintillation screen of a cold neutron imaging device in the research reactor.In milliseconds of exposure time,a large number of weak light clusters and their distribution in the scintillation screen were recorded frame by frame,to complete single-neutron detection.Several reconstruction algorithms were proposed for the calculations.The location of neutron capture was calculated using several processing methods such as noise removal,filtering,spot segmentation,contour analysis,and local positioning.The proposed algorithm achieved a higher imaging resolution and faster reconstruction speed,and single-neutron super-resolution imaging was realized by combining single-neutron detection experiments and reconstruction calculations.The results show that the resolution of the 100μm thick^(6)LiF-ZnS scintillation screen can be improved from 125 to 40 microns.This indicates that the proposed single-neutron detection and calculation method is effective and can significantly improve imaging resolution.展开更多
Monitoring the dynamics of cellular pseudopodia at nanoscale has become essential for understanding their diverse and complex functions in living cells.This is made possible by combining single-molecule localization m...Monitoring the dynamics of cellular pseudopodia at nanoscale has become essential for understanding their diverse and complex functions in living cells.This is made possible by combining single-molecule localization microscopy(SMLM)with self-blinking dyes.However,existing self-blinking dyes often face limitations,such as nonspecific blinking and low photostability,which can bring background noise and yield erroneous localization signals,hindering their effectiveness for nanoscale visualization.Here,we present a method for long-term SMLM imaging of cellular pseudopodia dynamics using a blinkogenic probe that exhibits self-blinking activation upon molecular recognition.This approach enabled the precise tracking of various pseudopodia structures,including filopodia,lamellipodia,and(tunneling nanotubes)-nanoscale(TNTs),in living cells.We monitored the growth and fusion of filopodia,as well as the extension and shrinkage of lamellipodia,in real-time.Additionally,we identified two distinct fusion modes between filopodia and lamellipodia and captured the formation of TNTs and their interactions with filopodia,demonstrating the probe's utility in visualizing real-time pseudopodia dynamics at nanoscale.展开更多
Ultrasonic Lamb waves undergo complex mode conversion and diffraction at non-penetrating defects, such as plate corrosion and cracks. Lamb wave imaging has a resolution limit due to the guided wave dispersion characte...Ultrasonic Lamb waves undergo complex mode conversion and diffraction at non-penetrating defects, such as plate corrosion and cracks. Lamb wave imaging has a resolution limit due to the guided wave dispersion characteristics and Rayleigh criterion limitations. In this paper, a full convolutional network is designed to segment and reconstruct the received signals, enabling the automatic identification of target modalities. This approach eliminates clutter and mode conversion interference when calculating direct and accompanying acoustic fields in time-domain topological energy(TDTE) imaging.Subsequently, the measured accompanying acoustic field is reversed for adaptive focusing on defects and enhance the imaging quality. To circumvent the limitations of the Rayleigh criterion, the direct acoustic field and the accompanying acoustic field were fused to characterize the pixel distribution in the imaging region, achieving Lamb wave super-resolution imaging. Experimental results indicate that compared to the sign coherence factor-total focusing method(SCF-TFM),the proposed method achieves a 31.41% improvement in lateral resolution and a 29.53% increase in signal-to-noise ratio for single-blind-hole defects. In the case of multiple-blind-hole defects with spacings greater than the Rayleigh criterion resolution limit, it exhibits a 27.23% enhancement in signal-to-noise ratio. On the contrary, when the defect spacings are relatively smaller than the limit, this method has a higher resolution limit than SCF-TFM in super-resolution imaging.展开更多
The employment of deep convolutional neural networks has recently contributed to significant progress in single image super-resolution(SISR)research.However,the high computational demands of most SR techniques hinder ...The employment of deep convolutional neural networks has recently contributed to significant progress in single image super-resolution(SISR)research.However,the high computational demands of most SR techniques hinder their applicability to edge devices,despite their satisfactory reconstruction performance.These methods commonly use standard convolutions,which increase the convolutional operation cost of the model.In this paper,a lightweight Partial Separation and Multiscale Fusion Network(PSMFNet)is proposed to alleviate this problem.Specifically,this paper introduces partial convolution(PConv),which reduces the redundant convolution operations throughout the model by separating some of the features of an image while retaining features useful for image reconstruction.Additionally,it is worth noting that the existing methods have not fully utilized the rich feature information,leading to information loss,which reduces the ability to learn feature representations.Inspired by self-attention,this paper develops a multiscale feature fusion block(MFFB),which can better utilize the non-local features of an image.MFFB can learn long-range dependencies from the spatial dimension and extract features from the channel dimension,thereby obtaining more comprehensive and rich feature information.As the role of the MFFB is to capture rich global features,this paper further introduces an efficient inverted residual block(EIRB)to supplement the local feature extraction ability of PSMFNet.A comprehensive analysis of the experimental results shows that PSMFNet maintains a better performance with fewer parameters than the state-of-the-art models.展开更多
Single Image Super-Resolution(SISR)technology aims to reconstruct a clear,high-resolution image with more information from an input low-resolution image that is blurry and contains less information.This technology has...Single Image Super-Resolution(SISR)technology aims to reconstruct a clear,high-resolution image with more information from an input low-resolution image that is blurry and contains less information.This technology has significant research value and is widely used in fields such as medical imaging,satellite image processing,and security surveillance.Despite significant progress in existing research,challenges remain in reconstructing clear and complex texture details,with issues such as edge blurring and artifacts still present.The visual perception effect still needs further enhancement.Therefore,this study proposes a Pyramid Separable Channel Attention Network(PSCAN)for the SISR task.Thismethod designs a convolutional backbone network composed of Pyramid Separable Channel Attention blocks to effectively extract and fuse multi-scale features.This expands the model’s receptive field,reduces resolution loss,and enhances the model’s ability to reconstruct texture details.Additionally,an innovative artifact loss function is designed to better distinguish between artifacts and real edge details,reducing artifacts in the reconstructed images.We conducted comprehensive ablation and comparative experiments on the Arabidopsis root image dataset and several public datasets.The experimental results show that the proposed PSCAN method achieves the best-known performance in both subjective visual effects and objective evaluation metrics,with improvements of 0.84 in Peak Signal-to-Noise Ratio(PSNR)and 0.017 in Structural Similarity Index(SSIM).This demonstrates that the method can effectively preserve high-frequency texture details,reduce artifacts,and have good generalization performance.展开更多
Aiming at the problems such as low reconstruction efficiency,fuzzy texture details,and difficult convergence of reconstruction network face image super-resolution reconstruction algorithms,a new super-resolution recon...Aiming at the problems such as low reconstruction efficiency,fuzzy texture details,and difficult convergence of reconstruction network face image super-resolution reconstruction algorithms,a new super-resolution reconstruction algorithm with residual concern was proposed.Firstly,to solve the influence of redundant and invalid information about the face image super-resolution reconstruction network,an attention mechanism was introduced into the feature extraction module of the network,which improved the feature utilization rate of the overall network.Secondly,to alleviate the problem of gradient disappearance,the adaptive residual was introduced into the network to make the network model easier to converge during training,and features were supplemented according to the needs during training.The experimental results showed that the proposed algorithm had better reconstruction performance,more facial details,and clearer texture in the reconstructed face image than the comparison algorithm.In objective evaluation,the proposed algorithm's peak signalto-noise ratio and structural similarity were also better than other algorithms.展开更多
In order to solve the problem of the lack of ornamental value and research value of ancient mural paintings due to low resolution and fuzzy texture details,a super resolution(SR)method based on generative adduction ne...In order to solve the problem of the lack of ornamental value and research value of ancient mural paintings due to low resolution and fuzzy texture details,a super resolution(SR)method based on generative adduction network(GAN)was proposed.This method reconstructed the detail texture of mural image better.Firstly,in view of the insufficient utilization of shallow image features,information distillation blocks(IDB)were introduced to extract shallow image features and enhance the output results of the network behind.Secondly,residual dense blocks with residual scaling and feature fusion(RRDB-Fs)were used to extract deep image features,which removed the BN layer in the residual block that affected the quality of image generation,and improved the training speed of the network.Furthermore,local feature fusion and global feature fusion were applied in the generation network,and the features of different levels were merged together adaptively,so that the reconstructed image contained rich details.Finally,in calculating the perceptual loss,the brightness consistency between the reconstructed fresco and the original fresco was enhanced by using the features before activation,while avoiding artificial interference.The experimental results showed that the peak signal-to-noise ratio and structural similarity metrics were improved compared with other algorithms,with an improvement of 0.512 dB-3.016 dB in peak signal-to-noise ratio and 0.009-0.089 in structural similarity,and the proposed method had better visual effects.展开更多
Background:Enhancing the quality of images from retinal,MRI and echocardiography imaging shows promise with SR-GANs for medical imaging use.Using these networks,it is possible to produce high-quality images even from ...Background:Enhancing the quality of images from retinal,MRI and echocardiography imaging shows promise with SR-GANs for medical imaging use.Using these networks,it is possible to produce high-quality images even from low-quality medical scans.Methods:To do this,SR-GANs make use of growth from low to high resolutions in two 2×stages,multiple sizes of filters and powerful loss functions.The medical super-resolution network and denoising SR-GAN focus on problems such as image noise and artifacts to improve a photo’s stability,ability to extract features and how it looks.Results:Assessment by numbers has found that using SR-GAN-based approaches leads to marked improvements such as increases in the PSNR by up to 4.85 dB and improvements in the SSIM by between 0.04 and 0.05.Such improvements are better than traditional super-resolution methods which help doctors achieve clear images of the mitral valve in cardiac ultrasonography.Conclusion:It is anticipated that applying SR-GANs in clinical tasks will increase the accuracy of diagnoses,ease the workload for patients and widen the application of super-resolution methods in various medical procedures.The results prove that SR-GANs improve the picture quality of echocardiograms used for diagnosing mitral valve problems.Having proven the model in research settings,future studies should try to apply it to real-world clinical cases,test for its use across a range of imaging devices and perfect the system to ensure it is efficient for use in medical settings.展开更多
Alzheimer’s Disease(AD)is a progressive neurodegenerative disorder that significantly affects cognitive function,making early and accurate diagnosis essential.Traditional Deep Learning(DL)-based approaches often stru...Alzheimer’s Disease(AD)is a progressive neurodegenerative disorder that significantly affects cognitive function,making early and accurate diagnosis essential.Traditional Deep Learning(DL)-based approaches often struggle with low-contrast MRI images,class imbalance,and suboptimal feature extraction.This paper develops a Hybrid DL system that unites MobileNetV2 with adaptive classification methods to boost Alzheimer’s diagnosis by processing MRI scans.Image enhancement is done using Contrast-Limited Adaptive Histogram Equalization(CLAHE)and Enhanced Super-Resolution Generative Adversarial Networks(ESRGAN).A classification robustness enhancement system integrates class weighting techniques and a Matthews Correlation Coefficient(MCC)-based evaluation method into the design.The trained and validated model gives a 98.88%accuracy rate and 0.9614 MCC score.We also performed a 10-fold cross-validation experiment with an average accuracy of 96.52%(±1.51),a loss of 0.1671,and an MCC score of 0.9429 across folds.The proposed framework outperforms the state-of-the-art models with a 98%weighted F1-score while decreasing misdiagnosis results for every AD stage.The model demonstrates apparent separation abilities between AD progression stages according to the results of the confusion matrix analysis.These results validate the effectiveness of hybrid DL models with adaptive preprocessing for early and reliable Alzheimer’s diagnosis,contributing to improved computer-aided diagnosis(CAD)systems in clinical practice.展开更多
Single image super-resolution has attracted increasing attention and has a wide range of applications in satellite imaging, medical imaging, computer vision, security surveillance imaging, remote sensing, objection de...Single image super-resolution has attracted increasing attention and has a wide range of applications in satellite imaging, medical imaging, computer vision, security surveillance imaging, remote sensing, objection detection, and recognition. Recently, deep learning techniques have emerged and blossomed, producing " the state-of-the-art” in many domains. Due to their capability in feature extraction and mapping, it is very helpful to predict high-frequency details lost in low-resolution images. In this paper, we give an overview of recent advances in deep learning-based models and methods that have been applied to single image super-resolution tasks. We also summarize, compare and discuss various models from the past and present for comprehensive understanding and finally provide open problems and possible directions for future research.展开更多
Hyperspectral image super-resolution,which refers to reconstructing the high-resolution hyperspectral image from the input low-resolution observation,aims to improve the spatial resolution of the hyperspectral image,w...Hyperspectral image super-resolution,which refers to reconstructing the high-resolution hyperspectral image from the input low-resolution observation,aims to improve the spatial resolution of the hyperspectral image,which is beneficial for subsequent applications.The development of deep learning has promoted significant progress in hyperspectral image super-resolution,and the powerful expression capabilities of deep neural networks make the predicted results more reliable.Recently,several latest deep learning technologies have made the hyperspectral image super-resolution method explode.However,a comprehensive review and analysis of the latest deep learning methods from the hyperspectral image super-resolution perspective is absent.To this end,in this survey,we first introduce the concept of hyperspectral image super-resolution and classify the methods from the perspectives with or without auxiliary information.Then,we review the learning-based methods in three categories,including single hyperspectral image super-resolution,panchromatic-based hyperspectral image super-resolution,and multispectral-based hyperspectral image super-resolution.Subsequently,we summarize the commonly used hyperspectral dataset,and the evaluations for some representative methods in three categories are performed qualitatively and quantitatively.Moreover,we briefly introduce several typical applications of hyperspectral image super-resolution,including ground object classification,urban change detection,and ecosystem monitoring.Finally,we provide the conclusion and challenges in existing learning-based methods,looking forward to potential future research directions.展开更多
A super-resolution reconstruction approach of （SVD） technique was presented, and its performance was radar image using an adaptive-threshold singular value decomposition analyzed, compared and assessed detailedly. F...A super-resolution reconstruction approach of （SVD） technique was presented, and its performance was radar image using an adaptive-threshold singular value decomposition analyzed, compared and assessed detailedly. First, radar imaging model and super-resolution reconstruction mechanism were outlined. Then, the adaptive-threshold SVD super-resolution algorithm, and its two key aspects, namely the determination method of point spread function （PSF） matrix T and the selection scheme of singular value threshold, were presented. Finally, the super-resolution algorithm was demonstrated successfully using the measured synthetic-aperture radar （SAR） images, and a Monte Carlo assessment was carried out to evaluate the performance of the algorithm by using the input/output signal-to-noise ratio （SNR）. Five versions of SVD algorithms, namely 1 ） using all singular values, 2） using the top 80% singular values, 3） using the top 50% singular values, 4） using the top 20% singular values and 5） using singular values s such that S2≥/max（s2）/rinsNR were tested. The experimental results indicate that when the singular value threshold is set as Smax/（rinSNR）1/2, the super-resolution algorithm provides a good compromise between too much noise and too much bias and has good reconstruction results.展开更多
文摘Image super-resolution reconstruction technology is currently widely used in medical imaging,video surveillance,and industrial quality inspection.It not only enhances image quality but also improves details and visual perception,significantly increasing the utility of low-resolution images.In this study,an improved image superresolution reconstruction model based on Generative Adversarial Networks(SRGAN)was proposed.This model introduced a channel and spatial attention mechanism(CSAB)in the generator,allowing it to effectively leverage the information from the input image to enhance feature representations and capture important details.The discriminator was designed with an improved PatchGAN architecture,which more accurately captured local details and texture information of the image.With these enhanced generator and discriminator architectures and an optimized loss function design,this method demonstrated superior performance in image quality assessment metrics.Experimental results showed that this model outperforms traditional methods,presenting more detailed and realistic image details in the visual effects.
文摘Significant advancements have been achieved in the field of Single Image Super-Resolution(SISR)through the utilization of Convolutional Neural Networks(CNNs)to attain state-of-the-art performance.Recent efforts have explored the incorporation of Transformers to augment network performance in SISR.However,the high computational cost of Transformers makes them less suitable for deployment on lightweight devices.Moreover,the majority of enhancements for CNNs rely predominantly on small spatial convolutions,thereby neglecting the potential advantages of large kernel convolution.In this paper,the authors propose a Multi-Perception Large Kernel convNet(MPLKN)which delves into the exploration of large kernel convolution.Specifically,the authors have architected a Multi-Perception Large Kernel(MPLK)module aimed at extracting multi-scale features and employ a stepwise feature fusion strategy to seamlessly integrate these features.In addition,to enhance the network's capacity for nonlinear spatial information processing,the authors have designed a Spatial-Channel Gated Feed-forward Network(SCGFN)that is capable of adapting to feature interactions across both spatial and channel dimensions.Experimental results demonstrate that MPLKN outperforms other lightweight image super-resolution models while maintaining a minimal number of parameters and FLOPs.
基金funded in part by theHenan ProvinceKeyR&DProgramProject,“Research and Application Demonstration of Class Ⅱ Superlattice Medium Wave High Temperature Infrared Detector Technology”under Grant No.231111210400.
文摘Infrared imaging technology has been widely adopted in various fields,such as military reconnaissance,medical diagnosis,and security monitoring,due to its excellent ability to penetrate smoke and fog.However,the prevalent low resolution of infrared images severely limits the accurate interpretation of their contents.In addition,deploying super-resolution models on resource-constrained devices faces significant challenges.To address these issues,this study proposes a lightweight super-resolution network for infrared images based on an adaptive attention mechanism.The network’s dynamic weighting module automatically adjusts the weights of the attention and nonattention branch outputs based on the network’s characteristics at different levels.Among them,the attention branch is further subdivided into pixel attention and brightness-texture attention,which are specialized for extracting the most informative features in infrared images.Meanwhile,the non-attention branch supplements the extraction of those neglected features to enhance the comprehensiveness of the features.Through ablation experiments,we verify the effectiveness of the proposed module.Finally,through experiments on two datasets,FLIR and Thermal101,qualitative and quantitative results demonstrate that the model can effectively recover high-frequency details of infrared images and significantly improve image resolution.In detail,compared with the suboptimal method,we have reduced the number of parameters by 30%and improved the model performance.When the scale factor is 2,the peak signal-tonoise ratio of the test datasets FLIR and Thermal101 is improved by 0.09 and 0.15 dB,respectively.When the scale factor is 4,it is improved by 0.05 and 0.09 dB,respectively.In addition,due to the lightweight design of the network structure,it has a low computational cost.It is suitable for deployment on edge devices,thus effectively enhancing the sensing performance of infrared imaging devices.
基金This study was supported by:Inner Mongolia Academy of Forestry Sciences Open Research Project(Grant No.KF2024MS03)The Project to Improve the Scientific Research Capacity of the Inner Mongolia Academy of Forestry Sciences(Grant No.2024NLTS04)The Innovation and Entrepreneurship Training Program for Undergraduates of Beijing Forestry University(Grant No.X202410022268).
文摘Remote sensing image super-resolution technology is pivotal for enhancing image quality in critical applications including environmental monitoring,urban planning,and disaster assessment.However,traditional methods exhibit deficiencies in detail recovery and noise suppression,particularly when processing complex landscapes(e.g.,forests,farmlands),leading to artifacts and spectral distortions that limit practical utility.To address this,we propose an enhanced Super-Resolution Generative Adversarial Network(SRGAN)framework featuring three key innovations:(1)Replacement of L1/L2 loss with a robust Charbonnier loss to suppress noise while preserving edge details via adaptive gradient balancing;(2)A multi-loss joint optimization strategy dynamically weighting Charbonnier loss(β=0.5),Visual Geometry Group(VGG)perceptual loss(α=1),and adversarial loss(γ=0.1)to synergize pixel-level accuracy and perceptual quality;(3)A multi-scale residual network(MSRN)capturing cross-scale texture features(e.g.,forest canopies,mountain contours).Validated on Sentinel-2(10 m)and SPOT-6/7(2.5 m)datasets covering 904 km2 in Motuo County,Xizang,our method outperforms the SRGAN baseline(SR4RS)with Peak Signal-to-Noise Ratio(PSNR)gains of 0.29 dB and Structural Similarity Index(SSIM)improvements of 3.08%on forest imagery.Visual comparisons confirm enhanced texture continuity despite marginal Learned Perceptual Image Patch Similarity(LPIPS)increases.The method significantly improves noise robustness and edge retention in complex geomorphology,demonstrating 18%faster response in forest fire early warning and providing high-resolution support for agricultural/urban monitoring.Future work will integrate spectral constraints and lightweight architectures.
文摘The application of image super-resolution(SR)has brought significant assistance in the medical field,aiding doctors to make more precise diagnoses.However,solely relying on a convolutional neural network(CNN)for image SR may lead to issues such as blurry details and excessive smoothness.To address the limitations,we proposed an algorithm based on the generative adversarial network(GAN)framework.In the generator network,three different sizes of convolutions connected by a residual dense structure were used to extract detailed features,and an attention mechanism combined with dual channel and spatial information was applied to concentrate the computing power on crucial areas.In the discriminator network,using InstanceNorm to normalize tensors sped up the training process while retaining feature information.The experimental results demonstrate that our algorithm achieves higher peak signal-to-noise ratio(PSNR)and structural similarity index measure(SSIM)compared to other methods,resulting in an improved visual quality.
基金supported by the following grants:National Natural Science Foundation of China(grant nos.92354305,32271428,and 32201132)National Key R&D Program of China(grant no.2022YFC3401100)+1 种基金Fund for Knowledge Innovation of Wuhan Science and Technology Bureau(grant no.2022020801010558)Director Fund of WNLO.
文摘The rapid development of super-resolution microscopy has made it possible to observe subcellular structures and dynamic behaviors in living cells with nanoscale spatial resolution, greatly advancing progress in life sciences. As hardware technology continues to evolve, the availability of new fluorescent probes with superior performance is becoming increasingly important. In recent years, fluorescent nanoprobes (FNPs) have emerged as highly promising fluorescent probes for bioimaging due to their high brightness and excellent photostability. This paper focuses on the development and applications of FNPs as probes for live-cell super-resolution imaging. It provides an overview of different super-resolution methods, discusses the performance requirements for FNPs in these methods, and reviews the latest applications of FNPs in the super-resolution imaging of living cells. Finally, it addresses the challenges and future outlook in this field.
基金supported by the following grants:National Key R&D Program of China(Grant no.2022YFC3401100)National Natural Science Foundation of China(Grant nos.32271428,92054110,32201132 and 31600692).
文摘Blood cells are the most integral part of the body,which are made up of erythrocytes,platelets and white blood cells.The examination of subcellular structures and proteins within blood cells at the nanoscale can provide valuable insights into the health status of an individual,accurate diagnosis,and efficient treatment strategies for diseases.Super-resolution microscopy(SRM)has recently emerged as a cutting-edge tool for the study of blood cells,providing numerous advantages over traditional methods for examining subcellular structures and proteins.In this paper,we focus on outlining the fundamental principles of various SRM techniques and their applications in both normal and diseased states of blood cells.Furthermore,future prospects of SRM techniques in the analysis of blood cells are also discussed.
基金Supported by AI+Health Collaborative Innovation Cultivation Project of Beijing City,No.Z221100003522005.
文摘BACKGROUND Deep learning-based super-resolution(SR)reconstruction can obtain high-quality images with more detailed information.AIM To compare multiparametric normal-resolution(NR)and SR magnetic resonance imaging(MRI)in predicting the histopathologic grade in hepatocellular carcinoma.METHODS We retrospectively analyzed a total of 826 patients from two medical centers(training 459;validation 196;test 171).T2-weighted imaging,diffusion-weighted imaging,and portal venous phases were collected.Tumor segmentations were conducted automatically by 3D U-Net.Based on generative adversarial network,we utilized 3D SR reconstruction to produce SR MRI.Radiomics models were developed and validated by XGBoost and Catboost.The predictive efficiency was demonstrated by calibration curves,decision curve analysis,area under the curve(AUC)and net reclassification index(NRI).RESULTS We extracted 3045 radiomic features from both NR and SR MRI,retaining 29 and 28 features,respectively.For XGBoost models,SR MRI yielded higher AUC value than NR MRI in the validation and test cohorts(0.83 vs 0.79;0.80 vs 0.78),respectively.Consistent trends were seen in CatBoost models:SR MRI achieved AUCs of 0.89 and 0.80 compared to NR MRI’s 0.81 and 0.76.NRI indicated that the SR MRI models could improve the prediction accuracy by-1.6%to 20.9%compared to the NR MRI models.CONCLUSION Deep learning-based SR MRI could improve the predictive performance of histopathologic grade in HCC.It may be a powerful tool for better stratification management for patients with operable HCC.
基金supported by the National Natural Science Foundation of China(Nos.12205271,12075217,U20B2011,and 51978218)Sichuan Science and Technology Program(No.2019ZDZX0010)the National Key R&D Program of China(No.2022YFA1604002).
文摘Neutron capture event imaging is a novel technique that has the potential to substantially enhance the resolution of existing imaging systems.This study provides a measurement method for neutron capture event distribution along with multiple reconstruction methods for super-resolution imaging.The proposed technology reduces the point-spread function of an imag-ing system through single-neutron detection and event reconstruction,thereby significantly improving imaging resolution.A single-neutron detection experiment was conducted using a highly practical and efficient^(6)LiF-ZnS scintillation screen of a cold neutron imaging device in the research reactor.In milliseconds of exposure time,a large number of weak light clusters and their distribution in the scintillation screen were recorded frame by frame,to complete single-neutron detection.Several reconstruction algorithms were proposed for the calculations.The location of neutron capture was calculated using several processing methods such as noise removal,filtering,spot segmentation,contour analysis,and local positioning.The proposed algorithm achieved a higher imaging resolution and faster reconstruction speed,and single-neutron super-resolution imaging was realized by combining single-neutron detection experiments and reconstruction calculations.The results show that the resolution of the 100μm thick^(6)LiF-ZnS scintillation screen can be improved from 125 to 40 microns.This indicates that the proposed single-neutron detection and calculation method is effective and can significantly improve imaging resolution.
基金supported by the National Natural Science Foundation of China(Nos.22225806,22078314,22278394,22378385)Dalian Institute of Chemical Physics(Nos.DICPI202227,DICPI202436)。
文摘Monitoring the dynamics of cellular pseudopodia at nanoscale has become essential for understanding their diverse and complex functions in living cells.This is made possible by combining single-molecule localization microscopy(SMLM)with self-blinking dyes.However,existing self-blinking dyes often face limitations,such as nonspecific blinking and low photostability,which can bring background noise and yield erroneous localization signals,hindering their effectiveness for nanoscale visualization.Here,we present a method for long-term SMLM imaging of cellular pseudopodia dynamics using a blinkogenic probe that exhibits self-blinking activation upon molecular recognition.This approach enabled the precise tracking of various pseudopodia structures,including filopodia,lamellipodia,and(tunneling nanotubes)-nanoscale(TNTs),in living cells.We monitored the growth and fusion of filopodia,as well as the extension and shrinkage of lamellipodia,in real-time.Additionally,we identified two distinct fusion modes between filopodia and lamellipodia and captured the formation of TNTs and their interactions with filopodia,demonstrating the probe's utility in visualizing real-time pseudopodia dynamics at nanoscale.
基金Project supported by the National Natural Science Foundation of China (Grant No. 12174085)the Key Research and Development Project of Changzhou, Jiangsu Province, China (Grant No. CE20235054)the Postgraduate Research and Practice Innovation Program of Jiangsu Province, China (Grant No. KYCX24 0833)。
文摘Ultrasonic Lamb waves undergo complex mode conversion and diffraction at non-penetrating defects, such as plate corrosion and cracks. Lamb wave imaging has a resolution limit due to the guided wave dispersion characteristics and Rayleigh criterion limitations. In this paper, a full convolutional network is designed to segment and reconstruct the received signals, enabling the automatic identification of target modalities. This approach eliminates clutter and mode conversion interference when calculating direct and accompanying acoustic fields in time-domain topological energy(TDTE) imaging.Subsequently, the measured accompanying acoustic field is reversed for adaptive focusing on defects and enhance the imaging quality. To circumvent the limitations of the Rayleigh criterion, the direct acoustic field and the accompanying acoustic field were fused to characterize the pixel distribution in the imaging region, achieving Lamb wave super-resolution imaging. Experimental results indicate that compared to the sign coherence factor-total focusing method(SCF-TFM),the proposed method achieves a 31.41% improvement in lateral resolution and a 29.53% increase in signal-to-noise ratio for single-blind-hole defects. In the case of multiple-blind-hole defects with spacings greater than the Rayleigh criterion resolution limit, it exhibits a 27.23% enhancement in signal-to-noise ratio. On the contrary, when the defect spacings are relatively smaller than the limit, this method has a higher resolution limit than SCF-TFM in super-resolution imaging.
基金Guangdong Science and Technology Program under Grant No.202206010052Foshan Province R&D Key Project under Grant No.2020001006827Guangdong Academy of Sciences Integrated Industry Technology Innovation Center Action Special Project under Grant No.2022GDASZH-2022010108.
文摘The employment of deep convolutional neural networks has recently contributed to significant progress in single image super-resolution(SISR)research.However,the high computational demands of most SR techniques hinder their applicability to edge devices,despite their satisfactory reconstruction performance.These methods commonly use standard convolutions,which increase the convolutional operation cost of the model.In this paper,a lightweight Partial Separation and Multiscale Fusion Network(PSMFNet)is proposed to alleviate this problem.Specifically,this paper introduces partial convolution(PConv),which reduces the redundant convolution operations throughout the model by separating some of the features of an image while retaining features useful for image reconstruction.Additionally,it is worth noting that the existing methods have not fully utilized the rich feature information,leading to information loss,which reduces the ability to learn feature representations.Inspired by self-attention,this paper develops a multiscale feature fusion block(MFFB),which can better utilize the non-local features of an image.MFFB can learn long-range dependencies from the spatial dimension and extract features from the channel dimension,thereby obtaining more comprehensive and rich feature information.As the role of the MFFB is to capture rich global features,this paper further introduces an efficient inverted residual block(EIRB)to supplement the local feature extraction ability of PSMFNet.A comprehensive analysis of the experimental results shows that PSMFNet maintains a better performance with fewer parameters than the state-of-the-art models.
基金supported by Beijing Municipal Science and Technology Project(No.Z221100007122003).
文摘Single Image Super-Resolution(SISR)technology aims to reconstruct a clear,high-resolution image with more information from an input low-resolution image that is blurry and contains less information.This technology has significant research value and is widely used in fields such as medical imaging,satellite image processing,and security surveillance.Despite significant progress in existing research,challenges remain in reconstructing clear and complex texture details,with issues such as edge blurring and artifacts still present.The visual perception effect still needs further enhancement.Therefore,this study proposes a Pyramid Separable Channel Attention Network(PSCAN)for the SISR task.Thismethod designs a convolutional backbone network composed of Pyramid Separable Channel Attention blocks to effectively extract and fuse multi-scale features.This expands the model’s receptive field,reduces resolution loss,and enhances the model’s ability to reconstruct texture details.Additionally,an innovative artifact loss function is designed to better distinguish between artifacts and real edge details,reducing artifacts in the reconstructed images.We conducted comprehensive ablation and comparative experiments on the Arabidopsis root image dataset and several public datasets.The experimental results show that the proposed PSCAN method achieves the best-known performance in both subjective visual effects and objective evaluation metrics,with improvements of 0.84 in Peak Signal-to-Noise Ratio(PSNR)and 0.017 in Structural Similarity Index(SSIM).This demonstrates that the method can effectively preserve high-frequency texture details,reduce artifacts,and have good generalization performance.
基金supported by National Natural Science Foundation of China(No.62063014)。
文摘Aiming at the problems such as low reconstruction efficiency,fuzzy texture details,and difficult convergence of reconstruction network face image super-resolution reconstruction algorithms,a new super-resolution reconstruction algorithm with residual concern was proposed.Firstly,to solve the influence of redundant and invalid information about the face image super-resolution reconstruction network,an attention mechanism was introduced into the feature extraction module of the network,which improved the feature utilization rate of the overall network.Secondly,to alleviate the problem of gradient disappearance,the adaptive residual was introduced into the network to make the network model easier to converge during training,and features were supplemented according to the needs during training.The experimental results showed that the proposed algorithm had better reconstruction performance,more facial details,and clearer texture in the reconstructed face image than the comparison algorithm.In objective evaluation,the proposed algorithm's peak signalto-noise ratio and structural similarity were also better than other algorithms.
文摘In order to solve the problem of the lack of ornamental value and research value of ancient mural paintings due to low resolution and fuzzy texture details,a super resolution(SR)method based on generative adduction network(GAN)was proposed.This method reconstructed the detail texture of mural image better.Firstly,in view of the insufficient utilization of shallow image features,information distillation blocks(IDB)were introduced to extract shallow image features and enhance the output results of the network behind.Secondly,residual dense blocks with residual scaling and feature fusion(RRDB-Fs)were used to extract deep image features,which removed the BN layer in the residual block that affected the quality of image generation,and improved the training speed of the network.Furthermore,local feature fusion and global feature fusion were applied in the generation network,and the features of different levels were merged together adaptively,so that the reconstructed image contained rich details.Finally,in calculating the perceptual loss,the brightness consistency between the reconstructed fresco and the original fresco was enhanced by using the features before activation,while avoiding artificial interference.The experimental results showed that the peak signal-to-noise ratio and structural similarity metrics were improved compared with other algorithms,with an improvement of 0.512 dB-3.016 dB in peak signal-to-noise ratio and 0.009-0.089 in structural similarity,and the proposed method had better visual effects.
文摘Background:Enhancing the quality of images from retinal,MRI and echocardiography imaging shows promise with SR-GANs for medical imaging use.Using these networks,it is possible to produce high-quality images even from low-quality medical scans.Methods:To do this,SR-GANs make use of growth from low to high resolutions in two 2×stages,multiple sizes of filters and powerful loss functions.The medical super-resolution network and denoising SR-GAN focus on problems such as image noise and artifacts to improve a photo’s stability,ability to extract features and how it looks.Results:Assessment by numbers has found that using SR-GAN-based approaches leads to marked improvements such as increases in the PSNR by up to 4.85 dB and improvements in the SSIM by between 0.04 and 0.05.Such improvements are better than traditional super-resolution methods which help doctors achieve clear images of the mitral valve in cardiac ultrasonography.Conclusion:It is anticipated that applying SR-GANs in clinical tasks will increase the accuracy of diagnoses,ease the workload for patients and widen the application of super-resolution methods in various medical procedures.The results prove that SR-GANs improve the picture quality of echocardiograms used for diagnosing mitral valve problems.Having proven the model in research settings,future studies should try to apply it to real-world clinical cases,test for its use across a range of imaging devices and perfect the system to ensure it is efficient for use in medical settings.
基金funded by the Deanship of Graduate Studies and Scientific Research at Jouf University under grant No.(DGSSR-2025-02-01295).
文摘Alzheimer’s Disease(AD)is a progressive neurodegenerative disorder that significantly affects cognitive function,making early and accurate diagnosis essential.Traditional Deep Learning(DL)-based approaches often struggle with low-contrast MRI images,class imbalance,and suboptimal feature extraction.This paper develops a Hybrid DL system that unites MobileNetV2 with adaptive classification methods to boost Alzheimer’s diagnosis by processing MRI scans.Image enhancement is done using Contrast-Limited Adaptive Histogram Equalization(CLAHE)and Enhanced Super-Resolution Generative Adversarial Networks(ESRGAN).A classification robustness enhancement system integrates class weighting techniques and a Matthews Correlation Coefficient(MCC)-based evaluation method into the design.The trained and validated model gives a 98.88%accuracy rate and 0.9614 MCC score.We also performed a 10-fold cross-validation experiment with an average accuracy of 96.52%(±1.51),a loss of 0.1671,and an MCC score of 0.9429 across folds.The proposed framework outperforms the state-of-the-art models with a 98%weighted F1-score while decreasing misdiagnosis results for every AD stage.The model demonstrates apparent separation abilities between AD progression stages according to the results of the confusion matrix analysis.These results validate the effectiveness of hybrid DL models with adaptive preprocessing for early and reliable Alzheimer’s diagnosis,contributing to improved computer-aided diagnosis(CAD)systems in clinical practice.
基金the support from the Shanxi Hundred People Plan of China
文摘Single image super-resolution has attracted increasing attention and has a wide range of applications in satellite imaging, medical imaging, computer vision, security surveillance imaging, remote sensing, objection detection, and recognition. Recently, deep learning techniques have emerged and blossomed, producing " the state-of-the-art” in many domains. Due to their capability in feature extraction and mapping, it is very helpful to predict high-frequency details lost in low-resolution images. In this paper, we give an overview of recent advances in deep learning-based models and methods that have been applied to single image super-resolution tasks. We also summarize, compare and discuss various models from the past and present for comprehensive understanding and finally provide open problems and possible directions for future research.
基金supported in part by the National Natural Science Foundation of China(62276192)。
文摘Hyperspectral image super-resolution,which refers to reconstructing the high-resolution hyperspectral image from the input low-resolution observation,aims to improve the spatial resolution of the hyperspectral image,which is beneficial for subsequent applications.The development of deep learning has promoted significant progress in hyperspectral image super-resolution,and the powerful expression capabilities of deep neural networks make the predicted results more reliable.Recently,several latest deep learning technologies have made the hyperspectral image super-resolution method explode.However,a comprehensive review and analysis of the latest deep learning methods from the hyperspectral image super-resolution perspective is absent.To this end,in this survey,we first introduce the concept of hyperspectral image super-resolution and classify the methods from the perspectives with or without auxiliary information.Then,we review the learning-based methods in three categories,including single hyperspectral image super-resolution,panchromatic-based hyperspectral image super-resolution,and multispectral-based hyperspectral image super-resolution.Subsequently,we summarize the commonly used hyperspectral dataset,and the evaluations for some representative methods in three categories are performed qualitatively and quantitatively.Moreover,we briefly introduce several typical applications of hyperspectral image super-resolution,including ground object classification,urban change detection,and ecosystem monitoring.Finally,we provide the conclusion and challenges in existing learning-based methods,looking forward to potential future research directions.
基金Project(2008041001) supported by the Academician Foundation of China Project(N0601-041) supported by the General Armament Department Science Foundation of China
文摘A super-resolution reconstruction approach of （SVD） technique was presented, and its performance was radar image using an adaptive-threshold singular value decomposition analyzed, compared and assessed detailedly. First, radar imaging model and super-resolution reconstruction mechanism were outlined. Then, the adaptive-threshold SVD super-resolution algorithm, and its two key aspects, namely the determination method of point spread function （PSF） matrix T and the selection scheme of singular value threshold, were presented. Finally, the super-resolution algorithm was demonstrated successfully using the measured synthetic-aperture radar （SAR） images, and a Monte Carlo assessment was carried out to evaluate the performance of the algorithm by using the input/output signal-to-noise ratio （SNR）. Five versions of SVD algorithms, namely 1 ） using all singular values, 2） using the top 80% singular values, 3） using the top 50% singular values, 4） using the top 20% singular values and 5） using singular values s such that S2≥/max（s2）/rinsNR were tested. The experimental results indicate that when the singular value threshold is set as Smax/（rinSNR）1/2, the super-resolution algorithm provides a good compromise between too much noise and too much bias and has good reconstruction results.
