BACKGROUND Deep learning-based super-resolution(SR)reconstruction can obtain high-quality images with more detailed information.AIM To compare multiparametric normal-resolution(NR)and SR magnetic resonance imaging(MRI...BACKGROUND Deep learning-based super-resolution(SR)reconstruction can obtain high-quality images with more detailed information.AIM To compare multiparametric normal-resolution(NR)and SR magnetic resonance imaging(MRI)in predicting the histopathologic grade in hepatocellular carcinoma.METHODS We retrospectively analyzed a total of 826 patients from two medical centers(training 459;validation 196;test 171).T2-weighted imaging,diffusion-weighted imaging,and portal venous phases were collected.Tumor segmentations were conducted automatically by 3D U-Net.Based on generative adversarial network,we utilized 3D SR reconstruction to produce SR MRI.Radiomics models were developed and validated by XGBoost and Catboost.The predictive efficiency was demonstrated by calibration curves,decision curve analysis,area under the curve(AUC)and net reclassification index(NRI).RESULTS We extracted 3045 radiomic features from both NR and SR MRI,retaining 29 and 28 features,respectively.For XGBoost models,SR MRI yielded higher AUC value than NR MRI in the validation and test cohorts(0.83 vs 0.79;0.80 vs 0.78),respectively.Consistent trends were seen in CatBoost models:SR MRI achieved AUCs of 0.89 and 0.80 compared to NR MRI’s 0.81 and 0.76.NRI indicated that the SR MRI models could improve the prediction accuracy by-1.6%to 20.9%compared to the NR MRI models.CONCLUSION Deep learning-based SR MRI could improve the predictive performance of histopathologic grade in HCC.It may be a powerful tool for better stratification management for patients with operable HCC.展开更多
Background:This study aims to predict the extraction difficulty of mandibular third molars based on panoramic images using transfer learning while employing super-resolution(SR)technology to enhance the feasibility an...Background:This study aims to predict the extraction difficulty of mandibular third molars based on panoramic images using transfer learning while employing super-resolution(SR)technology to enhance the feasibility and validity of the prediction.Methods:We reviewed a total of 608 preoperative mandibular third molar panoramic radiographs from two medical facilities:the First Affiliated Hospital of Zhengzhou University(n=509;456 in the training set and 53 in the test set)and the Henan Provincial Dental Hospital(n=99 in the validation set).We conducted a deep-transfer learning network on high-resolution(HR)panoramic radiographs to improve the longitudinal resolution of the images and obtained the SR images.Subsequently,we constructed models named Model-HR and Model-SR using high-dimensional quantitative features extracted through the Least Absolute Shrinkage and Selection Operator method.The models’performances were evaluated using the receiver operating characteristic curve(ROC).To assess the reliability of the model,we compared the results from the test set with those of three dentists.Results:Model-SR outperformed Model-HR(area under the curve(AUC):0.779,sensitivity:85.5%,specificity:60.9%,and accuracy:79.8%vs.AUC:0.753,sensitivity:73.7%,specificity:73.9%,and accuracy:73.7%)in predicting the difficulty of extracting mandibular third molars.Both Model-HR(AUC=0.821,95%CI 0.687–0.956)and Model-SR(AUC=0.963,95%CI 0.921–0.999)demonstrated superior performance compared to expert dentists(highest AUC=0.799,95%CI 0.671–0.927).Conclusions:Model-SR yielded superior predictive performance in determining the difficulty of extracting mandibular third molars when compared with Model-HR and expert dentists’visual assessments.展开更多
The algorithm used for reconstruction or resolution enhancement is one of the factors affectingthe quality of super-resolution images obtained by fluorescence microscopy.Deep-learning-basedalgorithms have achieved sta...The algorithm used for reconstruction or resolution enhancement is one of the factors affectingthe quality of super-resolution images obtained by fluorescence microscopy.Deep-learning-basedalgorithms have achieved stateof-the-art performance in super-resolution fluorescence micros-copy and are becoming increasingly attractive.We firstly introduce commonly-used deep learningmodels,and then review the latest applications in terms of the net work architectures,the trainingdata and the loss functions.Additionally,we discuss the challenges and limits when using deeplearning to analyze the fluorescence microscopic data,and suggest ways to improve the reliability and robustness of deep learning applications.展开更多
The rapid development of super-resolution microscopy has made it possible to observe subcellular structures and dynamic behaviors in living cells with nanoscale spatial resolution, greatly advancing progress in life s...The rapid development of super-resolution microscopy has made it possible to observe subcellular structures and dynamic behaviors in living cells with nanoscale spatial resolution, greatly advancing progress in life sciences. As hardware technology continues to evolve, the availability of new fluorescent probes with superior performance is becoming increasingly important. In recent years, fluorescent nanoprobes (FNPs) have emerged as highly promising fluorescent probes for bioimaging due to their high brightness and excellent photostability. This paper focuses on the development and applications of FNPs as probes for live-cell super-resolution imaging. It provides an overview of different super-resolution methods, discusses the performance requirements for FNPs in these methods, and reviews the latest applications of FNPs in the super-resolution imaging of living cells. Finally, it addresses the challenges and future outlook in this field.展开更多
Image super-resolution reconstruction technology is currently widely used in medical imaging,video surveillance,and industrial quality inspection.It not only enhances image quality but also improves details and visual...Image super-resolution reconstruction technology is currently widely used in medical imaging,video surveillance,and industrial quality inspection.It not only enhances image quality but also improves details and visual perception,significantly increasing the utility of low-resolution images.In this study,an improved image superresolution reconstruction model based on Generative Adversarial Networks(SRGAN)was proposed.This model introduced a channel and spatial attention mechanism(CSAB)in the generator,allowing it to effectively leverage the information from the input image to enhance feature representations and capture important details.The discriminator was designed with an improved PatchGAN architecture,which more accurately captured local details and texture information of the image.With these enhanced generator and discriminator architectures and an optimized loss function design,this method demonstrated superior performance in image quality assessment metrics.Experimental results showed that this model outperforms traditional methods,presenting more detailed and realistic image details in the visual effects.展开更多
Significant advancements have been achieved in the field of Single Image Super-Resolution(SISR)through the utilization of Convolutional Neural Networks(CNNs)to attain state-of-the-art performance.Recent efforts have e...Significant advancements have been achieved in the field of Single Image Super-Resolution(SISR)through the utilization of Convolutional Neural Networks(CNNs)to attain state-of-the-art performance.Recent efforts have explored the incorporation of Transformers to augment network performance in SISR.However,the high computational cost of Transformers makes them less suitable for deployment on lightweight devices.Moreover,the majority of enhancements for CNNs rely predominantly on small spatial convolutions,thereby neglecting the potential advantages of large kernel convolution.In this paper,the authors propose a Multi-Perception Large Kernel convNet(MPLKN)which delves into the exploration of large kernel convolution.Specifically,the authors have architected a Multi-Perception Large Kernel(MPLK)module aimed at extracting multi-scale features and employ a stepwise feature fusion strategy to seamlessly integrate these features.In addition,to enhance the network's capacity for nonlinear spatial information processing,the authors have designed a Spatial-Channel Gated Feed-forward Network(SCGFN)that is capable of adapting to feature interactions across both spatial and channel dimensions.Experimental results demonstrate that MPLKN outperforms other lightweight image super-resolution models while maintaining a minimal number of parameters and FLOPs.展开更多
Blood cells are the most integral part of the body,which are made up of erythrocytes,platelets and white blood cells.The examination of subcellular structures and proteins within blood cells at the nanoscale can provi...Blood cells are the most integral part of the body,which are made up of erythrocytes,platelets and white blood cells.The examination of subcellular structures and proteins within blood cells at the nanoscale can provide valuable insights into the health status of an individual,accurate diagnosis,and efficient treatment strategies for diseases.Super-resolution microscopy(SRM)has recently emerged as a cutting-edge tool for the study of blood cells,providing numerous advantages over traditional methods for examining subcellular structures and proteins.In this paper,we focus on outlining the fundamental principles of various SRM techniques and their applications in both normal and diseased states of blood cells.Furthermore,future prospects of SRM techniques in the analysis of blood cells are also discussed.展开更多
A new scheme of super-resolution optical fluctuation imaging(SOFI)is proposed to broaden its application in the high-order cumulant reconstruction by optimizing blinking characteristics,eliminating noise in raw data a...A new scheme of super-resolution optical fluctuation imaging(SOFI)is proposed to broaden its application in the high-order cumulant reconstruction by optimizing blinking characteristics,eliminating noise in raw data and applying multi-resolution analysis in cumulant reconstruction.A motor-driven rotating mask optical modulation system is designed to adjust the excitation lightfield and allows for fast deployment.Active-modulated fluorescence fluctuation superresolution microscopy with multi-resolution analysis(AMF-MRA-SOFI)demonstrates enhanced resolution ability and reconstruction quality in experiments performed on sample of conventional dyes,achieving a resolution of 100 nm in the fourth order compared to conventional SOFI reconstruction.Furthermore,our approach combining expansion super-resolution achieved a resolution at-57 nm.展开更多
The evaluation of adsorption states and shale gas content in shale fractures and pores relies on the analysis of these fractures and pores.Scanning electron microscopy images are commonly used for shale analysis;howev...The evaluation of adsorption states and shale gas content in shale fractures and pores relies on the analysis of these fractures and pores.Scanning electron microscopy images are commonly used for shale analysis;however,their low resolution,particularly the loss of high-frequency information at pore edges,presents challenges in analyzing fractures and pores in shale gas reservoirs.This study introduced a novel neural network called the spatial-spectral domain attention network(SSDAN),which employed spatial and spectral domain attention mechanisms to extract features and restore information in parallel.The network generated super-resolution images through a fusion module that included CNN-based spatial blocks for pixel-level image information recovery,spectral blocks to process Fourier transform information of images and enhance high-frequency recovery,and an adaptive vision transformer to process Fourier transform block information,eliminating the need for a preset image size.The SSDAN model demonstrated exceptional performance in comparative experiments on marine shale and marine continental shale datasets,achieving optimal performance on key indicators such as peak signal-to-noise ratio,structural similarity,learned perceptual image patch similarity,and Frechet inception distance while also exhibiting superior visual performance in pore recovery.Ablation experiments further confirmed the effectiveness of the spatial blocks,channel attention,spectral blocks,and frequency loss function in the model.The SSDAN model showed remarkable capability in enhancing the resolution of shale gas reservoir images and restoring high-frequency information at pore edges,thereby validating its effectiveness in unconventional natural gas reservoir analyses.展开更多
Infrared imaging technology has been widely adopted in various fields,such as military reconnaissance,medical diagnosis,and security monitoring,due to its excellent ability to penetrate smoke and fog.However,the preva...Infrared imaging technology has been widely adopted in various fields,such as military reconnaissance,medical diagnosis,and security monitoring,due to its excellent ability to penetrate smoke and fog.However,the prevalent low resolution of infrared images severely limits the accurate interpretation of their contents.In addition,deploying super-resolution models on resource-constrained devices faces significant challenges.To address these issues,this study proposes a lightweight super-resolution network for infrared images based on an adaptive attention mechanism.The network’s dynamic weighting module automatically adjusts the weights of the attention and nonattention branch outputs based on the network’s characteristics at different levels.Among them,the attention branch is further subdivided into pixel attention and brightness-texture attention,which are specialized for extracting the most informative features in infrared images.Meanwhile,the non-attention branch supplements the extraction of those neglected features to enhance the comprehensiveness of the features.Through ablation experiments,we verify the effectiveness of the proposed module.Finally,through experiments on two datasets,FLIR and Thermal101,qualitative and quantitative results demonstrate that the model can effectively recover high-frequency details of infrared images and significantly improve image resolution.In detail,compared with the suboptimal method,we have reduced the number of parameters by 30%and improved the model performance.When the scale factor is 2,the peak signal-tonoise ratio of the test datasets FLIR and Thermal101 is improved by 0.09 and 0.15 dB,respectively.When the scale factor is 4,it is improved by 0.05 and 0.09 dB,respectively.In addition,due to the lightweight design of the network structure,it has a low computational cost.It is suitable for deployment on edge devices,thus effectively enhancing the sensing performance of infrared imaging devices.展开更多
Deep convolutional neural networks(CNNs)have demonstrated remarkable performance in video super-resolution(VSR).However,the ability of most existing methods to recover fine details in complex scenes is often hindered ...Deep convolutional neural networks(CNNs)have demonstrated remarkable performance in video super-resolution(VSR).However,the ability of most existing methods to recover fine details in complex scenes is often hindered by the loss of shallow texture information during feature extraction.To address this limitation,we propose a 3D Convolutional Enhanced Residual Video Super-Resolution Network(3D-ERVSNet).This network employs a forward and backward bidirectional propagation module(FBBPM)that aligns features across frames using explicit optical flow through lightweight SPyNet.By incorporating an enhanced residual structure(ERS)with skip connections,shallow and deep features are effectively integrated,enhancing texture restoration capabilities.Furthermore,3D convolution module(3DCM)is applied after the backward propagation module to implicitly capture spatio-temporal dependencies.The architecture synergizes these components where FBBPM extracts aligned features,ERS fuses hierarchical representations,and 3DCM refines temporal coherence.Finally,a deep feature aggregation module(DFAM)fuses the processed features,and a pixel-upsampling module(PUM)reconstructs the high-resolution(HR)video frames.Comprehensive evaluations on REDS,Vid4,UDM10,and Vim4 benchmarks demonstrate well performance including 30.95 dB PSNR/0.8822 SSIM on REDS and 32.78 dB/0.8987 on Vim4.3D-ERVSNet achieves significant gains over baselines while maintaining high efficiency with only 6.3M parameters and 77ms/frame runtime(i.e.,20×faster than RBPN).The network’s effectiveness stems from its task-specific asymmetric design that balances explicit alignment and implicit fusion.展开更多
Neutron capture event imaging is a novel technique that has the potential to substantially enhance the resolution of existing imaging systems.This study provides a measurement method for neutron capture event distribu...Neutron capture event imaging is a novel technique that has the potential to substantially enhance the resolution of existing imaging systems.This study provides a measurement method for neutron capture event distribution along with multiple reconstruction methods for super-resolution imaging.The proposed technology reduces the point-spread function of an imag-ing system through single-neutron detection and event reconstruction,thereby significantly improving imaging resolution.A single-neutron detection experiment was conducted using a highly practical and efficient^(6)LiF-ZnS scintillation screen of a cold neutron imaging device in the research reactor.In milliseconds of exposure time,a large number of weak light clusters and their distribution in the scintillation screen were recorded frame by frame,to complete single-neutron detection.Several reconstruction algorithms were proposed for the calculations.The location of neutron capture was calculated using several processing methods such as noise removal,filtering,spot segmentation,contour analysis,and local positioning.The proposed algorithm achieved a higher imaging resolution and faster reconstruction speed,and single-neutron super-resolution imaging was realized by combining single-neutron detection experiments and reconstruction calculations.The results show that the resolution of the 100μm thick^(6)LiF-ZnS scintillation screen can be improved from 125 to 40 microns.This indicates that the proposed single-neutron detection and calculation method is effective and can significantly improve imaging resolution.展开更多
Monitoring the dynamics of cellular pseudopodia at nanoscale has become essential for understanding their diverse and complex functions in living cells.This is made possible by combining single-molecule localization m...Monitoring the dynamics of cellular pseudopodia at nanoscale has become essential for understanding their diverse and complex functions in living cells.This is made possible by combining single-molecule localization microscopy(SMLM)with self-blinking dyes.However,existing self-blinking dyes often face limitations,such as nonspecific blinking and low photostability,which can bring background noise and yield erroneous localization signals,hindering their effectiveness for nanoscale visualization.Here,we present a method for long-term SMLM imaging of cellular pseudopodia dynamics using a blinkogenic probe that exhibits self-blinking activation upon molecular recognition.This approach enabled the precise tracking of various pseudopodia structures,including filopodia,lamellipodia,and(tunneling nanotubes)-nanoscale(TNTs),in living cells.We monitored the growth and fusion of filopodia,as well as the extension and shrinkage of lamellipodia,in real-time.Additionally,we identified two distinct fusion modes between filopodia and lamellipodia and captured the formation of TNTs and their interactions with filopodia,demonstrating the probe's utility in visualizing real-time pseudopodia dynamics at nanoscale.展开更多
This study proposes a new component of the composite loss function minimised during training of the Super-Resolution(SR)algorithms—the normalised structural similarity index loss LSSIMN,which has the potential to imp...This study proposes a new component of the composite loss function minimised during training of the Super-Resolution(SR)algorithms—the normalised structural similarity index loss LSSIMN,which has the potential to improve the natural appearance of reconstructed images.Deep learning-based super-resolution(SR)algorithms reconstruct high-resolution images from low-resolution inputs,offering a practical means to enhance image quality without requiring superior imaging hardware,which is particularly important in medical applications where diagnostic accuracy is critical.Although recent SR methods employing convolutional and generative adversarial networks achieve high pixel fidelity,visual artefacts may persist,making the design of the loss function during training essential for ensuring reliable and naturalistic image reconstruction.Our research shows on two models—SR and Invertible Rescaling Neural Network(IRN)—trained on multiple benchmark datasets that the function LSSIMN significantly contributes to the visual quality,preserving the structural fidelity on the reference datasets.The quantitative analysis of results while incorporating LSSIMN shows that including this loss function component has a mean 2.88%impact on the improvement of the final structural similarity of the reconstructed images in the validation set,in comparison to leaving it out and 0.218%in comparison when this component is non-normalised.展开更多
Existing imaging techniques cannot simultaneously achieve high resolution and a wide field of view,and manual multi-mineral segmentation in shale lacks precision.To address these limitations,we propose a comprehensive...Existing imaging techniques cannot simultaneously achieve high resolution and a wide field of view,and manual multi-mineral segmentation in shale lacks precision.To address these limitations,we propose a comprehensive framework based on generative adversarial network(GAN)for characterizing pore structure properties of shale,which incorporates image augmentation,super-resolution reconstruction,and multi-mineral auto-segmentation.Using real 2D and 3D shale images,the framework was assessed through correlation function,entropy,porosity,pore size distribution,and permeability.The application results show that this framework enables the enhancement of 3D low-resolution digital cores by a scale factor of 8,without paired shale images,effectively reconstructing the unresolved fine-scale pores under a low resolution,rather than merely denoising,deblurring,and edge clarification.The trained GAN-based segmentation model effectively improves manual multi-mineral segmentation results,resulting in a strong resemblance to real samples in terms of pore size distribution and permeability.This framework significantly improves the characterization of complex shale microstructures and can be expanded to other heterogeneous porous media,such as carbonate,coal,and tight sandstone reservoirs.展开更多
With the growing demand for high-precision flow field simulations in computational science and engineering,the super-resolution reconstruction of physical fields has attracted considerable research interest.However,tr...With the growing demand for high-precision flow field simulations in computational science and engineering,the super-resolution reconstruction of physical fields has attracted considerable research interest.However,tradi-tional numerical methods often entail high computational costs,involve complex data processing,and struggle to capture fine-scale high-frequency details.To address these challenges,we propose an innovative super-resolution reconstruction framework that integrates a Fourier neural operator(FNO)with an enhanced diffusion model.The framework employs an adaptively weighted FNO to process low-resolution flow field inputs,effectively capturing global dependencies and high-frequency features.Furthermore,a residual-guided diffusion model is introduced to further improve reconstruction performance.This model uses a Markov chain for noise injection in phys-ical fields and integrates a reverse denoising procedure,efficiently solved by an adaptive time-step ordinary differential equation solver,thereby ensuring both stability and computational efficiency.Experimental results demonstrate that the proposed framework significantly outperforms existing methods in terms of accuracy and efficiency,offering a promising solution for fine-grained data reconstruction in scientific simulations.展开更多
Ultrasonic Lamb waves undergo complex mode conversion and diffraction at non-penetrating defects, such as plate corrosion and cracks. Lamb wave imaging has a resolution limit due to the guided wave dispersion characte...Ultrasonic Lamb waves undergo complex mode conversion and diffraction at non-penetrating defects, such as plate corrosion and cracks. Lamb wave imaging has a resolution limit due to the guided wave dispersion characteristics and Rayleigh criterion limitations. In this paper, a full convolutional network is designed to segment and reconstruct the received signals, enabling the automatic identification of target modalities. This approach eliminates clutter and mode conversion interference when calculating direct and accompanying acoustic fields in time-domain topological energy(TDTE) imaging.Subsequently, the measured accompanying acoustic field is reversed for adaptive focusing on defects and enhance the imaging quality. To circumvent the limitations of the Rayleigh criterion, the direct acoustic field and the accompanying acoustic field were fused to characterize the pixel distribution in the imaging region, achieving Lamb wave super-resolution imaging. Experimental results indicate that compared to the sign coherence factor-total focusing method(SCF-TFM),the proposed method achieves a 31.41% improvement in lateral resolution and a 29.53% increase in signal-to-noise ratio for single-blind-hole defects. In the case of multiple-blind-hole defects with spacings greater than the Rayleigh criterion resolution limit, it exhibits a 27.23% enhancement in signal-to-noise ratio. On the contrary, when the defect spacings are relatively smaller than the limit, this method has a higher resolution limit than SCF-TFM in super-resolution imaging.展开更多
The application of image super-resolution(SR)has brought significant assistance in the medical field,aiding doctors to make more precise diagnoses.However,solely relying on a convolutional neural network(CNN)for image...The application of image super-resolution(SR)has brought significant assistance in the medical field,aiding doctors to make more precise diagnoses.However,solely relying on a convolutional neural network(CNN)for image SR may lead to issues such as blurry details and excessive smoothness.To address the limitations,we proposed an algorithm based on the generative adversarial network(GAN)framework.In the generator network,three different sizes of convolutions connected by a residual dense structure were used to extract detailed features,and an attention mechanism combined with dual channel and spatial information was applied to concentrate the computing power on crucial areas.In the discriminator network,using InstanceNorm to normalize tensors sped up the training process while retaining feature information.The experimental results demonstrate that our algorithm achieves higher peak signal-to-noise ratio(PSNR)and structural similarity index measure(SSIM)compared to other methods,resulting in an improved visual quality.展开更多
As the density of wireless networks increases globally, the vulnerability of overlapped dense wireless communications to interference by hidden nodes and denial-of-service (DoS) attacks is becoming more apparent. Ther...As the density of wireless networks increases globally, the vulnerability of overlapped dense wireless communications to interference by hidden nodes and denial-of-service (DoS) attacks is becoming more apparent. There exists a gap in research on the detection and response to attacks on Medium Access Control (MAC) mechanisms themselves, which would lead to service outages between nodes. Classifying exploitation and deceptive jamming attacks on control mechanisms is particularly challengingdue to their resemblance to normal heavy communication patterns. Accordingly, this paper proposes a machine learning-based selective attack mitigation model that detects DoS attacks on wireless networks by monitoring packet log data. Based on the type of detected attack, it implements effective corresponding mitigation techniques to restore performance to nodes whose availability has been compromised. Experimental results reveal that the accuracy of the proposed model is 14% higher than that of a baseline anomaly detection model. Further, the appropriate mitigation techniques selected by the proposed system based on the attack type improve the average throughput by more than 440% compared to the case without a response.展开更多
Visual question answering(VQA)is a multimodal task,involving a deep understanding of the image scene and the question’s meaning and capturing the relevant correlations between both modalities to infer the appropriate...Visual question answering(VQA)is a multimodal task,involving a deep understanding of the image scene and the question’s meaning and capturing the relevant correlations between both modalities to infer the appropriate answer.In this paper,we propose a VQA system intended to answer yes/no questions about real-world images,in Arabic.To support a robust VQA system,we work in two directions:(1)Using deep neural networks to semantically represent the given image and question in a fine-grainedmanner,namely ResNet-152 and Gated Recurrent Units(GRU).(2)Studying the role of the utilizedmultimodal bilinear pooling fusion technique in the trade-o.between the model complexity and the overall model performance.Some fusion techniques could significantly increase the model complexity,which seriously limits their applicability for VQA models.So far,there is no evidence of how efficient these multimodal bilinear pooling fusion techniques are for VQA systems dedicated to yes/no questions.Hence,a comparative analysis is conducted between eight bilinear pooling fusion techniques,in terms of their ability to reduce themodel complexity and improve themodel performance in this case of VQA systems.Experiments indicate that these multimodal bilinear pooling fusion techniques have improved the VQA model’s performance,until reaching the best performance of 89.25%.Further,experiments have proven that the number of answers in the developed VQA system is a critical factor that a.ects the effectiveness of these multimodal bilinear pooling techniques in achieving their main objective of reducing the model complexity.The Multimodal Local Perception Bilinear Pooling(MLPB)technique has shown the best balance between the model complexity and its performance,for VQA systems designed to answer yes/no questions.展开更多
基金Supported by AI+Health Collaborative Innovation Cultivation Project of Beijing City,No.Z221100003522005.
文摘BACKGROUND Deep learning-based super-resolution(SR)reconstruction can obtain high-quality images with more detailed information.AIM To compare multiparametric normal-resolution(NR)and SR magnetic resonance imaging(MRI)in predicting the histopathologic grade in hepatocellular carcinoma.METHODS We retrospectively analyzed a total of 826 patients from two medical centers(training 459;validation 196;test 171).T2-weighted imaging,diffusion-weighted imaging,and portal venous phases were collected.Tumor segmentations were conducted automatically by 3D U-Net.Based on generative adversarial network,we utilized 3D SR reconstruction to produce SR MRI.Radiomics models were developed and validated by XGBoost and Catboost.The predictive efficiency was demonstrated by calibration curves,decision curve analysis,area under the curve(AUC)and net reclassification index(NRI).RESULTS We extracted 3045 radiomic features from both NR and SR MRI,retaining 29 and 28 features,respectively.For XGBoost models,SR MRI yielded higher AUC value than NR MRI in the validation and test cohorts(0.83 vs 0.79;0.80 vs 0.78),respectively.Consistent trends were seen in CatBoost models:SR MRI achieved AUCs of 0.89 and 0.80 compared to NR MRI’s 0.81 and 0.76.NRI indicated that the SR MRI models could improve the prediction accuracy by-1.6%to 20.9%compared to the NR MRI models.CONCLUSION Deep learning-based SR MRI could improve the predictive performance of histopathologic grade in HCC.It may be a powerful tool for better stratification management for patients with operable HCC.
基金supported by the National Natural Science Foundation of China(U1904145)the Joint Funds for the Innovation of Science and Technology of Fujian province(2019Y9128).
文摘Background:This study aims to predict the extraction difficulty of mandibular third molars based on panoramic images using transfer learning while employing super-resolution(SR)technology to enhance the feasibility and validity of the prediction.Methods:We reviewed a total of 608 preoperative mandibular third molar panoramic radiographs from two medical facilities:the First Affiliated Hospital of Zhengzhou University(n=509;456 in the training set and 53 in the test set)and the Henan Provincial Dental Hospital(n=99 in the validation set).We conducted a deep-transfer learning network on high-resolution(HR)panoramic radiographs to improve the longitudinal resolution of the images and obtained the SR images.Subsequently,we constructed models named Model-HR and Model-SR using high-dimensional quantitative features extracted through the Least Absolute Shrinkage and Selection Operator method.The models’performances were evaluated using the receiver operating characteristic curve(ROC).To assess the reliability of the model,we compared the results from the test set with those of three dentists.Results:Model-SR outperformed Model-HR(area under the curve(AUC):0.779,sensitivity:85.5%,specificity:60.9%,and accuracy:79.8%vs.AUC:0.753,sensitivity:73.7%,specificity:73.9%,and accuracy:73.7%)in predicting the difficulty of extracting mandibular third molars.Both Model-HR(AUC=0.821,95%CI 0.687–0.956)and Model-SR(AUC=0.963,95%CI 0.921–0.999)demonstrated superior performance compared to expert dentists(highest AUC=0.799,95%CI 0.671–0.927).Conclusions:Model-SR yielded superior predictive performance in determining the difficulty of extracting mandibular third molars when compared with Model-HR and expert dentists’visual assessments.
基金supported by the National Key R&D Program of China(2021YFF0502900)the National Natural Science Foundation of China(61835009/62127819).
文摘The algorithm used for reconstruction or resolution enhancement is one of the factors affectingthe quality of super-resolution images obtained by fluorescence microscopy.Deep-learning-basedalgorithms have achieved stateof-the-art performance in super-resolution fluorescence micros-copy and are becoming increasingly attractive.We firstly introduce commonly-used deep learningmodels,and then review the latest applications in terms of the net work architectures,the trainingdata and the loss functions.Additionally,we discuss the challenges and limits when using deeplearning to analyze the fluorescence microscopic data,and suggest ways to improve the reliability and robustness of deep learning applications.
基金supported by the following grants:National Natural Science Foundation of China(grant nos.92354305,32271428,and 32201132)National Key R&D Program of China(grant no.2022YFC3401100)+1 种基金Fund for Knowledge Innovation of Wuhan Science and Technology Bureau(grant no.2022020801010558)Director Fund of WNLO.
文摘The rapid development of super-resolution microscopy has made it possible to observe subcellular structures and dynamic behaviors in living cells with nanoscale spatial resolution, greatly advancing progress in life sciences. As hardware technology continues to evolve, the availability of new fluorescent probes with superior performance is becoming increasingly important. In recent years, fluorescent nanoprobes (FNPs) have emerged as highly promising fluorescent probes for bioimaging due to their high brightness and excellent photostability. This paper focuses on the development and applications of FNPs as probes for live-cell super-resolution imaging. It provides an overview of different super-resolution methods, discusses the performance requirements for FNPs in these methods, and reviews the latest applications of FNPs in the super-resolution imaging of living cells. Finally, it addresses the challenges and future outlook in this field.
文摘Image super-resolution reconstruction technology is currently widely used in medical imaging,video surveillance,and industrial quality inspection.It not only enhances image quality but also improves details and visual perception,significantly increasing the utility of low-resolution images.In this study,an improved image superresolution reconstruction model based on Generative Adversarial Networks(SRGAN)was proposed.This model introduced a channel and spatial attention mechanism(CSAB)in the generator,allowing it to effectively leverage the information from the input image to enhance feature representations and capture important details.The discriminator was designed with an improved PatchGAN architecture,which more accurately captured local details and texture information of the image.With these enhanced generator and discriminator architectures and an optimized loss function design,this method demonstrated superior performance in image quality assessment metrics.Experimental results showed that this model outperforms traditional methods,presenting more detailed and realistic image details in the visual effects.
文摘Significant advancements have been achieved in the field of Single Image Super-Resolution(SISR)through the utilization of Convolutional Neural Networks(CNNs)to attain state-of-the-art performance.Recent efforts have explored the incorporation of Transformers to augment network performance in SISR.However,the high computational cost of Transformers makes them less suitable for deployment on lightweight devices.Moreover,the majority of enhancements for CNNs rely predominantly on small spatial convolutions,thereby neglecting the potential advantages of large kernel convolution.In this paper,the authors propose a Multi-Perception Large Kernel convNet(MPLKN)which delves into the exploration of large kernel convolution.Specifically,the authors have architected a Multi-Perception Large Kernel(MPLK)module aimed at extracting multi-scale features and employ a stepwise feature fusion strategy to seamlessly integrate these features.In addition,to enhance the network's capacity for nonlinear spatial information processing,the authors have designed a Spatial-Channel Gated Feed-forward Network(SCGFN)that is capable of adapting to feature interactions across both spatial and channel dimensions.Experimental results demonstrate that MPLKN outperforms other lightweight image super-resolution models while maintaining a minimal number of parameters and FLOPs.
基金supported by the following grants:National Key R&D Program of China(Grant no.2022YFC3401100)National Natural Science Foundation of China(Grant nos.32271428,92054110,32201132 and 31600692).
文摘Blood cells are the most integral part of the body,which are made up of erythrocytes,platelets and white blood cells.The examination of subcellular structures and proteins within blood cells at the nanoscale can provide valuable insights into the health status of an individual,accurate diagnosis,and efficient treatment strategies for diseases.Super-resolution microscopy(SRM)has recently emerged as a cutting-edge tool for the study of blood cells,providing numerous advantages over traditional methods for examining subcellular structures and proteins.In this paper,we focus on outlining the fundamental principles of various SRM techniques and their applications in both normal and diseased states of blood cells.Furthermore,future prospects of SRM techniques in the analysis of blood cells are also discussed.
基金supported by the National Natural Science Foundation of China(62175034,62175036,32271510)the National Key R&D Program of China(2021YFF0502900)+2 种基金the Science and Technology Research Program of Shanghai(Grant No.19DZ2282100)the Shanghai Key Laboratory of Metasurfaces for Light Manipulation(23dz2260100)the Shanghai Engineering Technology Research Center of Hair Medicine(19DZ2250500).
文摘A new scheme of super-resolution optical fluctuation imaging(SOFI)is proposed to broaden its application in the high-order cumulant reconstruction by optimizing blinking characteristics,eliminating noise in raw data and applying multi-resolution analysis in cumulant reconstruction.A motor-driven rotating mask optical modulation system is designed to adjust the excitation lightfield and allows for fast deployment.Active-modulated fluorescence fluctuation superresolution microscopy with multi-resolution analysis(AMF-MRA-SOFI)demonstrates enhanced resolution ability and reconstruction quality in experiments performed on sample of conventional dyes,achieving a resolution of 100 nm in the fourth order compared to conventional SOFI reconstruction.Furthermore,our approach combining expansion super-resolution achieved a resolution at-57 nm.
基金the National Natural Science Foundation(NNSF)of China under Grant 41927801.
文摘The evaluation of adsorption states and shale gas content in shale fractures and pores relies on the analysis of these fractures and pores.Scanning electron microscopy images are commonly used for shale analysis;however,their low resolution,particularly the loss of high-frequency information at pore edges,presents challenges in analyzing fractures and pores in shale gas reservoirs.This study introduced a novel neural network called the spatial-spectral domain attention network(SSDAN),which employed spatial and spectral domain attention mechanisms to extract features and restore information in parallel.The network generated super-resolution images through a fusion module that included CNN-based spatial blocks for pixel-level image information recovery,spectral blocks to process Fourier transform information of images and enhance high-frequency recovery,and an adaptive vision transformer to process Fourier transform block information,eliminating the need for a preset image size.The SSDAN model demonstrated exceptional performance in comparative experiments on marine shale and marine continental shale datasets,achieving optimal performance on key indicators such as peak signal-to-noise ratio,structural similarity,learned perceptual image patch similarity,and Frechet inception distance while also exhibiting superior visual performance in pore recovery.Ablation experiments further confirmed the effectiveness of the spatial blocks,channel attention,spectral blocks,and frequency loss function in the model.The SSDAN model showed remarkable capability in enhancing the resolution of shale gas reservoir images and restoring high-frequency information at pore edges,thereby validating its effectiveness in unconventional natural gas reservoir analyses.
基金funded in part by theHenan ProvinceKeyR&DProgramProject,“Research and Application Demonstration of Class Ⅱ Superlattice Medium Wave High Temperature Infrared Detector Technology”under Grant No.231111210400.
文摘Infrared imaging technology has been widely adopted in various fields,such as military reconnaissance,medical diagnosis,and security monitoring,due to its excellent ability to penetrate smoke and fog.However,the prevalent low resolution of infrared images severely limits the accurate interpretation of their contents.In addition,deploying super-resolution models on resource-constrained devices faces significant challenges.To address these issues,this study proposes a lightweight super-resolution network for infrared images based on an adaptive attention mechanism.The network’s dynamic weighting module automatically adjusts the weights of the attention and nonattention branch outputs based on the network’s characteristics at different levels.Among them,the attention branch is further subdivided into pixel attention and brightness-texture attention,which are specialized for extracting the most informative features in infrared images.Meanwhile,the non-attention branch supplements the extraction of those neglected features to enhance the comprehensiveness of the features.Through ablation experiments,we verify the effectiveness of the proposed module.Finally,through experiments on two datasets,FLIR and Thermal101,qualitative and quantitative results demonstrate that the model can effectively recover high-frequency details of infrared images and significantly improve image resolution.In detail,compared with the suboptimal method,we have reduced the number of parameters by 30%and improved the model performance.When the scale factor is 2,the peak signal-tonoise ratio of the test datasets FLIR and Thermal101 is improved by 0.09 and 0.15 dB,respectively.When the scale factor is 4,it is improved by 0.05 and 0.09 dB,respectively.In addition,due to the lightweight design of the network structure,it has a low computational cost.It is suitable for deployment on edge devices,thus effectively enhancing the sensing performance of infrared imaging devices.
基金supported in part by the Basic and Applied Basic Research Foundation of Guangdong Province[2025A1515011566]in part by the State Key Laboratory for Novel Software Technology,Nanjing University[KFKT2024B08]+1 种基金in part by Leading Talents in Gusu Innovation and Entrepreneurship[ZXL2023170]in part by the Basic Research Programs of Taicang 2024,[TC2024JC32].
文摘Deep convolutional neural networks(CNNs)have demonstrated remarkable performance in video super-resolution(VSR).However,the ability of most existing methods to recover fine details in complex scenes is often hindered by the loss of shallow texture information during feature extraction.To address this limitation,we propose a 3D Convolutional Enhanced Residual Video Super-Resolution Network(3D-ERVSNet).This network employs a forward and backward bidirectional propagation module(FBBPM)that aligns features across frames using explicit optical flow through lightweight SPyNet.By incorporating an enhanced residual structure(ERS)with skip connections,shallow and deep features are effectively integrated,enhancing texture restoration capabilities.Furthermore,3D convolution module(3DCM)is applied after the backward propagation module to implicitly capture spatio-temporal dependencies.The architecture synergizes these components where FBBPM extracts aligned features,ERS fuses hierarchical representations,and 3DCM refines temporal coherence.Finally,a deep feature aggregation module(DFAM)fuses the processed features,and a pixel-upsampling module(PUM)reconstructs the high-resolution(HR)video frames.Comprehensive evaluations on REDS,Vid4,UDM10,and Vim4 benchmarks demonstrate well performance including 30.95 dB PSNR/0.8822 SSIM on REDS and 32.78 dB/0.8987 on Vim4.3D-ERVSNet achieves significant gains over baselines while maintaining high efficiency with only 6.3M parameters and 77ms/frame runtime(i.e.,20×faster than RBPN).The network’s effectiveness stems from its task-specific asymmetric design that balances explicit alignment and implicit fusion.
基金supported by the National Natural Science Foundation of China(Nos.12205271,12075217,U20B2011,and 51978218)Sichuan Science and Technology Program(No.2019ZDZX0010)the National Key R&D Program of China(No.2022YFA1604002).
文摘Neutron capture event imaging is a novel technique that has the potential to substantially enhance the resolution of existing imaging systems.This study provides a measurement method for neutron capture event distribution along with multiple reconstruction methods for super-resolution imaging.The proposed technology reduces the point-spread function of an imag-ing system through single-neutron detection and event reconstruction,thereby significantly improving imaging resolution.A single-neutron detection experiment was conducted using a highly practical and efficient^(6)LiF-ZnS scintillation screen of a cold neutron imaging device in the research reactor.In milliseconds of exposure time,a large number of weak light clusters and their distribution in the scintillation screen were recorded frame by frame,to complete single-neutron detection.Several reconstruction algorithms were proposed for the calculations.The location of neutron capture was calculated using several processing methods such as noise removal,filtering,spot segmentation,contour analysis,and local positioning.The proposed algorithm achieved a higher imaging resolution and faster reconstruction speed,and single-neutron super-resolution imaging was realized by combining single-neutron detection experiments and reconstruction calculations.The results show that the resolution of the 100μm thick^(6)LiF-ZnS scintillation screen can be improved from 125 to 40 microns.This indicates that the proposed single-neutron detection and calculation method is effective and can significantly improve imaging resolution.
基金supported by the National Natural Science Foundation of China(Nos.22225806,22078314,22278394,22378385)Dalian Institute of Chemical Physics(Nos.DICPI202227,DICPI202436)。
文摘Monitoring the dynamics of cellular pseudopodia at nanoscale has become essential for understanding their diverse and complex functions in living cells.This is made possible by combining single-molecule localization microscopy(SMLM)with self-blinking dyes.However,existing self-blinking dyes often face limitations,such as nonspecific blinking and low photostability,which can bring background noise and yield erroneous localization signals,hindering their effectiveness for nanoscale visualization.Here,we present a method for long-term SMLM imaging of cellular pseudopodia dynamics using a blinkogenic probe that exhibits self-blinking activation upon molecular recognition.This approach enabled the precise tracking of various pseudopodia structures,including filopodia,lamellipodia,and(tunneling nanotubes)-nanoscale(TNTs),in living cells.We monitored the growth and fusion of filopodia,as well as the extension and shrinkage of lamellipodia,in real-time.Additionally,we identified two distinct fusion modes between filopodia and lamellipodia and captured the formation of TNTs and their interactions with filopodia,demonstrating the probe's utility in visualizing real-time pseudopodia dynamics at nanoscale.
基金support from the following institutional grant.Internal Grant Agency of the Faculty of Economics and Management,Czech University of Life Sciences Prague,grant no.2023A0004(https://iga.pef.czu.cz/,accessed on 6 June 2025).
文摘This study proposes a new component of the composite loss function minimised during training of the Super-Resolution(SR)algorithms—the normalised structural similarity index loss LSSIMN,which has the potential to improve the natural appearance of reconstructed images.Deep learning-based super-resolution(SR)algorithms reconstruct high-resolution images from low-resolution inputs,offering a practical means to enhance image quality without requiring superior imaging hardware,which is particularly important in medical applications where diagnostic accuracy is critical.Although recent SR methods employing convolutional and generative adversarial networks achieve high pixel fidelity,visual artefacts may persist,making the design of the loss function during training essential for ensuring reliable and naturalistic image reconstruction.Our research shows on two models—SR and Invertible Rescaling Neural Network(IRN)—trained on multiple benchmark datasets that the function LSSIMN significantly contributes to the visual quality,preserving the structural fidelity on the reference datasets.The quantitative analysis of results while incorporating LSSIMN shows that including this loss function component has a mean 2.88%impact on the improvement of the final structural similarity of the reconstructed images in the validation set,in comparison to leaving it out and 0.218%in comparison when this component is non-normalised.
基金Supported by the National Natural Science Foundation of China(U23A20595,52034010,52288101)National Key Research and Development Program of China(2022YFE0203400)+1 种基金Shandong Provincial Natural Science Foundation(ZR2024ZD17)Fundamental Research Funds for the Central Universities(23CX10004A).
文摘Existing imaging techniques cannot simultaneously achieve high resolution and a wide field of view,and manual multi-mineral segmentation in shale lacks precision.To address these limitations,we propose a comprehensive framework based on generative adversarial network(GAN)for characterizing pore structure properties of shale,which incorporates image augmentation,super-resolution reconstruction,and multi-mineral auto-segmentation.Using real 2D and 3D shale images,the framework was assessed through correlation function,entropy,porosity,pore size distribution,and permeability.The application results show that this framework enables the enhancement of 3D low-resolution digital cores by a scale factor of 8,without paired shale images,effectively reconstructing the unresolved fine-scale pores under a low resolution,rather than merely denoising,deblurring,and edge clarification.The trained GAN-based segmentation model effectively improves manual multi-mineral segmentation results,resulting in a strong resemblance to real samples in terms of pore size distribution and permeability.This framework significantly improves the characterization of complex shale microstructures and can be expanded to other heterogeneous porous media,such as carbonate,coal,and tight sandstone reservoirs.
基金supported by the National Natural Science Foundation of China(Grant Nos.42005003 and 41475094)National Key R&D Program of China(Grant No.2018YFC1506704).
文摘With the growing demand for high-precision flow field simulations in computational science and engineering,the super-resolution reconstruction of physical fields has attracted considerable research interest.However,tradi-tional numerical methods often entail high computational costs,involve complex data processing,and struggle to capture fine-scale high-frequency details.To address these challenges,we propose an innovative super-resolution reconstruction framework that integrates a Fourier neural operator(FNO)with an enhanced diffusion model.The framework employs an adaptively weighted FNO to process low-resolution flow field inputs,effectively capturing global dependencies and high-frequency features.Furthermore,a residual-guided diffusion model is introduced to further improve reconstruction performance.This model uses a Markov chain for noise injection in phys-ical fields and integrates a reverse denoising procedure,efficiently solved by an adaptive time-step ordinary differential equation solver,thereby ensuring both stability and computational efficiency.Experimental results demonstrate that the proposed framework significantly outperforms existing methods in terms of accuracy and efficiency,offering a promising solution for fine-grained data reconstruction in scientific simulations.
基金Project supported by the National Natural Science Foundation of China (Grant No. 12174085)the Key Research and Development Project of Changzhou, Jiangsu Province, China (Grant No. CE20235054)the Postgraduate Research and Practice Innovation Program of Jiangsu Province, China (Grant No. KYCX24 0833)。
文摘Ultrasonic Lamb waves undergo complex mode conversion and diffraction at non-penetrating defects, such as plate corrosion and cracks. Lamb wave imaging has a resolution limit due to the guided wave dispersion characteristics and Rayleigh criterion limitations. In this paper, a full convolutional network is designed to segment and reconstruct the received signals, enabling the automatic identification of target modalities. This approach eliminates clutter and mode conversion interference when calculating direct and accompanying acoustic fields in time-domain topological energy(TDTE) imaging.Subsequently, the measured accompanying acoustic field is reversed for adaptive focusing on defects and enhance the imaging quality. To circumvent the limitations of the Rayleigh criterion, the direct acoustic field and the accompanying acoustic field were fused to characterize the pixel distribution in the imaging region, achieving Lamb wave super-resolution imaging. Experimental results indicate that compared to the sign coherence factor-total focusing method(SCF-TFM),the proposed method achieves a 31.41% improvement in lateral resolution and a 29.53% increase in signal-to-noise ratio for single-blind-hole defects. In the case of multiple-blind-hole defects with spacings greater than the Rayleigh criterion resolution limit, it exhibits a 27.23% enhancement in signal-to-noise ratio. On the contrary, when the defect spacings are relatively smaller than the limit, this method has a higher resolution limit than SCF-TFM in super-resolution imaging.
文摘The application of image super-resolution(SR)has brought significant assistance in the medical field,aiding doctors to make more precise diagnoses.However,solely relying on a convolutional neural network(CNN)for image SR may lead to issues such as blurry details and excessive smoothness.To address the limitations,we proposed an algorithm based on the generative adversarial network(GAN)framework.In the generator network,three different sizes of convolutions connected by a residual dense structure were used to extract detailed features,and an attention mechanism combined with dual channel and spatial information was applied to concentrate the computing power on crucial areas.In the discriminator network,using InstanceNorm to normalize tensors sped up the training process while retaining feature information.The experimental results demonstrate that our algorithm achieves higher peak signal-to-noise ratio(PSNR)and structural similarity index measure(SSIM)compared to other methods,resulting in an improved visual quality.
基金supported by the Ministry of Trade,Industry and Energy(MOTIE)under Training Industrial Security Specialist for High-Tech Industry(RS-2024-00415520)supervised by the Korea Institute for Advancement of Technology(KIAT)the Ministry of Science and ICT(MSIT)under the ICT Challenge and Advanced Network of HRD(ICAN)Program(No.IITP-2022-RS-2022-00156310)supervised by the Institute of Information&Communication Technology Planning&Evaluation(IITP).
文摘As the density of wireless networks increases globally, the vulnerability of overlapped dense wireless communications to interference by hidden nodes and denial-of-service (DoS) attacks is becoming more apparent. There exists a gap in research on the detection and response to attacks on Medium Access Control (MAC) mechanisms themselves, which would lead to service outages between nodes. Classifying exploitation and deceptive jamming attacks on control mechanisms is particularly challengingdue to their resemblance to normal heavy communication patterns. Accordingly, this paper proposes a machine learning-based selective attack mitigation model that detects DoS attacks on wireless networks by monitoring packet log data. Based on the type of detected attack, it implements effective corresponding mitigation techniques to restore performance to nodes whose availability has been compromised. Experimental results reveal that the accuracy of the proposed model is 14% higher than that of a baseline anomaly detection model. Further, the appropriate mitigation techniques selected by the proposed system based on the attack type improve the average throughput by more than 440% compared to the case without a response.
文摘Visual question answering(VQA)is a multimodal task,involving a deep understanding of the image scene and the question’s meaning and capturing the relevant correlations between both modalities to infer the appropriate answer.In this paper,we propose a VQA system intended to answer yes/no questions about real-world images,in Arabic.To support a robust VQA system,we work in two directions:(1)Using deep neural networks to semantically represent the given image and question in a fine-grainedmanner,namely ResNet-152 and Gated Recurrent Units(GRU).(2)Studying the role of the utilizedmultimodal bilinear pooling fusion technique in the trade-o.between the model complexity and the overall model performance.Some fusion techniques could significantly increase the model complexity,which seriously limits their applicability for VQA models.So far,there is no evidence of how efficient these multimodal bilinear pooling fusion techniques are for VQA systems dedicated to yes/no questions.Hence,a comparative analysis is conducted between eight bilinear pooling fusion techniques,in terms of their ability to reduce themodel complexity and improve themodel performance in this case of VQA systems.Experiments indicate that these multimodal bilinear pooling fusion techniques have improved the VQA model’s performance,until reaching the best performance of 89.25%.Further,experiments have proven that the number of answers in the developed VQA system is a critical factor that a.ects the effectiveness of these multimodal bilinear pooling techniques in achieving their main objective of reducing the model complexity.The Multimodal Local Perception Bilinear Pooling(MLPB)technique has shown the best balance between the model complexity and its performance,for VQA systems designed to answer yes/no questions.
