Recent advances in deep learning have significantly improved image deblurring;however,existing approaches still suffer from limited global context modeling,inadequate detail restoration,and poor texture or edge percep...Recent advances in deep learning have significantly improved image deblurring;however,existing approaches still suffer from limited global context modeling,inadequate detail restoration,and poor texture or edge perception,especially under complex dynamic blur.To address these challenges,we propose the Multi-Resolution Fusion Network(MRFNet),a blind multi-scale deblurring framework that integrates progressive residual connectivity for hierarchical feature fusion.The network employs a three-stage design:(1)TransformerBlocks capture long-range dependencies and reconstruct coarse global structures;(2)Nonlinear Activation Free Blocks(NAFBlocks)enhance local detail representation and mid-level feature fusion;and(3)an optimized residual subnetwork based on gated feature modulation refines texture and edge details for high-fidelity restoration.Extensive experiments demonstrate that MRFNet achieves superior performance compared to state-of-the-art methods.On GoPro,it attains 32.52 dB Peak Signal-to-Noise Ratio(PSNR)and 0.071 Learned Perceptual Image Patch Similarity(LPIPS),outperforming MIMOWNet(32.50 dB,0.075).On HIDE,it achieves 30.25 dB PSNR and 0.945 Structural Similarity Index Measure(SSIM),representing gains of+0.26 dB and+0.015 SSIM over MIMO-UNet(29.99 dB,0.930).On RealBlur-J,it reaches 28.82 dB PSNR and 0.872 SSIM,surpassing MIMO-UNet by+1.19 dB and+0.035 SSIM(27.63 dB,0.837).These results validate the effectiveness of the proposed progressive residual fusion and hybrid attention mechanisms in balancing global context understanding and local detail recovery for blind image deblurring.展开更多
In the PSP(Pressure-Sensitive Paint),image deblurring is essential due to factors such as prolonged camera exposure times and highmodel velocities,which can lead to significant image blurring.Conventional deblurring m...In the PSP(Pressure-Sensitive Paint),image deblurring is essential due to factors such as prolonged camera exposure times and highmodel velocities,which can lead to significant image blurring.Conventional deblurring methods applied to PSP images often suffer from limited accuracy and require extensive computational resources.To address these issues,this study proposes a deep learning-based approach tailored for PSP image deblurring.Considering that PSP applications primarily involve the accurate pressure measurements of complex geometries,the images captured under such conditions exhibit distinctive non-uniform motion blur,presenting challenges for standard deep learning models utilizing convolutional or attention-based techniques.In this paper,we introduce a novel deblurring architecture featuring multiple DAAM(Deformable Ack Attention Module).These modules provide enhanced flexibility for end-to-end deblurring,leveraging irregular convolution operations for efficient feature extraction while employing attention mechanisms interpreted as multiple 1×1 convolutions,subsequently reassembled to enhance performance.Furthermore,we incorporate a RSC(Residual Shortcut Convolution)module for initial feature processing,aimed at reducing redundant computations and improving the learning capacity for representative shallow features.To preserve critical spatial information during upsampling and downsampling,we replace conventional convolutions with wt(Haar wavelet downsampling)and dysample(Upsampling by Dynamic Sampling).This modification significantly enhances high-precision image reconstruction.By integrating these advanced modules within an encoder-decoder framework,we present the DFDNet(Deformable Fusion Deblurring Network)for image blur removal,providing robust technical support for subsequent PSP data analysis.Experimental evaluations on the FY dataset demonstrate the superior performance of our model,achieving competitive results on the GOPRO and HIDE datasets.展开更多
Computed Tomography(CT)reconstruction is essential inmedical imaging and other engineering fields.However,blurring of the projection during CT imaging can lead to artifacts in the reconstructed images.Projection blur ...Computed Tomography(CT)reconstruction is essential inmedical imaging and other engineering fields.However,blurring of the projection during CT imaging can lead to artifacts in the reconstructed images.Projection blur combines factors such as larger ray sources,scattering and imaging system vibration.To address the problem,we propose DeblurTomo,a novel self-supervised learning-based deblurring and reconstruction algorithm that efficiently reconstructs sharp CT images from blurry input without needing external data and blur measurement.Specifically,we constructed a coordinate-based implicit neural representation reconstruction network,which can map the coordinates to the attenuation coefficient in the reconstructed space formore convenient ray representation.Then,wemodel the blur as aweighted sumof offset rays and design the RayCorrectionNetwork(RCN)andWeight ProposalNetwork(WPN)to fit these rays and their weights bymulti-view consistency and geometric information,thereby extending 2D deblurring to 3D space.In the training phase,we use the blurry input as the supervision signal to optimize the reconstruction network,the RCN,and the WPN simultaneously.Extensive experiments on the widely used synthetic dataset show that DeblurTomo performs superiorly on the limited-angle and sparse-view in the simulated blurred scenarios.Further experiments on real datasets demonstrate the superiority of our method in practical scenarios.展开更多
Photographs taken in daily life often became blurred due to shaking,out-of-focus,changes in depth of field,and movement of photographed objects.Aiming at this problem,a double-channel cyclic image deblurring method ba...Photographs taken in daily life often became blurred due to shaking,out-of-focus,changes in depth of field,and movement of photographed objects.Aiming at this problem,a double-channel cyclic image deblurring method based on edge features was proposed.Firstly,image edge gradient operator was introduced as a threshold based on the rule that the maximum value of the image edge gradient will decrease after the blurring process,making the blurred image be divided into two channels:edge channel and non-edge channel.Secondly,a double-channel loop iteration network was designed,where the edge gradient was used in the edge channel to sample the main edge structure and bilateral filtering was used in the non-edge channel to extract the detailed texture feature information.Finally,the feature information extracted from two channels was cyclically iterated to obtain a clear image using the deblurring model with maximum a posteriori probability.The experimental results showed that the image evaluation indexes obtained by the proposed deblurring model were superior to those of other algorithms,and the edge structure and texture details of the image were effectively recovered with better performance.展开更多
Traditional cameras inevitably suffer from motion blur when facing high-speed moving objects.Event cameras,as high temporal resolution bionic cameras,record intensity changes in an asynchronous manner,and their record...Traditional cameras inevitably suffer from motion blur when facing high-speed moving objects.Event cameras,as high temporal resolution bionic cameras,record intensity changes in an asynchronous manner,and their recorded high temporal resolution information can effectively solve the problem of time information loss in motion blur.Existing event-based deblurring methods still face challenges when facing high-speed moving objects.We conducted an in-depth study of the imaging principle of event cameras.We found that the event stream contains excessive noise.The valid information is sparse.Invalid event features hinder the expression of valid features due to the uncertainty of the global threshold.To address this problem,a denoising-based long and short-term memory module(DTM)is designed in this paper.The DTM suppressed the original event information by noise reduction process.Invalid features in the event stream and solves the problem of sparse valid information in the event stream,and it also combines with the long short-term memory module(LSTM),which further enhances the event feature information in the time scale.In addition,through the in-depth understanding of the unique characteristics of event features,it is found that the high-frequency information recorded by event features does not effectively guide the fusion feature deblurring process in the spatial-domain-based feature processing,and for this reason,we introduce the residual fast fourier transform module(RES-FFT)to further enhance the high-frequency characteristics of the fusion features by performing the feature extraction of the fusion features from the perspective of the frequency domain.Ultimately,our proposed event image fusion network based on event denoising and frequency domain feature enhancement(DNEFNET)achieved Peak Signal-to-Noise Ratio(PSNR)/Structural Similarity Index Measure(SSIM)scores of 35.55/0.972 on the GoPro dataset and 38.27/0.975 on the REBlur dataset,achieving the state of the art(SOTA)effect.展开更多
The utilization of gradient operators is prevalent in image processing,as they effectively detect edges and provide directional information.However,these operators only differentiate the horizontal and vertical direct...The utilization of gradient operators is prevalent in image processing,as they effectively detect edges and provide directional information.However,these operators only differentiate the horizontal and vertical directions,ignoring details and causing loss of information in other directions.This paper introduces the shear gradient operator to overcome this limitation by capturing details accurately in multiple directions.It investigates the properties of the shear gradient operator and proposes the shear total variation(STV)norm for image deblurring.By combining non-convex regularization to avoid excessive penalty and retain image details,a novel deblurring model integrating the STV norm and the L_(1)/L_(2) minimization is proposed.The alternating direction method of multipliers(ADMM)algorithm is employed to solve this computationally challenging model,demonstrating exceptional performance in non-blind image deblurring through experiments.展开更多
Reducing the defocus blur that arises from the finite aperture size and short exposure time is an essential problem in computational photography.It is very challenging because the blur kernel is spatially varying and ...Reducing the defocus blur that arises from the finite aperture size and short exposure time is an essential problem in computational photography.It is very challenging because the blur kernel is spatially varying and difficult to estimate by traditional methods.Due to its great breakthrough in low-level tasks,convolutional neural networks(CNNs)have been introdu-ced to the defocus deblurring problem and achieved significant progress.However,previous methods apply the same learned kernel for different regions of the defocus blurred images,thus it is difficult to handle nonuniform blurred images.To this end,this study designs a novel blur-aware multi-branch network(Ba-MBNet),in which different regions are treated differentially.In particular,we estimate the blur amounts of different regions by the internal geometric constraint of the dual-pixel(DP)data,which measures the defocus disparity between the left and right views.Based on the assumption that different image regions with different blur amounts have different deblurring difficulties,we leverage different networks with different capacities to treat different image regions.Moreover,we introduce a meta-learning defocus mask generation algorithm to assign each pixel to a proper branch.In this way,we can expect to maintain the information of the clear regions well while recovering the missing details of the blurred regions.Both quantitative and qualitative experiments demonstrate that our BaMBNet outperforms the state-of-the-art(SOTA)methods.For the dual-pixel defocus deblurring(DPD)-blur dataset,the proposed BaMBNet achieves 1.20 dB gain over the previous SOTA method in term of peak signal-to-noise ratio(PSNR)and reduces learnable parameters by 85%.The details of the code and dataset are available at https://github.com/junjun-jiang/BaMBNet.展开更多
Deconvolution is a commonly employed technique for enhancing image quality in optical imaging methods.Unfortu-nately,its application in optical coherence tomography(OCT)is often hindered by sensitivity to noise,which ...Deconvolution is a commonly employed technique for enhancing image quality in optical imaging methods.Unfortu-nately,its application in optical coherence tomography(OCT)is often hindered by sensitivity to noise,which leads to ad-ditive ringing artifacts.These artifacts considerably degrade the quality of deconvolved images,thereby limiting its effect-iveness in OCT imaging.In this study,we propose a framework that integrates numerical random phase masks into the deconvolution process,effectively eliminating these artifacts and enhancing image clarity.The optimized joint operation of an iterative Richardson-Lucy deconvolution and numerical synthesis of random phase masks(RPM),termed as De-conv-RPM,enables a 2.5-fold reduction in full width at half-maximum(FWHM).We demonstrate that the Deconv-RPM method significantly enhances image clarity,allowing for the discernment of previously unresolved cellular-level details in nonkeratinized epithelial cells ex vivo and moving blood cells in vivo.展开更多
In general, there is a demand for real-time processing of mass quantity remote sensing images. However, the task is not only data-intensive but also computating-intensive. Distributed processing is a hot topic in remo...In general, there is a demand for real-time processing of mass quantity remote sensing images. However, the task is not only data-intensive but also computating-intensive. Distributed processing is a hot topic in remote sensing processing and image deblurring is also one of the most important needs. In order to satisfy the demand for quick proc- essing and deblurring of mass quantity satellite images, we developed a distributed, grid computation-based platform as well as a corresponding middleware for grid computation. Both a constrained power spectrum equalization algorithm and effective block processing measures, which can avoid boundary effect, were applied during the processing. The re- sult is satisfactory since computation efficiency and visual effect were greatly improved. It can be concluded that the technology of spatial information grids is effective for mass quantity remote sensing image processing.展开更多
In this paper,we propose a shear high-order gradient(SHOG)operator by combining the shear operator and high-order gradient(HOG)operator.Compared with the HOG operator,the proposed SHOG operator can incorporate more di...In this paper,we propose a shear high-order gradient(SHOG)operator by combining the shear operator and high-order gradient(HOG)operator.Compared with the HOG operator,the proposed SHOG operator can incorporate more directionality and detect more abundant edge information.Based on the SHOG operator,we extend the total variation(TV)norm to shear high-order total variation(SHOTV),and then propose a SHOTV deblurring model.We also study some properties of the SHOG operator,and show that the SHOG matrices are Block Circulant with Circulant Blocks(BCCB)when the shear angle isπ/4.The proposed model is solved efficiently by the alternating direction method of multipliers(ADMM).Experimental results demonstrate that the proposed method outperforms some state-of-the-art non-blind deblurring methods in both objective and perceptual quality.展开更多
Single image motion deblurring has been a very challenging problem in the field of image processing. Although there are many researches had been proposed to solve this problem, it still has problems on kernel accuracy...Single image motion deblurring has been a very challenging problem in the field of image processing. Although there are many researches had been proposed to solve this problem, it still has problems on kernel accuracy. In order to improve the kernel accuracy, an effective structure selection method was used to select the salient structure of the blur image. Then a novel kernel estimation method based on L0-2 norm was proposed. To guarantee the sparse kernel and eliminate the negative influence of details L0-norm was used. And L2-norm was used to ensure the continuity of kernel. Many experiments were done to compare proposed method and state-of-the-art methods. The results show that our method can estimate a better kernel and use less time than previous work, especially when the size of blur kernel is large.展开更多
In this paper, we propose a novel shear gradient operator by combining the shear and gradient operators. The shear gradient operator performs well to capture diverse directional information in the image gradient domai...In this paper, we propose a novel shear gradient operator by combining the shear and gradient operators. The shear gradient operator performs well to capture diverse directional information in the image gradient domain. Based on the shear gradient operator, we extend the total variation(TV) norm to the shear total variation(STV) norm by adding two shear gradient terms. Subsequently, we introduce a shear total variation deblurring model. Experimental results are provided to validate the ability of the STV norm to capture the detailed information. Leveraging the Block Circulant with Circulant Blocks(BCCB) structure of the shear gradient matrices, the alternating direction method of multipliers(ADMM) algorithm can be used to solve the proposed model efficiently. Numerous experiments are presented to verify the performance of our algorithm for non-blind image deblurring.展开更多
Motion deblurring is one of the basic problems inthe field of image processing. This paper summarizes the mathematical basis of the previous work and presents a deblurringmethod that can improve the estimation of the ...Motion deblurring is one of the basic problems inthe field of image processing. This paper summarizes the mathematical basis of the previous work and presents a deblurringmethod that can improve the estimation of the motion blurkernel and obtain a better result than the traditional methods.Experiments show the motion blur kernel loses some important and useful properties during the estimation of the kernel which may cause a bad estimation and increase the ringingartifacts. Considering that the kernel is provided by the motion of the imaging sensor during the exposure and that the kernel shows the trace of the motion, this paper ensures the physical meaning of the kernel such as the continuity and the center of thekernel during the iterative process. By adding a post process to the estimation of the motion blur kernel, we remove some discrete points and make use of the centralizationof the kernel in order to accurate the estimation. The experiment shows the existence of the post process improves the effect of the estimation of the kernel and provides a better result with the clear edges.展开更多
A general pre-processing procedure of the measured SAXS patterns for reducing the effect of beam stop and beam stop holder is described. A proper method for automatically choosing the regularization parameter is imple...A general pre-processing procedure of the measured SAXS patterns for reducing the effect of beam stop and beam stop holder is described. A proper method for automatically choosing the regularization parameter is implemented. The method works out on the two-dimensional SAXS patterns. After deblurring, the corresponding two-dimensional patterns will be converted into one-dimensional integrated intensity distribution curves. We tested the program using both calculated artificial data and real experimental data such as polystyrene and poly（methyl methacrylate） latices. The deblurred results are satisfactory showing the effectiveness of the method. The deblurring process of a typical two-dimensional SAXS pattern using the Matlab based program can be completed in few seconds on normal personal computers.展开更多
The rotary motion deblurring is an inevitable procedure when the imaging seeker is mounted in the rotating missiles.Traditional rotary motion deblurring methods suffer from ringing artifacts and noise,especially for l...The rotary motion deblurring is an inevitable procedure when the imaging seeker is mounted in the rotating missiles.Traditional rotary motion deblurring methods suffer from ringing artifacts and noise,especially for large blur extents.To solve the above problems,we propose a progressive rotary motion deblurring framework consisting of a coarse deblurring stage and a refinement stage.In the first stage,we design an adaptive blur extents factor(BE factor)to balance noise suppression and details reconstruction.And a novel deconvolution model is proposed based on BE factor.In the second stage,a triplescale deformable module CNN(TDM-CNN)is designed to reduce the ringing artifacts,which can exploit the 2D information of an image and adaptively adjust spatial sampling locations.To establish a standard evaluation benchmark,a real-world rotary motion blur dataset is proposed and released,which includes rotary blurred images and corresponding ground truth images with different blur angles.Experimental results demonstrate that the proposed method outperforms the state-of-the-art models on synthetic and real-world rotary motion blur datasets.The code and dataset are available at https://github.com/JinhuiQin/RotaryDeblurring.展开更多
As an ill-posed problem, multiframe blind super resolution imaging recovers a high resolution image from a group of low resolution images with some degradations when the information of blur kernel is limited. Note tha...As an ill-posed problem, multiframe blind super resolution imaging recovers a high resolution image from a group of low resolution images with some degradations when the information of blur kernel is limited. Note that the quality of the recovered image is influenced more by the accuracy of blur estimation than an advanced regularization. We study the traditional model of the multiframe super resolution and modify it for blind deblurring. Based on the analysis, we proposed two algorithms. The first one is based on the total variation blind deconvolution algorithm and formulated as a functional for optimization with the regularization of blur. Based on the alternating minimization and the gradient descent algorithm, the high resolution image and the unknown blur kernel are estimated iteratively. By using the median shift and add operator, the second algorithm is more robust to the outlier influence. The MSAA initialization simplifies the interpolation process to reconstruct the blurred high resolution image for blind deblurring and improves the accuracy of blind super resolution imaging. The experimental results demonstrate the superiority and accuracy of our novel algorithms.展开更多
Images are frequently affected because of blurring,and data loss occurred by sampling and noise occurrence.The images are getting blurred because of object movement in the scenario,atmospheric misrepresentations,and o...Images are frequently affected because of blurring,and data loss occurred by sampling and noise occurrence.The images are getting blurred because of object movement in the scenario,atmospheric misrepresentations,and optical aberrations.The main objective of image restoration is to evaluate the original image from the corrupted data.To overcome this issue,the multiobjective reptile search algorithm is proposed for performing an effective image deblurring and restoration(MORSA-IDR).The proposed MORSA is used in two different processes such as threshold and kernel parameter calculation.In that,threshold values are used for detecting and replacing the noisy pixel removal using deep residual network,and estimation of kernel is performed for deblurring the images.The main objective of the proposed MORSA-IDR is to enhance the process of deblurring for recovering low-level contextual information.The MORSA-IDR is evaluated using peak signal noise ratio(PSNR)and structural similarity index.The existing researches such as enhanced local maximum intensity(ELMI)prior and deep unrolling for blind deblurring(DUBLID)are used to evaluate the MORSA-IDR.The PSNR of MORSA-IDR for image 6 is 30.98 dB,which is high when compared with the ELMI and DUBLID.展开更多
Scanning electron microscopy(SEM)is a crucial tool in the field of materials science,providing valuable insightsinto the microstructural characteristics of materials.Unfortunately,SEM images often suffer from blurrine...Scanning electron microscopy(SEM)is a crucial tool in the field of materials science,providing valuable insightsinto the microstructural characteristics of materials.Unfortunately,SEM images often suffer from blurrinesscaused by improper hardware calibration or imaging automation errors,which present challenges in analyzingand interpretingmaterial characteristics.Consequently,rectifying the blurring of these images assumes paramountsignificance to enable subsequent analysis.To address this issue,we introduce a Material Images DeblurringNetwork(MIDNet)built upon the foundation of the Nonlinear Activation Free Network(NAFNet).MIDNetis meticulously tailored to address the blurring in images capturing the microstructure of materials.The keycontributions include enhancing the NAFNet architecture for better feature extraction and representation,integratinga novel soft attention mechanism to uncover important correlations between encoder and decoder,andintroducing newmulti-loss functions to improve training effectiveness and overallmodel performance.We conducta comprehensive set of experiments utilizing the material blurry dataset and compare them to several state-of-theartdeblurring methods.The experimental results demonstrate the applicability and effectiveness of MIDNet in thedomain of deblurring material microstructure images,with a PSNR(Peak Signal-to-Noise Ratio)reaching 35.26 dBand an SSIM(Structural Similarity)of 0.946.Our dataset is available at:https://github.com/woshigui/MIDNet.展开更多
Texture extract from digital aerial image is widely used in three-dimensional city modeling to generate “photo-realistic” views. In this paper, a method based on reforming “Steep edge” curve, which clearly explain...Texture extract from digital aerial image is widely used in three-dimensional city modeling to generate “photo-realistic” views. In this paper, a method based on reforming “Steep edge” curve, which clearly explains how the diffraction of the sunlight makes digital aerial image blurring, is proposed to deblur the texture extraction from digital aerial image, and the experiment shows a good result in visualization and automation.展开更多
Background For static scenes with multiple depth layers,existing defocused image deblurring methods have the problems of edge-ringing artifacts or insufficient deblurring owing to inaccurate estimation of the blur amo...Background For static scenes with multiple depth layers,existing defocused image deblurring methods have the problems of edge-ringing artifacts or insufficient deblurring owing to inaccurate estimation of the blur amount,and prior knowledge in nonblind deconvolution is not strong,which leads to image detail recovery challenges.Methods To this end,this study proposes a blur map estimation method for defocused images based on the gradient difference of the boundary neighborhood,which uses the gradient difference of the boundary neighborhood to accurately obtain the amount of blurring,thereby preventing boundary ringing artifacts.The obtained blur map is then used for blur detection to determine whether the image needs to be deblurred,thereby improving the efficiency of deblurring without manual intervention and judgment.Finally,a nonblind deconvolution algorithm was designed to achieve image deblurring based on the blur amount selection strategy and sparse prior.Results Experimental results showed that our method improves PSNR(Peak Signal-to-Noise Ratio)and SSIM(Structural Similarity Index)by an average of 4.6%and 7.3%,respectively,compared to existing methods.Conclusions Experimental results showed that the proposed method outperforms existing methods.Compared to existing methods,our method can better solve the problems of boundary ringing artifacts and detail information preservation in defocused image deblurring.展开更多
基金funded by Qinghai University Postgraduate Research and Practice Innovation Program of Funder,grant number 2025-GMKY-42.
文摘Recent advances in deep learning have significantly improved image deblurring;however,existing approaches still suffer from limited global context modeling,inadequate detail restoration,and poor texture or edge perception,especially under complex dynamic blur.To address these challenges,we propose the Multi-Resolution Fusion Network(MRFNet),a blind multi-scale deblurring framework that integrates progressive residual connectivity for hierarchical feature fusion.The network employs a three-stage design:(1)TransformerBlocks capture long-range dependencies and reconstruct coarse global structures;(2)Nonlinear Activation Free Blocks(NAFBlocks)enhance local detail representation and mid-level feature fusion;and(3)an optimized residual subnetwork based on gated feature modulation refines texture and edge details for high-fidelity restoration.Extensive experiments demonstrate that MRFNet achieves superior performance compared to state-of-the-art methods.On GoPro,it attains 32.52 dB Peak Signal-to-Noise Ratio(PSNR)and 0.071 Learned Perceptual Image Patch Similarity(LPIPS),outperforming MIMOWNet(32.50 dB,0.075).On HIDE,it achieves 30.25 dB PSNR and 0.945 Structural Similarity Index Measure(SSIM),representing gains of+0.26 dB and+0.015 SSIM over MIMO-UNet(29.99 dB,0.930).On RealBlur-J,it reaches 28.82 dB PSNR and 0.872 SSIM,surpassing MIMO-UNet by+1.19 dB and+0.035 SSIM(27.63 dB,0.837).These results validate the effectiveness of the proposed progressive residual fusion and hybrid attention mechanisms in balancing global context understanding and local detail recovery for blind image deblurring.
基金supported by the National Natural Science Foundation of China(No.12202476).
文摘In the PSP(Pressure-Sensitive Paint),image deblurring is essential due to factors such as prolonged camera exposure times and highmodel velocities,which can lead to significant image blurring.Conventional deblurring methods applied to PSP images often suffer from limited accuracy and require extensive computational resources.To address these issues,this study proposes a deep learning-based approach tailored for PSP image deblurring.Considering that PSP applications primarily involve the accurate pressure measurements of complex geometries,the images captured under such conditions exhibit distinctive non-uniform motion blur,presenting challenges for standard deep learning models utilizing convolutional or attention-based techniques.In this paper,we introduce a novel deblurring architecture featuring multiple DAAM(Deformable Ack Attention Module).These modules provide enhanced flexibility for end-to-end deblurring,leveraging irregular convolution operations for efficient feature extraction while employing attention mechanisms interpreted as multiple 1×1 convolutions,subsequently reassembled to enhance performance.Furthermore,we incorporate a RSC(Residual Shortcut Convolution)module for initial feature processing,aimed at reducing redundant computations and improving the learning capacity for representative shallow features.To preserve critical spatial information during upsampling and downsampling,we replace conventional convolutions with wt(Haar wavelet downsampling)and dysample(Upsampling by Dynamic Sampling).This modification significantly enhances high-precision image reconstruction.By integrating these advanced modules within an encoder-decoder framework,we present the DFDNet(Deformable Fusion Deblurring Network)for image blur removal,providing robust technical support for subsequent PSP data analysis.Experimental evaluations on the FY dataset demonstrate the superior performance of our model,achieving competitive results on the GOPRO and HIDE datasets.
基金supported in part by the National Natural Science Foundation of China under Grants 62472434 and 62402171in part by the National Key Research and Development Program of China under Grant 2022YFF1203001+1 种基金in part by the Science and Technology Innovation Program of Hunan Province under Grant 2022RC3061in part by the Sci-Tech Innovation 2030 Agenda under Grant 2023ZD0508600.
文摘Computed Tomography(CT)reconstruction is essential inmedical imaging and other engineering fields.However,blurring of the projection during CT imaging can lead to artifacts in the reconstructed images.Projection blur combines factors such as larger ray sources,scattering and imaging system vibration.To address the problem,we propose DeblurTomo,a novel self-supervised learning-based deblurring and reconstruction algorithm that efficiently reconstructs sharp CT images from blurry input without needing external data and blur measurement.Specifically,we constructed a coordinate-based implicit neural representation reconstruction network,which can map the coordinates to the attenuation coefficient in the reconstructed space formore convenient ray representation.Then,wemodel the blur as aweighted sumof offset rays and design the RayCorrectionNetwork(RCN)andWeight ProposalNetwork(WPN)to fit these rays and their weights bymulti-view consistency and geometric information,thereby extending 2D deblurring to 3D space.In the training phase,we use the blurry input as the supervision signal to optimize the reconstruction network,the RCN,and the WPN simultaneously.Extensive experiments on the widely used synthetic dataset show that DeblurTomo performs superiorly on the limited-angle and sparse-view in the simulated blurred scenarios.Further experiments on real datasets demonstrate the superiority of our method in practical scenarios.
基金supported in part by Natural Science Research Foundation of Shanxi Province(Nos.20210302123019,20210302124195,20210302124212,20210302123189)。
文摘Photographs taken in daily life often became blurred due to shaking,out-of-focus,changes in depth of field,and movement of photographed objects.Aiming at this problem,a double-channel cyclic image deblurring method based on edge features was proposed.Firstly,image edge gradient operator was introduced as a threshold based on the rule that the maximum value of the image edge gradient will decrease after the blurring process,making the blurred image be divided into two channels:edge channel and non-edge channel.Secondly,a double-channel loop iteration network was designed,where the edge gradient was used in the edge channel to sample the main edge structure and bilateral filtering was used in the non-edge channel to extract the detailed texture feature information.Finally,the feature information extracted from two channels was cyclically iterated to obtain a clear image using the deblurring model with maximum a posteriori probability.The experimental results showed that the image evaluation indexes obtained by the proposed deblurring model were superior to those of other algorithms,and the edge structure and texture details of the image were effectively recovered with better performance.
文摘Traditional cameras inevitably suffer from motion blur when facing high-speed moving objects.Event cameras,as high temporal resolution bionic cameras,record intensity changes in an asynchronous manner,and their recorded high temporal resolution information can effectively solve the problem of time information loss in motion blur.Existing event-based deblurring methods still face challenges when facing high-speed moving objects.We conducted an in-depth study of the imaging principle of event cameras.We found that the event stream contains excessive noise.The valid information is sparse.Invalid event features hinder the expression of valid features due to the uncertainty of the global threshold.To address this problem,a denoising-based long and short-term memory module(DTM)is designed in this paper.The DTM suppressed the original event information by noise reduction process.Invalid features in the event stream and solves the problem of sparse valid information in the event stream,and it also combines with the long short-term memory module(LSTM),which further enhances the event feature information in the time scale.In addition,through the in-depth understanding of the unique characteristics of event features,it is found that the high-frequency information recorded by event features does not effectively guide the fusion feature deblurring process in the spatial-domain-based feature processing,and for this reason,we introduce the residual fast fourier transform module(RES-FFT)to further enhance the high-frequency characteristics of the fusion features by performing the feature extraction of the fusion features from the perspective of the frequency domain.Ultimately,our proposed event image fusion network based on event denoising and frequency domain feature enhancement(DNEFNET)achieved Peak Signal-to-Noise Ratio(PSNR)/Structural Similarity Index Measure(SSIM)scores of 35.55/0.972 on the GoPro dataset and 38.27/0.975 on the REBlur dataset,achieving the state of the art(SOTA)effect.
基金Supported by the National Natural Science Foundation of China(61701004)。
文摘The utilization of gradient operators is prevalent in image processing,as they effectively detect edges and provide directional information.However,these operators only differentiate the horizontal and vertical directions,ignoring details and causing loss of information in other directions.This paper introduces the shear gradient operator to overcome this limitation by capturing details accurately in multiple directions.It investigates the properties of the shear gradient operator and proposes the shear total variation(STV)norm for image deblurring.By combining non-convex regularization to avoid excessive penalty and retain image details,a novel deblurring model integrating the STV norm and the L_(1)/L_(2) minimization is proposed.The alternating direction method of multipliers(ADMM)algorithm is employed to solve this computationally challenging model,demonstrating exceptional performance in non-blind image deblurring through experiments.
基金supported by the National Natural Science Foundation of China (61971165, 61922027, 61773295)in part by the Fundamental Research Funds for the Central Universities (FRFCU5710050119)+1 种基金the Natural Science Foundation of Heilongjiang Province(YQ2020F004)the Chinese Association for Artificial Intelligence(CAAI)-Huawei Mind Spore Open Fund
文摘Reducing the defocus blur that arises from the finite aperture size and short exposure time is an essential problem in computational photography.It is very challenging because the blur kernel is spatially varying and difficult to estimate by traditional methods.Due to its great breakthrough in low-level tasks,convolutional neural networks(CNNs)have been introdu-ced to the defocus deblurring problem and achieved significant progress.However,previous methods apply the same learned kernel for different regions of the defocus blurred images,thus it is difficult to handle nonuniform blurred images.To this end,this study designs a novel blur-aware multi-branch network(Ba-MBNet),in which different regions are treated differentially.In particular,we estimate the blur amounts of different regions by the internal geometric constraint of the dual-pixel(DP)data,which measures the defocus disparity between the left and right views.Based on the assumption that different image regions with different blur amounts have different deblurring difficulties,we leverage different networks with different capacities to treat different image regions.Moreover,we introduce a meta-learning defocus mask generation algorithm to assign each pixel to a proper branch.In this way,we can expect to maintain the information of the clear regions well while recovering the missing details of the blurred regions.Both quantitative and qualitative experiments demonstrate that our BaMBNet outperforms the state-of-the-art(SOTA)methods.For the dual-pixel defocus deblurring(DPD)-blur dataset,the proposed BaMBNet achieves 1.20 dB gain over the previous SOTA method in term of peak signal-to-noise ratio(PSNR)and reduces learnable parameters by 85%.The details of the code and dataset are available at https://github.com/junjun-jiang/BaMBNet.
基金supported by the Guangdong Natural Science Fund General Program (2023A1515011289)Singapore Ministry of Health's National Medical Research Council under its Open Fund Individual Research Grant (MOH-OFIRG19may-0009)+2 种基金Ministry of Education Singapore under its Academic Research Fund Tier 1 (RG35/22)Academic Research Funding Tier 2 (MOE-T2EP30120-0001)China-Singapore International Joint Research Institute (203-A022001).
文摘Deconvolution is a commonly employed technique for enhancing image quality in optical imaging methods.Unfortu-nately,its application in optical coherence tomography(OCT)is often hindered by sensitivity to noise,which leads to ad-ditive ringing artifacts.These artifacts considerably degrade the quality of deconvolved images,thereby limiting its effect-iveness in OCT imaging.In this study,we propose a framework that integrates numerical random phase masks into the deconvolution process,effectively eliminating these artifacts and enhancing image clarity.The optimized joint operation of an iterative Richardson-Lucy deconvolution and numerical synthesis of random phase masks(RPM),termed as De-conv-RPM,enables a 2.5-fold reduction in full width at half-maximum(FWHM).We demonstrate that the Deconv-RPM method significantly enhances image clarity,allowing for the discernment of previously unresolved cellular-level details in nonkeratinized epithelial cells ex vivo and moving blood cells in vivo.
基金Project 2003AA135010 supported by the National High Technology Research and Development Program of China
文摘In general, there is a demand for real-time processing of mass quantity remote sensing images. However, the task is not only data-intensive but also computating-intensive. Distributed processing is a hot topic in remote sensing processing and image deblurring is also one of the most important needs. In order to satisfy the demand for quick proc- essing and deblurring of mass quantity satellite images, we developed a distributed, grid computation-based platform as well as a corresponding middleware for grid computation. Both a constrained power spectrum equalization algorithm and effective block processing measures, which can avoid boundary effect, were applied during the processing. The re- sult is satisfactory since computation efficiency and visual effect were greatly improved. It can be concluded that the technology of spatial information grids is effective for mass quantity remote sensing image processing.
基金Supported by the National Natural Science Foundation of China(61701004)Outstanding Young Talents Support Program of Anhui Province(gxyq2021178)+1 种基金Open Fund of Key Laboratory of Anhui Higher Education Institutes(CS2021-07)Program of University Mathematics Teaching Research and Development Center(CMC20200301)。
文摘In this paper,we propose a shear high-order gradient(SHOG)operator by combining the shear operator and high-order gradient(HOG)operator.Compared with the HOG operator,the proposed SHOG operator can incorporate more directionality and detect more abundant edge information.Based on the SHOG operator,we extend the total variation(TV)norm to shear high-order total variation(SHOTV),and then propose a SHOTV deblurring model.We also study some properties of the SHOG operator,and show that the SHOG matrices are Block Circulant with Circulant Blocks(BCCB)when the shear angle isπ/4.The proposed model is solved efficiently by the alternating direction method of multipliers(ADMM).Experimental results demonstrate that the proposed method outperforms some state-of-the-art non-blind deblurring methods in both objective and perceptual quality.
文摘Single image motion deblurring has been a very challenging problem in the field of image processing. Although there are many researches had been proposed to solve this problem, it still has problems on kernel accuracy. In order to improve the kernel accuracy, an effective structure selection method was used to select the salient structure of the blur image. Then a novel kernel estimation method based on L0-2 norm was proposed. To guarantee the sparse kernel and eliminate the negative influence of details L0-norm was used. And L2-norm was used to ensure the continuity of kernel. Many experiments were done to compare proposed method and state-of-the-art methods. The results show that our method can estimate a better kernel and use less time than previous work, especially when the size of blur kernel is large.
基金Supported by Open Fund of Key Laboratory of Anhui Higher Education Institutes (CS2021-07)the National Natural Science Foundation of China (61701004)Outstanding Young Talents Support Program of Anhui Province (gxyq2021178)。
文摘In this paper, we propose a novel shear gradient operator by combining the shear and gradient operators. The shear gradient operator performs well to capture diverse directional information in the image gradient domain. Based on the shear gradient operator, we extend the total variation(TV) norm to the shear total variation(STV) norm by adding two shear gradient terms. Subsequently, we introduce a shear total variation deblurring model. Experimental results are provided to validate the ability of the STV norm to capture the detailed information. Leveraging the Block Circulant with Circulant Blocks(BCCB) structure of the shear gradient matrices, the alternating direction method of multipliers(ADMM) algorithm can be used to solve the proposed model efficiently. Numerous experiments are presented to verify the performance of our algorithm for non-blind image deblurring.
基金Supported by Liao Ning University Innovation Research and Training Program(No.201410141683)
文摘Motion deblurring is one of the basic problems inthe field of image processing. This paper summarizes the mathematical basis of the previous work and presents a deblurringmethod that can improve the estimation of the motion blurkernel and obtain a better result than the traditional methods.Experiments show the motion blur kernel loses some important and useful properties during the estimation of the kernel which may cause a bad estimation and increase the ringingartifacts. Considering that the kernel is provided by the motion of the imaging sensor during the exposure and that the kernel shows the trace of the motion, this paper ensures the physical meaning of the kernel such as the continuity and the center of thekernel during the iterative process. By adding a post process to the estimation of the motion blur kernel, we remove some discrete points and make use of the centralizationof the kernel in order to accurate the estimation. The experiment shows the existence of the post process improves the effect of the estimation of the kernel and provides a better result with the clear edges.
基金financially supported by the National Natural Science Foundation of China(Nos.21134006 and 51275504)Dutch Polymer Institute(DPI project:779)Science and Technology Development Plane of Jilin(No.20140519007JH)
文摘A general pre-processing procedure of the measured SAXS patterns for reducing the effect of beam stop and beam stop holder is described. A proper method for automatically choosing the regularization parameter is implemented. The method works out on the two-dimensional SAXS patterns. After deblurring, the corresponding two-dimensional patterns will be converted into one-dimensional integrated intensity distribution curves. We tested the program using both calculated artificial data and real experimental data such as polystyrene and poly（methyl methacrylate） latices. The deblurred results are satisfactory showing the effectiveness of the method. The deblurring process of a typical two-dimensional SAXS pattern using the Matlab based program can be completed in few seconds on normal personal computers.
基金the National Natural Science Foundation of China under Grant 62075169,Grant 62003247,and Grant 62061160370the Hubei Province Key Research and Development Program under Grant 2021BBA235the Zhuhai Basic and Applied Basic Research Foundation under Grant ZH22017003200010PWC.
文摘The rotary motion deblurring is an inevitable procedure when the imaging seeker is mounted in the rotating missiles.Traditional rotary motion deblurring methods suffer from ringing artifacts and noise,especially for large blur extents.To solve the above problems,we propose a progressive rotary motion deblurring framework consisting of a coarse deblurring stage and a refinement stage.In the first stage,we design an adaptive blur extents factor(BE factor)to balance noise suppression and details reconstruction.And a novel deconvolution model is proposed based on BE factor.In the second stage,a triplescale deformable module CNN(TDM-CNN)is designed to reduce the ringing artifacts,which can exploit the 2D information of an image and adaptively adjust spatial sampling locations.To establish a standard evaluation benchmark,a real-world rotary motion blur dataset is proposed and released,which includes rotary blurred images and corresponding ground truth images with different blur angles.Experimental results demonstrate that the proposed method outperforms the state-of-the-art models on synthetic and real-world rotary motion blur datasets.The code and dataset are available at https://github.com/JinhuiQin/RotaryDeblurring.
基金Supported by the National Natural Science Foundation of China(No.61340034)the Research Program of Application Foundation and Advanced Technology of Tianjin(No.13JCYBJC15600)
文摘As an ill-posed problem, multiframe blind super resolution imaging recovers a high resolution image from a group of low resolution images with some degradations when the information of blur kernel is limited. Note that the quality of the recovered image is influenced more by the accuracy of blur estimation than an advanced regularization. We study the traditional model of the multiframe super resolution and modify it for blind deblurring. Based on the analysis, we proposed two algorithms. The first one is based on the total variation blind deconvolution algorithm and formulated as a functional for optimization with the regularization of blur. Based on the alternating minimization and the gradient descent algorithm, the high resolution image and the unknown blur kernel are estimated iteratively. By using the median shift and add operator, the second algorithm is more robust to the outlier influence. The MSAA initialization simplifies the interpolation process to reconstruct the blurred high resolution image for blind deblurring and improves the accuracy of blind super resolution imaging. The experimental results demonstrate the superiority and accuracy of our novel algorithms.
文摘Images are frequently affected because of blurring,and data loss occurred by sampling and noise occurrence.The images are getting blurred because of object movement in the scenario,atmospheric misrepresentations,and optical aberrations.The main objective of image restoration is to evaluate the original image from the corrupted data.To overcome this issue,the multiobjective reptile search algorithm is proposed for performing an effective image deblurring and restoration(MORSA-IDR).The proposed MORSA is used in two different processes such as threshold and kernel parameter calculation.In that,threshold values are used for detecting and replacing the noisy pixel removal using deep residual network,and estimation of kernel is performed for deblurring the images.The main objective of the proposed MORSA-IDR is to enhance the process of deblurring for recovering low-level contextual information.The MORSA-IDR is evaluated using peak signal noise ratio(PSNR)and structural similarity index.The existing researches such as enhanced local maximum intensity(ELMI)prior and deep unrolling for blind deblurring(DUBLID)are used to evaluate the MORSA-IDR.The PSNR of MORSA-IDR for image 6 is 30.98 dB,which is high when compared with the ELMI and DUBLID.
基金the National Key R&D Program of China(GrantNo.2021YFA1601104)National KeyR&DProgram of China(GrantNo.2022YFA16038004)+1 种基金National Key R&D Program of China(Grant No.2022YFA16038002)National Science and Technology Major Project of China(No.J2019-VI-0004-0117).
文摘Scanning electron microscopy(SEM)is a crucial tool in the field of materials science,providing valuable insightsinto the microstructural characteristics of materials.Unfortunately,SEM images often suffer from blurrinesscaused by improper hardware calibration or imaging automation errors,which present challenges in analyzingand interpretingmaterial characteristics.Consequently,rectifying the blurring of these images assumes paramountsignificance to enable subsequent analysis.To address this issue,we introduce a Material Images DeblurringNetwork(MIDNet)built upon the foundation of the Nonlinear Activation Free Network(NAFNet).MIDNetis meticulously tailored to address the blurring in images capturing the microstructure of materials.The keycontributions include enhancing the NAFNet architecture for better feature extraction and representation,integratinga novel soft attention mechanism to uncover important correlations between encoder and decoder,andintroducing newmulti-loss functions to improve training effectiveness and overallmodel performance.We conducta comprehensive set of experiments utilizing the material blurry dataset and compare them to several state-of-theartdeblurring methods.The experimental results demonstrate the applicability and effectiveness of MIDNet in thedomain of deblurring material microstructure images,with a PSNR(Peak Signal-to-Noise Ratio)reaching 35.26 dBand an SSIM(Structural Similarity)of 0.946.Our dataset is available at:https://github.com/woshigui/MIDNet.
文摘Texture extract from digital aerial image is widely used in three-dimensional city modeling to generate “photo-realistic” views. In this paper, a method based on reforming “Steep edge” curve, which clearly explains how the diffraction of the sunlight makes digital aerial image blurring, is proposed to deblur the texture extraction from digital aerial image, and the experiment shows a good result in visualization and automation.
基金Supported by the National Natural Science Foundation of China (62172190)the“Double Creation”Plan of Jiangsu Province (JSSCRC2021532)the“Taihu Talent-Innovative Leading Talent”Plan of Wuxi City (Certificate Date:202110)。
文摘Background For static scenes with multiple depth layers,existing defocused image deblurring methods have the problems of edge-ringing artifacts or insufficient deblurring owing to inaccurate estimation of the blur amount,and prior knowledge in nonblind deconvolution is not strong,which leads to image detail recovery challenges.Methods To this end,this study proposes a blur map estimation method for defocused images based on the gradient difference of the boundary neighborhood,which uses the gradient difference of the boundary neighborhood to accurately obtain the amount of blurring,thereby preventing boundary ringing artifacts.The obtained blur map is then used for blur detection to determine whether the image needs to be deblurred,thereby improving the efficiency of deblurring without manual intervention and judgment.Finally,a nonblind deconvolution algorithm was designed to achieve image deblurring based on the blur amount selection strategy and sparse prior.Results Experimental results showed that our method improves PSNR(Peak Signal-to-Noise Ratio)and SSIM(Structural Similarity Index)by an average of 4.6%and 7.3%,respectively,compared to existing methods.Conclusions Experimental results showed that the proposed method outperforms existing methods.Compared to existing methods,our method can better solve the problems of boundary ringing artifacts and detail information preservation in defocused image deblurring.
