Photographs taken in daily life often became blurred due to shaking,out-of-focus,changes in depth of field,and movement of photographed objects.Aiming at this problem,a double-channel cyclic image deblurring method ba...Photographs taken in daily life often became blurred due to shaking,out-of-focus,changes in depth of field,and movement of photographed objects.Aiming at this problem,a double-channel cyclic image deblurring method based on edge features was proposed.Firstly,image edge gradient operator was introduced as a threshold based on the rule that the maximum value of the image edge gradient will decrease after the blurring process,making the blurred image be divided into two channels:edge channel and non-edge channel.Secondly,a double-channel loop iteration network was designed,where the edge gradient was used in the edge channel to sample the main edge structure and bilateral filtering was used in the non-edge channel to extract the detailed texture feature information.Finally,the feature information extracted from two channels was cyclically iterated to obtain a clear image using the deblurring model with maximum a posteriori probability.The experimental results showed that the image evaluation indexes obtained by the proposed deblurring model were superior to those of other algorithms,and the edge structure and texture details of the image were effectively recovered with better performance.展开更多
Traditional cameras inevitably suffer from motion blur when facing high-speed moving objects.Event cameras,as high temporal resolution bionic cameras,record intensity changes in an asynchronous manner,and their record...Traditional cameras inevitably suffer from motion blur when facing high-speed moving objects.Event cameras,as high temporal resolution bionic cameras,record intensity changes in an asynchronous manner,and their recorded high temporal resolution information can effectively solve the problem of time information loss in motion blur.Existing event-based deblurring methods still face challenges when facing high-speed moving objects.We conducted an in-depth study of the imaging principle of event cameras.We found that the event stream contains excessive noise.The valid information is sparse.Invalid event features hinder the expression of valid features due to the uncertainty of the global threshold.To address this problem,a denoising-based long and short-term memory module(DTM)is designed in this paper.The DTM suppressed the original event information by noise reduction process.Invalid features in the event stream and solves the problem of sparse valid information in the event stream,and it also combines with the long short-term memory module(LSTM),which further enhances the event feature information in the time scale.In addition,through the in-depth understanding of the unique characteristics of event features,it is found that the high-frequency information recorded by event features does not effectively guide the fusion feature deblurring process in the spatial-domain-based feature processing,and for this reason,we introduce the residual fast fourier transform module(RES-FFT)to further enhance the high-frequency characteristics of the fusion features by performing the feature extraction of the fusion features from the perspective of the frequency domain.Ultimately,our proposed event image fusion network based on event denoising and frequency domain feature enhancement(DNEFNET)achieved Peak Signal-to-Noise Ratio(PSNR)/Structural Similarity Index Measure(SSIM)scores of 35.55/0.972 on the GoPro dataset and 38.27/0.975 on the REBlur dataset,achieving the state of the art(SOTA)effect.展开更多
Deconvolution is a commonly employed technique for enhancing image quality in optical imaging methods.Unfortu-nately,its application in optical coherence tomography(OCT)is often hindered by sensitivity to noise,which ...Deconvolution is a commonly employed technique for enhancing image quality in optical imaging methods.Unfortu-nately,its application in optical coherence tomography(OCT)is often hindered by sensitivity to noise,which leads to ad-ditive ringing artifacts.These artifacts considerably degrade the quality of deconvolved images,thereby limiting its effect-iveness in OCT imaging.In this study,we propose a framework that integrates numerical random phase masks into the deconvolution process,effectively eliminating these artifacts and enhancing image clarity.The optimized joint operation of an iterative Richardson-Lucy deconvolution and numerical synthesis of random phase masks(RPM),termed as De-conv-RPM,enables a 2.5-fold reduction in full width at half-maximum(FWHM).We demonstrate that the Deconv-RPM method significantly enhances image clarity,allowing for the discernment of previously unresolved cellular-level details in nonkeratinized epithelial cells ex vivo and moving blood cells in vivo.展开更多
The rotary motion deblurring is an inevitable procedure when the imaging seeker is mounted in the rotating missiles.Traditional rotary motion deblurring methods suffer from ringing artifacts and noise,especially for l...The rotary motion deblurring is an inevitable procedure when the imaging seeker is mounted in the rotating missiles.Traditional rotary motion deblurring methods suffer from ringing artifacts and noise,especially for large blur extents.To solve the above problems,we propose a progressive rotary motion deblurring framework consisting of a coarse deblurring stage and a refinement stage.In the first stage,we design an adaptive blur extents factor(BE factor)to balance noise suppression and details reconstruction.And a novel deconvolution model is proposed based on BE factor.In the second stage,a triplescale deformable module CNN(TDM-CNN)is designed to reduce the ringing artifacts,which can exploit the 2D information of an image and adaptively adjust spatial sampling locations.To establish a standard evaluation benchmark,a real-world rotary motion blur dataset is proposed and released,which includes rotary blurred images and corresponding ground truth images with different blur angles.Experimental results demonstrate that the proposed method outperforms the state-of-the-art models on synthetic and real-world rotary motion blur datasets.The code and dataset are available at https://github.com/JinhuiQin/RotaryDeblurring.展开更多
Scanning electron microscopy(SEM)is a crucial tool in the field of materials science,providing valuable insightsinto the microstructural characteristics of materials.Unfortunately,SEM images often suffer from blurrine...Scanning electron microscopy(SEM)is a crucial tool in the field of materials science,providing valuable insightsinto the microstructural characteristics of materials.Unfortunately,SEM images often suffer from blurrinesscaused by improper hardware calibration or imaging automation errors,which present challenges in analyzingand interpretingmaterial characteristics.Consequently,rectifying the blurring of these images assumes paramountsignificance to enable subsequent analysis.To address this issue,we introduce a Material Images DeblurringNetwork(MIDNet)built upon the foundation of the Nonlinear Activation Free Network(NAFNet).MIDNetis meticulously tailored to address the blurring in images capturing the microstructure of materials.The keycontributions include enhancing the NAFNet architecture for better feature extraction and representation,integratinga novel soft attention mechanism to uncover important correlations between encoder and decoder,andintroducing newmulti-loss functions to improve training effectiveness and overallmodel performance.We conducta comprehensive set of experiments utilizing the material blurry dataset and compare them to several state-of-theartdeblurring methods.The experimental results demonstrate the applicability and effectiveness of MIDNet in thedomain of deblurring material microstructure images,with a PSNR(Peak Signal-to-Noise Ratio)reaching 35.26 dBand an SSIM(Structural Similarity)of 0.946.Our dataset is available at:https://github.com/woshigui/MIDNet.展开更多
In this paper, we propose a novel shear gradient operator by combining the shear and gradient operators. The shear gradient operator performs well to capture diverse directional information in the image gradient domai...In this paper, we propose a novel shear gradient operator by combining the shear and gradient operators. The shear gradient operator performs well to capture diverse directional information in the image gradient domain. Based on the shear gradient operator, we extend the total variation(TV) norm to the shear total variation(STV) norm by adding two shear gradient terms. Subsequently, we introduce a shear total variation deblurring model. Experimental results are provided to validate the ability of the STV norm to capture the detailed information. Leveraging the Block Circulant with Circulant Blocks(BCCB) structure of the shear gradient matrices, the alternating direction method of multipliers(ADMM) algorithm can be used to solve the proposed model efficiently. Numerous experiments are presented to verify the performance of our algorithm for non-blind image deblurring.展开更多
In this paper,in order to reduce the energy leakage caused by the discretized representation in sparse channel estimation for Orthogonal Frequency Division Multiplexing(OFDM)systems,we systematically have analyzed the...In this paper,in order to reduce the energy leakage caused by the discretized representation in sparse channel estimation for Orthogonal Frequency Division Multiplexing(OFDM)systems,we systematically have analyzed the optimal locations of atoms with discrete delays for each path reconstruction from the perspective of linear fitting theory.Then,we have investigated the adverse effects of the non-ideal inner product function on the iteration in one of the most widely used channel estimation method,Orthogonal Matching Pursuit(OMP).The study shows that the distance between the selected atoms for each path in OMP can be larger than the sampling interval,which prevents OMP-based methods from achieving better performance.To overcome this drawback,the image deblurring-based channel estimation method,in which the channel estimation problem is analogized to one-dimensional image deblurring,was proposed to improve the large compensation distance of traditional OMP.The advantage of the proposed method was validated by the results of numerical simulation and sea trial data decoding.展开更多
Reducing the defocus blur that arises from the finite aperture size and short exposure time is an essential problem in computational photography.It is very challenging because the blur kernel is spatially varying and ...Reducing the defocus blur that arises from the finite aperture size and short exposure time is an essential problem in computational photography.It is very challenging because the blur kernel is spatially varying and difficult to estimate by traditional methods.Due to its great breakthrough in low-level tasks,convolutional neural networks(CNNs)have been introdu-ced to the defocus deblurring problem and achieved significant progress.However,previous methods apply the same learned kernel for different regions of the defocus blurred images,thus it is difficult to handle nonuniform blurred images.To this end,this study designs a novel blur-aware multi-branch network(Ba-MBNet),in which different regions are treated differentially.In particular,we estimate the blur amounts of different regions by the internal geometric constraint of the dual-pixel(DP)data,which measures the defocus disparity between the left and right views.Based on the assumption that different image regions with different blur amounts have different deblurring difficulties,we leverage different networks with different capacities to treat different image regions.Moreover,we introduce a meta-learning defocus mask generation algorithm to assign each pixel to a proper branch.In this way,we can expect to maintain the information of the clear regions well while recovering the missing details of the blurred regions.Both quantitative and qualitative experiments demonstrate that our BaMBNet outperforms the state-of-the-art(SOTA)methods.For the dual-pixel defocus deblurring(DPD)-blur dataset,the proposed BaMBNet achieves 1.20 dB gain over the previous SOTA method in term of peak signal-to-noise ratio(PSNR)and reduces learnable parameters by 85%.The details of the code and dataset are available at https://github.com/junjun-jiang/BaMBNet.展开更多
In general, there is a demand for real-time processing of mass quantity remote sensing images. However, the task is not only data-intensive but also computating-intensive. Distributed processing is a hot topic in remo...In general, there is a demand for real-time processing of mass quantity remote sensing images. However, the task is not only data-intensive but also computating-intensive. Distributed processing is a hot topic in remote sensing processing and image deblurring is also one of the most important needs. In order to satisfy the demand for quick proc- essing and deblurring of mass quantity satellite images, we developed a distributed, grid computation-based platform as well as a corresponding middleware for grid computation. Both a constrained power spectrum equalization algorithm and effective block processing measures, which can avoid boundary effect, were applied during the processing. The re- sult is satisfactory since computation efficiency and visual effect were greatly improved. It can be concluded that the technology of spatial information grids is effective for mass quantity remote sensing image processing.展开更多
In this paper,we propose a shear high-order gradient(SHOG)operator by combining the shear operator and high-order gradient(HOG)operator.Compared with the HOG operator,the proposed SHOG operator can incorporate more di...In this paper,we propose a shear high-order gradient(SHOG)operator by combining the shear operator and high-order gradient(HOG)operator.Compared with the HOG operator,the proposed SHOG operator can incorporate more directionality and detect more abundant edge information.Based on the SHOG operator,we extend the total variation(TV)norm to shear high-order total variation(SHOTV),and then propose a SHOTV deblurring model.We also study some properties of the SHOG operator,and show that the SHOG matrices are Block Circulant with Circulant Blocks(BCCB)when the shear angle isπ/4.The proposed model is solved efficiently by the alternating direction method of multipliers(ADMM).Experimental results demonstrate that the proposed method outperforms some state-of-the-art non-blind deblurring methods in both objective and perceptual quality.展开更多
Single image motion deblurring has been a very challenging problem in the field of image processing. Although there are many researches had been proposed to solve this problem, it still has problems on kernel accuracy...Single image motion deblurring has been a very challenging problem in the field of image processing. Although there are many researches had been proposed to solve this problem, it still has problems on kernel accuracy. In order to improve the kernel accuracy, an effective structure selection method was used to select the salient structure of the blur image. Then a novel kernel estimation method based on L0-2 norm was proposed. To guarantee the sparse kernel and eliminate the negative influence of details L0-norm was used. And L2-norm was used to ensure the continuity of kernel. Many experiments were done to compare proposed method and state-of-the-art methods. The results show that our method can estimate a better kernel and use less time than previous work, especially when the size of blur kernel is large.展开更多
Images are frequently affected because of blurring,and data loss occurred by sampling and noise occurrence.The images are getting blurred because of object movement in the scenario,atmospheric misrepresentations,and o...Images are frequently affected because of blurring,and data loss occurred by sampling and noise occurrence.The images are getting blurred because of object movement in the scenario,atmospheric misrepresentations,and optical aberrations.The main objective of image restoration is to evaluate the original image from the corrupted data.To overcome this issue,the multiobjective reptile search algorithm is proposed for performing an effective image deblurring and restoration(MORSA-IDR).The proposed MORSA is used in two different processes such as threshold and kernel parameter calculation.In that,threshold values are used for detecting and replacing the noisy pixel removal using deep residual network,and estimation of kernel is performed for deblurring the images.The main objective of the proposed MORSA-IDR is to enhance the process of deblurring for recovering low-level contextual information.The MORSA-IDR is evaluated using peak signal noise ratio(PSNR)and structural similarity index.The existing researches such as enhanced local maximum intensity(ELMI)prior and deep unrolling for blind deblurring(DUBLID)are used to evaluate the MORSA-IDR.The PSNR of MORSA-IDR for image 6 is 30.98 dB,which is high when compared with the ELMI and DUBLID.展开更多
Texture extract from digital aerial image is widely used in three-dimensional city modeling to generate “photo-realistic” views. In this paper, a method based on reforming “Steep edge” curve, which clearly explain...Texture extract from digital aerial image is widely used in three-dimensional city modeling to generate “photo-realistic” views. In this paper, a method based on reforming “Steep edge” curve, which clearly explains how the diffraction of the sunlight makes digital aerial image blurring, is proposed to deblur the texture extraction from digital aerial image, and the experiment shows a good result in visualization and automation.展开更多
Background For static scenes with multiple depth layers,existing defocused image deblurring methods have the problems of edge-ringing artifacts or insufficient deblurring owing to inaccurate estimation of the blur amo...Background For static scenes with multiple depth layers,existing defocused image deblurring methods have the problems of edge-ringing artifacts or insufficient deblurring owing to inaccurate estimation of the blur amount,and prior knowledge in nonblind deconvolution is not strong,which leads to image detail recovery challenges.Methods To this end,this study proposes a blur map estimation method for defocused images based on the gradient difference of the boundary neighborhood,which uses the gradient difference of the boundary neighborhood to accurately obtain the amount of blurring,thereby preventing boundary ringing artifacts.The obtained blur map is then used for blur detection to determine whether the image needs to be deblurred,thereby improving the efficiency of deblurring without manual intervention and judgment.Finally,a nonblind deconvolution algorithm was designed to achieve image deblurring based on the blur amount selection strategy and sparse prior.Results Experimental results showed that our method improves PSNR(Peak Signal-to-Noise Ratio)and SSIM(Structural Similarity Index)by an average of 4.6%and 7.3%,respectively,compared to existing methods.Conclusions Experimental results showed that the proposed method outperforms existing methods.Compared to existing methods,our method can better solve the problems of boundary ringing artifacts and detail information preservation in defocused image deblurring.展开更多
Online defect visual inspection (ODVI) works while the object has to be static, otherwise the relative motion between camera and object will create motion blur in images. In order to implement ODVI in dynamic scene, i...Online defect visual inspection (ODVI) works while the object has to be static, otherwise the relative motion between camera and object will create motion blur in images. In order to implement ODVI in dynamic scene, it developes one blind motion deblurring method whose objective is to estimate blur kernel parameters precisely. In the proposed method, Radon transform on superpixels determinated the blur angle, and the autocorrelation function based on magnitude (AFM) of the preprocessed blurred image was utilized to identify the blur length. With the projection relationship discussed in this study, it will be unnecessary to rotate the blurred image or the axis. The proposed method is of high accuracy and robustness to noise, and it can somehow handle saturated pixels. To validate the proposed method, experiments have been carried out on synthetic images both in noise free and noisy situations. The results show that the method outperforms existing approaches. With the modified Richardson– Lucy deconvolution, it demonstrates that the proposed method is effective for ODVI in terms of subjective visual quality.展开更多
Motion deblurring is a basic problem in the field of image processing and analysis. This paper proposes a new method of single image blind deblurring which can be significant to kernel estimation and non-blind deconvo...Motion deblurring is a basic problem in the field of image processing and analysis. This paper proposes a new method of single image blind deblurring which can be significant to kernel estimation and non-blind deconvolution. Experiments show that the details of the image destroy the structure of the kernel, especially when the blur kernel is large. So we extract the image structure with salient edges by the method based on RTV. In addition, the traditional method for motion blur kernel estimation based on sparse priors is conducive to gain a sparse blur kernel. But these priors do not ensure the continuity of blur kernel and sometimes induce noisy estimated results. Therefore we propose the kernel refinement method based on L0 to overcome the above shortcomings. In terms of non-blind deconvolution we adopt the L1/L2 regularization term. Compared with the traditional method, the method based on L1/L2 norm has better adaptability to image structure, and the constructed energy functional can better describe the sharp image. For this model, an effective algorithm is presented based on alternating minimization algorithm.展开更多
A general pre-processing procedure of the measured SAXS patterns for reducing the effect of beam stop and beam stop holder is described. A proper method for automatically choosing the regularization parameter is imple...A general pre-processing procedure of the measured SAXS patterns for reducing the effect of beam stop and beam stop holder is described. A proper method for automatically choosing the regularization parameter is implemented. The method works out on the two-dimensional SAXS patterns. After deblurring, the corresponding two-dimensional patterns will be converted into one-dimensional integrated intensity distribution curves. We tested the program using both calculated artificial data and real experimental data such as polystyrene and poly（methyl methacrylate） latices. The deblurred results are satisfactory showing the effectiveness of the method. The deblurring process of a typical two-dimensional SAXS pattern using the Matlab based program can be completed in few seconds on normal personal computers.展开更多
High-resolution line scan cameras with wide-angle lenses are highly accurate and efficient for tunnel detection.However,due to the curvature of the tunnel,there are variations in object distance that exceed the depth ...High-resolution line scan cameras with wide-angle lenses are highly accurate and efficient for tunnel detection.However,due to the curvature of the tunnel,there are variations in object distance that exceed the depth of field of the lens,resulting in uneven defocus blur in the captured images.This can significantly affect the accuracy of defect recognition.While existing deblurring algorithms can improve image quality,they often prioritize results over inference time,which is not ideal for high-speed tunnel image acquisition.To address this issue,we developed a lightweight tunnel structure defect deblurring network(TSDDNet)for curved-tunnel line scanning with wide-angle lenses.Our method employs an innovative progressive structure that balances network depth and feature breadth to simultaneously achieve good performance and short inference time.The proposed depthwise ResBlocks significantly improves the parameter efficiency of the network.Additionally,the proposed feature refinement block captures the structurally similar features to enhance the image details,increasing the peak signal-to-noise ratio(PSNR).A raw dataset containing tunnel blur images was created using a high-resolution line scan camera and used to train and test our model.TSDDNet achieved a PSNR of 26.82 dB and a structural similarity index measure of 0.888,while using one-third of the parameters of comparable alternatives.Moreover,our method exhibited a higher computational speed than that of conventional methods,with inference times of 8.82 ms for a single 512×512 pixel image patch and 227.22 ms for completely processing a 2048×2560 pixel image.The test results indicated that the structural scalability of the network allows it to accommodate large inputs,making it effective for high-resolution images.展开更多
When a facial image is blurred,it significantly affects high-level vision tasks such as face recognition.The purpose of facial image deblurring is to recover a clear image from a blurry input image,which can improve t...When a facial image is blurred,it significantly affects high-level vision tasks such as face recognition.The purpose of facial image deblurring is to recover a clear image from a blurry input image,which can improve the recognition accuracy,etc.However,general deblurring methods do not perform well on facial images.Therefore,some face deblurring methods have been proposed to improve performance by adding semantic or structural information as specific priors according to the characteristics of the facial images.In this paper,we survey and summarize recently published methods for facial image deblurring,most of which are based on deep learning.First,we provide a brief introduction to the modeling of image blurring.Next,we summarize face deblurring methods into two categories:model-based methods and deep learning-based methods.Furthermore,we summarize the datasets,loss functions,and performance evaluation metrics commonly used in the neural network training process.We show the performance of classical methods on these datasets and metrics and provide a brief discussion on the differences between model-based and learning-based methods.Finally,we discuss the current challenges and possible future research directions.展开更多
In the PSP(Pressure-Sensitive Paint),image deblurring is essential due to factors such as prolonged camera exposure times and highmodel velocities,which can lead to significant image blurring.Conventional deblurring m...In the PSP(Pressure-Sensitive Paint),image deblurring is essential due to factors such as prolonged camera exposure times and highmodel velocities,which can lead to significant image blurring.Conventional deblurring methods applied to PSP images often suffer from limited accuracy and require extensive computational resources.To address these issues,this study proposes a deep learning-based approach tailored for PSP image deblurring.Considering that PSP applications primarily involve the accurate pressure measurements of complex geometries,the images captured under such conditions exhibit distinctive non-uniform motion blur,presenting challenges for standard deep learning models utilizing convolutional or attention-based techniques.In this paper,we introduce a novel deblurring architecture featuring multiple DAAM(Deformable Ack Attention Module).These modules provide enhanced flexibility for end-to-end deblurring,leveraging irregular convolution operations for efficient feature extraction while employing attention mechanisms interpreted as multiple 1×1 convolutions,subsequently reassembled to enhance performance.Furthermore,we incorporate a RSC(Residual Shortcut Convolution)module for initial feature processing,aimed at reducing redundant computations and improving the learning capacity for representative shallow features.To preserve critical spatial information during upsampling and downsampling,we replace conventional convolutions with wt(Haar wavelet downsampling)and dysample(Upsampling by Dynamic Sampling).This modification significantly enhances high-precision image reconstruction.By integrating these advanced modules within an encoder-decoder framework,we present the DFDNet(Deformable Fusion Deblurring Network)for image blur removal,providing robust technical support for subsequent PSP data analysis.Experimental evaluations on the FY dataset demonstrate the superior performance of our model,achieving competitive results on the GOPRO and HIDE datasets.展开更多
基金supported in part by Natural Science Research Foundation of Shanxi Province(Nos.20210302123019,20210302124195,20210302124212,20210302123189)。
文摘Photographs taken in daily life often became blurred due to shaking,out-of-focus,changes in depth of field,and movement of photographed objects.Aiming at this problem,a double-channel cyclic image deblurring method based on edge features was proposed.Firstly,image edge gradient operator was introduced as a threshold based on the rule that the maximum value of the image edge gradient will decrease after the blurring process,making the blurred image be divided into two channels:edge channel and non-edge channel.Secondly,a double-channel loop iteration network was designed,where the edge gradient was used in the edge channel to sample the main edge structure and bilateral filtering was used in the non-edge channel to extract the detailed texture feature information.Finally,the feature information extracted from two channels was cyclically iterated to obtain a clear image using the deblurring model with maximum a posteriori probability.The experimental results showed that the image evaluation indexes obtained by the proposed deblurring model were superior to those of other algorithms,and the edge structure and texture details of the image were effectively recovered with better performance.
文摘Traditional cameras inevitably suffer from motion blur when facing high-speed moving objects.Event cameras,as high temporal resolution bionic cameras,record intensity changes in an asynchronous manner,and their recorded high temporal resolution information can effectively solve the problem of time information loss in motion blur.Existing event-based deblurring methods still face challenges when facing high-speed moving objects.We conducted an in-depth study of the imaging principle of event cameras.We found that the event stream contains excessive noise.The valid information is sparse.Invalid event features hinder the expression of valid features due to the uncertainty of the global threshold.To address this problem,a denoising-based long and short-term memory module(DTM)is designed in this paper.The DTM suppressed the original event information by noise reduction process.Invalid features in the event stream and solves the problem of sparse valid information in the event stream,and it also combines with the long short-term memory module(LSTM),which further enhances the event feature information in the time scale.In addition,through the in-depth understanding of the unique characteristics of event features,it is found that the high-frequency information recorded by event features does not effectively guide the fusion feature deblurring process in the spatial-domain-based feature processing,and for this reason,we introduce the residual fast fourier transform module(RES-FFT)to further enhance the high-frequency characteristics of the fusion features by performing the feature extraction of the fusion features from the perspective of the frequency domain.Ultimately,our proposed event image fusion network based on event denoising and frequency domain feature enhancement(DNEFNET)achieved Peak Signal-to-Noise Ratio(PSNR)/Structural Similarity Index Measure(SSIM)scores of 35.55/0.972 on the GoPro dataset and 38.27/0.975 on the REBlur dataset,achieving the state of the art(SOTA)effect.
基金supported by the Guangdong Natural Science Fund General Program (2023A1515011289)Singapore Ministry of Health's National Medical Research Council under its Open Fund Individual Research Grant (MOH-OFIRG19may-0009)+2 种基金Ministry of Education Singapore under its Academic Research Fund Tier 1 (RG35/22)Academic Research Funding Tier 2 (MOE-T2EP30120-0001)China-Singapore International Joint Research Institute (203-A022001).
文摘Deconvolution is a commonly employed technique for enhancing image quality in optical imaging methods.Unfortu-nately,its application in optical coherence tomography(OCT)is often hindered by sensitivity to noise,which leads to ad-ditive ringing artifacts.These artifacts considerably degrade the quality of deconvolved images,thereby limiting its effect-iveness in OCT imaging.In this study,we propose a framework that integrates numerical random phase masks into the deconvolution process,effectively eliminating these artifacts and enhancing image clarity.The optimized joint operation of an iterative Richardson-Lucy deconvolution and numerical synthesis of random phase masks(RPM),termed as De-conv-RPM,enables a 2.5-fold reduction in full width at half-maximum(FWHM).We demonstrate that the Deconv-RPM method significantly enhances image clarity,allowing for the discernment of previously unresolved cellular-level details in nonkeratinized epithelial cells ex vivo and moving blood cells in vivo.
基金the National Natural Science Foundation of China under Grant 62075169,Grant 62003247,and Grant 62061160370the Hubei Province Key Research and Development Program under Grant 2021BBA235the Zhuhai Basic and Applied Basic Research Foundation under Grant ZH22017003200010PWC.
文摘The rotary motion deblurring is an inevitable procedure when the imaging seeker is mounted in the rotating missiles.Traditional rotary motion deblurring methods suffer from ringing artifacts and noise,especially for large blur extents.To solve the above problems,we propose a progressive rotary motion deblurring framework consisting of a coarse deblurring stage and a refinement stage.In the first stage,we design an adaptive blur extents factor(BE factor)to balance noise suppression and details reconstruction.And a novel deconvolution model is proposed based on BE factor.In the second stage,a triplescale deformable module CNN(TDM-CNN)is designed to reduce the ringing artifacts,which can exploit the 2D information of an image and adaptively adjust spatial sampling locations.To establish a standard evaluation benchmark,a real-world rotary motion blur dataset is proposed and released,which includes rotary blurred images and corresponding ground truth images with different blur angles.Experimental results demonstrate that the proposed method outperforms the state-of-the-art models on synthetic and real-world rotary motion blur datasets.The code and dataset are available at https://github.com/JinhuiQin/RotaryDeblurring.
基金the National Key R&D Program of China(GrantNo.2021YFA1601104)National KeyR&DProgram of China(GrantNo.2022YFA16038004)+1 种基金National Key R&D Program of China(Grant No.2022YFA16038002)National Science and Technology Major Project of China(No.J2019-VI-0004-0117).
文摘Scanning electron microscopy(SEM)is a crucial tool in the field of materials science,providing valuable insightsinto the microstructural characteristics of materials.Unfortunately,SEM images often suffer from blurrinesscaused by improper hardware calibration or imaging automation errors,which present challenges in analyzingand interpretingmaterial characteristics.Consequently,rectifying the blurring of these images assumes paramountsignificance to enable subsequent analysis.To address this issue,we introduce a Material Images DeblurringNetwork(MIDNet)built upon the foundation of the Nonlinear Activation Free Network(NAFNet).MIDNetis meticulously tailored to address the blurring in images capturing the microstructure of materials.The keycontributions include enhancing the NAFNet architecture for better feature extraction and representation,integratinga novel soft attention mechanism to uncover important correlations between encoder and decoder,andintroducing newmulti-loss functions to improve training effectiveness and overallmodel performance.We conducta comprehensive set of experiments utilizing the material blurry dataset and compare them to several state-of-theartdeblurring methods.The experimental results demonstrate the applicability and effectiveness of MIDNet in thedomain of deblurring material microstructure images,with a PSNR(Peak Signal-to-Noise Ratio)reaching 35.26 dBand an SSIM(Structural Similarity)of 0.946.Our dataset is available at:https://github.com/woshigui/MIDNet.
基金Supported by Open Fund of Key Laboratory of Anhui Higher Education Institutes (CS2021-07)the National Natural Science Foundation of China (61701004)Outstanding Young Talents Support Program of Anhui Province (gxyq2021178)。
文摘In this paper, we propose a novel shear gradient operator by combining the shear and gradient operators. The shear gradient operator performs well to capture diverse directional information in the image gradient domain. Based on the shear gradient operator, we extend the total variation(TV) norm to the shear total variation(STV) norm by adding two shear gradient terms. Subsequently, we introduce a shear total variation deblurring model. Experimental results are provided to validate the ability of the STV norm to capture the detailed information. Leveraging the Block Circulant with Circulant Blocks(BCCB) structure of the shear gradient matrices, the alternating direction method of multipliers(ADMM) algorithm can be used to solve the proposed model efficiently. Numerous experiments are presented to verify the performance of our algorithm for non-blind image deblurring.
基金supported by the Fundamental Research Funds for the Central Universities under Grant 20720200092the National Natural Science Foundation of China under Grant 62171394,U21A20444,61771152,62071402+2 种基金the Sustainable Funding of the Key Laboratory of Underwater Acoustic Technology under Grant JCKYS2022604SSJS001Key Laboratory of Universal Wireless Communications(BUPT)Ministry of Education,P.R.China under Grant KFKT-2022103.
文摘In this paper,in order to reduce the energy leakage caused by the discretized representation in sparse channel estimation for Orthogonal Frequency Division Multiplexing(OFDM)systems,we systematically have analyzed the optimal locations of atoms with discrete delays for each path reconstruction from the perspective of linear fitting theory.Then,we have investigated the adverse effects of the non-ideal inner product function on the iteration in one of the most widely used channel estimation method,Orthogonal Matching Pursuit(OMP).The study shows that the distance between the selected atoms for each path in OMP can be larger than the sampling interval,which prevents OMP-based methods from achieving better performance.To overcome this drawback,the image deblurring-based channel estimation method,in which the channel estimation problem is analogized to one-dimensional image deblurring,was proposed to improve the large compensation distance of traditional OMP.The advantage of the proposed method was validated by the results of numerical simulation and sea trial data decoding.
基金supported by the National Natural Science Foundation of China (61971165, 61922027, 61773295)in part by the Fundamental Research Funds for the Central Universities (FRFCU5710050119)+1 种基金the Natural Science Foundation of Heilongjiang Province(YQ2020F004)the Chinese Association for Artificial Intelligence(CAAI)-Huawei Mind Spore Open Fund
文摘Reducing the defocus blur that arises from the finite aperture size and short exposure time is an essential problem in computational photography.It is very challenging because the blur kernel is spatially varying and difficult to estimate by traditional methods.Due to its great breakthrough in low-level tasks,convolutional neural networks(CNNs)have been introdu-ced to the defocus deblurring problem and achieved significant progress.However,previous methods apply the same learned kernel for different regions of the defocus blurred images,thus it is difficult to handle nonuniform blurred images.To this end,this study designs a novel blur-aware multi-branch network(Ba-MBNet),in which different regions are treated differentially.In particular,we estimate the blur amounts of different regions by the internal geometric constraint of the dual-pixel(DP)data,which measures the defocus disparity between the left and right views.Based on the assumption that different image regions with different blur amounts have different deblurring difficulties,we leverage different networks with different capacities to treat different image regions.Moreover,we introduce a meta-learning defocus mask generation algorithm to assign each pixel to a proper branch.In this way,we can expect to maintain the information of the clear regions well while recovering the missing details of the blurred regions.Both quantitative and qualitative experiments demonstrate that our BaMBNet outperforms the state-of-the-art(SOTA)methods.For the dual-pixel defocus deblurring(DPD)-blur dataset,the proposed BaMBNet achieves 1.20 dB gain over the previous SOTA method in term of peak signal-to-noise ratio(PSNR)and reduces learnable parameters by 85%.The details of the code and dataset are available at https://github.com/junjun-jiang/BaMBNet.
基金Project 2003AA135010 supported by the National High Technology Research and Development Program of China
文摘In general, there is a demand for real-time processing of mass quantity remote sensing images. However, the task is not only data-intensive but also computating-intensive. Distributed processing is a hot topic in remote sensing processing and image deblurring is also one of the most important needs. In order to satisfy the demand for quick proc- essing and deblurring of mass quantity satellite images, we developed a distributed, grid computation-based platform as well as a corresponding middleware for grid computation. Both a constrained power spectrum equalization algorithm and effective block processing measures, which can avoid boundary effect, were applied during the processing. The re- sult is satisfactory since computation efficiency and visual effect were greatly improved. It can be concluded that the technology of spatial information grids is effective for mass quantity remote sensing image processing.
基金Supported by the National Natural Science Foundation of China(61701004)Outstanding Young Talents Support Program of Anhui Province(gxyq2021178)+1 种基金Open Fund of Key Laboratory of Anhui Higher Education Institutes(CS2021-07)Program of University Mathematics Teaching Research and Development Center(CMC20200301)。
文摘In this paper,we propose a shear high-order gradient(SHOG)operator by combining the shear operator and high-order gradient(HOG)operator.Compared with the HOG operator,the proposed SHOG operator can incorporate more directionality and detect more abundant edge information.Based on the SHOG operator,we extend the total variation(TV)norm to shear high-order total variation(SHOTV),and then propose a SHOTV deblurring model.We also study some properties of the SHOG operator,and show that the SHOG matrices are Block Circulant with Circulant Blocks(BCCB)when the shear angle isπ/4.The proposed model is solved efficiently by the alternating direction method of multipliers(ADMM).Experimental results demonstrate that the proposed method outperforms some state-of-the-art non-blind deblurring methods in both objective and perceptual quality.
文摘Single image motion deblurring has been a very challenging problem in the field of image processing. Although there are many researches had been proposed to solve this problem, it still has problems on kernel accuracy. In order to improve the kernel accuracy, an effective structure selection method was used to select the salient structure of the blur image. Then a novel kernel estimation method based on L0-2 norm was proposed. To guarantee the sparse kernel and eliminate the negative influence of details L0-norm was used. And L2-norm was used to ensure the continuity of kernel. Many experiments were done to compare proposed method and state-of-the-art methods. The results show that our method can estimate a better kernel and use less time than previous work, especially when the size of blur kernel is large.
文摘Images are frequently affected because of blurring,and data loss occurred by sampling and noise occurrence.The images are getting blurred because of object movement in the scenario,atmospheric misrepresentations,and optical aberrations.The main objective of image restoration is to evaluate the original image from the corrupted data.To overcome this issue,the multiobjective reptile search algorithm is proposed for performing an effective image deblurring and restoration(MORSA-IDR).The proposed MORSA is used in two different processes such as threshold and kernel parameter calculation.In that,threshold values are used for detecting and replacing the noisy pixel removal using deep residual network,and estimation of kernel is performed for deblurring the images.The main objective of the proposed MORSA-IDR is to enhance the process of deblurring for recovering low-level contextual information.The MORSA-IDR is evaluated using peak signal noise ratio(PSNR)and structural similarity index.The existing researches such as enhanced local maximum intensity(ELMI)prior and deep unrolling for blind deblurring(DUBLID)are used to evaluate the MORSA-IDR.The PSNR of MORSA-IDR for image 6 is 30.98 dB,which is high when compared with the ELMI and DUBLID.
文摘Texture extract from digital aerial image is widely used in three-dimensional city modeling to generate “photo-realistic” views. In this paper, a method based on reforming “Steep edge” curve, which clearly explains how the diffraction of the sunlight makes digital aerial image blurring, is proposed to deblur the texture extraction from digital aerial image, and the experiment shows a good result in visualization and automation.
基金Supported by the National Natural Science Foundation of China (62172190)the“Double Creation”Plan of Jiangsu Province (JSSCRC2021532)the“Taihu Talent-Innovative Leading Talent”Plan of Wuxi City (Certificate Date:202110)。
文摘Background For static scenes with multiple depth layers,existing defocused image deblurring methods have the problems of edge-ringing artifacts or insufficient deblurring owing to inaccurate estimation of the blur amount,and prior knowledge in nonblind deconvolution is not strong,which leads to image detail recovery challenges.Methods To this end,this study proposes a blur map estimation method for defocused images based on the gradient difference of the boundary neighborhood,which uses the gradient difference of the boundary neighborhood to accurately obtain the amount of blurring,thereby preventing boundary ringing artifacts.The obtained blur map is then used for blur detection to determine whether the image needs to be deblurred,thereby improving the efficiency of deblurring without manual intervention and judgment.Finally,a nonblind deconvolution algorithm was designed to achieve image deblurring based on the blur amount selection strategy and sparse prior.Results Experimental results showed that our method improves PSNR(Peak Signal-to-Noise Ratio)and SSIM(Structural Similarity Index)by an average of 4.6%and 7.3%,respectively,compared to existing methods.Conclusions Experimental results showed that the proposed method outperforms existing methods.Compared to existing methods,our method can better solve the problems of boundary ringing artifacts and detail information preservation in defocused image deblurring.
文摘Online defect visual inspection (ODVI) works while the object has to be static, otherwise the relative motion between camera and object will create motion blur in images. In order to implement ODVI in dynamic scene, it developes one blind motion deblurring method whose objective is to estimate blur kernel parameters precisely. In the proposed method, Radon transform on superpixels determinated the blur angle, and the autocorrelation function based on magnitude (AFM) of the preprocessed blurred image was utilized to identify the blur length. With the projection relationship discussed in this study, it will be unnecessary to rotate the blurred image or the axis. The proposed method is of high accuracy and robustness to noise, and it can somehow handle saturated pixels. To validate the proposed method, experiments have been carried out on synthetic images both in noise free and noisy situations. The results show that the method outperforms existing approaches. With the modified Richardson– Lucy deconvolution, it demonstrates that the proposed method is effective for ODVI in terms of subjective visual quality.
基金Partially Supported by National Natural Science Foundation of China(No.61173102)
文摘Motion deblurring is a basic problem in the field of image processing and analysis. This paper proposes a new method of single image blind deblurring which can be significant to kernel estimation and non-blind deconvolution. Experiments show that the details of the image destroy the structure of the kernel, especially when the blur kernel is large. So we extract the image structure with salient edges by the method based on RTV. In addition, the traditional method for motion blur kernel estimation based on sparse priors is conducive to gain a sparse blur kernel. But these priors do not ensure the continuity of blur kernel and sometimes induce noisy estimated results. Therefore we propose the kernel refinement method based on L0 to overcome the above shortcomings. In terms of non-blind deconvolution we adopt the L1/L2 regularization term. Compared with the traditional method, the method based on L1/L2 norm has better adaptability to image structure, and the constructed energy functional can better describe the sharp image. For this model, an effective algorithm is presented based on alternating minimization algorithm.
基金financially supported by the National Natural Science Foundation of China(Nos.21134006 and 51275504)Dutch Polymer Institute(DPI project:779)Science and Technology Development Plane of Jilin(No.20140519007JH)
文摘A general pre-processing procedure of the measured SAXS patterns for reducing the effect of beam stop and beam stop holder is described. A proper method for automatically choosing the regularization parameter is implemented. The method works out on the two-dimensional SAXS patterns. After deblurring, the corresponding two-dimensional patterns will be converted into one-dimensional integrated intensity distribution curves. We tested the program using both calculated artificial data and real experimental data such as polystyrene and poly（methyl methacrylate） latices. The deblurred results are satisfactory showing the effectiveness of the method. The deblurring process of a typical two-dimensional SAXS pattern using the Matlab based program can be completed in few seconds on normal personal computers.
基金supported by the National Natural Science Foundation of China(Grant No.51978582).
文摘High-resolution line scan cameras with wide-angle lenses are highly accurate and efficient for tunnel detection.However,due to the curvature of the tunnel,there are variations in object distance that exceed the depth of field of the lens,resulting in uneven defocus blur in the captured images.This can significantly affect the accuracy of defect recognition.While existing deblurring algorithms can improve image quality,they often prioritize results over inference time,which is not ideal for high-speed tunnel image acquisition.To address this issue,we developed a lightweight tunnel structure defect deblurring network(TSDDNet)for curved-tunnel line scanning with wide-angle lenses.Our method employs an innovative progressive structure that balances network depth and feature breadth to simultaneously achieve good performance and short inference time.The proposed depthwise ResBlocks significantly improves the parameter efficiency of the network.Additionally,the proposed feature refinement block captures the structurally similar features to enhance the image details,increasing the peak signal-to-noise ratio(PSNR).A raw dataset containing tunnel blur images was created using a high-resolution line scan camera and used to train and test our model.TSDDNet achieved a PSNR of 26.82 dB and a structural similarity index measure of 0.888,while using one-third of the parameters of comparable alternatives.Moreover,our method exhibited a higher computational speed than that of conventional methods,with inference times of 8.82 ms for a single 512×512 pixel image patch and 227.22 ms for completely processing a 2048×2560 pixel image.The test results indicated that the structural scalability of the network allows it to accommodate large inputs,making it effective for high-resolution images.
基金We acknowledge the support from the research grants No.E2RC5901 and No.E3KW5902.
文摘When a facial image is blurred,it significantly affects high-level vision tasks such as face recognition.The purpose of facial image deblurring is to recover a clear image from a blurry input image,which can improve the recognition accuracy,etc.However,general deblurring methods do not perform well on facial images.Therefore,some face deblurring methods have been proposed to improve performance by adding semantic or structural information as specific priors according to the characteristics of the facial images.In this paper,we survey and summarize recently published methods for facial image deblurring,most of which are based on deep learning.First,we provide a brief introduction to the modeling of image blurring.Next,we summarize face deblurring methods into two categories:model-based methods and deep learning-based methods.Furthermore,we summarize the datasets,loss functions,and performance evaluation metrics commonly used in the neural network training process.We show the performance of classical methods on these datasets and metrics and provide a brief discussion on the differences between model-based and learning-based methods.Finally,we discuss the current challenges and possible future research directions.
基金supported by the National Natural Science Foundation of China(No.12202476).
文摘In the PSP(Pressure-Sensitive Paint),image deblurring is essential due to factors such as prolonged camera exposure times and highmodel velocities,which can lead to significant image blurring.Conventional deblurring methods applied to PSP images often suffer from limited accuracy and require extensive computational resources.To address these issues,this study proposes a deep learning-based approach tailored for PSP image deblurring.Considering that PSP applications primarily involve the accurate pressure measurements of complex geometries,the images captured under such conditions exhibit distinctive non-uniform motion blur,presenting challenges for standard deep learning models utilizing convolutional or attention-based techniques.In this paper,we introduce a novel deblurring architecture featuring multiple DAAM(Deformable Ack Attention Module).These modules provide enhanced flexibility for end-to-end deblurring,leveraging irregular convolution operations for efficient feature extraction while employing attention mechanisms interpreted as multiple 1×1 convolutions,subsequently reassembled to enhance performance.Furthermore,we incorporate a RSC(Residual Shortcut Convolution)module for initial feature processing,aimed at reducing redundant computations and improving the learning capacity for representative shallow features.To preserve critical spatial information during upsampling and downsampling,we replace conventional convolutions with wt(Haar wavelet downsampling)and dysample(Upsampling by Dynamic Sampling).This modification significantly enhances high-precision image reconstruction.By integrating these advanced modules within an encoder-decoder framework,we present the DFDNet(Deformable Fusion Deblurring Network)for image blur removal,providing robust technical support for subsequent PSP data analysis.Experimental evaluations on the FY dataset demonstrate the superior performance of our model,achieving competitive results on the GOPRO and HIDE datasets.
