Photographs taken in daily life often became blurred due to shaking,out-of-focus,changes in depth of field,and movement of photographed objects.Aiming at this problem,a double-channel cyclic image deblurring method ba...Photographs taken in daily life often became blurred due to shaking,out-of-focus,changes in depth of field,and movement of photographed objects.Aiming at this problem,a double-channel cyclic image deblurring method based on edge features was proposed.Firstly,image edge gradient operator was introduced as a threshold based on the rule that the maximum value of the image edge gradient will decrease after the blurring process,making the blurred image be divided into two channels:edge channel and non-edge channel.Secondly,a double-channel loop iteration network was designed,where the edge gradient was used in the edge channel to sample the main edge structure and bilateral filtering was used in the non-edge channel to extract the detailed texture feature information.Finally,the feature information extracted from two channels was cyclically iterated to obtain a clear image using the deblurring model with maximum a posteriori probability.The experimental results showed that the image evaluation indexes obtained by the proposed deblurring model were superior to those of other algorithms,and the edge structure and texture details of the image were effectively recovered with better performance.展开更多
Traditional cameras inevitably suffer from motion blur when facing high-speed moving objects.Event cameras,as high temporal resolution bionic cameras,record intensity changes in an asynchronous manner,and their record...Traditional cameras inevitably suffer from motion blur when facing high-speed moving objects.Event cameras,as high temporal resolution bionic cameras,record intensity changes in an asynchronous manner,and their recorded high temporal resolution information can effectively solve the problem of time information loss in motion blur.Existing event-based deblurring methods still face challenges when facing high-speed moving objects.We conducted an in-depth study of the imaging principle of event cameras.We found that the event stream contains excessive noise.The valid information is sparse.Invalid event features hinder the expression of valid features due to the uncertainty of the global threshold.To address this problem,a denoising-based long and short-term memory module(DTM)is designed in this paper.The DTM suppressed the original event information by noise reduction process.Invalid features in the event stream and solves the problem of sparse valid information in the event stream,and it also combines with the long short-term memory module(LSTM),which further enhances the event feature information in the time scale.In addition,through the in-depth understanding of the unique characteristics of event features,it is found that the high-frequency information recorded by event features does not effectively guide the fusion feature deblurring process in the spatial-domain-based feature processing,and for this reason,we introduce the residual fast fourier transform module(RES-FFT)to further enhance the high-frequency characteristics of the fusion features by performing the feature extraction of the fusion features from the perspective of the frequency domain.Ultimately,our proposed event image fusion network based on event denoising and frequency domain feature enhancement(DNEFNET)achieved Peak Signal-to-Noise Ratio(PSNR)/Structural Similarity Index Measure(SSIM)scores of 35.55/0.972 on the GoPro dataset and 38.27/0.975 on the REBlur dataset,achieving the state of the art(SOTA)effect.展开更多
In this paper, we propose a novel shear gradient operator by combining the shear and gradient operators. The shear gradient operator performs well to capture diverse directional information in the image gradient domai...In this paper, we propose a novel shear gradient operator by combining the shear and gradient operators. The shear gradient operator performs well to capture diverse directional information in the image gradient domain. Based on the shear gradient operator, we extend the total variation(TV) norm to the shear total variation(STV) norm by adding two shear gradient terms. Subsequently, we introduce a shear total variation deblurring model. Experimental results are provided to validate the ability of the STV norm to capture the detailed information. Leveraging the Block Circulant with Circulant Blocks(BCCB) structure of the shear gradient matrices, the alternating direction method of multipliers(ADMM) algorithm can be used to solve the proposed model efficiently. Numerous experiments are presented to verify the performance of our algorithm for non-blind image deblurring.展开更多
In this paper,in order to reduce the energy leakage caused by the discretized representation in sparse channel estimation for Orthogonal Frequency Division Multiplexing(OFDM)systems,we systematically have analyzed the...In this paper,in order to reduce the energy leakage caused by the discretized representation in sparse channel estimation for Orthogonal Frequency Division Multiplexing(OFDM)systems,we systematically have analyzed the optimal locations of atoms with discrete delays for each path reconstruction from the perspective of linear fitting theory.Then,we have investigated the adverse effects of the non-ideal inner product function on the iteration in one of the most widely used channel estimation method,Orthogonal Matching Pursuit(OMP).The study shows that the distance between the selected atoms for each path in OMP can be larger than the sampling interval,which prevents OMP-based methods from achieving better performance.To overcome this drawback,the image deblurring-based channel estimation method,in which the channel estimation problem is analogized to one-dimensional image deblurring,was proposed to improve the large compensation distance of traditional OMP.The advantage of the proposed method was validated by the results of numerical simulation and sea trial data decoding.展开更多
In general, there is a demand for real-time processing of mass quantity remote sensing images. However, the task is not only data-intensive but also computating-intensive. Distributed processing is a hot topic in remo...In general, there is a demand for real-time processing of mass quantity remote sensing images. However, the task is not only data-intensive but also computating-intensive. Distributed processing is a hot topic in remote sensing processing and image deblurring is also one of the most important needs. In order to satisfy the demand for quick proc- essing and deblurring of mass quantity satellite images, we developed a distributed, grid computation-based platform as well as a corresponding middleware for grid computation. Both a constrained power spectrum equalization algorithm and effective block processing measures, which can avoid boundary effect, were applied during the processing. The re- sult is satisfactory since computation efficiency and visual effect were greatly improved. It can be concluded that the technology of spatial information grids is effective for mass quantity remote sensing image processing.展开更多
In this paper,we propose a shear high-order gradient(SHOG)operator by combining the shear operator and high-order gradient(HOG)operator.Compared with the HOG operator,the proposed SHOG operator can incorporate more di...In this paper,we propose a shear high-order gradient(SHOG)operator by combining the shear operator and high-order gradient(HOG)operator.Compared with the HOG operator,the proposed SHOG operator can incorporate more directionality and detect more abundant edge information.Based on the SHOG operator,we extend the total variation(TV)norm to shear high-order total variation(SHOTV),and then propose a SHOTV deblurring model.We also study some properties of the SHOG operator,and show that the SHOG matrices are Block Circulant with Circulant Blocks(BCCB)when the shear angle isπ/4.The proposed model is solved efficiently by the alternating direction method of multipliers(ADMM).Experimental results demonstrate that the proposed method outperforms some state-of-the-art non-blind deblurring methods in both objective and perceptual quality.展开更多
Images are frequently affected because of blurring,and data loss occurred by sampling and noise occurrence.The images are getting blurred because of object movement in the scenario,atmospheric misrepresentations,and o...Images are frequently affected because of blurring,and data loss occurred by sampling and noise occurrence.The images are getting blurred because of object movement in the scenario,atmospheric misrepresentations,and optical aberrations.The main objective of image restoration is to evaluate the original image from the corrupted data.To overcome this issue,the multiobjective reptile search algorithm is proposed for performing an effective image deblurring and restoration(MORSA-IDR).The proposed MORSA is used in two different processes such as threshold and kernel parameter calculation.In that,threshold values are used for detecting and replacing the noisy pixel removal using deep residual network,and estimation of kernel is performed for deblurring the images.The main objective of the proposed MORSA-IDR is to enhance the process of deblurring for recovering low-level contextual information.The MORSA-IDR is evaluated using peak signal noise ratio(PSNR)and structural similarity index.The existing researches such as enhanced local maximum intensity(ELMI)prior and deep unrolling for blind deblurring(DUBLID)are used to evaluate the MORSA-IDR.The PSNR of MORSA-IDR for image 6 is 30.98 dB,which is high when compared with the ELMI and DUBLID.展开更多
When a facial image is blurred,it significantly affects high-level vision tasks such as face recognition.The purpose of facial image deblurring is to recover a clear image from a blurry input image,which can improve t...When a facial image is blurred,it significantly affects high-level vision tasks such as face recognition.The purpose of facial image deblurring is to recover a clear image from a blurry input image,which can improve the recognition accuracy,etc.However,general deblurring methods do not perform well on facial images.Therefore,some face deblurring methods have been proposed to improve performance by adding semantic or structural information as specific priors according to the characteristics of the facial images.In this paper,we survey and summarize recently published methods for facial image deblurring,most of which are based on deep learning.First,we provide a brief introduction to the modeling of image blurring.Next,we summarize face deblurring methods into two categories:model-based methods and deep learning-based methods.Furthermore,we summarize the datasets,loss functions,and performance evaluation metrics commonly used in the neural network training process.We show the performance of classical methods on these datasets and metrics and provide a brief discussion on the differences between model-based and learning-based methods.Finally,we discuss the current challenges and possible future research directions.展开更多
Scanning electron microscopy(SEM)is a crucial tool in the field of materials science,providing valuable insightsinto the microstructural characteristics of materials.Unfortunately,SEM images often suffer from blurrine...Scanning electron microscopy(SEM)is a crucial tool in the field of materials science,providing valuable insightsinto the microstructural characteristics of materials.Unfortunately,SEM images often suffer from blurrinesscaused by improper hardware calibration or imaging automation errors,which present challenges in analyzingand interpretingmaterial characteristics.Consequently,rectifying the blurring of these images assumes paramountsignificance to enable subsequent analysis.To address this issue,we introduce a Material Images DeblurringNetwork(MIDNet)built upon the foundation of the Nonlinear Activation Free Network(NAFNet).MIDNetis meticulously tailored to address the blurring in images capturing the microstructure of materials.The keycontributions include enhancing the NAFNet architecture for better feature extraction and representation,integratinga novel soft attention mechanism to uncover important correlations between encoder and decoder,andintroducing newmulti-loss functions to improve training effectiveness and overallmodel performance.We conducta comprehensive set of experiments utilizing the material blurry dataset and compare them to several state-of-theartdeblurring methods.The experimental results demonstrate the applicability and effectiveness of MIDNet in thedomain of deblurring material microstructure images,with a PSNR(Peak Signal-to-Noise Ratio)reaching 35.26 dBand an SSIM(Structural Similarity)of 0.946.Our dataset is available at:https://github.com/woshigui/MIDNet.展开更多
In the PSP(Pressure-Sensitive Paint),image deblurring is essential due to factors such as prolonged camera exposure times and highmodel velocities,which can lead to significant image blurring.Conventional deblurring m...In the PSP(Pressure-Sensitive Paint),image deblurring is essential due to factors such as prolonged camera exposure times and highmodel velocities,which can lead to significant image blurring.Conventional deblurring methods applied to PSP images often suffer from limited accuracy and require extensive computational resources.To address these issues,this study proposes a deep learning-based approach tailored for PSP image deblurring.Considering that PSP applications primarily involve the accurate pressure measurements of complex geometries,the images captured under such conditions exhibit distinctive non-uniform motion blur,presenting challenges for standard deep learning models utilizing convolutional or attention-based techniques.In this paper,we introduce a novel deblurring architecture featuring multiple DAAM(Deformable Ack Attention Module).These modules provide enhanced flexibility for end-to-end deblurring,leveraging irregular convolution operations for efficient feature extraction while employing attention mechanisms interpreted as multiple 1×1 convolutions,subsequently reassembled to enhance performance.Furthermore,we incorporate a RSC(Residual Shortcut Convolution)module for initial feature processing,aimed at reducing redundant computations and improving the learning capacity for representative shallow features.To preserve critical spatial information during upsampling and downsampling,we replace conventional convolutions with wt(Haar wavelet downsampling)and dysample(Upsampling by Dynamic Sampling).This modification significantly enhances high-precision image reconstruction.By integrating these advanced modules within an encoder-decoder framework,we present the DFDNet(Deformable Fusion Deblurring Network)for image blur removal,providing robust technical support for subsequent PSP data analysis.Experimental evaluations on the FY dataset demonstrate the superior performance of our model,achieving competitive results on the GOPRO and HIDE datasets.展开更多
Non-blind deblurring is crucial in image restoration.While most previous works assume that the exact blurring kernel is known,this is often not the case in prac-tice.The blurring kernel is most likely estimated by a b...Non-blind deblurring is crucial in image restoration.While most previous works assume that the exact blurring kernel is known,this is often not the case in prac-tice.The blurring kernel is most likely estimated by a blind deblurring method and is not error-free.In this work,we incorporate a kernel error term into an advanced non-blind deblurring method to recover the clear image with an inaccurately estimated kernel.Based on the celebrated principle of Maximum Entropy on the Mean(MEM),the regularization at the level of the probability distribution of images is carefully com-bined with the classical total variation regularizer at the level of image/kernel.Exten-sive experiments show clearly the effectiveness of the proposed method in the pres-ence of kernel error.As a traditional method,the proposed method is even better than some of the state-of-the-art deep-learning-based methods.We also demonstrate the potential of combining the MEM framework with classical regularization approaches in image deblurring,which is extremely inspiring for other related works.展开更多
Blind deblurring for color images has long been a challenging computer vision task.The intrinsic color structures within image channels have typically been disregarded in many excellent works.We investigate employing ...Blind deblurring for color images has long been a challenging computer vision task.The intrinsic color structures within image channels have typically been disregarded in many excellent works.We investigate employing regularizations in the hue,saturation,and value(HSV)color space via the quaternion framework in order to better retain the internal relationship among the multiple channels and reduce color distortions and color artifacts.We observe that a geometric spatial-feature prior utilized in the intermediate latent image successfully enhances the kernel accuracy for the blind deblurring variational models,preserving the salient edges while decreasing the unfavorable structures.Motivated by this,we develop a saturation-value geometric spatial-feature prior in the HSV color space via the quaternion framework for blind color image deblurring,which facilitates blur kernel estimation.An alternating optimization strategy combined with a primal-dual projected gradient method can effectively solve this novel proposed model.Extensive experimental results show that our model outperforms state-of-the-art methods in blind color image deblurring by a wide margin,demonstrating the effectiveness of the proposed model.展开更多
Texture extract from digital aerial image is widely used in three-dimensional city modeling to generate “photo-realistic” views. In this paper, a method based on reforming “Steep edge” curve, which clearly explain...Texture extract from digital aerial image is widely used in three-dimensional city modeling to generate “photo-realistic” views. In this paper, a method based on reforming “Steep edge” curve, which clearly explains how the diffraction of the sunlight makes digital aerial image blurring, is proposed to deblur the texture extraction from digital aerial image, and the experiment shows a good result in visualization and automation.展开更多
For the backward diffusion equation,a stable discrete energy regularization algorithm is proposed.Existence and uniqueness of the numerical solution are given.Moreover,the error between the solution of the given backw...For the backward diffusion equation,a stable discrete energy regularization algorithm is proposed.Existence and uniqueness of the numerical solution are given.Moreover,the error between the solution of the given backward diffusion equation and the numerical solution via the regularization method can be estimated.Some numerical experiments illustrate the efficiency of the method,and its application in image deblurring.展开更多
Motion deblurring is a basic problem in the field of image processing and analysis. This paper proposes a new method of single image blind deblurring which can be significant to kernel estimation and non-blind deconvo...Motion deblurring is a basic problem in the field of image processing and analysis. This paper proposes a new method of single image blind deblurring which can be significant to kernel estimation and non-blind deconvolution. Experiments show that the details of the image destroy the structure of the kernel, especially when the blur kernel is large. So we extract the image structure with salient edges by the method based on RTV. In addition, the traditional method for motion blur kernel estimation based on sparse priors is conducive to gain a sparse blur kernel. But these priors do not ensure the continuity of blur kernel and sometimes induce noisy estimated results. Therefore we propose the kernel refinement method based on L0 to overcome the above shortcomings. In terms of non-blind deconvolution we adopt the L1/L2 regularization term. Compared with the traditional method, the method based on L1/L2 norm has better adaptability to image structure, and the constructed energy functional can better describe the sharp image. For this model, an effective algorithm is presented based on alternating minimization algorithm.展开更多
High-resolution line scan cameras with wide-angle lenses are highly accurate and efficient for tunnel detection.However,due to the curvature of the tunnel,there are variations in object distance that exceed the depth ...High-resolution line scan cameras with wide-angle lenses are highly accurate and efficient for tunnel detection.However,due to the curvature of the tunnel,there are variations in object distance that exceed the depth of field of the lens,resulting in uneven defocus blur in the captured images.This can significantly affect the accuracy of defect recognition.While existing deblurring algorithms can improve image quality,they often prioritize results over inference time,which is not ideal for high-speed tunnel image acquisition.To address this issue,we developed a lightweight tunnel structure defect deblurring network(TSDDNet)for curved-tunnel line scanning with wide-angle lenses.Our method employs an innovative progressive structure that balances network depth and feature breadth to simultaneously achieve good performance and short inference time.The proposed depthwise ResBlocks significantly improves the parameter efficiency of the network.Additionally,the proposed feature refinement block captures the structurally similar features to enhance the image details,increasing the peak signal-to-noise ratio(PSNR).A raw dataset containing tunnel blur images was created using a high-resolution line scan camera and used to train and test our model.TSDDNet achieved a PSNR of 26.82 dB and a structural similarity index measure of 0.888,while using one-third of the parameters of comparable alternatives.Moreover,our method exhibited a higher computational speed than that of conventional methods,with inference times of 8.82 ms for a single 512×512 pixel image patch and 227.22 ms for completely processing a 2048×2560 pixel image.The test results indicated that the structural scalability of the network allows it to accommodate large inputs,making it effective for high-resolution images.展开更多
Motion deblurring is one of the basic problems inthe field of image processing. This paper summarizes the mathematical basis of the previous work and presents a deblurringmethod that can improve the estimation of the ...Motion deblurring is one of the basic problems inthe field of image processing. This paper summarizes the mathematical basis of the previous work and presents a deblurringmethod that can improve the estimation of the motion blurkernel and obtain a better result than the traditional methods.Experiments show the motion blur kernel loses some important and useful properties during the estimation of the kernel which may cause a bad estimation and increase the ringingartifacts. Considering that the kernel is provided by the motion of the imaging sensor during the exposure and that the kernel shows the trace of the motion, this paper ensures the physical meaning of the kernel such as the continuity and the center of thekernel during the iterative process. By adding a post process to the estimation of the motion blur kernel, we remove some discrete points and make use of the centralizationof the kernel in order to accurate the estimation. The experiment shows the existence of the post process improves the effect of the estimation of the kernel and provides a better result with the clear edges.展开更多
Improving the spatial resolution of a fluorescence microscope has been an ongoing challenge in the imaging community.To address this challenge,a variety of approaches have been taken,ranging from instrumentation devel...Improving the spatial resolution of a fluorescence microscope has been an ongoing challenge in the imaging community.To address this challenge,a variety of approaches have been taken,ranging from instrumentation development to image postprocessing.An example of the latter is deconvolution,where images are numerically deblurred based on a knowledge of the microscope point spread function.However,deconvolution can easily lead to noise-amplification artifacts.Deblurring by postprocessing can also lead to negativities or fail to conserve local linearity between sample and image.We describe here a simple image deblurring algorithm based on pixel reassignment that inherently avoids such artifacts and can be applied to general microscope modalities and fluorophore types.Our algorithm helps distinguish nearby fluorophores,even when these are separated by distances smaller than the conventional resolution limit,helping facilitate,for example,the application of single-molecule localization microscopy in dense samples.We demonstrate the versatility and performance of our algorithm under a variety of imaging conditions.展开更多
Deblurring images of dynamic scenes is a challenging task because blurring occurs due to a combination of many factors.In recent years,the use of multi-scale pyramid methods to recover high-resolution sharp images has...Deblurring images of dynamic scenes is a challenging task because blurring occurs due to a combination of many factors.In recent years,the use of multi-scale pyramid methods to recover high-resolution sharp images has been extensively studied.We have made improvements to the lack of detail recovery in the cascade structure through a network using progressive integration of data streams.Our new multi-scale structure and edge feature perception design deals with changes in blurring at different spatial scales and enhances the sensitivity of the network to blurred edges.The coarse-to-fine architecture restores the image structure,first performing global adjustments,and then performing local refinement.In this way,not only is global correlation considered,but also residual information is used to significantly improve image restoration and enhance texture details.Experimental results show quantitative and qualitative improvements over existing methods.展开更多
基金supported in part by Natural Science Research Foundation of Shanxi Province(Nos.20210302123019,20210302124195,20210302124212,20210302123189)。
文摘Photographs taken in daily life often became blurred due to shaking,out-of-focus,changes in depth of field,and movement of photographed objects.Aiming at this problem,a double-channel cyclic image deblurring method based on edge features was proposed.Firstly,image edge gradient operator was introduced as a threshold based on the rule that the maximum value of the image edge gradient will decrease after the blurring process,making the blurred image be divided into two channels:edge channel and non-edge channel.Secondly,a double-channel loop iteration network was designed,where the edge gradient was used in the edge channel to sample the main edge structure and bilateral filtering was used in the non-edge channel to extract the detailed texture feature information.Finally,the feature information extracted from two channels was cyclically iterated to obtain a clear image using the deblurring model with maximum a posteriori probability.The experimental results showed that the image evaluation indexes obtained by the proposed deblurring model were superior to those of other algorithms,and the edge structure and texture details of the image were effectively recovered with better performance.
文摘Traditional cameras inevitably suffer from motion blur when facing high-speed moving objects.Event cameras,as high temporal resolution bionic cameras,record intensity changes in an asynchronous manner,and their recorded high temporal resolution information can effectively solve the problem of time information loss in motion blur.Existing event-based deblurring methods still face challenges when facing high-speed moving objects.We conducted an in-depth study of the imaging principle of event cameras.We found that the event stream contains excessive noise.The valid information is sparse.Invalid event features hinder the expression of valid features due to the uncertainty of the global threshold.To address this problem,a denoising-based long and short-term memory module(DTM)is designed in this paper.The DTM suppressed the original event information by noise reduction process.Invalid features in the event stream and solves the problem of sparse valid information in the event stream,and it also combines with the long short-term memory module(LSTM),which further enhances the event feature information in the time scale.In addition,through the in-depth understanding of the unique characteristics of event features,it is found that the high-frequency information recorded by event features does not effectively guide the fusion feature deblurring process in the spatial-domain-based feature processing,and for this reason,we introduce the residual fast fourier transform module(RES-FFT)to further enhance the high-frequency characteristics of the fusion features by performing the feature extraction of the fusion features from the perspective of the frequency domain.Ultimately,our proposed event image fusion network based on event denoising and frequency domain feature enhancement(DNEFNET)achieved Peak Signal-to-Noise Ratio(PSNR)/Structural Similarity Index Measure(SSIM)scores of 35.55/0.972 on the GoPro dataset and 38.27/0.975 on the REBlur dataset,achieving the state of the art(SOTA)effect.
基金Supported by Open Fund of Key Laboratory of Anhui Higher Education Institutes (CS2021-07)the National Natural Science Foundation of China (61701004)Outstanding Young Talents Support Program of Anhui Province (gxyq2021178)。
文摘In this paper, we propose a novel shear gradient operator by combining the shear and gradient operators. The shear gradient operator performs well to capture diverse directional information in the image gradient domain. Based on the shear gradient operator, we extend the total variation(TV) norm to the shear total variation(STV) norm by adding two shear gradient terms. Subsequently, we introduce a shear total variation deblurring model. Experimental results are provided to validate the ability of the STV norm to capture the detailed information. Leveraging the Block Circulant with Circulant Blocks(BCCB) structure of the shear gradient matrices, the alternating direction method of multipliers(ADMM) algorithm can be used to solve the proposed model efficiently. Numerous experiments are presented to verify the performance of our algorithm for non-blind image deblurring.
基金supported by the Fundamental Research Funds for the Central Universities under Grant 20720200092the National Natural Science Foundation of China under Grant 62171394,U21A20444,61771152,62071402+2 种基金the Sustainable Funding of the Key Laboratory of Underwater Acoustic Technology under Grant JCKYS2022604SSJS001Key Laboratory of Universal Wireless Communications(BUPT)Ministry of Education,P.R.China under Grant KFKT-2022103.
文摘In this paper,in order to reduce the energy leakage caused by the discretized representation in sparse channel estimation for Orthogonal Frequency Division Multiplexing(OFDM)systems,we systematically have analyzed the optimal locations of atoms with discrete delays for each path reconstruction from the perspective of linear fitting theory.Then,we have investigated the adverse effects of the non-ideal inner product function on the iteration in one of the most widely used channel estimation method,Orthogonal Matching Pursuit(OMP).The study shows that the distance between the selected atoms for each path in OMP can be larger than the sampling interval,which prevents OMP-based methods from achieving better performance.To overcome this drawback,the image deblurring-based channel estimation method,in which the channel estimation problem is analogized to one-dimensional image deblurring,was proposed to improve the large compensation distance of traditional OMP.The advantage of the proposed method was validated by the results of numerical simulation and sea trial data decoding.
基金Project 2003AA135010 supported by the National High Technology Research and Development Program of China
文摘In general, there is a demand for real-time processing of mass quantity remote sensing images. However, the task is not only data-intensive but also computating-intensive. Distributed processing is a hot topic in remote sensing processing and image deblurring is also one of the most important needs. In order to satisfy the demand for quick proc- essing and deblurring of mass quantity satellite images, we developed a distributed, grid computation-based platform as well as a corresponding middleware for grid computation. Both a constrained power spectrum equalization algorithm and effective block processing measures, which can avoid boundary effect, were applied during the processing. The re- sult is satisfactory since computation efficiency and visual effect were greatly improved. It can be concluded that the technology of spatial information grids is effective for mass quantity remote sensing image processing.
基金Supported by the National Natural Science Foundation of China(61701004)Outstanding Young Talents Support Program of Anhui Province(gxyq2021178)+1 种基金Open Fund of Key Laboratory of Anhui Higher Education Institutes(CS2021-07)Program of University Mathematics Teaching Research and Development Center(CMC20200301)。
文摘In this paper,we propose a shear high-order gradient(SHOG)operator by combining the shear operator and high-order gradient(HOG)operator.Compared with the HOG operator,the proposed SHOG operator can incorporate more directionality and detect more abundant edge information.Based on the SHOG operator,we extend the total variation(TV)norm to shear high-order total variation(SHOTV),and then propose a SHOTV deblurring model.We also study some properties of the SHOG operator,and show that the SHOG matrices are Block Circulant with Circulant Blocks(BCCB)when the shear angle isπ/4.The proposed model is solved efficiently by the alternating direction method of multipliers(ADMM).Experimental results demonstrate that the proposed method outperforms some state-of-the-art non-blind deblurring methods in both objective and perceptual quality.
文摘Images are frequently affected because of blurring,and data loss occurred by sampling and noise occurrence.The images are getting blurred because of object movement in the scenario,atmospheric misrepresentations,and optical aberrations.The main objective of image restoration is to evaluate the original image from the corrupted data.To overcome this issue,the multiobjective reptile search algorithm is proposed for performing an effective image deblurring and restoration(MORSA-IDR).The proposed MORSA is used in two different processes such as threshold and kernel parameter calculation.In that,threshold values are used for detecting and replacing the noisy pixel removal using deep residual network,and estimation of kernel is performed for deblurring the images.The main objective of the proposed MORSA-IDR is to enhance the process of deblurring for recovering low-level contextual information.The MORSA-IDR is evaluated using peak signal noise ratio(PSNR)and structural similarity index.The existing researches such as enhanced local maximum intensity(ELMI)prior and deep unrolling for blind deblurring(DUBLID)are used to evaluate the MORSA-IDR.The PSNR of MORSA-IDR for image 6 is 30.98 dB,which is high when compared with the ELMI and DUBLID.
基金We acknowledge the support from the research grants No.E2RC5901 and No.E3KW5902.
文摘When a facial image is blurred,it significantly affects high-level vision tasks such as face recognition.The purpose of facial image deblurring is to recover a clear image from a blurry input image,which can improve the recognition accuracy,etc.However,general deblurring methods do not perform well on facial images.Therefore,some face deblurring methods have been proposed to improve performance by adding semantic or structural information as specific priors according to the characteristics of the facial images.In this paper,we survey and summarize recently published methods for facial image deblurring,most of which are based on deep learning.First,we provide a brief introduction to the modeling of image blurring.Next,we summarize face deblurring methods into two categories:model-based methods and deep learning-based methods.Furthermore,we summarize the datasets,loss functions,and performance evaluation metrics commonly used in the neural network training process.We show the performance of classical methods on these datasets and metrics and provide a brief discussion on the differences between model-based and learning-based methods.Finally,we discuss the current challenges and possible future research directions.
基金the National Key R&D Program of China(GrantNo.2021YFA1601104)National KeyR&DProgram of China(GrantNo.2022YFA16038004)+1 种基金National Key R&D Program of China(Grant No.2022YFA16038002)National Science and Technology Major Project of China(No.J2019-VI-0004-0117).
文摘Scanning electron microscopy(SEM)is a crucial tool in the field of materials science,providing valuable insightsinto the microstructural characteristics of materials.Unfortunately,SEM images often suffer from blurrinesscaused by improper hardware calibration or imaging automation errors,which present challenges in analyzingand interpretingmaterial characteristics.Consequently,rectifying the blurring of these images assumes paramountsignificance to enable subsequent analysis.To address this issue,we introduce a Material Images DeblurringNetwork(MIDNet)built upon the foundation of the Nonlinear Activation Free Network(NAFNet).MIDNetis meticulously tailored to address the blurring in images capturing the microstructure of materials.The keycontributions include enhancing the NAFNet architecture for better feature extraction and representation,integratinga novel soft attention mechanism to uncover important correlations between encoder and decoder,andintroducing newmulti-loss functions to improve training effectiveness and overallmodel performance.We conducta comprehensive set of experiments utilizing the material blurry dataset and compare them to several state-of-theartdeblurring methods.The experimental results demonstrate the applicability and effectiveness of MIDNet in thedomain of deblurring material microstructure images,with a PSNR(Peak Signal-to-Noise Ratio)reaching 35.26 dBand an SSIM(Structural Similarity)of 0.946.Our dataset is available at:https://github.com/woshigui/MIDNet.
基金supported by the National Natural Science Foundation of China(No.12202476).
文摘In the PSP(Pressure-Sensitive Paint),image deblurring is essential due to factors such as prolonged camera exposure times and highmodel velocities,which can lead to significant image blurring.Conventional deblurring methods applied to PSP images often suffer from limited accuracy and require extensive computational resources.To address these issues,this study proposes a deep learning-based approach tailored for PSP image deblurring.Considering that PSP applications primarily involve the accurate pressure measurements of complex geometries,the images captured under such conditions exhibit distinctive non-uniform motion blur,presenting challenges for standard deep learning models utilizing convolutional or attention-based techniques.In this paper,we introduce a novel deblurring architecture featuring multiple DAAM(Deformable Ack Attention Module).These modules provide enhanced flexibility for end-to-end deblurring,leveraging irregular convolution operations for efficient feature extraction while employing attention mechanisms interpreted as multiple 1×1 convolutions,subsequently reassembled to enhance performance.Furthermore,we incorporate a RSC(Residual Shortcut Convolution)module for initial feature processing,aimed at reducing redundant computations and improving the learning capacity for representative shallow features.To preserve critical spatial information during upsampling and downsampling,we replace conventional convolutions with wt(Haar wavelet downsampling)and dysample(Upsampling by Dynamic Sampling).This modification significantly enhances high-precision image reconstruction.By integrating these advanced modules within an encoder-decoder framework,we present the DFDNet(Deformable Fusion Deblurring Network)for image blur removal,providing robust technical support for subsequent PSP data analysis.Experimental evaluations on the FY dataset demonstrate the superior performance of our model,achieving competitive results on the GOPRO and HIDE datasets.
基金supported in part by the National Key R&D Programof China under Grant 2021YFE0203700Grant NSFC/RGCN CUHK 415/19,Grant ITFMHP/038/20,Grant RGC 14300219,14302920,14301121CUHK Direct Grant for Research under Grant 4053405,4053460.
文摘Non-blind deblurring is crucial in image restoration.While most previous works assume that the exact blurring kernel is known,this is often not the case in prac-tice.The blurring kernel is most likely estimated by a blind deblurring method and is not error-free.In this work,we incorporate a kernel error term into an advanced non-blind deblurring method to recover the clear image with an inaccurately estimated kernel.Based on the celebrated principle of Maximum Entropy on the Mean(MEM),the regularization at the level of the probability distribution of images is carefully com-bined with the classical total variation regularizer at the level of image/kernel.Exten-sive experiments show clearly the effectiveness of the proposed method in the pres-ence of kernel error.As a traditional method,the proposed method is even better than some of the state-of-the-art deep-learning-based methods.We also demonstrate the potential of combining the MEM framework with classical regularization approaches in image deblurring,which is extremely inspiring for other related works.
基金the National Key R&D Program of China under Grant 2021YFE0203700Grant NSFC/RGC N CUHK 415/19,Grant ITF MHP/038/20,Grant CRF 8730063Grant RGC 14300219,14302920,14301121,CUHK Direct Grant for Research.
文摘Blind deblurring for color images has long been a challenging computer vision task.The intrinsic color structures within image channels have typically been disregarded in many excellent works.We investigate employing regularizations in the hue,saturation,and value(HSV)color space via the quaternion framework in order to better retain the internal relationship among the multiple channels and reduce color distortions and color artifacts.We observe that a geometric spatial-feature prior utilized in the intermediate latent image successfully enhances the kernel accuracy for the blind deblurring variational models,preserving the salient edges while decreasing the unfavorable structures.Motivated by this,we develop a saturation-value geometric spatial-feature prior in the HSV color space via the quaternion framework for blind color image deblurring,which facilitates blur kernel estimation.An alternating optimization strategy combined with a primal-dual projected gradient method can effectively solve this novel proposed model.Extensive experimental results show that our model outperforms state-of-the-art methods in blind color image deblurring by a wide margin,demonstrating the effectiveness of the proposed model.
文摘Texture extract from digital aerial image is widely used in three-dimensional city modeling to generate “photo-realistic” views. In this paper, a method based on reforming “Steep edge” curve, which clearly explains how the diffraction of the sunlight makes digital aerial image blurring, is proposed to deblur the texture extraction from digital aerial image, and the experiment shows a good result in visualization and automation.
基金National Natural Science Foundation of China(No.10471073)。
文摘For the backward diffusion equation,a stable discrete energy regularization algorithm is proposed.Existence and uniqueness of the numerical solution are given.Moreover,the error between the solution of the given backward diffusion equation and the numerical solution via the regularization method can be estimated.Some numerical experiments illustrate the efficiency of the method,and its application in image deblurring.
基金Partially Supported by National Natural Science Foundation of China(No.61173102)
文摘Motion deblurring is a basic problem in the field of image processing and analysis. This paper proposes a new method of single image blind deblurring which can be significant to kernel estimation and non-blind deconvolution. Experiments show that the details of the image destroy the structure of the kernel, especially when the blur kernel is large. So we extract the image structure with salient edges by the method based on RTV. In addition, the traditional method for motion blur kernel estimation based on sparse priors is conducive to gain a sparse blur kernel. But these priors do not ensure the continuity of blur kernel and sometimes induce noisy estimated results. Therefore we propose the kernel refinement method based on L0 to overcome the above shortcomings. In terms of non-blind deconvolution we adopt the L1/L2 regularization term. Compared with the traditional method, the method based on L1/L2 norm has better adaptability to image structure, and the constructed energy functional can better describe the sharp image. For this model, an effective algorithm is presented based on alternating minimization algorithm.
基金supported by the National Natural Science Foundation of China(Grant No.51978582).
文摘High-resolution line scan cameras with wide-angle lenses are highly accurate and efficient for tunnel detection.However,due to the curvature of the tunnel,there are variations in object distance that exceed the depth of field of the lens,resulting in uneven defocus blur in the captured images.This can significantly affect the accuracy of defect recognition.While existing deblurring algorithms can improve image quality,they often prioritize results over inference time,which is not ideal for high-speed tunnel image acquisition.To address this issue,we developed a lightweight tunnel structure defect deblurring network(TSDDNet)for curved-tunnel line scanning with wide-angle lenses.Our method employs an innovative progressive structure that balances network depth and feature breadth to simultaneously achieve good performance and short inference time.The proposed depthwise ResBlocks significantly improves the parameter efficiency of the network.Additionally,the proposed feature refinement block captures the structurally similar features to enhance the image details,increasing the peak signal-to-noise ratio(PSNR).A raw dataset containing tunnel blur images was created using a high-resolution line scan camera and used to train and test our model.TSDDNet achieved a PSNR of 26.82 dB and a structural similarity index measure of 0.888,while using one-third of the parameters of comparable alternatives.Moreover,our method exhibited a higher computational speed than that of conventional methods,with inference times of 8.82 ms for a single 512×512 pixel image patch and 227.22 ms for completely processing a 2048×2560 pixel image.The test results indicated that the structural scalability of the network allows it to accommodate large inputs,making it effective for high-resolution images.
基金Supported by Liao Ning University Innovation Research and Training Program(No.201410141683)
文摘Motion deblurring is one of the basic problems inthe field of image processing. This paper summarizes the mathematical basis of the previous work and presents a deblurringmethod that can improve the estimation of the motion blurkernel and obtain a better result than the traditional methods.Experiments show the motion blur kernel loses some important and useful properties during the estimation of the kernel which may cause a bad estimation and increase the ringingartifacts. Considering that the kernel is provided by the motion of the imaging sensor during the exposure and that the kernel shows the trace of the motion, this paper ensures the physical meaning of the kernel such as the continuity and the center of thekernel during the iterative process. By adding a post process to the estimation of the motion blur kernel, we remove some discrete points and make use of the centralizationof the kernel in order to accurate the estimation. The experiment shows the existence of the post process improves the effect of the estimation of the kernel and provides a better result with the clear edges.
基金funded by the National Science Foundation(EEC-1647837,2215990)the National Institutes of Health(R01EB029171,R01NS116139).
文摘Improving the spatial resolution of a fluorescence microscope has been an ongoing challenge in the imaging community.To address this challenge,a variety of approaches have been taken,ranging from instrumentation development to image postprocessing.An example of the latter is deconvolution,where images are numerically deblurred based on a knowledge of the microscope point spread function.However,deconvolution can easily lead to noise-amplification artifacts.Deblurring by postprocessing can also lead to negativities or fail to conserve local linearity between sample and image.We describe here a simple image deblurring algorithm based on pixel reassignment that inherently avoids such artifacts and can be applied to general microscope modalities and fluorophore types.Our algorithm helps distinguish nearby fluorophores,even when these are separated by distances smaller than the conventional resolution limit,helping facilitate,for example,the application of single-molecule localization microscopy in dense samples.We demonstrate the versatility and performance of our algorithm under a variety of imaging conditions.
基金National Natural Science Foundation of China(61772319,62002200,61976125,61976124)Shandong Natural Science Foundation of China(ZR2017MF049)。
文摘Deblurring images of dynamic scenes is a challenging task because blurring occurs due to a combination of many factors.In recent years,the use of multi-scale pyramid methods to recover high-resolution sharp images has been extensively studied.We have made improvements to the lack of detail recovery in the cascade structure through a network using progressive integration of data streams.Our new multi-scale structure and edge feature perception design deals with changes in blurring at different spatial scales and enhances the sensitivity of the network to blurred edges.The coarse-to-fine architecture restores the image structure,first performing global adjustments,and then performing local refinement.In this way,not only is global correlation considered,but also residual information is used to significantly improve image restoration and enhance texture details.Experimental results show quantitative and qualitative improvements over existing methods.
