The internal flow fields within a three-dimensional inward-tunning combined inlet are extremely complex,especially during the engine mode transition,where the tunnel changes may impact the flow fields significantly.To...The internal flow fields within a three-dimensional inward-tunning combined inlet are extremely complex,especially during the engine mode transition,where the tunnel changes may impact the flow fields significantly.To develop an efficient flow field reconstruction model for this,we present an Improved Conditional Denoising Diffusion Generative Adversarial Network(ICDDGAN),which integrates Conditional Denoising Diffusion Probabilistic Models(CDDPMs)with Style GAN,and introduce a reconstruction discrimination mechanism and dynamic loss weight learning strategy.We establish the Mach number flow field dataset by numerical simulation at various backpressures for the mode transition process from turbine mode to ejector ramjet mode at Mach number 2.5.The proposed ICDDGAN model,given only sparse parameter information,can rapidly generate high-quality Mach number flow fields without a large number of samples for training.The results show that ICDDGAN is superior to CDDGAN in terms of training convergence and stability.Moreover,the interpolation and extrapolation test results during backpressure conditions show that ICDDGAN can accurately and quickly reconstruct Mach number fields at various tunnel slice shapes,with a Structural Similarity Index Measure(SSIM)of over 0.96 and a Mean-Square Error(MSE)of 0.035%to actual flow fields,reducing time costs by 7-8 orders of magnitude compared to Computational Fluid Dynamics(CFD)calculations.This can provide an efficient means for rapid computation of complex flow fields.展开更多
A high resolution range profile(HRRP) is a summation vector of the sub-echoes of the target scattering points acquired by a wide-band radar.Generally, HRRPs obtained in a noncooperative complex electromagnetic environ...A high resolution range profile(HRRP) is a summation vector of the sub-echoes of the target scattering points acquired by a wide-band radar.Generally, HRRPs obtained in a noncooperative complex electromagnetic environment are contaminated by strong noise.Effective pre-processing of the HRRP data can greatly improve the accuracy of target recognition.In this paper, a denoising and reconstruction method for HRRP is proposed based on a Modified Sparse Auto-Encoder, which is a representative non-linear model.To better reconstruct the HRRP, a sparse constraint is added to the proposed model and the sparse coefficient is calculated based on the intrinsic dimension of HRRP.The denoising of the HRRP is performed by adding random noise to the input HRRP data during the training process and fine-tuning the weight matrix through singular-value decomposition.The results of simulations showed that the proposed method can both reconstruct the signal with fidelity and suppress noise effectively, significantly outperforming other methods, especially in low Signal-to-Noise Ratio conditions.展开更多
Sparse representation models have been shown promising results for image denoising. However, conventional sparse representation-based models cannot obtain satisfactory estimations for sparse coefficients and the dicti...Sparse representation models have been shown promising results for image denoising. However, conventional sparse representation-based models cannot obtain satisfactory estimations for sparse coefficients and the dictionary. To address this weakness, in this paper, we propose a novel fractional-order sparse representation(FSR) model. Specifically, we cluster the image patches into K groups, and calculate the singular values for each clean/noisy patch pair in the wavelet domain. Then the uniform fractional-order parameters are learned for each cluster.Then a novel fractional-order sample space is constructed using adaptive fractional-order parameters in the wavelet domain to obtain more accurate sparse coefficients and dictionary for image denoising. Extensive experimental results show that the proposed model outperforms state-of-the-art sparse representation-based models and the block-matching and 3D filtering algorithm in terms of denoising performance and the computational efficiency.展开更多
Single nucletide polymorphism(SNP)is an important factor for the study of genetic variation in human families and animal and plant strains.Therefore,it is widely used in the study of population genetics and disease re...Single nucletide polymorphism(SNP)is an important factor for the study of genetic variation in human families and animal and plant strains.Therefore,it is widely used in the study of population genetics and disease related gene.In pharmacogenomics research,identifying the association between SNP site and drug is the key to clinical precision medication,therefore,a predictive model of SNP site and drug association based on denoising variational auto-encoder(DVAE-SVM)is proposed.Firstly,k-mer algorithm is used to construct the initial SNP site feature vector,meanwhile,MACCS molecular fingerprint is introduced to generate the feature vector of the drug module.Then,we use the DVAE to extract the effective features of the initial feature vector of the SNP site.Finally,the effective feature vector of the SNP site and the feature vector of the drug module are fused input to the support vector machines(SVM)to predict the relationship of SNP site and drug module.The results of five-fold cross-validation experiments indicate that the proposed algorithm performs better than random forest(RF)and logistic regression(LR)classification.Further experiments show that compared with the feature extraction algorithms of principal component analysis(PCA),denoising auto-encoder(DAE)and variational auto-encode(VAE),the proposed algorithm has better prediction results.展开更多
Motivated by local coordinate coding(LCC) theory in nonlinear manifold learning, a new image representation model called local sparse representation(LSR) for astronomical image denoising was proposed. Borrowing ideas ...Motivated by local coordinate coding(LCC) theory in nonlinear manifold learning, a new image representation model called local sparse representation(LSR) for astronomical image denoising was proposed. Borrowing ideas from surrogate function and applying the iterative shrinkage-thresholding algorithm(ISTA), an iterative shrinkage operator for LSR was derived. Meanwhile, a fast approximated LSR method by first performing a K-nearest-neighbor search and then solving a l1optimization problem was presented under the guarantee of denoising performance. In addition, the LSR model and adaptive dictionary learning were incorporated into a unified optimization framework, which explicitly established the inner connection of them. Such processing allows us to simultaneously update sparse coding vectors and the dictionary by alternating optimization method. The experimental results show that the proposed method is superior to the traditional denoising method and reaches state-of-the-art performance on astronomical image.展开更多
This paper proposes a denoising algorithm called truncated sparse decomposition （TSD） algorithm, which combines the advantage of the sparse decomposition with that of the minimum energy model truncation operation. E...This paper proposes a denoising algorithm called truncated sparse decomposition （TSD） algorithm, which combines the advantage of the sparse decomposition with that of the minimum energy model truncation operation. Experimental results on two real chaotic signals show that the TSD algorithm outperforms the recently reported denoising algorithmsnon-negative sparse coding and singular value decomposition based method.展开更多
Image denoising is a well-studied problem closely related to sparse coding. Noticing that the Laplacian distribution has a strong sparseness, we use Laplacian scale mixture to model sparse coefficients. With the obser...Image denoising is a well-studied problem closely related to sparse coding. Noticing that the Laplacian distribution has a strong sparseness, we use Laplacian scale mixture to model sparse coefficients. With the observation that prior information of an image is relevant to the estimation of sparse coefficients, we introduce the prior information into maximum a posteriori（MAP） estimation of sparse coefficients by an appropriate estimate of the probability density function. Extending to structured sparsity, a nonlocal image denoising model： Improved Simultaneous Sparse Coding with Laplacian Scale Mixture（ISSC-LSM） is proposed. The centering preprocessing, which admits biased-mean of sparse coefficients and saves expensive computation, is done firstly. By alternating minimization and learning an orthogonal PCA dictionary, an efficient algorithm with closed-form solutions is proposed. When applied to noise removal, our proposed ISSC-LSM can capture structured image features, and the adoption of image prior information leads to highly competitive denoising performance. Experimental results show that the proposed method often provides higher subjective and objective qualities than other competing approaches. Our method is most suitable for processing images with abundant self-repeating patterns by effectively suppressing undesirable artifacts while maintaining the textures and edges.展开更多
Rolling bearings are important central components in rotating machines, whose fault diagnosis is crucial in condition-based maintenance to reduce the complexity of different kinds of faults. To classify various rollin...Rolling bearings are important central components in rotating machines, whose fault diagnosis is crucial in condition-based maintenance to reduce the complexity of different kinds of faults. To classify various rolling bearing faults, a prognostic algorithm consisting of four phases was proposed. Since stacked denoising auto-encoder can be filtered, noise of large numbers of mechanical vibration signals was used for deep learning structure to extract the characteristics of the noise. Unsupervised pre-training method, which can greatly simplify the traditional manual extraction approach, was utilized to process the depth of the data automatically. Furthermore, the aggregation layer of stacked denoising auto-encoder(SDA) was proposed to get rid of gradient disappearance in deeper layers of network, mix superficial nodes’ expression with deeper layers, and avoid the insufficient express ability in deeper layers. Principal component analysis(PCA) was adopted to extract different features for classification. According to the experimental data of this method and from the comparison results, the proposed method of rolling bearing fault classification reached 97.02% of correct rate, suggesting a better performance than other algorithms.展开更多
Denoising of chaotic signal is a challenge work due to its wide-band and noise-like characteristics.The algorithm should make the denoised signal have a high signal to noise ratio and retain the chaotic characteristic...Denoising of chaotic signal is a challenge work due to its wide-band and noise-like characteristics.The algorithm should make the denoised signal have a high signal to noise ratio and retain the chaotic characteristics.We propose a denoising method of chaotic signals based on sparse decomposition and K-singular value decomposition(K-SVD)optimization.The observed signal is divided into segments and decomposed sparsely.The over-complete atomic library is constructed according to the differential equation of chaotic signals.The orthogonal matching pursuit algorithm is used to search the optimal matching atom.The atoms and coefficients are further processed to obtain the globally optimal atoms and coefficients by K-SVD.The simulation results show that the denoised signals have a higher signal to noise ratio and better preserve the chaotic characteristics.展开更多
In order to enhance the image contrast and quality, inspired by the interesting observation that an increase in noise intensity tends to narrow the dynamic range of the local standard deviation (LSD) of an image, a tr...In order to enhance the image contrast and quality, inspired by the interesting observation that an increase in noise intensity tends to narrow the dynamic range of the local standard deviation (LSD) of an image, a tree-structured group sparse optimization model in the wavelet domain is proposed for image denoising. The compressed dynamic range of LSD caused by noise leads to a contrast reduction in the image, as well as the degradation of image quality. To equalize the LSD distribution, sparsity on the LSD matrix is enforced by employing a mixed norm as a regularizer in the image denoising model. This mixed norm introduces a coupling between wavelet coefficients and provides a tree-structured group scheme. The alternating direction method of multipliers (ADMM) and the fast iterative shrinkage-thresholding algorithm (FISTA) are applied to solve the group sparse model based on different cases. Several experiments are conducted to verify the effectiveness of the proposed model. The experimental results indicate that the proposed group sparse model can efficiently equalize the LSD distribution and therefore can improve the image contrast and quality.展开更多
In order to improve the efficiency of speech emotion recognition across corpora,a speech emotion transfer learning method based on the deep sparse auto-encoder is proposed.The algorithm first reconstructs a small amou...In order to improve the efficiency of speech emotion recognition across corpora,a speech emotion transfer learning method based on the deep sparse auto-encoder is proposed.The algorithm first reconstructs a small amount of data in the target domain by training the deep sparse auto-encoder,so that the encoder can learn the low-dimensional structural representation of the target domain data.Then,the source domain data and the target domain data are coded by the trained deep sparse auto-encoder to obtain the reconstruction data of the low-dimensional structural representation close to the target domain.Finally,a part of the reconstructed tagged target domain data is mixed with the reconstructed source domain data to jointly train the classifier.This part of the target domain data is used to guide the source domain data.Experiments on the CASIA,SoutheastLab corpus show that the model recognition rate after a small amount of data transferred reached 89.2%and 72.4%on the DNN.Compared to the training results of the complete original corpus,it only decreased by 2%in the CASIA corpus,and only 3.4%in the SoutheastLab corpus.Experiments show that the algorithm can achieve the effect of labeling all data in the extreme case that the data set has only a small amount of data tagged.展开更多
Extreme learning machine (ELM) is a feedforward neural network-based machine learning method that has the benefits of short training times, strong generalization capabilities, and will not fall into local minima. Howe...Extreme learning machine (ELM) is a feedforward neural network-based machine learning method that has the benefits of short training times, strong generalization capabilities, and will not fall into local minima. However, due to the traditional ELM shallow architecture, it requires a large number of hidden nodes when dealing with high-dimensional data sets to ensure its classification performance. The other aspect, it is easy to degrade the classification performance in the face of noise interference from noisy data. To improve the above problem, this paper proposes a double pseudo-inverse extreme learning machine (DPELM) based on Sparse Denoising AutoEncoder (SDAE) namely, SDAE-DPELM. The algorithm can directly determine the input weight and output weight of the network by using the pseudo-inverse method. As a result, the algorithm only requires a few hidden layer nodes to produce superior classification results when classifying data. And its combination with SDAE can effectively improve the classification performance and noise resistance. Extensive numerical experiments show that the algorithm has high classification accuracy and good robustness when dealing with high-dimensional noisy data and high-dimensional noiseless data. Furthermore, applying such an algorithm to Miao character recognition substantiates its excellent performance, which further illustrates the practicability of the algorithm.展开更多
In this paper,we propose an image denoising method combining the priors of non-local self similarity(NSS),low rank and group sparsity.In the proposed scheme,the image is decomposed into overlapping patches,and then th...In this paper,we propose an image denoising method combining the priors of non-local self similarity(NSS),low rank and group sparsity.In the proposed scheme,the image is decomposed into overlapping patches,and then these patches are classified by the K-means clustering.Patches in each cluster are stacked into a matrix and then are decomposed into low frequency component and high frequency component through 2-D wavelet transform.Intuitively,the low frequency component should be a low rank matrix.We show that the high frequency component can be recovered by weighted mixed norm minimization which is also known as group sparse model.Then we propose an image denoising model using nuclear norm and weighted mixed norm as regularizers to enforce the priors on the low and high frequency.The proposed model can be solved efficiently in the framework of alternating direction multiplier method(ADMM)algorithm.Several experiments are carried out to verify the performance of the proposed model.展开更多
Sparse coding has achieved great success in various image restoration tasks.However,if the sparse representation coefficients of the structure(low-frequency information)and texture(high-frequency information)component...Sparse coding has achieved great success in various image restoration tasks.However,if the sparse representation coefficients of the structure(low-frequency information)and texture(high-frequency information)components of the image are under the same penalty constraint,the restoration effect may not be ideal.In this paper,an image denoising model combining mixed norm and weighted nuclear norm as regularization terms is proposed.The proposed model simultaneously exploits the group sparsity of the high frequency and lowrankness of the low frequency in dictionary-domain.The mixed norm is used to constrain the high frequency part and the weighted nuclear norm is used to constrain the low frequency part.In order to make the proposed model easy to solve under the framework of alternative direction multiplier method(ADMM),iterative shrinkage threshold method and weighted nuclear norm minimization method are used to solve the two sub-problems.The validity of the model is verified experimentally through comparison with some state-of-the-art methods.展开更多
Group sparse residual constraint with non-local priors(GSRC)has achieved great success in image restoration producing stateof-the-art performance.In the GSRC model,the l_(1)norm minimization is employed to reduce the ...Group sparse residual constraint with non-local priors(GSRC)has achieved great success in image restoration producing stateof-the-art performance.In the GSRC model,the l_(1)norm minimization is employed to reduce the group sparse residual.In recent years,nonconvex regularization terms have been widely used in image denoising problems,which have achieved better results in denoising than convex regularization terms.In this paper,we use the ratio of the l_(1)and l_(2)norm instead of the l_(1)norm to propose a new image denoising model,i.e.,a group sparse residual constraint model with l_(1)/l_(2)minimization(GSRC-l_(1)/l_(2)).Due to the computational difficulties arisen from the non-convexity and non-linearity,we focus on a constrained optimization problem that can be solved by alternative direction method of multipliers(ADMM).Experimental results of image denoising show that the pro-posed model outperforms several state-of-the-art image denoising methods both visually and quantitatively.展开更多
Time-domain airborne electromagnetic(AEM)data are frequently subject to interference from various types of noise,which can reduce the data quality and affect data inversion and interpretation.Traditional denoising met...Time-domain airborne electromagnetic(AEM)data are frequently subject to interference from various types of noise,which can reduce the data quality and affect data inversion and interpretation.Traditional denoising methods primarily deal with data directly,without analyzing the data in detail;thus,the results are not always satisfactory.In this paper,we propose a method based on dictionary learning for EM data denoising.This method uses dictionary learning to perform feature analysis and to extract and reconstruct the true signal.In the process of dictionary learning,the random noise is fi ltered out as residuals.To verify the eff ectiveness of this dictionary learning approach for denoising,we use a fi xed overcomplete discrete cosine transform(ODCT)dictionary algorithm,the method-of-optimal-directions(MOD)dictionary learning algorithm,and the K-singular value decomposition(K-SVD)dictionary learning algorithm to denoise decay curves at single points and to denoise profi le data for diff erent time channels in time-domain AEM.The results show obvious diff erences among the three dictionaries for denoising AEM data,with the K-SVD dictionary achieving the best performance.展开更多
In this paper,we propose Hformer,a novel supervised learning model for low-dose computer tomography(LDCT)denoising.Hformer combines the strengths of convolutional neural networks for local feature extraction and trans...In this paper,we propose Hformer,a novel supervised learning model for low-dose computer tomography(LDCT)denoising.Hformer combines the strengths of convolutional neural networks for local feature extraction and transformer models for global feature capture.The performance of Hformer was verified and evaluated based on the AAPM-Mayo Clinic LDCT Grand Challenge Dataset.Compared with the former representative state-of-the-art(SOTA)model designs under different architectures,Hformer achieved optimal metrics without requiring a large number of learning parameters,with metrics of33.4405 PSNR,8.6956 RMSE,and 0.9163 SSIM.The experiments demonstrated designed Hformer is a SOTA model for noise suppression,structure preservation,and lesion detection.展开更多
Due to the strong background noise and the acquisition system noise,the useful characteristics are often difficult to be detected.To solve this problem,sparse coding captures a concise representation of the high-level...Due to the strong background noise and the acquisition system noise,the useful characteristics are often difficult to be detected.To solve this problem,sparse coding captures a concise representation of the high-level features in the signal using the underlying structure of the signal.Recently,an Online Convolutional Sparse Coding(OCSC)denoising algorithm has been proposed.However,it does not consider the structural characteristics of the signal,the sparsity of each iteration is not enough.Therefore,a threshold shrinkage algorithm considering neighborhood sparsity is proposed,and a training strategy from loose to tight is developed to further improve the denoising performance of the algorithm,called Variable Threshold Neighborhood Online Convolution Sparse Coding(VTNOCSC).By embedding the structural sparse threshold shrinkage operator into the process of solving the sparse coefficient and gradually approaching the optimal noise separation point in the training,the signal denoising performance of the algorithm is greatly improved.VTNOCSC is used to process the actual bearing fault signal,the noise interference is successfully reduced and the interest features are more evident.Compared with other existing methods,VTNOCSC has better denoising performance.展开更多
Enhancing seismic resolution is a key component in seismic data processing, which plays a valuable role in raising the prospecting accuracy of oil reservoirs. However, in noisy situations, existing resolution enhancem...Enhancing seismic resolution is a key component in seismic data processing, which plays a valuable role in raising the prospecting accuracy of oil reservoirs. However, in noisy situations, existing resolution enhancement methods are difficult to yield satisfactory processing outcomes for reservoir characterization. To solve this problem, we develop a new approach for simultaneous denoising and resolution enhancement of seismic data based on convolution dictionary learning. First, an elastic convolution dictionary learning algorithm is presented to efficiently learn a convolution dictionary with stronger representation capability from the noisy data to be processed. Specifically, the algorithm introduces the elastic L1/2 norm as a sparsity constraint and employs a steepest gradient descent strategy to efficiently solve the frequency-domain linear system with substantial computational cost in a half-quadratic splitting framework. Then, based on the learned convolution dictionary, a weighted convolutional sparse representation paradigm is designed to encode the noisy data to acquire an optimal sparse approximation of the effective signal. Subsequently, a high-resolution dictionary with a broadband spectrum is constructed by the proposed parameter scaling strategy and matched filtering technique on the basis of atomic spectrum modeling. Finally, the optimal sparse approximation of the effective signal and the constructed high-resolution dictionary are used for data reconstruction to obtain the seismic signal with high resolution and high signal-to-noise ratio. Synthetic and field dataset examples are executed to check the effectiveness and reliability of the developed method. The results indicate that this method has a more competitive performance in seismic applications compared with the conventional deconvolution and spectral whitening methods.展开更多
With the explosion in the number of digital images taken every day,the demand for more accurate and visually pleasing images is increasing.However,the images captured by modern cameras are inevitably degraded by noise...With the explosion in the number of digital images taken every day,the demand for more accurate and visually pleasing images is increasing.However,the images captured by modern cameras are inevitably degraded by noise,which leads to deteriorated visual image quality.Therefore,work is required to reduce noise without losing image features(edges,corners,and other sharp structures).So far,researchers have already proposed various methods for decreasing noise.Each method has its own advantages and disadvantages.In this paper,we summarize some important research in the field of image denoising.First,we give the formulation of the image denoising problem,and then we present several image denoising techniques.In addition,we discuss the characteristics of these techniques.Finally,we provide several promising directions for future research.展开更多
文摘The internal flow fields within a three-dimensional inward-tunning combined inlet are extremely complex,especially during the engine mode transition,where the tunnel changes may impact the flow fields significantly.To develop an efficient flow field reconstruction model for this,we present an Improved Conditional Denoising Diffusion Generative Adversarial Network(ICDDGAN),which integrates Conditional Denoising Diffusion Probabilistic Models(CDDPMs)with Style GAN,and introduce a reconstruction discrimination mechanism and dynamic loss weight learning strategy.We establish the Mach number flow field dataset by numerical simulation at various backpressures for the mode transition process from turbine mode to ejector ramjet mode at Mach number 2.5.The proposed ICDDGAN model,given only sparse parameter information,can rapidly generate high-quality Mach number flow fields without a large number of samples for training.The results show that ICDDGAN is superior to CDDGAN in terms of training convergence and stability.Moreover,the interpolation and extrapolation test results during backpressure conditions show that ICDDGAN can accurately and quickly reconstruct Mach number fields at various tunnel slice shapes,with a Structural Similarity Index Measure(SSIM)of over 0.96 and a Mean-Square Error(MSE)of 0.035%to actual flow fields,reducing time costs by 7-8 orders of magnitude compared to Computational Fluid Dynamics(CFD)calculations.This can provide an efficient means for rapid computation of complex flow fields.
基金co-supported by the National Natural Science Foundation of China(Nos.61671463,61471379,61790551 and 61102166)。
文摘A high resolution range profile(HRRP) is a summation vector of the sub-echoes of the target scattering points acquired by a wide-band radar.Generally, HRRPs obtained in a noncooperative complex electromagnetic environment are contaminated by strong noise.Effective pre-processing of the HRRP data can greatly improve the accuracy of target recognition.In this paper, a denoising and reconstruction method for HRRP is proposed based on a Modified Sparse Auto-Encoder, which is a representative non-linear model.To better reconstruct the HRRP, a sparse constraint is added to the proposed model and the sparse coefficient is calculated based on the intrinsic dimension of HRRP.The denoising of the HRRP is performed by adding random noise to the input HRRP data during the training process and fine-tuning the weight matrix through singular-value decomposition.The results of simulations showed that the proposed method can both reconstruct the signal with fidelity and suppress noise effectively, significantly outperforming other methods, especially in low Signal-to-Noise Ratio conditions.
基金supported by the National Natural Science Foundation of China(61573219,61402203,61401209,61701192,61671274)the Opening Fund of Shandong Provincial Key Laboratory of Network Based Intelligent Computing+2 种基金the Fostering Project of Dominant DisciplineTalent Team of Shandong Province Higher Education InstitutionsFostering Project of Dominant Discipline and Talent Team of SDUFE
文摘Sparse representation models have been shown promising results for image denoising. However, conventional sparse representation-based models cannot obtain satisfactory estimations for sparse coefficients and the dictionary. To address this weakness, in this paper, we propose a novel fractional-order sparse representation(FSR) model. Specifically, we cluster the image patches into K groups, and calculate the singular values for each clean/noisy patch pair in the wavelet domain. Then the uniform fractional-order parameters are learned for each cluster.Then a novel fractional-order sample space is constructed using adaptive fractional-order parameters in the wavelet domain to obtain more accurate sparse coefficients and dictionary for image denoising. Extensive experimental results show that the proposed model outperforms state-of-the-art sparse representation-based models and the block-matching and 3D filtering algorithm in terms of denoising performance and the computational efficiency.
基金Lanzhou Talent Innovation and Entrepreneurship Project(No.2020-RC-14)。
文摘Single nucletide polymorphism(SNP)is an important factor for the study of genetic variation in human families and animal and plant strains.Therefore,it is widely used in the study of population genetics and disease related gene.In pharmacogenomics research,identifying the association between SNP site and drug is the key to clinical precision medication,therefore,a predictive model of SNP site and drug association based on denoising variational auto-encoder(DVAE-SVM)is proposed.Firstly,k-mer algorithm is used to construct the initial SNP site feature vector,meanwhile,MACCS molecular fingerprint is introduced to generate the feature vector of the drug module.Then,we use the DVAE to extract the effective features of the initial feature vector of the SNP site.Finally,the effective feature vector of the SNP site and the feature vector of the drug module are fused input to the support vector machines(SVM)to predict the relationship of SNP site and drug module.The results of five-fold cross-validation experiments indicate that the proposed algorithm performs better than random forest(RF)and logistic regression(LR)classification.Further experiments show that compared with the feature extraction algorithms of principal component analysis(PCA),denoising auto-encoder(DAE)and variational auto-encode(VAE),the proposed algorithm has better prediction results.
基金Project(60972114) supported by the National Natural Science Foundation of ChinaProject(2012M512168) supported by China Postdoctoral Science Foundation
文摘Motivated by local coordinate coding(LCC) theory in nonlinear manifold learning, a new image representation model called local sparse representation(LSR) for astronomical image denoising was proposed. Borrowing ideas from surrogate function and applying the iterative shrinkage-thresholding algorithm(ISTA), an iterative shrinkage operator for LSR was derived. Meanwhile, a fast approximated LSR method by first performing a K-nearest-neighbor search and then solving a l1optimization problem was presented under the guarantee of denoising performance. In addition, the LSR model and adaptive dictionary learning were incorporated into a unified optimization framework, which explicitly established the inner connection of them. Such processing allows us to simultaneously update sparse coding vectors and the dictionary by alternating optimization method. The experimental results show that the proposed method is superior to the traditional denoising method and reaches state-of-the-art performance on astronomical image.
基金Project supported by the National Natural Science Foundation of China(Grant No.60872123)the Joint Fund of the National Natural Science Foundation and the Guangdong Provincial Natural Science Foundation(Grant No.U0835001)+5 种基金the Doctorate Foundation of South China University of Technologythe Post-Doc Foundation of South China University of Technologythe Basic Scientific Research Fund of South China University of Technology for Youththe Natural Science Fund of South China University of Technology for Youththe Natural Science Foundation of Guangdong Province,Chinathe China Postdoctoral Science Foundation(Grant No.20100480049)
文摘This paper proposes a denoising algorithm called truncated sparse decomposition （TSD） algorithm, which combines the advantage of the sparse decomposition with that of the minimum energy model truncation operation. Experimental results on two real chaotic signals show that the TSD algorithm outperforms the recently reported denoising algorithmsnon-negative sparse coding and singular value decomposition based method.
基金Supported by the National Natural Science Foundation of China(61573014)
文摘Image denoising is a well-studied problem closely related to sparse coding. Noticing that the Laplacian distribution has a strong sparseness, we use Laplacian scale mixture to model sparse coefficients. With the observation that prior information of an image is relevant to the estimation of sparse coefficients, we introduce the prior information into maximum a posteriori（MAP） estimation of sparse coefficients by an appropriate estimate of the probability density function. Extending to structured sparsity, a nonlocal image denoising model： Improved Simultaneous Sparse Coding with Laplacian Scale Mixture（ISSC-LSM） is proposed. The centering preprocessing, which admits biased-mean of sparse coefficients and saves expensive computation, is done firstly. By alternating minimization and learning an orthogonal PCA dictionary, an efficient algorithm with closed-form solutions is proposed. When applied to noise removal, our proposed ISSC-LSM can capture structured image features, and the adoption of image prior information leads to highly competitive denoising performance. Experimental results show that the proposed method often provides higher subjective and objective qualities than other competing approaches. Our method is most suitable for processing images with abundant self-repeating patterns by effectively suppressing undesirable artifacts while maintaining the textures and edges.
基金Sponsored by the National Natural Science Foundation of China(Grant No.51704138)
文摘Rolling bearings are important central components in rotating machines, whose fault diagnosis is crucial in condition-based maintenance to reduce the complexity of different kinds of faults. To classify various rolling bearing faults, a prognostic algorithm consisting of four phases was proposed. Since stacked denoising auto-encoder can be filtered, noise of large numbers of mechanical vibration signals was used for deep learning structure to extract the characteristics of the noise. Unsupervised pre-training method, which can greatly simplify the traditional manual extraction approach, was utilized to process the depth of the data automatically. Furthermore, the aggregation layer of stacked denoising auto-encoder(SDA) was proposed to get rid of gradient disappearance in deeper layers of network, mix superficial nodes’ expression with deeper layers, and avoid the insufficient express ability in deeper layers. Principal component analysis(PCA) was adopted to extract different features for classification. According to the experimental data of this method and from the comparison results, the proposed method of rolling bearing fault classification reached 97.02% of correct rate, suggesting a better performance than other algorithms.
基金National Natural Science Foundation of China(Grant No.61872083)the Natural Science Foundation of Guangdong Province,China(Grant Nos.2017A030310659 and 2019A1515011123).
文摘Denoising of chaotic signal is a challenge work due to its wide-band and noise-like characteristics.The algorithm should make the denoised signal have a high signal to noise ratio and retain the chaotic characteristics.We propose a denoising method of chaotic signals based on sparse decomposition and K-singular value decomposition(K-SVD)optimization.The observed signal is divided into segments and decomposed sparsely.The over-complete atomic library is constructed according to the differential equation of chaotic signals.The orthogonal matching pursuit algorithm is used to search the optimal matching atom.The atoms and coefficients are further processed to obtain the globally optimal atoms and coefficients by K-SVD.The simulation results show that the denoised signals have a higher signal to noise ratio and better preserve the chaotic characteristics.
基金The National Natural Science Foundation of China(No.61701004,11504003)the Natural Science Foundation of Anhui Province(No.1708085QA15)
文摘In order to enhance the image contrast and quality, inspired by the interesting observation that an increase in noise intensity tends to narrow the dynamic range of the local standard deviation (LSD) of an image, a tree-structured group sparse optimization model in the wavelet domain is proposed for image denoising. The compressed dynamic range of LSD caused by noise leads to a contrast reduction in the image, as well as the degradation of image quality. To equalize the LSD distribution, sparsity on the LSD matrix is enforced by employing a mixed norm as a regularizer in the image denoising model. This mixed norm introduces a coupling between wavelet coefficients and provides a tree-structured group scheme. The alternating direction method of multipliers (ADMM) and the fast iterative shrinkage-thresholding algorithm (FISTA) are applied to solve the group sparse model based on different cases. Several experiments are conducted to verify the effectiveness of the proposed model. The experimental results indicate that the proposed group sparse model can efficiently equalize the LSD distribution and therefore can improve the image contrast and quality.
基金The National Natural Science Foundation of China(No.61871213,61673108,61571106)Six Talent Peaks Project in Jiangsu Province(No.2016-DZXX-023)
文摘In order to improve the efficiency of speech emotion recognition across corpora,a speech emotion transfer learning method based on the deep sparse auto-encoder is proposed.The algorithm first reconstructs a small amount of data in the target domain by training the deep sparse auto-encoder,so that the encoder can learn the low-dimensional structural representation of the target domain data.Then,the source domain data and the target domain data are coded by the trained deep sparse auto-encoder to obtain the reconstruction data of the low-dimensional structural representation close to the target domain.Finally,a part of the reconstructed tagged target domain data is mixed with the reconstructed source domain data to jointly train the classifier.This part of the target domain data is used to guide the source domain data.Experiments on the CASIA,SoutheastLab corpus show that the model recognition rate after a small amount of data transferred reached 89.2%and 72.4%on the DNN.Compared to the training results of the complete original corpus,it only decreased by 2%in the CASIA corpus,and only 3.4%in the SoutheastLab corpus.Experiments show that the algorithm can achieve the effect of labeling all data in the extreme case that the data set has only a small amount of data tagged.
文摘Extreme learning machine (ELM) is a feedforward neural network-based machine learning method that has the benefits of short training times, strong generalization capabilities, and will not fall into local minima. However, due to the traditional ELM shallow architecture, it requires a large number of hidden nodes when dealing with high-dimensional data sets to ensure its classification performance. The other aspect, it is easy to degrade the classification performance in the face of noise interference from noisy data. To improve the above problem, this paper proposes a double pseudo-inverse extreme learning machine (DPELM) based on Sparse Denoising AutoEncoder (SDAE) namely, SDAE-DPELM. The algorithm can directly determine the input weight and output weight of the network by using the pseudo-inverse method. As a result, the algorithm only requires a few hidden layer nodes to produce superior classification results when classifying data. And its combination with SDAE can effectively improve the classification performance and noise resistance. Extensive numerical experiments show that the algorithm has high classification accuracy and good robustness when dealing with high-dimensional noisy data and high-dimensional noiseless data. Furthermore, applying such an algorithm to Miao character recognition substantiates its excellent performance, which further illustrates the practicability of the algorithm.
基金Supported by the National Natural Science Foundation of China(61701004)Outstanding Young Talents Support Program of Anhui Province
文摘In this paper,we propose an image denoising method combining the priors of non-local self similarity(NSS),low rank and group sparsity.In the proposed scheme,the image is decomposed into overlapping patches,and then these patches are classified by the K-means clustering.Patches in each cluster are stacked into a matrix and then are decomposed into low frequency component and high frequency component through 2-D wavelet transform.Intuitively,the low frequency component should be a low rank matrix.We show that the high frequency component can be recovered by weighted mixed norm minimization which is also known as group sparse model.Then we propose an image denoising model using nuclear norm and weighted mixed norm as regularizers to enforce the priors on the low and high frequency.The proposed model can be solved efficiently in the framework of alternating direction multiplier method(ADMM)algorithm.Several experiments are carried out to verify the performance of the proposed model.
基金Supported by the National Natural Science Foundation of China(61701004)Outstanding Young Talents Support Program of Anhui Province(GXYQ2021178)。
文摘Sparse coding has achieved great success in various image restoration tasks.However,if the sparse representation coefficients of the structure(low-frequency information)and texture(high-frequency information)components of the image are under the same penalty constraint,the restoration effect may not be ideal.In this paper,an image denoising model combining mixed norm and weighted nuclear norm as regularization terms is proposed.The proposed model simultaneously exploits the group sparsity of the high frequency and lowrankness of the low frequency in dictionary-domain.The mixed norm is used to constrain the high frequency part and the weighted nuclear norm is used to constrain the low frequency part.In order to make the proposed model easy to solve under the framework of alternative direction multiplier method(ADMM),iterative shrinkage threshold method and weighted nuclear norm minimization method are used to solve the two sub-problems.The validity of the model is verified experimentally through comparison with some state-of-the-art methods.
基金Supported by the Open Fund of Key Laboratory of Anhui Higher Education Institutes(CS2021-07)the National Natural Science Foundation of China(61701004),the Outstanding Young Talents Support Program of Anhui Province(GXYQ 2021178)University Natural Science Research Project of Anhui Province of China(KJ2020A0238)。
文摘Group sparse residual constraint with non-local priors(GSRC)has achieved great success in image restoration producing stateof-the-art performance.In the GSRC model,the l_(1)norm minimization is employed to reduce the group sparse residual.In recent years,nonconvex regularization terms have been widely used in image denoising problems,which have achieved better results in denoising than convex regularization terms.In this paper,we use the ratio of the l_(1)and l_(2)norm instead of the l_(1)norm to propose a new image denoising model,i.e.,a group sparse residual constraint model with l_(1)/l_(2)minimization(GSRC-l_(1)/l_(2)).Due to the computational difficulties arisen from the non-convexity and non-linearity,we focus on a constrained optimization problem that can be solved by alternative direction method of multipliers(ADMM).Experimental results of image denoising show that the pro-posed model outperforms several state-of-the-art image denoising methods both visually and quantitatively.
基金financially supported the Strategic Priority Research Program of the Chinese Academy of Sciences (No. XDA14020102)the National Natural Science Foundation of China (Nos. 41774125,41530320 and 41804098)the Key National Research Project of China (Nos. 2016YFC0303100,2017YFC0601900)。
文摘Time-domain airborne electromagnetic(AEM)data are frequently subject to interference from various types of noise,which can reduce the data quality and affect data inversion and interpretation.Traditional denoising methods primarily deal with data directly,without analyzing the data in detail;thus,the results are not always satisfactory.In this paper,we propose a method based on dictionary learning for EM data denoising.This method uses dictionary learning to perform feature analysis and to extract and reconstruct the true signal.In the process of dictionary learning,the random noise is fi ltered out as residuals.To verify the eff ectiveness of this dictionary learning approach for denoising,we use a fi xed overcomplete discrete cosine transform(ODCT)dictionary algorithm,the method-of-optimal-directions(MOD)dictionary learning algorithm,and the K-singular value decomposition(K-SVD)dictionary learning algorithm to denoise decay curves at single points and to denoise profi le data for diff erent time channels in time-domain AEM.The results show obvious diff erences among the three dictionaries for denoising AEM data,with the K-SVD dictionary achieving the best performance.
基金supported by the National Natural Science Foundation of China(Nos.11975292,12222512)the CAS"Light of West Chin"Program+1 种基金the CAS Pioneer Hundred Talent Programthe Guangdong Major Project of Basic and Applied Basic Research(No.2020B0301030008)。
文摘In this paper,we propose Hformer,a novel supervised learning model for low-dose computer tomography(LDCT)denoising.Hformer combines the strengths of convolutional neural networks for local feature extraction and transformer models for global feature capture.The performance of Hformer was verified and evaluated based on the AAPM-Mayo Clinic LDCT Grand Challenge Dataset.Compared with the former representative state-of-the-art(SOTA)model designs under different architectures,Hformer achieved optimal metrics without requiring a large number of learning parameters,with metrics of33.4405 PSNR,8.6956 RMSE,and 0.9163 SSIM.The experiments demonstrated designed Hformer is a SOTA model for noise suppression,structure preservation,and lesion detection.
基金supported by the National Key Research and Development Program of China(No.2018YFB2003300)National Science and Technology Major Project,China(No.2017-IV-0008-0045)National Natural Science Foundation of China(No.51675262).
文摘Due to the strong background noise and the acquisition system noise,the useful characteristics are often difficult to be detected.To solve this problem,sparse coding captures a concise representation of the high-level features in the signal using the underlying structure of the signal.Recently,an Online Convolutional Sparse Coding(OCSC)denoising algorithm has been proposed.However,it does not consider the structural characteristics of the signal,the sparsity of each iteration is not enough.Therefore,a threshold shrinkage algorithm considering neighborhood sparsity is proposed,and a training strategy from loose to tight is developed to further improve the denoising performance of the algorithm,called Variable Threshold Neighborhood Online Convolution Sparse Coding(VTNOCSC).By embedding the structural sparse threshold shrinkage operator into the process of solving the sparse coefficient and gradually approaching the optimal noise separation point in the training,the signal denoising performance of the algorithm is greatly improved.VTNOCSC is used to process the actual bearing fault signal,the noise interference is successfully reduced and the interest features are more evident.Compared with other existing methods,VTNOCSC has better denoising performance.
基金This work is supported by the Laoshan National Laboratoryof ScienceandTechnologyFoundation(No.LSKj202203400)the National Natural Science Foundation of China(No.41874146).
文摘Enhancing seismic resolution is a key component in seismic data processing, which plays a valuable role in raising the prospecting accuracy of oil reservoirs. However, in noisy situations, existing resolution enhancement methods are difficult to yield satisfactory processing outcomes for reservoir characterization. To solve this problem, we develop a new approach for simultaneous denoising and resolution enhancement of seismic data based on convolution dictionary learning. First, an elastic convolution dictionary learning algorithm is presented to efficiently learn a convolution dictionary with stronger representation capability from the noisy data to be processed. Specifically, the algorithm introduces the elastic L1/2 norm as a sparsity constraint and employs a steepest gradient descent strategy to efficiently solve the frequency-domain linear system with substantial computational cost in a half-quadratic splitting framework. Then, based on the learned convolution dictionary, a weighted convolutional sparse representation paradigm is designed to encode the noisy data to acquire an optimal sparse approximation of the effective signal. Subsequently, a high-resolution dictionary with a broadband spectrum is constructed by the proposed parameter scaling strategy and matched filtering technique on the basis of atomic spectrum modeling. Finally, the optimal sparse approximation of the effective signal and the constructed high-resolution dictionary are used for data reconstruction to obtain the seismic signal with high resolution and high signal-to-noise ratio. Synthetic and field dataset examples are executed to check the effectiveness and reliability of the developed method. The results indicate that this method has a more competitive performance in seismic applications compared with the conventional deconvolution and spectral whitening methods.
基金This work is supported by NSFC Joint Fund with Zhejiang Integration of Informatization and Industrialization under Key Project(No.U1609218)the National Nature Science Foundation of China(No.61602277)Shandong Provincial Natural Science Foundation of China(No.ZR2016FQ12).
文摘With the explosion in the number of digital images taken every day,the demand for more accurate and visually pleasing images is increasing.However,the images captured by modern cameras are inevitably degraded by noise,which leads to deteriorated visual image quality.Therefore,work is required to reduce noise without losing image features(edges,corners,and other sharp structures).So far,researchers have already proposed various methods for decreasing noise.Each method has its own advantages and disadvantages.In this paper,we summarize some important research in the field of image denoising.First,we give the formulation of the image denoising problem,and then we present several image denoising techniques.In addition,we discuss the characteristics of these techniques.Finally,we provide several promising directions for future research.
