In modern industrial design trends featuring with integration,miniaturization,and versatility,there is a growing demand on the utilization of microstructural array devices.The measurement of such microstructural array...In modern industrial design trends featuring with integration,miniaturization,and versatility,there is a growing demand on the utilization of microstructural array devices.The measurement of such microstructural array components often encounters challenges due to the reduced scale and complex structures,either by contact or noncontact optical approaches.Among these microstructural arrays,there are still no optical measurement methods for micro corner-cube reflector arrays.To solve this problem,this study introduces a method for effectively eliminating coherent noise and achieving surface profile reconstruction in interference measurements of microstructural arrays.The proposed denoising method allows the calibration and inverse solving of system errors in the frequency domain by employing standard components with known surface types.This enables the effective compensation of the complex amplitude of non-sample coherent light within the interferometer optical path.The proposed surface reconstruction method enables the profile calculation within the situation that there is complex multi-reflection during the propagation of rays in microstructural arrays.Based on the measurement results,two novel metrics are defined to estimate diffraction errors at array junctions and comprehensive errors across multiple array elements,offering insights into other types of microstructure devices.This research not only addresses challenges of the coherent noise and multi-reflection,but also makes a breakthrough for quantitively optical interference measurement of microstructural array devices.展开更多
To enhance the denoising performance of event-based sensors,we introduce a clustering-based temporal deep neural network denoising method(CBTDNN).Firstly,to cluster the sensor output data and obtain the respective clu...To enhance the denoising performance of event-based sensors,we introduce a clustering-based temporal deep neural network denoising method(CBTDNN).Firstly,to cluster the sensor output data and obtain the respective cluster centers,a combination of density-based spatial clustering of applications with noise(DBSCAN)and Kmeans++is utilized.Subsequently,long short-term memory(LSTM)is employed to fit and yield optimized cluster centers with temporal information.Lastly,based on the new cluster centers and denoising ratio,a radius threshold is set,and noise points beyond this threshold are removed.The comprehensive denoising metrics F1_score of CBTDNN have achieved 0.8931,0.7735,and 0.9215 on the traffic sequences dataset,pedestrian detection dataset,and turntable dataset,respectively.And these metrics demonstrate improvements of 49.90%,33.07%,19.31%,and 22.97%compared to four contrastive algorithms,namely nearest neighbor(NNb),nearest neighbor with polarity(NNp),Autoencoder,and multilayer perceptron denoising filter(MLPF).These results demonstrate that the proposed method enhances the denoising performance of event-based sensors.展开更多
Deep learning algorithms based on neural networks make remarkable achievements in machine fault diagnosis,while the noise mixed in measured signals harms the prediction accuracy of networks.Existing denoising methods ...Deep learning algorithms based on neural networks make remarkable achievements in machine fault diagnosis,while the noise mixed in measured signals harms the prediction accuracy of networks.Existing denoising methods in neural networks,such as using complex network architectures and introducing sparse techniques,always suffer from the difficulty of estimating hyperparameters and the lack of physical interpretability.To address this issue,this paper proposes a novel interpretable denoising layer based on reproducing kernel Hilbert space(RKHS)as the first layer for standard neural networks,with the aim to combine the advantages of both traditional signal processing technology with physical interpretation and network modeling strategy with parameter adaption.By investigating the influencing mechanism of parameters on the regularization procedure in RKHS,the key parameter that dynamically controls the signal smoothness with low computational cost is selected as the only trainable parameter of the proposed layer.Besides,the forward and backward propagation algorithms of the designed layer are formulated to ensure that the selected parameter can be automatically updated together with other parameters in the neural network.Moreover,exponential and piecewise functions are introduced in the weight updating process to keep the trainable weight within a reasonable range and avoid the ill-conditioned problem.Experiment studies verify the effectiveness and compatibility of the proposed layer design method in intelligent fault diagnosis of machinery in noisy environments.展开更多
In recent years, deep convolutional neural networks have shown superior performance in image denoising. However, deep network structures often come with a large number of model parameters, leading to high training cos...In recent years, deep convolutional neural networks have shown superior performance in image denoising. However, deep network structures often come with a large number of model parameters, leading to high training costs and long inference times, limiting their practical application in denoising tasks. This paper proposes a new dual convolutional denoising network with skip connections(DECDNet), which achieves an ideal balance between denoising effect and network complexity. The proposed DECDNet consists of a noise estimation network, a multi-scale feature extraction network, a dual convolutional neural network, and dual attention mechanisms. The noise estimation network is used to estimate the noise level map, and the multi-scale feature extraction network is combined to improve the model's flexibility in obtaining image features. The dual convolutional neural network branch design includes convolution and dilated convolution interactive connections, with the lower branch consisting of dilated convolution layers, and both branches using skip connections. Experiments show that compared with other models, the proposed DECDNet achieves superior PSNR and SSIM values at all compared noise levels, especially at higher noise levels, showing robustness to images with higher noise levels. It also demonstrates better visual effects, maintaining a balance between denoising and detail preservation.展开更多
To minimize radiation risk,dose reduction is important in the diagnostic and therapeutic applications of computed tomography(CT).However,image noise degrades image quality owing to the reduced X-ray dose and a possibl...To minimize radiation risk,dose reduction is important in the diagnostic and therapeutic applications of computed tomography(CT).However,image noise degrades image quality owing to the reduced X-ray dose and a possible unacceptably reduced diagnostic performance.Deep learning approaches with convolutional neural networks(CNNs)have been proposed for natural image denoising;however,these approaches might introduce image blurring or loss of original gradients.The aim of this study was to compare the dose-dependent properties of a CNN-based denoising method for low-dose CT with those of other noise-reduction methods on unique CT noise-simulation images.To simulate a low-dose CT image,a Poisson noise distribution was introduced to normal-dose images while convoluting the CT unit-specific modulation transfer function.An abdominal CT of 100 images obtained from a public database was adopted,and simulated dose-reduction images were created from the original dose at equal 10-step dose-reduction intervals with a final dose of 1/100.These images were denoised using the denoising network structure of CNN(DnCNN)as the general CNN model and for transfer learning.To evaluate the image quality,image similarities determined by the structural similarity index(SSIM)and peak signal-to-noise ratio(PSNR)were calculated for the denoised images.Significantly better denoising,in terms of SSIM and PSNR,was achieved by the DnCNN than by other image denoising methods,especially at the ultra-low-dose levels used to generate the 10%and 5%dose-equivalent images.Moreover,the developed CNN model can eliminate noise and maintain image sharpness at these dose levels and improve SSIM by approximately 10%from that of the original method.In contrast,under small dose-reduction conditions,this model also led to excessive smoothing of the images.In quantitative evaluations,the CNN denoising method improved the low-dose CT and prevented over-smoothing by tailoring the CNN model.展开更多
ive Arabic Text Summarization using Hyperparameter Tuned Denoising Deep Neural Network(AATS-HTDDNN)technique.The presented AATS-HTDDNN technique aims to generate summaries of Arabic text.In the presented AATS-HTDDNN t...ive Arabic Text Summarization using Hyperparameter Tuned Denoising Deep Neural Network(AATS-HTDDNN)technique.The presented AATS-HTDDNN technique aims to generate summaries of Arabic text.In the presented AATS-HTDDNN technique,the DDNN model is utilized to generate the summary.This study exploits the Chameleon Swarm Optimization(CSO)algorithm to fine-tune the hyperparameters relevant to the DDNN model since it considerably affects the summarization efficiency.This phase shows the novelty of the current study.To validate the enhanced summarization performance of the proposed AATS-HTDDNN model,a comprehensive experimental analysis was conducted.The comparison study outcomes confirmed the better performance of the AATS-HTDDNN model over other approaches.展开更多
Many existing aircraft engine fault detection methods are highly dependent on performance deviation data that are provided by the original equipment manufacturer. To improve the independent engine fault detection abil...Many existing aircraft engine fault detection methods are highly dependent on performance deviation data that are provided by the original equipment manufacturer. To improve the independent engine fault detection ability, Aircraft Communications Addressing and Reporting System(ACARS) data can be used. However, owing to the characteristics of high dimension, complex correlations between parameters, and large noise content, it is difficult for existing methods to detect faults effectively by using ACARS data. To solve this problem, a novel engine fault detection method based on original ACARS data is proposed. First, inspired by computer vision methods, all variables were divided into separated groups according to their correlations. Then, an improved convolutional denoising autoencoder was used to extract the features of each group. Finally, all of the extracted features were fused to form feature vectors. Thereby, fault samples could be identified based on these feature vectors. Experiments were conducted to validate the effectiveness and efficiency of our method and other competing methods by considering real ACARS data as the data source. The results reveal the good performance of our method with regard to comprehensive fault detection and robustness. Additionally, the computational and time costs of our method are shown to be relatively low.展开更多
Icing is an important factor threatening aircraft flight safety.According to the requirements of airworthiness regulations,aircraft icing safety assessment is needed to be carried out based on the ice shapes formed un...Icing is an important factor threatening aircraft flight safety.According to the requirements of airworthiness regulations,aircraft icing safety assessment is needed to be carried out based on the ice shapes formed under different icing conditions.Due to the complexity of the icing process,the rapid assessment of ice shape remains an important challenge.In this paper,an efficient prediction model of aircraft icing is established based on the deep belief network(DBN)and the stacked auto-encoder(SAE),which are all deep neural networks.The detailed network structures are designed and then the networks are trained according to the samples obtained by the icing numerical computation.After that the model is applied on the ice shape evaluation of NACA0012 airfoil.The results show that the model can accurately capture the nonlinear behavior of aircraft icing and thus make an excellent ice shape prediction.The model provides an important tool for aircraft icing analysis.展开更多
In many applications,flow measurements are usually sparse and possibly noisy.The reconstruction of a high-resolution flow field from limited and imperfect flow information is significant yet challenging.In this work,w...In many applications,flow measurements are usually sparse and possibly noisy.The reconstruction of a high-resolution flow field from limited and imperfect flow information is significant yet challenging.In this work,we propose an innovative physics-constrained Bayesian deep learning approach to reconstruct flow fields from sparse,noisy velocity data,where equationbased constraints are imposed through the likelihood function and uncertainty of the reconstructed flow can be estimated.Specifically,a Bayesian deep neural network is trained on sparse measurement data to capture the flow field.In the meantime,the violation of physical laws will be penalized on a large number of spatiotemporal points where measurements are not available.A non-parametric variational inference approach is applied to enable efficient physicsconstrained Bayesian learning.Several test cases on idealized vascular flows with synthetic measurement data are studied to demonstrate the merit of the proposed method.展开更多
Utilizing data from controlled seismic sources to image the subsurface structures and invert the physical properties of the subsurface media is a major effort in exploration geophysics. Dense seismic records with high...Utilizing data from controlled seismic sources to image the subsurface structures and invert the physical properties of the subsurface media is a major effort in exploration geophysics. Dense seismic records with high signal-to-noise ratio(SNR) and high fidelity helps in producing high quality imaging results. Therefore, seismic data denoising and missing traces reconstruction are significant for seismic data processing. Traditional denoising and interpolation methods rarely occasioned rely on noise level estimations, thus requiring heavy manual work to deal with records and the selection of optimal parameters. We propose a simultaneous denoising and interpolation method based on deep learning. For noisy records with missing traces, we adopt an iterative alternating optimization strategy and separate the objective function of the data restoring problem into two sub-problems. The seismic records can be reconstructed by solving a least-square problem and applying a set of pre-trained denoising models alternatively and iteratively.We demonstrate this method with synthetic and field data.展开更多
Safety is the foundation of sustainable development in civil aviation.Although catastrophic accidents are rare,indicators of potential incidents and unsafe events frequently materialize.Therefore,a history of unsafe d...Safety is the foundation of sustainable development in civil aviation.Although catastrophic accidents are rare,indicators of potential incidents and unsafe events frequently materialize.Therefore,a history of unsafe data are considered in predicting safety risks.A deep learning method is adopted for extracting reactions in safety risks.The deep neural network(DNN)model for safety risk prediction is shown to extract complex data characteristics better than a shallow network model.Using extended unsafe data and monthly risk indices,hidden layers and iterations are determined.The effectiveness of DNN is also revealed in comparison with the traditional neural network.Through early risk detection using the method in the paper,airlines and the government can mitigate potential risk and take proactive measures to improve civil aviation safety.展开更多
In this paper,we propose Hformer,a novel supervised learning model for low-dose computer tomography(LDCT)denoising.Hformer combines the strengths of convolutional neural networks for local feature extraction and trans...In this paper,we propose Hformer,a novel supervised learning model for low-dose computer tomography(LDCT)denoising.Hformer combines the strengths of convolutional neural networks for local feature extraction and transformer models for global feature capture.The performance of Hformer was verified and evaluated based on the AAPM-Mayo Clinic LDCT Grand Challenge Dataset.Compared with the former representative state-of-the-art(SOTA)model designs under different architectures,Hformer achieved optimal metrics without requiring a large number of learning parameters,with metrics of33.4405 PSNR,8.6956 RMSE,and 0.9163 SSIM.The experiments demonstrated designed Hformer is a SOTA model for noise suppression,structure preservation,and lesion detection.展开更多
The rolling bearing vibration signal is non-stationary and is easily disturbed by background noise,so it is difficult to accurately diagnose bearing faults.A fault diagnosis method of rolling bearing based on the time...The rolling bearing vibration signal is non-stationary and is easily disturbed by background noise,so it is difficult to accurately diagnose bearing faults.A fault diagnosis method of rolling bearing based on the time-frequency threshold denoising synchrosqueezing transform(TDSST)and convolutional neural network(CNN)is proposed.Since the traditional methods of wavelet threshold denoising and wavelet adjacent coefficient denoising are greatly affected by the estimation accuracy of noise variance,a time-frequency denoising method based on the STFT spectral correlation coefficient threshold optimization is adopted,which is combined with a synchrosqueezing transform.The ability of the TDSST to reduce noise and improve time-frequency resolution was verified by simulated impact fault signals of rolling bearings.Finally,the CNN is utilized to diagnose the time-frequency diagrams obtained by the TDSST.The diagnostic results of the rolling bearing experimental data show that the proposed method can effectively improve the accuracy of diagnosis.When the SNR of the bearing signal is larger than 0 dB,the accuracy is over 95%,even when the SNR reduces to-4 dB,the accuracy is still around 80%.Moreover,the standard deviation of multiple test results is small,which means that the method has good robustness.展开更多
With the explosion in the number of digital images taken every day,the demand for more accurate and visually pleasing images is increasing.However,the images captured by modern cameras are inevitably degraded by noise...With the explosion in the number of digital images taken every day,the demand for more accurate and visually pleasing images is increasing.However,the images captured by modern cameras are inevitably degraded by noise,which leads to deteriorated visual image quality.Therefore,work is required to reduce noise without losing image features(edges,corners,and other sharp structures).So far,researchers have already proposed various methods for decreasing noise.Each method has its own advantages and disadvantages.In this paper,we summarize some important research in the field of image denoising.First,we give the formulation of the image denoising problem,and then we present several image denoising techniques.In addition,we discuss the characteristics of these techniques.Finally,we provide several promising directions for future research.展开更多
Medical Resonance Imaging(MRI)is a noninvasive,nonradioactive,and meticulous diagnostic modality capability in the field of medical imaging.However,the efficiency of MR image reconstruction is affected by its bulky im...Medical Resonance Imaging(MRI)is a noninvasive,nonradioactive,and meticulous diagnostic modality capability in the field of medical imaging.However,the efficiency of MR image reconstruction is affected by its bulky image sets and slow process implementation.Therefore,to obtain a high-quality reconstructed image we presented a sparse aware noise removal technique that uses convolution neural network(SANR_CNN)for eliminating noise and improving the MR image reconstruction quality.The proposed noise removal or denoising technique adopts a fast CNN architecture that aids in training larger datasets with improved quality,and SARN algorithm is used for building a dictionary learning technique for denoising large image datasets.The proposed SANR_CNN model also preserves the details and edges in the image during reconstruction.An experiment was conducted to analyze the performance of SANR_CNN in a few existing models in regard with peak signal-to-noise ratio(PSNR),structural similarity index(SSIM),and mean squared error(MSE).The proposed SANR_CNN model achieved higher PSNR,SSIM,and MSE efficiency than the other noise removal techniques.The proposed architecture also provides transmission of these denoised medical images through secured IoT architecture.展开更多
In recent years,computer visionfinds wide applications in maritime surveillance with its sophisticated algorithms and advanced architecture.Auto-matic ship detection with computer vision techniques provide an efficien...In recent years,computer visionfinds wide applications in maritime surveillance with its sophisticated algorithms and advanced architecture.Auto-matic ship detection with computer vision techniques provide an efficient means to monitor as well as track ships in water bodies.Waterways being an important medium of transport require continuous monitoring for protection of national security.The remote sensing satellite images of ships in harbours and water bodies are the image data that aid the neural network models to localize ships and to facilitate early identification of possible threats at sea.This paper proposes a deep learning based model capable enough to classify between ships and no-ships as well as to localize ships in the original images using bounding box tech-nique.Furthermore,classified ships are again segmented with deep learning based auto-encoder model.The proposed model,in terms of classification,provides suc-cessful results generating 99.5%and 99.2%validation and training accuracy respectively.The auto-encoder model also produces 85.1%and 84.2%validation and training accuracies.Moreover the IoU metric of the segmented images is found to be of 0.77 value.The experimental results reveal that the model is accu-rate and can be implemented for automatic ship detection in water bodies consid-ering remote sensing satellite images as input to the computer vision system.展开更多
In order to obtain clear images and solve the problems of low image quality caused by noise disturbance,a lot of researches have been done on image denoising techniques.In the theoretical system of algorithms studied ...In order to obtain clear images and solve the problems of low image quality caused by noise disturbance,a lot of researches have been done on image denoising techniques.In the theoretical system of algorithms studied so far,many algorithms can effectively remove noise in low-dimensional images,but at the same time,the results are slightly inferior when processing high-dimensional images.This paper proposes a q-GAN,which uses multi-scale in generating networks.The convolution kernel extracts image features and transforms the denoising problem into the feature domain.In the feature domain,a residual structure is used to denoise,and the noise distribution is removed from the feature distribution.There are residual noise features in the obtained denoising features,which are removed by subsequent feature filtering of the network structure,and finally a denoised image is generated by fusing the noiseless features.展开更多
Image denoising is often used as a preprocessing step in computer vision tasks,which can help improve the accuracy of image processing models.Due to the imperfection of imaging systems,transmission media and recording...Image denoising is often used as a preprocessing step in computer vision tasks,which can help improve the accuracy of image processing models.Due to the imperfection of imaging systems,transmission media and recording equipment,digital images are often contaminated with various noises during their formation,which troubles the visual effects and even hinders people’s normal recognition.The pollution of noise directly affects the processing of image edge detection,feature extraction,pattern recognition,etc.,making it difficult for people to break through the bottleneck by modifying the model.Many traditional filtering methods have shown poor performance since they do not have optimal expression and adaptation for specific images.Meanwhile,deep learning technology opens up new possibilities for image denoising.In this paper,we propose a novel neural network which is based on generative adversarial networks for image denoising.Inspired by U-net,our method employs a novel symmetrical encoder-decoder based generator network.The encoder adopts convolutional neural networks to extract features,while the decoder outputs the noise in the images by deconvolutional neural networks.Specially,shortcuts are added between designated layers,which can preserve image texture details and prevent gradient explosions.Besides,in order to improve the training stability of the model,we add Wasserstein distance in loss function as an optimization.We use the peak signal-to-noise ratio(PSNR)to evaluate our model and we can prove the effectiveness of it with experimental results.When compared to the state-of-the-art approaches,our method presents competitive performance.展开更多
In network settings,one of the major disadvantages that threaten the network protocols is the insecurity.In most cases,unscrupulous people or bad actors can access information through unsecured connections by planting...In network settings,one of the major disadvantages that threaten the network protocols is the insecurity.In most cases,unscrupulous people or bad actors can access information through unsecured connections by planting software or what we call malicious software otherwise anomalies.The presence of anomalies is also one of the disadvantages,internet users are constantly plagued by virus on their system and get activated when a harmless link is clicked on,this a case of true benign detected as false.Deep learning is very adept at dealing with such cases,but sometimes it has its own faults when dealing benign cases.Here we tend to adopt a dynamic control system(DCSYS)that addresses data packets based on benign scenario to truly report on false benign and exclude anomalies.Its performance is compared with artificial neural network auto-encoders to define its predictive power.Results show that though physical systems can adapt securely,it can be used for network data packets to identify true benign cases.展开更多
1 School of Computer Science,Shaanxi Normal University,Xi’an 710119,China 2 Faculty of Computer Science and Control Engineering,Shenzhen Institute of Advanced Technology,Chinese Academy of Sciences,Shenzhen 518055,Ch...1 School of Computer Science,Shaanxi Normal University,Xi’an 710119,China 2 Faculty of Computer Science and Control Engineering,Shenzhen Institute of Advanced Technology,Chinese Academy of Sciences,Shenzhen 518055,China 3 Shenzhen Key Laboratory of Intelligent Bioinformatics,Shenzhen Institute of Advanced Technology,Chinese Academy of Science,Shenzhen 518055,China E-mail:xjlei@snnu.edu.cn;yalichen@snnu.edu.cn;yi.pan@siat.ac.cn Received December 9,2022;accepted July 29,2024.Abstract Identifying microbes associated with diseases is important for understanding the pathogenesis of diseases as well as for the diagnosis and treatment of diseases.In this article,we propose a method based on a multi-source association network to predict microbe-disease associations,named MMHN-MDA.First,a heterogeneous network of multimolecule associations is constructed based on associations between microbes,diseases,drugs,and metabolites.Second,the graph embedding algorithm Laplacian eigenmaps is applied to the association network to learn the behavior features of microbe nodes and disease nodes.At the same time,the denoising autoencoder(DAE)is used to learn the attribute features of microbe nodes and disease nodes.Finally,attribute features and behavior features are combined to get the final embedding features of microbes and diseases,which are fed into the convolutional neural network(CNN)to predict the microbedisease associations.Experimental results show that the proposed method is more effective than existing methods.In addition,case studies on bipolar disorder and schizophrenia demonstrate good predictive performance of the MMHN-MDA model,and further,the results suggest that gut microbes may influence host gene expression or compounds in the nervous system,such as neurotransmitters,or metabolites that alter the blood-brain barrier.展开更多
基金Supported by National Natural Science Foundation of China(Grant Nos.52375414,52075100)Shanghai Science and Technology Committee Innovation Grant of China(Grant No.23ZR1404200).
文摘In modern industrial design trends featuring with integration,miniaturization,and versatility,there is a growing demand on the utilization of microstructural array devices.The measurement of such microstructural array components often encounters challenges due to the reduced scale and complex structures,either by contact or noncontact optical approaches.Among these microstructural arrays,there are still no optical measurement methods for micro corner-cube reflector arrays.To solve this problem,this study introduces a method for effectively eliminating coherent noise and achieving surface profile reconstruction in interference measurements of microstructural arrays.The proposed denoising method allows the calibration and inverse solving of system errors in the frequency domain by employing standard components with known surface types.This enables the effective compensation of the complex amplitude of non-sample coherent light within the interferometer optical path.The proposed surface reconstruction method enables the profile calculation within the situation that there is complex multi-reflection during the propagation of rays in microstructural arrays.Based on the measurement results,two novel metrics are defined to estimate diffraction errors at array junctions and comprehensive errors across multiple array elements,offering insights into other types of microstructure devices.This research not only addresses challenges of the coherent noise and multi-reflection,but also makes a breakthrough for quantitively optical interference measurement of microstructural array devices.
基金supported by the National Natural Science Foundation of China(No.62134004).
文摘To enhance the denoising performance of event-based sensors,we introduce a clustering-based temporal deep neural network denoising method(CBTDNN).Firstly,to cluster the sensor output data and obtain the respective cluster centers,a combination of density-based spatial clustering of applications with noise(DBSCAN)and Kmeans++is utilized.Subsequently,long short-term memory(LSTM)is employed to fit and yield optimized cluster centers with temporal information.Lastly,based on the new cluster centers and denoising ratio,a radius threshold is set,and noise points beyond this threshold are removed.The comprehensive denoising metrics F1_score of CBTDNN have achieved 0.8931,0.7735,and 0.9215 on the traffic sequences dataset,pedestrian detection dataset,and turntable dataset,respectively.And these metrics demonstrate improvements of 49.90%,33.07%,19.31%,and 22.97%compared to four contrastive algorithms,namely nearest neighbor(NNb),nearest neighbor with polarity(NNp),Autoencoder,and multilayer perceptron denoising filter(MLPF).These results demonstrate that the proposed method enhances the denoising performance of event-based sensors.
基金Supported by National Natural Science Foundation of China(Grant Nos.12072188,11632011,11702171,11572189,51121063)Shanghai Municipal Natural Science Foundation of China(Grant No.20ZR1425200).
文摘Deep learning algorithms based on neural networks make remarkable achievements in machine fault diagnosis,while the noise mixed in measured signals harms the prediction accuracy of networks.Existing denoising methods in neural networks,such as using complex network architectures and introducing sparse techniques,always suffer from the difficulty of estimating hyperparameters and the lack of physical interpretability.To address this issue,this paper proposes a novel interpretable denoising layer based on reproducing kernel Hilbert space(RKHS)as the first layer for standard neural networks,with the aim to combine the advantages of both traditional signal processing technology with physical interpretation and network modeling strategy with parameter adaption.By investigating the influencing mechanism of parameters on the regularization procedure in RKHS,the key parameter that dynamically controls the signal smoothness with low computational cost is selected as the only trainable parameter of the proposed layer.Besides,the forward and backward propagation algorithms of the designed layer are formulated to ensure that the selected parameter can be automatically updated together with other parameters in the neural network.Moreover,exponential and piecewise functions are introduced in the weight updating process to keep the trainable weight within a reasonable range and avoid the ill-conditioned problem.Experiment studies verify the effectiveness and compatibility of the proposed layer design method in intelligent fault diagnosis of machinery in noisy environments.
基金funded by National Nature Science Foundation of China,grant number 61302188。
文摘In recent years, deep convolutional neural networks have shown superior performance in image denoising. However, deep network structures often come with a large number of model parameters, leading to high training costs and long inference times, limiting their practical application in denoising tasks. This paper proposes a new dual convolutional denoising network with skip connections(DECDNet), which achieves an ideal balance between denoising effect and network complexity. The proposed DECDNet consists of a noise estimation network, a multi-scale feature extraction network, a dual convolutional neural network, and dual attention mechanisms. The noise estimation network is used to estimate the noise level map, and the multi-scale feature extraction network is combined to improve the model's flexibility in obtaining image features. The dual convolutional neural network branch design includes convolution and dilated convolution interactive connections, with the lower branch consisting of dilated convolution layers, and both branches using skip connections. Experiments show that compared with other models, the proposed DECDNet achieves superior PSNR and SSIM values at all compared noise levels, especially at higher noise levels, showing robustness to images with higher noise levels. It also demonstrates better visual effects, maintaining a balance between denoising and detail preservation.
基金This work was supported by JSPS KAKENHI,No.18 K15563.
文摘To minimize radiation risk,dose reduction is important in the diagnostic and therapeutic applications of computed tomography(CT).However,image noise degrades image quality owing to the reduced X-ray dose and a possible unacceptably reduced diagnostic performance.Deep learning approaches with convolutional neural networks(CNNs)have been proposed for natural image denoising;however,these approaches might introduce image blurring or loss of original gradients.The aim of this study was to compare the dose-dependent properties of a CNN-based denoising method for low-dose CT with those of other noise-reduction methods on unique CT noise-simulation images.To simulate a low-dose CT image,a Poisson noise distribution was introduced to normal-dose images while convoluting the CT unit-specific modulation transfer function.An abdominal CT of 100 images obtained from a public database was adopted,and simulated dose-reduction images were created from the original dose at equal 10-step dose-reduction intervals with a final dose of 1/100.These images were denoised using the denoising network structure of CNN(DnCNN)as the general CNN model and for transfer learning.To evaluate the image quality,image similarities determined by the structural similarity index(SSIM)and peak signal-to-noise ratio(PSNR)were calculated for the denoised images.Significantly better denoising,in terms of SSIM and PSNR,was achieved by the DnCNN than by other image denoising methods,especially at the ultra-low-dose levels used to generate the 10%and 5%dose-equivalent images.Moreover,the developed CNN model can eliminate noise and maintain image sharpness at these dose levels and improve SSIM by approximately 10%from that of the original method.In contrast,under small dose-reduction conditions,this model also led to excessive smoothing of the images.In quantitative evaluations,the CNN denoising method improved the low-dose CT and prevented over-smoothing by tailoring the CNN model.
基金Princess Nourah bint Abdulrahman University Researchers Supporting Project Number(PNURSP2022R281)Princess Nourah bint Abdulrahman University,Riyadh,Saudi Arabia+1 种基金The authors would like to thank the Deanship of Scientific Research at Umm Al-Qura University for supporting this work by Grant Code:22UQU4210118DSR33The authors are thankful to the Deanship of ScientificResearch atNajranUniversity for funding thiswork under theResearch Groups Funding Program Grant Code(NU/RG/SERC/11/7).
文摘ive Arabic Text Summarization using Hyperparameter Tuned Denoising Deep Neural Network(AATS-HTDDNN)technique.The presented AATS-HTDDNN technique aims to generate summaries of Arabic text.In the presented AATS-HTDDNN technique,the DDNN model is utilized to generate the summary.This study exploits the Chameleon Swarm Optimization(CSO)algorithm to fine-tune the hyperparameters relevant to the DDNN model since it considerably affects the summarization efficiency.This phase shows the novelty of the current study.To validate the enhanced summarization performance of the proposed AATS-HTDDNN model,a comprehensive experimental analysis was conducted.The comparison study outcomes confirmed the better performance of the AATS-HTDDNN model over other approaches.
基金co-supported by the Key Program of National Natural Science Foundation of China (No. U1533202)the Civil Aviation Administration of China (No. MHRD20150104)Shandong Independent Innovation and Achievements Transformation Fund (No. 2014CGZH1101)
文摘Many existing aircraft engine fault detection methods are highly dependent on performance deviation data that are provided by the original equipment manufacturer. To improve the independent engine fault detection ability, Aircraft Communications Addressing and Reporting System(ACARS) data can be used. However, owing to the characteristics of high dimension, complex correlations between parameters, and large noise content, it is difficult for existing methods to detect faults effectively by using ACARS data. To solve this problem, a novel engine fault detection method based on original ACARS data is proposed. First, inspired by computer vision methods, all variables were divided into separated groups according to their correlations. Then, an improved convolutional denoising autoencoder was used to extract the features of each group. Finally, all of the extracted features were fused to form feature vectors. Thereby, fault samples could be identified based on these feature vectors. Experiments were conducted to validate the effectiveness and efficiency of our method and other competing methods by considering real ACARS data as the data source. The results reveal the good performance of our method with regard to comprehensive fault detection and robustness. Additionally, the computational and time costs of our method are shown to be relatively low.
基金supported in part by the National Natural Science Foundation of China(No.51606213)the National Major Science and Technology Projects(No.J2019-III-0010-0054)。
文摘Icing is an important factor threatening aircraft flight safety.According to the requirements of airworthiness regulations,aircraft icing safety assessment is needed to be carried out based on the ice shapes formed under different icing conditions.Due to the complexity of the icing process,the rapid assessment of ice shape remains an important challenge.In this paper,an efficient prediction model of aircraft icing is established based on the deep belief network(DBN)and the stacked auto-encoder(SAE),which are all deep neural networks.The detailed network structures are designed and then the networks are trained according to the samples obtained by the icing numerical computation.After that the model is applied on the ice shape evaluation of NACA0012 airfoil.The results show that the model can accurately capture the nonlinear behavior of aircraft icing and thus make an excellent ice shape prediction.The model provides an important tool for aircraft icing analysis.
基金support from the National Science Foundation (Grant CMMI-1934300)Defense Advanced Research Projects Agency (DARPA) under the Physics of Artificial Intelligence (PAI) program (Grant HR00111890034)partial funding support by graduate fellowship from China Scholarship Council (CSC) in this effort
文摘In many applications,flow measurements are usually sparse and possibly noisy.The reconstruction of a high-resolution flow field from limited and imperfect flow information is significant yet challenging.In this work,we propose an innovative physics-constrained Bayesian deep learning approach to reconstruct flow fields from sparse,noisy velocity data,where equationbased constraints are imposed through the likelihood function and uncertainty of the reconstructed flow can be estimated.Specifically,a Bayesian deep neural network is trained on sparse measurement data to capture the flow field.In the meantime,the violation of physical laws will be penalized on a large number of spatiotemporal points where measurements are not available.A non-parametric variational inference approach is applied to enable efficient physicsconstrained Bayesian learning.Several test cases on idealized vascular flows with synthetic measurement data are studied to demonstrate the merit of the proposed method.
基金sponsored by the National Natural Science Foundation of China(Grant No.41674120)
文摘Utilizing data from controlled seismic sources to image the subsurface structures and invert the physical properties of the subsurface media is a major effort in exploration geophysics. Dense seismic records with high signal-to-noise ratio(SNR) and high fidelity helps in producing high quality imaging results. Therefore, seismic data denoising and missing traces reconstruction are significant for seismic data processing. Traditional denoising and interpolation methods rarely occasioned rely on noise level estimations, thus requiring heavy manual work to deal with records and the selection of optimal parameters. We propose a simultaneous denoising and interpolation method based on deep learning. For noisy records with missing traces, we adopt an iterative alternating optimization strategy and separate the objective function of the data restoring problem into two sub-problems. The seismic records can be reconstructed by solving a least-square problem and applying a set of pre-trained denoising models alternatively and iteratively.We demonstrate this method with synthetic and field data.
基金supported by the Joint Funds of the National Natural Science Foundation of China (No. U1833110)
文摘Safety is the foundation of sustainable development in civil aviation.Although catastrophic accidents are rare,indicators of potential incidents and unsafe events frequently materialize.Therefore,a history of unsafe data are considered in predicting safety risks.A deep learning method is adopted for extracting reactions in safety risks.The deep neural network(DNN)model for safety risk prediction is shown to extract complex data characteristics better than a shallow network model.Using extended unsafe data and monthly risk indices,hidden layers and iterations are determined.The effectiveness of DNN is also revealed in comparison with the traditional neural network.Through early risk detection using the method in the paper,airlines and the government can mitigate potential risk and take proactive measures to improve civil aviation safety.
基金supported by the National Natural Science Foundation of China(Nos.11975292,12222512)the CAS"Light of West Chin"Program+1 种基金the CAS Pioneer Hundred Talent Programthe Guangdong Major Project of Basic and Applied Basic Research(No.2020B0301030008)。
文摘In this paper,we propose Hformer,a novel supervised learning model for low-dose computer tomography(LDCT)denoising.Hformer combines the strengths of convolutional neural networks for local feature extraction and transformer models for global feature capture.The performance of Hformer was verified and evaluated based on the AAPM-Mayo Clinic LDCT Grand Challenge Dataset.Compared with the former representative state-of-the-art(SOTA)model designs under different architectures,Hformer achieved optimal metrics without requiring a large number of learning parameters,with metrics of33.4405 PSNR,8.6956 RMSE,and 0.9163 SSIM.The experiments demonstrated designed Hformer is a SOTA model for noise suppression,structure preservation,and lesion detection.
文摘The rolling bearing vibration signal is non-stationary and is easily disturbed by background noise,so it is difficult to accurately diagnose bearing faults.A fault diagnosis method of rolling bearing based on the time-frequency threshold denoising synchrosqueezing transform(TDSST)and convolutional neural network(CNN)is proposed.Since the traditional methods of wavelet threshold denoising and wavelet adjacent coefficient denoising are greatly affected by the estimation accuracy of noise variance,a time-frequency denoising method based on the STFT spectral correlation coefficient threshold optimization is adopted,which is combined with a synchrosqueezing transform.The ability of the TDSST to reduce noise and improve time-frequency resolution was verified by simulated impact fault signals of rolling bearings.Finally,the CNN is utilized to diagnose the time-frequency diagrams obtained by the TDSST.The diagnostic results of the rolling bearing experimental data show that the proposed method can effectively improve the accuracy of diagnosis.When the SNR of the bearing signal is larger than 0 dB,the accuracy is over 95%,even when the SNR reduces to-4 dB,the accuracy is still around 80%.Moreover,the standard deviation of multiple test results is small,which means that the method has good robustness.
基金This work is supported by NSFC Joint Fund with Zhejiang Integration of Informatization and Industrialization under Key Project(No.U1609218)the National Nature Science Foundation of China(No.61602277)Shandong Provincial Natural Science Foundation of China(No.ZR2016FQ12).
文摘With the explosion in the number of digital images taken every day,the demand for more accurate and visually pleasing images is increasing.However,the images captured by modern cameras are inevitably degraded by noise,which leads to deteriorated visual image quality.Therefore,work is required to reduce noise without losing image features(edges,corners,and other sharp structures).So far,researchers have already proposed various methods for decreasing noise.Each method has its own advantages and disadvantages.In this paper,we summarize some important research in the field of image denoising.First,we give the formulation of the image denoising problem,and then we present several image denoising techniques.In addition,we discuss the characteristics of these techniques.Finally,we provide several promising directions for future research.
基金This research was financially supported in part by the Ministry of Trade,Industry and Energy(MOTIE)and Korea Institute for Advancement of Technology(KIAT)through the International Cooperative R&D program.(Project No.P0016038)and in part by the MSIT(Ministry of Science and ICT),Korea,under the ITRC(Information Technology Research Center)support program(IITP-2021-2016-0-00312)supervised by the IITP(Institute for Information&communications Technology Planning&Evaluation).
文摘Medical Resonance Imaging(MRI)is a noninvasive,nonradioactive,and meticulous diagnostic modality capability in the field of medical imaging.However,the efficiency of MR image reconstruction is affected by its bulky image sets and slow process implementation.Therefore,to obtain a high-quality reconstructed image we presented a sparse aware noise removal technique that uses convolution neural network(SANR_CNN)for eliminating noise and improving the MR image reconstruction quality.The proposed noise removal or denoising technique adopts a fast CNN architecture that aids in training larger datasets with improved quality,and SARN algorithm is used for building a dictionary learning technique for denoising large image datasets.The proposed SANR_CNN model also preserves the details and edges in the image during reconstruction.An experiment was conducted to analyze the performance of SANR_CNN in a few existing models in regard with peak signal-to-noise ratio(PSNR),structural similarity index(SSIM),and mean squared error(MSE).The proposed SANR_CNN model achieved higher PSNR,SSIM,and MSE efficiency than the other noise removal techniques.The proposed architecture also provides transmission of these denoised medical images through secured IoT architecture.
文摘In recent years,computer visionfinds wide applications in maritime surveillance with its sophisticated algorithms and advanced architecture.Auto-matic ship detection with computer vision techniques provide an efficient means to monitor as well as track ships in water bodies.Waterways being an important medium of transport require continuous monitoring for protection of national security.The remote sensing satellite images of ships in harbours and water bodies are the image data that aid the neural network models to localize ships and to facilitate early identification of possible threats at sea.This paper proposes a deep learning based model capable enough to classify between ships and no-ships as well as to localize ships in the original images using bounding box tech-nique.Furthermore,classified ships are again segmented with deep learning based auto-encoder model.The proposed model,in terms of classification,provides suc-cessful results generating 99.5%and 99.2%validation and training accuracy respectively.The auto-encoder model also produces 85.1%and 84.2%validation and training accuracies.Moreover the IoU metric of the segmented images is found to be of 0.77 value.The experimental results reveal that the model is accu-rate and can be implemented for automatic ship detection in water bodies consid-ering remote sensing satellite images as input to the computer vision system.
文摘In order to obtain clear images and solve the problems of low image quality caused by noise disturbance,a lot of researches have been done on image denoising techniques.In the theoretical system of algorithms studied so far,many algorithms can effectively remove noise in low-dimensional images,but at the same time,the results are slightly inferior when processing high-dimensional images.This paper proposes a q-GAN,which uses multi-scale in generating networks.The convolution kernel extracts image features and transforms the denoising problem into the feature domain.In the feature domain,a residual structure is used to denoise,and the noise distribution is removed from the feature distribution.There are residual noise features in the obtained denoising features,which are removed by subsequent feature filtering of the network structure,and finally a denoised image is generated by fusing the noiseless features.
基金supported by the National Natural Science Foundation of China(61872231,61701297)the Major Program of the National Social Science Foundation of China(Grant No.20&ZD130).
文摘Image denoising is often used as a preprocessing step in computer vision tasks,which can help improve the accuracy of image processing models.Due to the imperfection of imaging systems,transmission media and recording equipment,digital images are often contaminated with various noises during their formation,which troubles the visual effects and even hinders people’s normal recognition.The pollution of noise directly affects the processing of image edge detection,feature extraction,pattern recognition,etc.,making it difficult for people to break through the bottleneck by modifying the model.Many traditional filtering methods have shown poor performance since they do not have optimal expression and adaptation for specific images.Meanwhile,deep learning technology opens up new possibilities for image denoising.In this paper,we propose a novel neural network which is based on generative adversarial networks for image denoising.Inspired by U-net,our method employs a novel symmetrical encoder-decoder based generator network.The encoder adopts convolutional neural networks to extract features,while the decoder outputs the noise in the images by deconvolutional neural networks.Specially,shortcuts are added between designated layers,which can preserve image texture details and prevent gradient explosions.Besides,in order to improve the training stability of the model,we add Wasserstein distance in loss function as an optimization.We use the peak signal-to-noise ratio(PSNR)to evaluate our model and we can prove the effectiveness of it with experimental results.When compared to the state-of-the-art approaches,our method presents competitive performance.
文摘In network settings,one of the major disadvantages that threaten the network protocols is the insecurity.In most cases,unscrupulous people or bad actors can access information through unsecured connections by planting software or what we call malicious software otherwise anomalies.The presence of anomalies is also one of the disadvantages,internet users are constantly plagued by virus on their system and get activated when a harmless link is clicked on,this a case of true benign detected as false.Deep learning is very adept at dealing with such cases,but sometimes it has its own faults when dealing benign cases.Here we tend to adopt a dynamic control system(DCSYS)that addresses data packets based on benign scenario to truly report on false benign and exclude anomalies.Its performance is compared with artificial neural network auto-encoders to define its predictive power.Results show that though physical systems can adapt securely,it can be used for network data packets to identify true benign cases.
基金supported by the National Natural Science Foundation of China under Grant Nos.62272288 and U22A2041the Fundamental Research Funds for the Central Universities of China,and Shaanxi Normal University under Grant No.GK202302006.
文摘1 School of Computer Science,Shaanxi Normal University,Xi’an 710119,China 2 Faculty of Computer Science and Control Engineering,Shenzhen Institute of Advanced Technology,Chinese Academy of Sciences,Shenzhen 518055,China 3 Shenzhen Key Laboratory of Intelligent Bioinformatics,Shenzhen Institute of Advanced Technology,Chinese Academy of Science,Shenzhen 518055,China E-mail:xjlei@snnu.edu.cn;yalichen@snnu.edu.cn;yi.pan@siat.ac.cn Received December 9,2022;accepted July 29,2024.Abstract Identifying microbes associated with diseases is important for understanding the pathogenesis of diseases as well as for the diagnosis and treatment of diseases.In this article,we propose a method based on a multi-source association network to predict microbe-disease associations,named MMHN-MDA.First,a heterogeneous network of multimolecule associations is constructed based on associations between microbes,diseases,drugs,and metabolites.Second,the graph embedding algorithm Laplacian eigenmaps is applied to the association network to learn the behavior features of microbe nodes and disease nodes.At the same time,the denoising autoencoder(DAE)is used to learn the attribute features of microbe nodes and disease nodes.Finally,attribute features and behavior features are combined to get the final embedding features of microbes and diseases,which are fed into the convolutional neural network(CNN)to predict the microbedisease associations.Experimental results show that the proposed method is more effective than existing methods.In addition,case studies on bipolar disorder and schizophrenia demonstrate good predictive performance of the MMHN-MDA model,and further,the results suggest that gut microbes may influence host gene expression or compounds in the nervous system,such as neurotransmitters,or metabolites that alter the blood-brain barrier.
