With the rapid development of mechanical equipment,mechanical health monitoring field has entered the era of big data.Deep learning has made a great achievement in the processing of large data of image and speech due ...With the rapid development of mechanical equipment,mechanical health monitoring field has entered the era of big data.Deep learning has made a great achievement in the processing of large data of image and speech due to the powerful modeling capabilities,this also brings influence to the mechanical fault diagnosis field.Therefore,according to the characteristics of motor vibration signals(nonstationary and difficult to deal with)and mechanical‘big data’,combined with deep learning,a motor fault diagnosis method based on stacked de-noising auto-encoder is proposed.The frequency domain signals obtained by the Fourier transform are used as input to the network.This method can extract features adaptively and unsupervised,and get rid of the dependence of traditional machine learning methods on human extraction features.A supervised fine tuning of the model is then carried out by backpropagation.The Asynchronous motor in Drivetrain Dynamics Simulator system was taken as the research object,the effectiveness of the proposed method was verified by a large number of data,and research on visualization of network output,the results shown that the SDAE method is more efficient and more intelligent.展开更多
Rolling bearings are important central components in rotating machines, whose fault diagnosis is crucial in condition-based maintenance to reduce the complexity of different kinds of faults. To classify various rollin...Rolling bearings are important central components in rotating machines, whose fault diagnosis is crucial in condition-based maintenance to reduce the complexity of different kinds of faults. To classify various rolling bearing faults, a prognostic algorithm consisting of four phases was proposed. Since stacked denoising auto-encoder can be filtered, noise of large numbers of mechanical vibration signals was used for deep learning structure to extract the characteristics of the noise. Unsupervised pre-training method, which can greatly simplify the traditional manual extraction approach, was utilized to process the depth of the data automatically. Furthermore, the aggregation layer of stacked denoising auto-encoder(SDA) was proposed to get rid of gradient disappearance in deeper layers of network, mix superficial nodes’ expression with deeper layers, and avoid the insufficient express ability in deeper layers. Principal component analysis(PCA) was adopted to extract different features for classification. According to the experimental data of this method and from the comparison results, the proposed method of rolling bearing fault classification reached 97.02% of correct rate, suggesting a better performance than other algorithms.展开更多
Intelligent diagnosis approaches with shallow architectural models play an essential role in healthcare.Deep Learning(DL)models with unsupervised learning concepts have been proposed because high-quality feature extra...Intelligent diagnosis approaches with shallow architectural models play an essential role in healthcare.Deep Learning(DL)models with unsupervised learning concepts have been proposed because high-quality feature extraction and adequate labelled details significantly influence shallow models.On the other hand,skin lesionbased segregation and disintegration procedures play an essential role in earlier skin cancer detection.However,artefacts,an unclear boundary,poor contrast,and different lesion sizes make detection difficult.To address the issues in skin lesion diagnosis,this study creates the UDLS-DDOA model,an intelligent Unsupervised Deep Learning-based Stacked Auto-encoder(UDLS)optimized by Dynamic Differential Annealed Optimization(DDOA).Pre-processing,segregation,feature removal or separation,and disintegration are part of the proposed skin lesion diagnosis model.Pre-processing of skin lesion images occurs at the initial level for noise removal in the image using the Top hat filter and painting methodology.Following that,a Fuzzy C-Means(FCM)segregation procedure is performed using a Quasi-Oppositional Elephant Herd Optimization(QOEHO)algorithm.Besides,a novel feature extraction technique using the UDLS technique is applied where the parameter tuning takes place using DDOA.In the end,the disintegration procedure would be accomplished using a SoftMax(SM)classifier.The UDLS-DDOA model is tested against the International Skin Imaging Collaboration(ISIC)dataset,and the experimental results are examined using various computational attributes.The simulation results demonstrated that the UDLS-DDOA model outperformed the compared methods significantly.展开更多
The influenza virus changes its antigenicity frequently due to rapid mutations, leading to immune escape and failure of vaccination. Rapid determination of the influenza antigenicity could help identify the antigenic ...The influenza virus changes its antigenicity frequently due to rapid mutations, leading to immune escape and failure of vaccination. Rapid determination of the influenza antigenicity could help identify the antigenic variants in time. Here, we built a stacked auto-encoder (SAE) model for predicting the antigenic variant of human influenza A(H3N2) viruses based on the hemagglutinin (HA) protein sequences. The model achieved an accuracy of 0.95 in five-fold cross-validations, better than the logistic regression model did. Further analysis of the model shows that most of the active nodes in the hidden layer reflected the combined contribution of multiple residues to antigenic variation. Besides, some features (residues on HA protein) in the input layer were observed to take part in multiple active nodes, such as residue 189, 145 and 156, which were also reported to mostly determine the antigenic variation of influenza A(H3N2) viruses. Overall,this work is not only useful for rapidly identifying antigenic variants in influenza prevention, but also an interesting attempt in inferring the mechanisms of biological process through analysis of SAE model, which may give some insights into interpretation of the deep learning展开更多
Objective and accurate evaluation of rock mass quality classification is the prerequisite for reliable sta-bility assessment.To develop a tool that can deliver quick and accurate evaluation of rock mass quality,a deep...Objective and accurate evaluation of rock mass quality classification is the prerequisite for reliable sta-bility assessment.To develop a tool that can deliver quick and accurate evaluation of rock mass quality,a deep learning approach is developed,which uses stacked autoencoders(SAEs)with several autoencoders and a softmax net layer.Ten rock parameters of rock mass rating(RMR)system are calibrated in this model.The model is trained using 75%of the total database for training sample data.The SAEs trained model achieves a nearly 100%prediction accuracy.For comparison,other different models are also trained with the same dataset,using artificial neural network(ANN)and radial basis function(RBF).The results show that the SAEs classify all test samples correctly while the rating accuracies of ANN and RBF are 97.5%and 98.7%,repectively,which are calculated from the confusion matrix.Moreover,this model is further employed to predict the slope risk level of an abandoned quarry.The proposed approach using SAEs,or deep learning in general,is more objective and more accurate and requires less human inter-vention.The findings presented here shall shed light for engineers/researchers interested in analyzing rock mass classification criteria or performing field investigation.展开更多
针对强噪声环境下雷达新型有源干扰识别准确率不高的问题,提出了一种KPCA-SAE-BP网络算法。提取干扰信号时域、频域、波形域、小波域、双谱域等特征构建67维输入空间,经过核主成分分析(kernel principal component analysis,KPCA)将高...针对强噪声环境下雷达新型有源干扰识别准确率不高的问题,提出了一种KPCA-SAE-BP网络算法。提取干扰信号时域、频域、波形域、小波域、双谱域等特征构建67维输入空间,经过核主成分分析(kernel principal component analysis,KPCA)将高维数据进行非线性降维与重构,利用SAE-BP神经网络完成分类识别。仿真结果表明,在干噪比(JNR)大于-1 dB的强噪声环境中,KPCA-SAE-BP网络算法对6种新型有源干扰的识别准确率达到90%以上,训练与识别时间少于0.7 s。相同参数条件下,与经典BP神经网络、SAE-BP网络、KPCA-BP网络、GA-BP网络相比,具有更好的检测识别性能。展开更多
At present,ZPW-2000 track circuit fault diagnosis is artificially analyzed and monitored.Its discrimination method not only is low efficient and takes a long period,but also requires highly experienced personnel to an...At present,ZPW-2000 track circuit fault diagnosis is artificially analyzed and monitored.Its discrimination method not only is low efficient and takes a long period,but also requires highly experienced personnel to analyze the data.Therefore,we introduce kernel principal component analysis and stacked auto-encoder network(KPCA-SAD)into the fault diagnosis of ZPW-2000 track circuit.According to the working principle and fault characteristics of track circuit,a fault diagnosis model of KPCA-SAE network is established.The relevant parameters of key components recorded in the data collected by field staff are used as the fault feature parameters.The KPCA method is used to reduce the dimension and noise of fault document matrix to avoid information redundancy.The SAE network is trained by the processed fault data.The model parameters are optimized overall by using back propagation(BP)algorithm.The KPCA-SAE model is simulated in Matlab platform and is finally proved to be effective and feasible.Compared with the traditional method of artificially analyzing fault data and other intelligent algorithms,the KPCA-SAE based classifier has higher fault identification accuracy.展开更多
情感计算是现代人机交互中的关键问题,随着人工智能的发展,基于脑电信号(electroencephalogram, EEG)的情绪识别已经成为重要的研究方向.为了提高情绪识别的分类精度,本研究引入堆叠自动编码器(stacked autoencoder, SAE)对EEG多通道信...情感计算是现代人机交互中的关键问题,随着人工智能的发展,基于脑电信号(electroencephalogram, EEG)的情绪识别已经成为重要的研究方向.为了提高情绪识别的分类精度,本研究引入堆叠自动编码器(stacked autoencoder, SAE)对EEG多通道信号进行深度特征提取,并提出一种基于广义正态分布优化的支持向量机(generalized normal distribution optimization based support vector machine, GNDO-SVM)情绪识别模型.实验结果表明,与基于遗传算法、粒子群算法和麻雀搜索算法优化的支持向量机模型相比,所提出的GNDO-SVM模型具有更优的分类性能,基于SAE深度特征的情感识别准确率达到了90.94%,表明SAE能够有效地挖掘EEG信号不同通道间的深度相关性信息.因此,利用SAE深度特征结合GNDO-SVM模型可以有效地实现EEG信号的情绪识别.展开更多
The health status of aero engines is very important to the flight safety.However,it is difficult for aero engines to make an effective fault diagnosis due to its complex structure and poor working environment.Therefor...The health status of aero engines is very important to the flight safety.However,it is difficult for aero engines to make an effective fault diagnosis due to its complex structure and poor working environment.Therefore,an effective fault diagnosis method for aero engines based on the gravitational search algorithm and the stack autoencoder(GSA-SAE)is proposed,and the fault diagnosis technology of a turbofan engine is studied.Firstly,the data of 17 parameters,including total inlet air temperature,high-pressure rotor speed,low-pressure rotor speed,turbine pressure ratio,total inlet air temperature of high-pressure compressor and outlet air pressure of high-pressure compressor and so on,are preprocessed,and the fault diagnosis model architecture of SAE is constructed.In order to solve the problem that the best diagnosis effect cannot be obtained due to manually setting the number of neurons in each hidden layer of SAE network,a GSA optimization algorithm for the SAE network is proposed to find and obtain the optimal number of neurons in each hidden layer of SAE network.Furthermore,an optimal fault diagnosis model based on GSA-SAE is established for aero engines.Finally,the effectiveness of the optimal GSA-SAE fault diagnosis model is demonstrated using the practical data of aero engines.The results illustrate that the proposed fault diagnosis method effectively solves the problem of the poor fault diagnosis result because of manually setting the number of neurons in each hidden layer of SAE network,and has good fault diagnosis efficiency.The fault diagnosis accuracy of the GSA-SAE model reaches 98.222%,which is significantly higher than that of SAE,the general regression neural network(GRNN)and the back propagation(BP)network fault diagnosis models.展开更多
Heartbeat detection stays central to cardiovascular an electrocardiogram(ECG)is used to help with disease diagnosis and management.Existing Convolutional Neural Network(CNN)-based methods suffer from the less generali...Heartbeat detection stays central to cardiovascular an electrocardiogram(ECG)is used to help with disease diagnosis and management.Existing Convolutional Neural Network(CNN)-based methods suffer from the less generalization problem thus;the effectiveness and robustness of the traditional heartbeat detector methods cannot be guaranteed.In contrast,this work proposes a heartbeat detector Krill based Deep Neural Network Stacked Auto Encoders(KDNN-SAE)that computes the disease before the exact heart rate by combining features from multiple ECG Signals.Heartbeats are classified independently and multiple signals are fused to estimate life threatening conditions earlier without any error in classification of heart beat.This work contained Training and testing stages,in the preparation part at first the Adaptive Filter Enthalpy-based Empirical Mode Decomposition(EMD)is utilized to eliminate the motion artifact in the signal.At that point,the robotic process automation(RPA)learning part extracts the effective features are extracted,and normalized the value of the feature then estimated utilizing the RPA loss function.At last KDNN-SAE prepared training for the data stored in the dataset.In the subsequent stage,input signal compute motion artifact and RPA Learning the evaluation part determines the detection of Heartbeat.So early diagnosis of heart failures is an essential factor.The results of the experiments show that our proposed method has a high score outcome of 0.9997.Comparable to the CIF,which reaches 0.9990.The CNN and Artificial Neural Network(ANN)had less score 0.95115 and 0.90147.展开更多
基金This research is supported financially by Natural Science Foundation of China(Grant No.51505234,51405241,51575283).
文摘With the rapid development of mechanical equipment,mechanical health monitoring field has entered the era of big data.Deep learning has made a great achievement in the processing of large data of image and speech due to the powerful modeling capabilities,this also brings influence to the mechanical fault diagnosis field.Therefore,according to the characteristics of motor vibration signals(nonstationary and difficult to deal with)and mechanical‘big data’,combined with deep learning,a motor fault diagnosis method based on stacked de-noising auto-encoder is proposed.The frequency domain signals obtained by the Fourier transform are used as input to the network.This method can extract features adaptively and unsupervised,and get rid of the dependence of traditional machine learning methods on human extraction features.A supervised fine tuning of the model is then carried out by backpropagation.The Asynchronous motor in Drivetrain Dynamics Simulator system was taken as the research object,the effectiveness of the proposed method was verified by a large number of data,and research on visualization of network output,the results shown that the SDAE method is more efficient and more intelligent.
基金Sponsored by the National Natural Science Foundation of China(Grant No.51704138)
文摘Rolling bearings are important central components in rotating machines, whose fault diagnosis is crucial in condition-based maintenance to reduce the complexity of different kinds of faults. To classify various rolling bearing faults, a prognostic algorithm consisting of four phases was proposed. Since stacked denoising auto-encoder can be filtered, noise of large numbers of mechanical vibration signals was used for deep learning structure to extract the characteristics of the noise. Unsupervised pre-training method, which can greatly simplify the traditional manual extraction approach, was utilized to process the depth of the data automatically. Furthermore, the aggregation layer of stacked denoising auto-encoder(SDA) was proposed to get rid of gradient disappearance in deeper layers of network, mix superficial nodes’ expression with deeper layers, and avoid the insufficient express ability in deeper layers. Principal component analysis(PCA) was adopted to extract different features for classification. According to the experimental data of this method and from the comparison results, the proposed method of rolling bearing fault classification reached 97.02% of correct rate, suggesting a better performance than other algorithms.
基金deputyship for Research&Innovation,Ministry of Education in Saudi Arabia,for funding this research work through Project Number (IFP-2020-133).
文摘Intelligent diagnosis approaches with shallow architectural models play an essential role in healthcare.Deep Learning(DL)models with unsupervised learning concepts have been proposed because high-quality feature extraction and adequate labelled details significantly influence shallow models.On the other hand,skin lesionbased segregation and disintegration procedures play an essential role in earlier skin cancer detection.However,artefacts,an unclear boundary,poor contrast,and different lesion sizes make detection difficult.To address the issues in skin lesion diagnosis,this study creates the UDLS-DDOA model,an intelligent Unsupervised Deep Learning-based Stacked Auto-encoder(UDLS)optimized by Dynamic Differential Annealed Optimization(DDOA).Pre-processing,segregation,feature removal or separation,and disintegration are part of the proposed skin lesion diagnosis model.Pre-processing of skin lesion images occurs at the initial level for noise removal in the image using the Top hat filter and painting methodology.Following that,a Fuzzy C-Means(FCM)segregation procedure is performed using a Quasi-Oppositional Elephant Herd Optimization(QOEHO)algorithm.Besides,a novel feature extraction technique using the UDLS technique is applied where the parameter tuning takes place using DDOA.In the end,the disintegration procedure would be accomplished using a SoftMax(SM)classifier.The UDLS-DDOA model is tested against the International Skin Imaging Collaboration(ISIC)dataset,and the experimental results are examined using various computational attributes.The simulation results demonstrated that the UDLS-DDOA model outperformed the compared methods significantly.
文摘The influenza virus changes its antigenicity frequently due to rapid mutations, leading to immune escape and failure of vaccination. Rapid determination of the influenza antigenicity could help identify the antigenic variants in time. Here, we built a stacked auto-encoder (SAE) model for predicting the antigenic variant of human influenza A(H3N2) viruses based on the hemagglutinin (HA) protein sequences. The model achieved an accuracy of 0.95 in five-fold cross-validations, better than the logistic regression model did. Further analysis of the model shows that most of the active nodes in the hidden layer reflected the combined contribution of multiple residues to antigenic variation. Besides, some features (residues on HA protein) in the input layer were observed to take part in multiple active nodes, such as residue 189, 145 and 156, which were also reported to mostly determine the antigenic variation of influenza A(H3N2) viruses. Overall,this work is not only useful for rapidly identifying antigenic variants in influenza prevention, but also an interesting attempt in inferring the mechanisms of biological process through analysis of SAE model, which may give some insights into interpretation of the deep learning
基金supported by the National Natural Science Foundation of China(Grant Nos.51979253,51879245)the Fundamental Research Funds for the Central Universities,China University of Geosciences(Wuhan)(Grant No.CUGCJ1821).
文摘Objective and accurate evaluation of rock mass quality classification is the prerequisite for reliable sta-bility assessment.To develop a tool that can deliver quick and accurate evaluation of rock mass quality,a deep learning approach is developed,which uses stacked autoencoders(SAEs)with several autoencoders and a softmax net layer.Ten rock parameters of rock mass rating(RMR)system are calibrated in this model.The model is trained using 75%of the total database for training sample data.The SAEs trained model achieves a nearly 100%prediction accuracy.For comparison,other different models are also trained with the same dataset,using artificial neural network(ANN)and radial basis function(RBF).The results show that the SAEs classify all test samples correctly while the rating accuracies of ANN and RBF are 97.5%and 98.7%,repectively,which are calculated from the confusion matrix.Moreover,this model is further employed to predict the slope risk level of an abandoned quarry.The proposed approach using SAEs,or deep learning in general,is more objective and more accurate and requires less human inter-vention.The findings presented here shall shed light for engineers/researchers interested in analyzing rock mass classification criteria or performing field investigation.
基金National Natural Science Foundation of China(No.61763023)。
文摘At present,ZPW-2000 track circuit fault diagnosis is artificially analyzed and monitored.Its discrimination method not only is low efficient and takes a long period,but also requires highly experienced personnel to analyze the data.Therefore,we introduce kernel principal component analysis and stacked auto-encoder network(KPCA-SAD)into the fault diagnosis of ZPW-2000 track circuit.According to the working principle and fault characteristics of track circuit,a fault diagnosis model of KPCA-SAE network is established.The relevant parameters of key components recorded in the data collected by field staff are used as the fault feature parameters.The KPCA method is used to reduce the dimension and noise of fault document matrix to avoid information redundancy.The SAE network is trained by the processed fault data.The model parameters are optimized overall by using back propagation(BP)algorithm.The KPCA-SAE model is simulated in Matlab platform and is finally proved to be effective and feasible.Compared with the traditional method of artificially analyzing fault data and other intelligent algorithms,the KPCA-SAE based classifier has higher fault identification accuracy.
文摘情感计算是现代人机交互中的关键问题,随着人工智能的发展,基于脑电信号(electroencephalogram, EEG)的情绪识别已经成为重要的研究方向.为了提高情绪识别的分类精度,本研究引入堆叠自动编码器(stacked autoencoder, SAE)对EEG多通道信号进行深度特征提取,并提出一种基于广义正态分布优化的支持向量机(generalized normal distribution optimization based support vector machine, GNDO-SVM)情绪识别模型.实验结果表明,与基于遗传算法、粒子群算法和麻雀搜索算法优化的支持向量机模型相比,所提出的GNDO-SVM模型具有更优的分类性能,基于SAE深度特征的情感识别准确率达到了90.94%,表明SAE能够有效地挖掘EEG信号不同通道间的深度相关性信息.因此,利用SAE深度特征结合GNDO-SVM模型可以有效地实现EEG信号的情绪识别.
基金supported by the National Natural Science Foundation of China(No.51605309)the Aeronautical Science Foundation of China(Nos.201933054002,20163354004)。
文摘The health status of aero engines is very important to the flight safety.However,it is difficult for aero engines to make an effective fault diagnosis due to its complex structure and poor working environment.Therefore,an effective fault diagnosis method for aero engines based on the gravitational search algorithm and the stack autoencoder(GSA-SAE)is proposed,and the fault diagnosis technology of a turbofan engine is studied.Firstly,the data of 17 parameters,including total inlet air temperature,high-pressure rotor speed,low-pressure rotor speed,turbine pressure ratio,total inlet air temperature of high-pressure compressor and outlet air pressure of high-pressure compressor and so on,are preprocessed,and the fault diagnosis model architecture of SAE is constructed.In order to solve the problem that the best diagnosis effect cannot be obtained due to manually setting the number of neurons in each hidden layer of SAE network,a GSA optimization algorithm for the SAE network is proposed to find and obtain the optimal number of neurons in each hidden layer of SAE network.Furthermore,an optimal fault diagnosis model based on GSA-SAE is established for aero engines.Finally,the effectiveness of the optimal GSA-SAE fault diagnosis model is demonstrated using the practical data of aero engines.The results illustrate that the proposed fault diagnosis method effectively solves the problem of the poor fault diagnosis result because of manually setting the number of neurons in each hidden layer of SAE network,and has good fault diagnosis efficiency.The fault diagnosis accuracy of the GSA-SAE model reaches 98.222%,which is significantly higher than that of SAE,the general regression neural network(GRNN)and the back propagation(BP)network fault diagnosis models.
文摘Heartbeat detection stays central to cardiovascular an electrocardiogram(ECG)is used to help with disease diagnosis and management.Existing Convolutional Neural Network(CNN)-based methods suffer from the less generalization problem thus;the effectiveness and robustness of the traditional heartbeat detector methods cannot be guaranteed.In contrast,this work proposes a heartbeat detector Krill based Deep Neural Network Stacked Auto Encoders(KDNN-SAE)that computes the disease before the exact heart rate by combining features from multiple ECG Signals.Heartbeats are classified independently and multiple signals are fused to estimate life threatening conditions earlier without any error in classification of heart beat.This work contained Training and testing stages,in the preparation part at first the Adaptive Filter Enthalpy-based Empirical Mode Decomposition(EMD)is utilized to eliminate the motion artifact in the signal.At that point,the robotic process automation(RPA)learning part extracts the effective features are extracted,and normalized the value of the feature then estimated utilizing the RPA loss function.At last KDNN-SAE prepared training for the data stored in the dataset.In the subsequent stage,input signal compute motion artifact and RPA Learning the evaluation part determines the detection of Heartbeat.So early diagnosis of heart failures is an essential factor.The results of the experiments show that our proposed method has a high score outcome of 0.9997.Comparable to the CIF,which reaches 0.9990.The CNN and Artificial Neural Network(ANN)had less score 0.95115 and 0.90147.
