A new incremental support vector machine （SVM） algorithm is proposed which is based on multiple kernel learning. Through introducing multiple kernel learning into the SVM incremental learning, large scale data set l...A new incremental support vector machine （SVM） algorithm is proposed which is based on multiple kernel learning. Through introducing multiple kernel learning into the SVM incremental learning, large scale data set learning problem can be solved effectively. Furthermore, different punishments are adopted in allusion to the training subset and the acquired support vectors, which may help to improve the performance of SVM. Simulation results indicate that the proposed algorithm can not only solve the model selection problem in SVM incremental learning, but also improve the classification or prediction precision.展开更多
Word Sense Disambiguation has been a trending topic of research in Natural Language Processing and Machine Learning.Mining core features and performing the text classification still exist as a challenging task.Here the...Word Sense Disambiguation has been a trending topic of research in Natural Language Processing and Machine Learning.Mining core features and performing the text classification still exist as a challenging task.Here the features of the context such as neighboring words like adjective provide the evidence for classification using machine learning approach.This paper presented the text document classification that has wide applications in information retrieval,which uses movie review datasets.Here the document indexing based on controlled vocabulary,adjective,word sense disambiguation,generating hierarchical cate-gorization of web pages,spam detection,topic labeling,web search,document summarization,etc.Here the kernel support vector machine learning algorithm helps to classify the text and feature extract is performed by cuckoo search opti-mization.Positive review and negative review of movie dataset is presented to get the better classification accuracy.Experimental results focused with context mining,feature analysis and classification.By comparing with the previous work,proposed work designed to achieve the efficient results.Overall design is per-formed with MATLAB 2020a tool.展开更多
As one of the most serious geological disasters in deep underground engineering,rockburst has caused a large number of casualties.However,because of the complex relationship between the inducing factors and rockburst ...As one of the most serious geological disasters in deep underground engineering,rockburst has caused a large number of casualties.However,because of the complex relationship between the inducing factors and rockburst intensity,the problem of rockburst intensity prediction has not been well solved until now.In this study,we collect 292 sets of rockburst data including eight parameters,such as the maximum tangential stress of the surrounding rock σ_(θ),the uniaxial compressive strength of the rockσc,the uniaxial tensile strength of the rock σ_(t),and the strain energy storage index W_(et),etc.from more than 20 underground projects as training sets and establish two new rockburst prediction models based on the kernel extreme learning machine(KELM)combined with the genetic algorithm(KELM-GA)and cross-entropy method(KELM-CEM).To further verify the effect of the two models,ten sets of rockburst data from Shuangjiangkou Hydropower Station are selected for analysis and the results show that new models are more accurate compared with five traditional empirical criteria,especially the model based on KELM-CEM which has the accuracy rate of 90%.Meanwhile,the results of 10 consecutive runs of the model based on KELM-CEM are almost the same,meaning that the model has good stability and reliability for engineering applications.展开更多
Silicone material extrusion(MEX)is widely used for processing liquids and pastes.Owing to the uneven linewidth and elastic extrusion deformation caused by material accumulation,products may exhibit geometric errors an...Silicone material extrusion(MEX)is widely used for processing liquids and pastes.Owing to the uneven linewidth and elastic extrusion deformation caused by material accumulation,products may exhibit geometric errors and performance defects,leading to a decline in product quality and affecting its service life.This study proposes a process parameter optimization method that considers the mechanical properties of printed specimens and production costs.To improve the quality of silicone printing samples and reduce production costs,three machine learning models,kernel extreme learning machine(KELM),support vector regression(SVR),and random forest(RF),were developed to predict these three factors.Training data were obtained through a complete factorial experiment.A new dataset is obtained using the Euclidean distance method,which assigns the elimination factor.It is trained with Bayesian optimization algorithms for parameter optimization,the new dataset is input into the improved double Gaussian extreme learning machine,and finally obtains the improved KELM model.The results showed improved prediction accuracy over SVR and RF.Furthermore,a multi-objective optimization framework was proposed by combining genetic algorithm technology with the improved KELM model.The effectiveness and reasonableness of the model algorithm were verified by comparing the optimized results with the experimental results.展开更多
For short-term wind power prediction,a soft margin multiple kernel learning(MKL)method is proposed.In order to improve the predictive effect of the MKL method for wind power,a kernel slack variable is introduced into ...For short-term wind power prediction,a soft margin multiple kernel learning(MKL)method is proposed.In order to improve the predictive effect of the MKL method for wind power,a kernel slack variable is introduced into each base kernel to solve the objective function.Two kinds of soft margin MKL methods based on hinge loss function and square hinge loss function can be obtained when hinge loss functions and square hinge loss functions are selected.The improved methods demonstrate good robustness and avoid the disadvantage of the hard margin MKL method which only selects a few base kernels and discards other useful kernels when solving the objective function,thereby achieving an effective yet sparse solution for the MKL method.In order to verify the effectiveness of the proposed method,the soft margin MKL method was applied to the second wind farm of Tianfeng from Xinjiang for short-term wind power single-step prediction,and the single-step and multi-step predictions of short-term wind power was also carried out using measured data provided by alberta electric system operator(AESO).Compared with the support vector machine(SVM),extreme learning machine(ELM),kernel based extreme learning machine(KELM)methods as well as the SimpleMKL method under the same conditions,the experimental results demonstrate that the soft margin MKL method with different loss functions can efficiently achieve higher prediction accuracy and good generalization performance for short-term wind power prediction,which confirms the effectiveness of the method.展开更多
Numerous studies have demonstrated that human microRNAs(miRNAs)and diseases are associated and studies on the microRNA-disease association(MDA)have been conducted.We developed a model using a low-rank approximation-ba...Numerous studies have demonstrated that human microRNAs(miRNAs)and diseases are associated and studies on the microRNA-disease association(MDA)have been conducted.We developed a model using a low-rank approximation-based link propagation algorithm with Hilbert–Schmidt independence criterion-based multiple kernel learning(HSIC-MKL)to solve the problem of the large time commitment and cost of traditional biological experiments involving miRNAs and diseases,and improve the model effect.We constructed three kernels in miRNA and disease space and conducted kernel fusion using HSIC-MKL.Link propagation uses matrix factorization and matrix approximation to effectively reduce computation and time costs.The results of the experiment show that the approach we proposed has a good effect,and,in some respects,exceeds what existing models can do.展开更多
Emotion recognition based on electroencephalography(EEG)has a wide range of applications and has great potential value,so it has received increasing attention from academia and industry in recent years.Meanwhile,multi...Emotion recognition based on electroencephalography(EEG)has a wide range of applications and has great potential value,so it has received increasing attention from academia and industry in recent years.Meanwhile,multiple kernel learning(MKL)has also been favored by researchers for its data-driven convenience and high accuracy.However,there is little research on MKL in EEG-based emotion recognition.Therefore,this paper is dedicated to exploring the application of MKL methods in the field of EEG emotion recognition and promoting the application of MKL methods in EEG emotion recognition.Thus,we proposed a support vector machine(SVM)classifier based on the MKL algorithm EasyMKL to investigate the feasibility of MKL algorithms in EEG-based emotion recognition problems.We designed two data partition methods,random division to verify the validity of the MKL method and sequential division to simulate practical applications.Then,tri-categorization experiments were performed for neutral,negative and positive emotions based on a commonly used dataset,the Shanghai Jiao Tong University emotional EEG dataset(SEED).The average classification accuracies for random division and sequential division were 92.25%and 74.37%,respectively,which shows better classification performance than the traditional single kernel SVM.The final results show that the MKL method is obviously effective,and the application of MKL in EEG emotion recognition is worthy of further study.Through the analysis of the experimental results,we discovered that the simple mathematical operations of the features on the symmetrical electrodes could not effectively integrate the spatial information of the EEG signals to obtain better performance.It is also confirmed that higher frequency band information is more correlated with emotional state and contributes more to emotion recognition.In summary,this paper explores research on MKL methods in the field of EEG emotion recognition and provides a new way of thinking for EEG-based emotion recognition research.展开更多
Speech emotion recognition （SER） in noisy environment is a vital issue in artificial intelligence （AI）. In this paper, the reconstruction of speech samples removes the added noise. Acoustic features extracted from...Speech emotion recognition （SER） in noisy environment is a vital issue in artificial intelligence （AI）. In this paper, the reconstruction of speech samples removes the added noise. Acoustic features extracted from the reconstructed samples are selected to build an optimal feature subset with better emotional recognizability. A multiple-kernel （MK） support vector machine （SVM） classifier solved by semi-definite programming （SDP） is adopted in SER procedure. The proposed method in this paper is demonstrated on Berlin Database of Emotional Speech. Recognition accuracies of the original, noisy, and reconstructed samples classified by both single-kernel （SK） and MK classifiers are compared and analyzed. The experimental results show that the proposed method is effective and robust when noise exists.展开更多
An integrated and systematic database of sooting tendency with more than 190 kinds of fuels was obtained through a series of experimental investigations. The laser-induced incandescence (LII) method was used to acquir...An integrated and systematic database of sooting tendency with more than 190 kinds of fuels was obtained through a series of experimental investigations. The laser-induced incandescence (LII) method was used to acquire the 2D distribution of soot volume fraction, and an apparatus-independent yield sooting index (YSI) was experimentally obtained. Based on the database, a novel predicting model of YSI values for surrogate fuels was proposed with the application of a machine learning method, named the Bayesian multiple kernel learning (BMKL) model. A high correlation coefficient (0.986) between measured YSIs and predicted values with the BMKL model was obtained, indicating that the BMKL model had a reliable and accurate predictive capacity for YSI values of surrogate fuels. The BMKL model provides an accurate and low-cost approach to assess surrogate performances of diesel, jet fuel, and biodiesel in terms of sooting tendency. Particularly, this model is one of the first attempts to predict the sooting tendencies of surrogate fuels that concurrently contain hydrocarbon and oxygenated components and shows a satisfying matching level. During surrogate formulation, the BMKL model can be used to shrink the surrogate candidate list in terms of sooting tendency and ensure the optimal surrogate has a satisfying matching level of soot behaviors. Due to the high accuracy and resolution of YSI prediction, the BMKL model is also capable of providing distinguishing information of sooting tendency for surrogate design.展开更多
Kernel-based methods work by embedding the data into a feature space and then searching linear hypothesis among the embedding data points. The performance is mostly affected by which kernel is used. A promising way is...Kernel-based methods work by embedding the data into a feature space and then searching linear hypothesis among the embedding data points. The performance is mostly affected by which kernel is used. A promising way is to learn the kernel from the data automatically. A general regularized risk functional （RRF） criterion for kernel matrix learning is proposed. Compared with the RRF criterion, general RRF criterion takes into account the geometric distributions of the embedding data points. It is proven that the distance between different geometric distdbutions can be estimated by their centroid distance in the reproducing kernel Hilbert space. Using this criterion for kernel matrix learning leads to a convex quadratically constrained quadratic programming （QCQP） problem. For several commonly used loss functions, their mathematical formulations are given. Experiment results on a collection of benchmark data sets demonstrate the effectiveness of the proposed method.展开更多
Blasting is a common method of breaking rock in surface mines.Although the fragmentation with proper size is the main purpose,other undesirable effects such as flyrock are inevitable.This study is carried out to evalu...Blasting is a common method of breaking rock in surface mines.Although the fragmentation with proper size is the main purpose,other undesirable effects such as flyrock are inevitable.This study is carried out to evaluate the capability of a novel kernel-based extreme learning machine algorithm,called kernel extreme learning machine(KELM),by which the flyrock distance(FRD) is predicted.Furthermore,the other three data-driven models including local weighted linear regression(LWLR),response surface methodology(RSM) and boosted regression tree(BRT) are also developed to validate the main model.A database gathered from three quarry sites in Malaysia is employed to construct the proposed models using 73 sets of spacing,burden,stemming length and powder factor data as inputs and FRD as target.Afterwards,the validity of the models is evaluated by comparing the corresponding values of some statistical metrics and validation tools.Finally,the results verify that the proposed KELM model on account of highest correlation coefficient(R) and lowest root mean square error(RMSE) is more computationally efficient,leading to better predictive capability compared to LWLR,RSM and BRT models for all data sets.展开更多
Power transformer is one of the most crucial devices in power grid.It is significant to determine incipient faults of power transformers fast and accurately.Input features play critical roles in fault diagnosis accura...Power transformer is one of the most crucial devices in power grid.It is significant to determine incipient faults of power transformers fast and accurately.Input features play critical roles in fault diagnosis accuracy.In order to further improve the fault diagnosis performance of power trans-formers,a random forest feature selection method coupled with optimized kernel extreme learning machine is presented in this study.Firstly,the random forest feature selection approach is adopted to rank 42 related input features derived from gas concentration,gas ratio and energy-weighted dissolved gas analysis.Afterwards,a kernel extreme learning machine tuned by the Aquila optimization algorithm is implemented to adjust crucial parameters and select the optimal feature subsets.The diagnosis accuracy is used to assess the fault diagnosis capability of concerned feature subsets.Finally,the optimal feature subsets are applied to establish fault diagnosis model.According to the experimental results based on two public datasets and comparison with 5 conventional approaches,it can be seen that the average accuracy of the pro-posed method is up to 94.5%,which is superior to that of other conventional approaches.Fault diagnosis performances verify that the optimum feature subset obtained by the presented method can dramatically improve power transformers fault diagnosis accuracy.展开更多
To solve the increasing model complexity due to several input variables and large correlations under variable load conditions,a dynamic modeling method combining a kernel extreme learning machine(KELM)and principal co...To solve the increasing model complexity due to several input variables and large correlations under variable load conditions,a dynamic modeling method combining a kernel extreme learning machine(KELM)and principal component analysis(PCA)was proposed and applied to the prediction of nitrogen oxide(NO_(x))concentration at the outlet of a selective catalytic reduction(SCR)denitrification system.First,PCA is applied to the feature information extraction of input data,and the current and previous sequence values of the extracted information are used as the inputs of the KELM model to reflect the dynamic characteristics of the NO_(x)concentration at the SCR outlet.Then,the model takes the historical data of the NO_(x)concentration at the SCR outlet as the model input to improve its accuracy.Finally,an optimization algorithm is used to determine the optimal parameters of the model.Compared with the Gaussian process regression,long short-term memory,and convolutional neural network models,the prediction errors are reduced by approximately 78.4%,67.6%,and 59.3%,respectively.The results indicate that the proposed dynamic model structure is reliable and can accurately predict NO_(x)concentrations at the outlet of the SCR system.展开更多
Unmanned Aerial Vehicles(UAVs)are widely used and meet many demands in military and civilian fields.With the continuous enrichment and extensive expansion of application scenarios,the safety of UAVs is constantly bein...Unmanned Aerial Vehicles(UAVs)are widely used and meet many demands in military and civilian fields.With the continuous enrichment and extensive expansion of application scenarios,the safety of UAVs is constantly being challenged.To address this challenge,we propose algorithms to detect anomalous data collected from drones to improve drone safety.We deployed a one-class kernel extreme learning machine(OCKELM)to detect anomalies in drone data.By default,OCKELM uses the radial basis(RBF)kernel function as the kernel function of themodel.To improve the performance ofOCKELM,we choose a TriangularGlobalAlignmentKernel(TGAK)instead of anRBF Kernel and introduce the Fast Independent Component Analysis(FastICA)algorithm to reconstruct UAV data.Based on the above improvements,we create a novel anomaly detection strategy FastICA-TGAK-OCELM.The method is finally validated on the UCI dataset and detected on the Aeronautical Laboratory Failures and Anomalies(ALFA)dataset.The experimental results show that compared with other methods,the accuracy of this method is improved by more than 30%,and point anomalies are effectively detected.展开更多
The feature space extracted from vibration signals with various faults is often nonlinear and of high dimension.Currently,nonlinear dimensionality reduction methods are available for extracting low-dimensional embeddi...The feature space extracted from vibration signals with various faults is often nonlinear and of high dimension.Currently,nonlinear dimensionality reduction methods are available for extracting low-dimensional embeddings,such as manifold learning.However,these methods are all based on manual intervention,which have some shortages in stability,and suppressing the disturbance noise.To extract features automatically,a manifold learning method with self-organization mapping is introduced for the first time.Under the non-uniform sample distribution reconstructed by the phase space,the expectation maximization(EM) iteration algorithm is used to divide the local neighborhoods adaptively without manual intervention.After that,the local tangent space alignment(LTSA) algorithm is adopted to compress the high-dimensional phase space into a more truthful low-dimensional representation.Finally,the signal is reconstructed by the kernel regression.Several typical states include the Lorenz system,engine fault with piston pin defect,and bearing fault with outer-race defect are analyzed.Compared with the LTSA and continuous wavelet transform,the results show that the background noise can be fully restrained and the entire periodic repetition of impact components is well separated and identified.A new way to automatically and precisely extract the impulsive components from mechanical signals is proposed.展开更多
This paper investigates some approximation properties and learning rates of Lipschitz kernel on the sphere. A perfect convergence rate on the shifts of Lipschitz kernel on the sphere, which is faster than O（n-1/2）, ...This paper investigates some approximation properties and learning rates of Lipschitz kernel on the sphere. A perfect convergence rate on the shifts of Lipschitz kernel on the sphere, which is faster than O（n-1/2）, is obtained, where n is the number of parameters needed in the approximation. By means of the approximation, a learning rate of regularized least square algorithm with the Lipschitz kernel on the sphere is also deduced.展开更多
This article is devoted to developing a deep learning method for the numerical solution of the partial differential equations (PDEs). Graph kernel neural networks (GKNN) approach to embedding graphs into a computation...This article is devoted to developing a deep learning method for the numerical solution of the partial differential equations (PDEs). Graph kernel neural networks (GKNN) approach to embedding graphs into a computationally numerical format has been used. In particular, for investigation mathematical models of the dynamical system of cancer cell invasion in inhomogeneous areas of human tissues have been considered. Neural operators were initially proposed to model the differential operator of PDEs. The GKNN mapping features between input data to the PDEs and their solutions have been constructed. The boundary integral method in combination with Green’s functions for a large number of boundary conditions is used. The tools applied in this development are based on the Fourier neural operators (FNOs), graph theory, theory elasticity, and singular integral equations.展开更多
Although a various of existing techniques are able to improve the performance of detection of the weak interesting sig- nal, how to adaptively and efficiently attenuate the intricate noises especially in the case of n...Although a various of existing techniques are able to improve the performance of detection of the weak interesting sig- nal, how to adaptively and efficiently attenuate the intricate noises especially in the case of no available reference noise signal is still the bottleneck to be overcome. According to the characteristics of sonar arrays, a multi-channel differencing method is presented to provide the prerequisite reference noise. However, the ingre- dient of obtained reference noise is too complicated to be used to effectively reduce the interference noise only using the clas- sical linear cancellation methods. Hence, a novel adaptive noise cancellation method based on the multi-kernel normalized least- mean-square algorithm consisting of weighted linear and Gaussian kernel functions is proposed, which allows to simultaneously con- sider the cancellation of linear and nonlinear components in the reference noise. The simulation results demonstrate that the out- put signal-to-noise ratio （SNR） of the novel multi-kernel adaptive filtering method outperforms the conventional linear normalized least-mean-square method and the mono-kernel normalized least- mean-square method using the realistic noise data measured in the lake experiment.展开更多
基金supported by the National Natural Science Key Foundation of China(69974021)
文摘A new incremental support vector machine （SVM） algorithm is proposed which is based on multiple kernel learning. Through introducing multiple kernel learning into the SVM incremental learning, large scale data set learning problem can be solved effectively. Furthermore, different punishments are adopted in allusion to the training subset and the acquired support vectors, which may help to improve the performance of SVM. Simulation results indicate that the proposed algorithm can not only solve the model selection problem in SVM incremental learning, but also improve the classification or prediction precision.
文摘Word Sense Disambiguation has been a trending topic of research in Natural Language Processing and Machine Learning.Mining core features and performing the text classification still exist as a challenging task.Here the features of the context such as neighboring words like adjective provide the evidence for classification using machine learning approach.This paper presented the text document classification that has wide applications in information retrieval,which uses movie review datasets.Here the document indexing based on controlled vocabulary,adjective,word sense disambiguation,generating hierarchical cate-gorization of web pages,spam detection,topic labeling,web search,document summarization,etc.Here the kernel support vector machine learning algorithm helps to classify the text and feature extract is performed by cuckoo search opti-mization.Positive review and negative review of movie dataset is presented to get the better classification accuracy.Experimental results focused with context mining,feature analysis and classification.By comparing with the previous work,proposed work designed to achieve the efficient results.Overall design is per-formed with MATLAB 2020a tool.
基金funded by National Natural Science Foundation of China(Grants Nos.41825018 and 42141009)the Second Tibetan Plateau Scientific Expedition and Research Program(Grants No.2019QZKK0904)。
文摘As one of the most serious geological disasters in deep underground engineering,rockburst has caused a large number of casualties.However,because of the complex relationship between the inducing factors and rockburst intensity,the problem of rockburst intensity prediction has not been well solved until now.In this study,we collect 292 sets of rockburst data including eight parameters,such as the maximum tangential stress of the surrounding rock σ_(θ),the uniaxial compressive strength of the rockσc,the uniaxial tensile strength of the rock σ_(t),and the strain energy storage index W_(et),etc.from more than 20 underground projects as training sets and establish two new rockburst prediction models based on the kernel extreme learning machine(KELM)combined with the genetic algorithm(KELM-GA)and cross-entropy method(KELM-CEM).To further verify the effect of the two models,ten sets of rockburst data from Shuangjiangkou Hydropower Station are selected for analysis and the results show that new models are more accurate compared with five traditional empirical criteria,especially the model based on KELM-CEM which has the accuracy rate of 90%.Meanwhile,the results of 10 consecutive runs of the model based on KELM-CEM are almost the same,meaning that the model has good stability and reliability for engineering applications.
基金supported by the National Key R&D Program of China(No.2022YFA1005204l)。
文摘Silicone material extrusion(MEX)is widely used for processing liquids and pastes.Owing to the uneven linewidth and elastic extrusion deformation caused by material accumulation,products may exhibit geometric errors and performance defects,leading to a decline in product quality and affecting its service life.This study proposes a process parameter optimization method that considers the mechanical properties of printed specimens and production costs.To improve the quality of silicone printing samples and reduce production costs,three machine learning models,kernel extreme learning machine(KELM),support vector regression(SVR),and random forest(RF),were developed to predict these three factors.Training data were obtained through a complete factorial experiment.A new dataset is obtained using the Euclidean distance method,which assigns the elimination factor.It is trained with Bayesian optimization algorithms for parameter optimization,the new dataset is input into the improved double Gaussian extreme learning machine,and finally obtains the improved KELM model.The results showed improved prediction accuracy over SVR and RF.Furthermore,a multi-objective optimization framework was proposed by combining genetic algorithm technology with the improved KELM model.The effectiveness and reasonableness of the model algorithm were verified by comparing the optimized results with the experimental results.
基金Supported by the National Natural Science Foundation of China(51467008).
文摘For short-term wind power prediction,a soft margin multiple kernel learning(MKL)method is proposed.In order to improve the predictive effect of the MKL method for wind power,a kernel slack variable is introduced into each base kernel to solve the objective function.Two kinds of soft margin MKL methods based on hinge loss function and square hinge loss function can be obtained when hinge loss functions and square hinge loss functions are selected.The improved methods demonstrate good robustness and avoid the disadvantage of the hard margin MKL method which only selects a few base kernels and discards other useful kernels when solving the objective function,thereby achieving an effective yet sparse solution for the MKL method.In order to verify the effectiveness of the proposed method,the soft margin MKL method was applied to the second wind farm of Tianfeng from Xinjiang for short-term wind power single-step prediction,and the single-step and multi-step predictions of short-term wind power was also carried out using measured data provided by alberta electric system operator(AESO).Compared with the support vector machine(SVM),extreme learning machine(ELM),kernel based extreme learning machine(KELM)methods as well as the SimpleMKL method under the same conditions,the experimental results demonstrate that the soft margin MKL method with different loss functions can efficiently achieve higher prediction accuracy and good generalization performance for short-term wind power prediction,which confirms the effectiveness of the method.
基金supported in part by the National Natural Science Foundation of China(Grant Nos.62072385,62172076,and U22A2038)the Municipal Government of Quzhou(2022D040)the Zhejiang Provincia1l Natural Science Foundationof China(No.LY23F020003).
文摘Numerous studies have demonstrated that human microRNAs(miRNAs)and diseases are associated and studies on the microRNA-disease association(MDA)have been conducted.We developed a model using a low-rank approximation-based link propagation algorithm with Hilbert–Schmidt independence criterion-based multiple kernel learning(HSIC-MKL)to solve the problem of the large time commitment and cost of traditional biological experiments involving miRNAs and diseases,and improve the model effect.We constructed three kernels in miRNA and disease space and conducted kernel fusion using HSIC-MKL.Link propagation uses matrix factorization and matrix approximation to effectively reduce computation and time costs.The results of the experiment show that the approach we proposed has a good effect,and,in some respects,exceeds what existing models can do.
基金supported by National Natural Science Foundation of China(No.62176054)University Synergy Innovation Program of Anhui Province,China(No.GXXT-2020-015)。
文摘Emotion recognition based on electroencephalography(EEG)has a wide range of applications and has great potential value,so it has received increasing attention from academia and industry in recent years.Meanwhile,multiple kernel learning(MKL)has also been favored by researchers for its data-driven convenience and high accuracy.However,there is little research on MKL in EEG-based emotion recognition.Therefore,this paper is dedicated to exploring the application of MKL methods in the field of EEG emotion recognition and promoting the application of MKL methods in EEG emotion recognition.Thus,we proposed a support vector machine(SVM)classifier based on the MKL algorithm EasyMKL to investigate the feasibility of MKL algorithms in EEG-based emotion recognition problems.We designed two data partition methods,random division to verify the validity of the MKL method and sequential division to simulate practical applications.Then,tri-categorization experiments were performed for neutral,negative and positive emotions based on a commonly used dataset,the Shanghai Jiao Tong University emotional EEG dataset(SEED).The average classification accuracies for random division and sequential division were 92.25%and 74.37%,respectively,which shows better classification performance than the traditional single kernel SVM.The final results show that the MKL method is obviously effective,and the application of MKL in EEG emotion recognition is worthy of further study.Through the analysis of the experimental results,we discovered that the simple mathematical operations of the features on the symmetrical electrodes could not effectively integrate the spatial information of the EEG signals to obtain better performance.It is also confirmed that higher frequency band information is more correlated with emotional state and contributes more to emotion recognition.In summary,this paper explores research on MKL methods in the field of EEG emotion recognition and provides a new way of thinking for EEG-based emotion recognition research.
基金supported by the National Natural Science Foundation of China (61501204,61601198)the Hebei Province Natural Science Foundation (E2016202341)+2 种基金the Hebei Province Foundation for Returned Scholars (C2012003038)the Shandong Province Natural Science Foundation (ZR2015FL010)the Science and Technology Program of University of Jinan (XKY1710)
文摘Speech emotion recognition （SER） in noisy environment is a vital issue in artificial intelligence （AI）. In this paper, the reconstruction of speech samples removes the added noise. Acoustic features extracted from the reconstructed samples are selected to build an optimal feature subset with better emotional recognizability. A multiple-kernel （MK） support vector machine （SVM） classifier solved by semi-definite programming （SDP） is adopted in SER procedure. The proposed method in this paper is demonstrated on Berlin Database of Emotional Speech. Recognition accuracies of the original, noisy, and reconstructed samples classified by both single-kernel （SK） and MK classifiers are compared and analyzed. The experimental results show that the proposed method is effective and robust when noise exists.
基金supported by the National Natural Science Foundation of China(Grant No.52071216)the Shanghai Rising-Star Program.
文摘An integrated and systematic database of sooting tendency with more than 190 kinds of fuels was obtained through a series of experimental investigations. The laser-induced incandescence (LII) method was used to acquire the 2D distribution of soot volume fraction, and an apparatus-independent yield sooting index (YSI) was experimentally obtained. Based on the database, a novel predicting model of YSI values for surrogate fuels was proposed with the application of a machine learning method, named the Bayesian multiple kernel learning (BMKL) model. A high correlation coefficient (0.986) between measured YSIs and predicted values with the BMKL model was obtained, indicating that the BMKL model had a reliable and accurate predictive capacity for YSI values of surrogate fuels. The BMKL model provides an accurate and low-cost approach to assess surrogate performances of diesel, jet fuel, and biodiesel in terms of sooting tendency. Particularly, this model is one of the first attempts to predict the sooting tendencies of surrogate fuels that concurrently contain hydrocarbon and oxygenated components and shows a satisfying matching level. During surrogate formulation, the BMKL model can be used to shrink the surrogate candidate list in terms of sooting tendency and ensure the optimal surrogate has a satisfying matching level of soot behaviors. Due to the high accuracy and resolution of YSI prediction, the BMKL model is also capable of providing distinguishing information of sooting tendency for surrogate design.
基金supported by the National Natural Science Fundation of China (60736021)the Joint Funds of NSFC-Guangdong Province(U0735003)
文摘Kernel-based methods work by embedding the data into a feature space and then searching linear hypothesis among the embedding data points. The performance is mostly affected by which kernel is used. A promising way is to learn the kernel from the data automatically. A general regularized risk functional （RRF） criterion for kernel matrix learning is proposed. Compared with the RRF criterion, general RRF criterion takes into account the geometric distributions of the embedding data points. It is proven that the distance between different geometric distdbutions can be estimated by their centroid distance in the reproducing kernel Hilbert space. Using this criterion for kernel matrix learning leads to a convex quadratically constrained quadratic programming （QCQP） problem. For several commonly used loss functions, their mathematical formulations are given. Experiment results on a collection of benchmark data sets demonstrate the effectiveness of the proposed method.
文摘Blasting is a common method of breaking rock in surface mines.Although the fragmentation with proper size is the main purpose,other undesirable effects such as flyrock are inevitable.This study is carried out to evaluate the capability of a novel kernel-based extreme learning machine algorithm,called kernel extreme learning machine(KELM),by which the flyrock distance(FRD) is predicted.Furthermore,the other three data-driven models including local weighted linear regression(LWLR),response surface methodology(RSM) and boosted regression tree(BRT) are also developed to validate the main model.A database gathered from three quarry sites in Malaysia is employed to construct the proposed models using 73 sets of spacing,burden,stemming length and powder factor data as inputs and FRD as target.Afterwards,the validity of the models is evaluated by comparing the corresponding values of some statistical metrics and validation tools.Finally,the results verify that the proposed KELM model on account of highest correlation coefficient(R) and lowest root mean square error(RMSE) is more computationally efficient,leading to better predictive capability compared to LWLR,RSM and BRT models for all data sets.
基金support of national natural science foundation of China(No.52067021)natural science foundation of Xinjiang(2022D01C35)+1 种基金excellent youth scientific and technological talents plan of Xinjiang(No.2019Q012)major science and technology special project of Xinjiang Uygur Autonomous Region(2022A01002-2).
文摘Power transformer is one of the most crucial devices in power grid.It is significant to determine incipient faults of power transformers fast and accurately.Input features play critical roles in fault diagnosis accuracy.In order to further improve the fault diagnosis performance of power trans-formers,a random forest feature selection method coupled with optimized kernel extreme learning machine is presented in this study.Firstly,the random forest feature selection approach is adopted to rank 42 related input features derived from gas concentration,gas ratio and energy-weighted dissolved gas analysis.Afterwards,a kernel extreme learning machine tuned by the Aquila optimization algorithm is implemented to adjust crucial parameters and select the optimal feature subsets.The diagnosis accuracy is used to assess the fault diagnosis capability of concerned feature subsets.Finally,the optimal feature subsets are applied to establish fault diagnosis model.According to the experimental results based on two public datasets and comparison with 5 conventional approaches,it can be seen that the average accuracy of the pro-posed method is up to 94.5%,which is superior to that of other conventional approaches.Fault diagnosis performances verify that the optimum feature subset obtained by the presented method can dramatically improve power transformers fault diagnosis accuracy.
基金The National Natural Science Foundation of China(No.71471060)the Natural Science Foundation of Hebei Province(No.E2018502111)。
文摘To solve the increasing model complexity due to several input variables and large correlations under variable load conditions,a dynamic modeling method combining a kernel extreme learning machine(KELM)and principal component analysis(PCA)was proposed and applied to the prediction of nitrogen oxide(NO_(x))concentration at the outlet of a selective catalytic reduction(SCR)denitrification system.First,PCA is applied to the feature information extraction of input data,and the current and previous sequence values of the extracted information are used as the inputs of the KELM model to reflect the dynamic characteristics of the NO_(x)concentration at the SCR outlet.Then,the model takes the historical data of the NO_(x)concentration at the SCR outlet as the model input to improve its accuracy.Finally,an optimization algorithm is used to determine the optimal parameters of the model.Compared with the Gaussian process regression,long short-term memory,and convolutional neural network models,the prediction errors are reduced by approximately 78.4%,67.6%,and 59.3%,respectively.The results indicate that the proposed dynamic model structure is reliable and can accurately predict NO_(x)concentrations at the outlet of the SCR system.
基金supported by the Natural Science Foundation of The Jiangsu Higher Education Institutions of China(Grant No.19JKB520031).
文摘Unmanned Aerial Vehicles(UAVs)are widely used and meet many demands in military and civilian fields.With the continuous enrichment and extensive expansion of application scenarios,the safety of UAVs is constantly being challenged.To address this challenge,we propose algorithms to detect anomalous data collected from drones to improve drone safety.We deployed a one-class kernel extreme learning machine(OCKELM)to detect anomalies in drone data.By default,OCKELM uses the radial basis(RBF)kernel function as the kernel function of themodel.To improve the performance ofOCKELM,we choose a TriangularGlobalAlignmentKernel(TGAK)instead of anRBF Kernel and introduce the Fast Independent Component Analysis(FastICA)algorithm to reconstruct UAV data.Based on the above improvements,we create a novel anomaly detection strategy FastICA-TGAK-OCELM.The method is finally validated on the UCI dataset and detected on the Aeronautical Laboratory Failures and Anomalies(ALFA)dataset.The experimental results show that compared with other methods,the accuracy of this method is improved by more than 30%,and point anomalies are effectively detected.
基金supported by National Natural Science Foundation of China(Grant No.51075323)
文摘The feature space extracted from vibration signals with various faults is often nonlinear and of high dimension.Currently,nonlinear dimensionality reduction methods are available for extracting low-dimensional embeddings,such as manifold learning.However,these methods are all based on manual intervention,which have some shortages in stability,and suppressing the disturbance noise.To extract features automatically,a manifold learning method with self-organization mapping is introduced for the first time.Under the non-uniform sample distribution reconstructed by the phase space,the expectation maximization(EM) iteration algorithm is used to divide the local neighborhoods adaptively without manual intervention.After that,the local tangent space alignment(LTSA) algorithm is adopted to compress the high-dimensional phase space into a more truthful low-dimensional representation.Finally,the signal is reconstructed by the kernel regression.Several typical states include the Lorenz system,engine fault with piston pin defect,and bearing fault with outer-race defect are analyzed.Compared with the LTSA and continuous wavelet transform,the results show that the background noise can be fully restrained and the entire periodic repetition of impact components is well separated and identified.A new way to automatically and precisely extract the impulsive components from mechanical signals is proposed.
基金Supported by the National Natural Science Foundation of China(61272023,91330118)
文摘This paper investigates some approximation properties and learning rates of Lipschitz kernel on the sphere. A perfect convergence rate on the shifts of Lipschitz kernel on the sphere, which is faster than O（n-1/2）, is obtained, where n is the number of parameters needed in the approximation. By means of the approximation, a learning rate of regularized least square algorithm with the Lipschitz kernel on the sphere is also deduced.
文摘This article is devoted to developing a deep learning method for the numerical solution of the partial differential equations (PDEs). Graph kernel neural networks (GKNN) approach to embedding graphs into a computationally numerical format has been used. In particular, for investigation mathematical models of the dynamical system of cancer cell invasion in inhomogeneous areas of human tissues have been considered. Neural operators were initially proposed to model the differential operator of PDEs. The GKNN mapping features between input data to the PDEs and their solutions have been constructed. The boundary integral method in combination with Green’s functions for a large number of boundary conditions is used. The tools applied in this development are based on the Fourier neural operators (FNOs), graph theory, theory elasticity, and singular integral equations.
基金supported by the National Natural Science Foundation of China(6100115361271415)+2 种基金the Opening Research Foundation of State Key Laboratory of Underwater Information Processing and Control(9140C231002130C23085)the Fundamental Research Funds for the Central Universities(3102014JCQ010103102014ZD0041)
文摘Although a various of existing techniques are able to improve the performance of detection of the weak interesting sig- nal, how to adaptively and efficiently attenuate the intricate noises especially in the case of no available reference noise signal is still the bottleneck to be overcome. According to the characteristics of sonar arrays, a multi-channel differencing method is presented to provide the prerequisite reference noise. However, the ingre- dient of obtained reference noise is too complicated to be used to effectively reduce the interference noise only using the clas- sical linear cancellation methods. Hence, a novel adaptive noise cancellation method based on the multi-kernel normalized least- mean-square algorithm consisting of weighted linear and Gaussian kernel functions is proposed, which allows to simultaneously con- sider the cancellation of linear and nonlinear components in the reference noise. The simulation results demonstrate that the out- put signal-to-noise ratio （SNR） of the novel multi-kernel adaptive filtering method outperforms the conventional linear normalized least-mean-square method and the mono-kernel normalized least- mean-square method using the realistic noise data measured in the lake experiment.
