The extended Kalman filter(EKF)is extensively applied in integrated navigation systems that combine the global navigation satellite system(GNSS)and strap-down inertial navigation system(SINS).However,the performance o...The extended Kalman filter(EKF)is extensively applied in integrated navigation systems that combine the global navigation satellite system(GNSS)and strap-down inertial navigation system(SINS).However,the performance of the EKF can be severely impacted by non-Gaussian noise and measurement noise uncertainties,making it difficult to achieve optimal GNSS/INS integration.Dealing with non-Gaussian noise remains a significant challenge in filter development today.Therefore,the maximum correntropy criterion(MCC)is utilized in EKFs to manage heavytailed measurement noise.However,its capability to handle non-Gaussian process noise and unknown disturbances remains largely unexplored.In this paper,we extend correntropy from using a single kernel to a multi-kernel approach.This leads to the development of a multi-kernel maximum correntropy extended Kalman filter(MKMC-EKF),which is designed to effectively manage multivariate non-Gaussian noise and disturbances.Further,theoretical analysis,including advanced stability proofs,can enhance understanding,while hybrid approaches integrating MKMC-EKF with particle filters may improve performance in nonlinear systems.The MKMC-EKF enhances estimation accuracy using a multi-kernel bandwidth approach.As bandwidth increases,the filter’s sensitivity to non-Gaussian features decreases,and its behavior progressively approximates that of the iterated EKF.The proposed approach for enhancing positioning in navigation is validated through performance evaluations,which demonstrate its practical applications in real-world systems like GPS navigation and measuring radar targets.展开更多
Multi-kernel-based support vector machine （SVM） model structure of nonlinear systems and its specific identification method is proposed, which is composed of a SVM with linear kernel function followed in series by a...Multi-kernel-based support vector machine （SVM） model structure of nonlinear systems and its specific identification method is proposed, which is composed of a SVM with linear kernel function followed in series by a SVM with spline kernel function. With the help of this model, nonlinear model predictive control can be transformed to linear model predictive control, and consequently a unified analytical solution of optimal input of multi-step-ahead predictive control is possible to derive. This algorithm does not require online iterative optimization in order to be suitable for real-time control with less calculation. The simulation results of pH neutralization process and CSTR reactor show the effectiveness and advantages of the presented algorithm.展开更多
Lithofacies identification is a crucial work in reservoir characterization and modeling.The vast inter-well area can be supplemented by facies identification of seismic data.However,the relationship between lithofacie...Lithofacies identification is a crucial work in reservoir characterization and modeling.The vast inter-well area can be supplemented by facies identification of seismic data.However,the relationship between lithofacies and seismic information that is affected by many factors is complicated.Machine learning has received extensive attention in recent years,among which support vector machine(SVM) is a potential method for lithofacies classification.Lithofacies classification involves identifying various types of lithofacies and is generally a nonlinear problem,which needs to be solved by means of the kernel function.Multi-kernel learning SVM is one of the main tools for solving the nonlinear problem about multi-classification.However,it is very difficult to determine the kernel function and the parameters,which is restricted by human factors.Besides,its computational efficiency is low.A lithofacies classification method based on local deep multi-kernel learning support vector machine(LDMKL-SVM) that can consider low-dimensional global features and high-dimensional local features is developed.The method can automatically learn parameters of kernel function and SVM to build a relationship between lithofacies and seismic elastic information.The calculation speed will be expedited at no cost with respect to discriminant accuracy for multi-class lithofacies identification.Both the model data test results and the field data application results certify advantages of the method.This contribution offers an effective method for lithofacies recognition and reservoir prediction by using SVM.展开更多
Although a various of existing techniques are able to improve the performance of detection of the weak interesting sig- nal, how to adaptively and efficiently attenuate the intricate noises especially in the case of n...Although a various of existing techniques are able to improve the performance of detection of the weak interesting sig- nal, how to adaptively and efficiently attenuate the intricate noises especially in the case of no available reference noise signal is still the bottleneck to be overcome. According to the characteristics of sonar arrays, a multi-channel differencing method is presented to provide the prerequisite reference noise. However, the ingre- dient of obtained reference noise is too complicated to be used to effectively reduce the interference noise only using the clas- sical linear cancellation methods. Hence, a novel adaptive noise cancellation method based on the multi-kernel normalized least- mean-square algorithm consisting of weighted linear and Gaussian kernel functions is proposed, which allows to simultaneously con- sider the cancellation of linear and nonlinear components in the reference noise. The simulation results demonstrate that the out- put signal-to-noise ratio （SNR） of the novel multi-kernel adaptive filtering method outperforms the conventional linear normalized least-mean-square method and the mono-kernel normalized least- mean-square method using the realistic noise data measured in the lake experiment.展开更多
滚动轴承是机械设备中的常见关键部件,准确预测其剩余使用寿命对机械设备的安全稳定运行至关重要。针对目前轴承寿命预测存在的轴承退化特征不明显、模型泛化能力差以及数据长期依赖关系难以捕捉的问题,提出基于时频域信号优化器(Time-F...滚动轴承是机械设备中的常见关键部件,准确预测其剩余使用寿命对机械设备的安全稳定运行至关重要。针对目前轴承寿命预测存在的轴承退化特征不明显、模型泛化能力差以及数据长期依赖关系难以捕捉的问题,提出基于时频域信号优化器(Time-Frequency domain signal Ratio Optimizer,TFRO)的多重膨胀多核时间卷积网络(Multi inflated Multi kernel Time Convolutional Network,Mi-MkTCN)模型。TFRO优化器为了精准记忆重要信息,在每一个时间节点上,将过去信息和当前信息重组,其中过去信息中的重要的时频域特征经过了有比例的分配。Mi-MkTCN利用多重膨胀确保重要特征不丢失,再利用多核时间卷积网络实现对不同尺度特征的提取。最终的消融对比实验验证了改进方法的有效性,模型的平均绝对误差、均方误差及均方根误差指标分别为0.00145、0.05069和0.12045。实验结果表明,所提方法显著提升了轴承剩余使用寿命的预测精度,为轴承剩余使用寿命预测提供了高精度、高鲁棒性的解决方案。展开更多
In order to accurately identify a bearing fault on a wind turbine, a novel fault diagnosis method based on stochastic subspace identification(SSI) and multi-kernel support vector machine(MSVM) is proposed. Firstly, th...In order to accurately identify a bearing fault on a wind turbine, a novel fault diagnosis method based on stochastic subspace identification(SSI) and multi-kernel support vector machine(MSVM) is proposed. Firstly, the collected vibration signal of the wind turbine bearing is processed by the SSI method to extract fault feature vectors. Then, the MSVM is constructed based on Gauss kernel support vector machine(SVM) and polynomial kernel SVM. Finally, fault feature vectors which indicate the condition of the wind turbine bearing are inputted to the MSVM for fault pattern recognition. The results indicate that the SSI-MSVM method is effective in fault diagnosis for a wind turbine bearing and can successfully identify fault types of bearing and achieve higher diagnostic accuracy than that of K-means clustering, fuzzy means clustering and traditional SVM.展开更多
Robot recognition tasks usually require multiple homogeneous or heterogeneous sensors which intrinsically generate sequential, redundant, and storage demanding data with various noise pollution. Thus, online machine l...Robot recognition tasks usually require multiple homogeneous or heterogeneous sensors which intrinsically generate sequential, redundant, and storage demanding data with various noise pollution. Thus, online machine learning algorithms performing efficient sensory feature fusion have become a hot topic in robot recognition domain. This paper proposes an online multi-kernel extreme learning machine （OM-ELM） which assembles multiple ELM classifiers and optimizes the kernel weights with a p-norm formulation of multi-kernel learning （MKL） problem. It can be applied in feature fusion applications that require incremental learning over multiple sequential sensory readings. The performance of OM-ELM is tested towards four different robot recognition tasks. By comparing to several state-of-the-art online models for multi-kernel learning, we claim that our method achieves a superior or equivalent training accuracy and generalization ability with less training time. Practical suggestions are also given to aid effective online fusion of robot sensory features.展开更多
In this paper, we present a new challenging task for emotion analysis, namely emotion cause extraction.In this task, we focus on the detection of emotion cause a.k.a the reason or the stimulant of an emotion, rather t...In this paper, we present a new challenging task for emotion analysis, namely emotion cause extraction.In this task, we focus on the detection of emotion cause a.k.a the reason or the stimulant of an emotion, rather than the regular emotion classification or emotion component extraction. Since there is no open dataset for this task available, we first designed and annotated an emotion cause dataset which follows the scheme of W3 C Emotion Markup Language. We then present an emotion cause detection method by using event extraction framework,where a tree structure-based representation method is used to represent the events. Since the distribution of events is imbalanced in the training data, we propose an under-sampling-based bagging algorithm to solve this problem. Even with a limited training set, the proposed approach may still extract sufficient features for analysis by a bagging of multi-kernel based SVMs method. Evaluations show that our approach achieves an F-measure 7.04%higher than the state-of-the-art methods.展开更多
In regularized kernel methods, the solution of a learning problem is found by minimizing a functional consisting of a empirical risk and a regularization term. In this paper, we study the existence of optimal solution...In regularized kernel methods, the solution of a learning problem is found by minimizing a functional consisting of a empirical risk and a regularization term. In this paper, we study the existence of optimal solution of multi-kernel regularization learning. First, we ameliorate a previous conclusion about this problem given by Micchelli and Pontil, and prove that the optimal solution exists whenever the kernel set is a compact set. Second, we consider this problem for Gaussian kernels with variance σ∈（0,∞）, and give some conditions under which the optimal solution exists.展开更多
The automatic classification and identification of maize varieties is one of the important research contents in agriculture.A multi-kernel maize varieties classification approach was proposed in this paper in order to...The automatic classification and identification of maize varieties is one of the important research contents in agriculture.A multi-kernel maize varieties classification approach was proposed in this paper in order to improve the recognition rate of maize varieties.In this approach,four kinds of maize varieties were selected,in each variety 200 grains were selected randomly as the samples,and in each sample 160 grains were taken as the training samples randomly;the characteristics of maize grain were extracted as the typical characteristics to distinguish maize varieties,by which the dictionary required by K-SVD was constructed;for the test samples,the feature-matrixes were extracted by dimension reduction method which were mapped to the high-dimension space by muti-kernel function mapping.The high-dimension characteristic matrixes were trained by K-SVD method and the corresponding feature dictionary was obtained respectively.Finally,the test samples representing were trained and classified by l2,1 minimization sparse coefficient.The experiment results showed that recognition rate was improved obviously through this approach,and the poor-effect to maize variety identification from partial occlusion can be eliminated effectively.展开更多
In this paper, we propose a multi-kernel multi-view canonical correlations(M2CCs) framework for subspace learning. In the proposed framework,the input data of each original view are mapped into multiple higher dimensi...In this paper, we propose a multi-kernel multi-view canonical correlations(M2CCs) framework for subspace learning. In the proposed framework,the input data of each original view are mapped into multiple higher dimensional feature spaces by multiple nonlinear mappings determined by different kernels. This makes M2 CC can discover multiple kinds of useful information of each original view in the feature spaces. With the framework, we further provide a specific multi-view feature learning method based on direct summation kernel strategy and its regularized version. The experimental results in visual recognition tasks demonstrate the effectiveness and robustness of the proposed method.展开更多
基金the support from National Science and Technology Council,Taiwan under grant numbers NSTC 113-2811-E-019-001 and NSTC 113-2221-E-019-059.
文摘The extended Kalman filter(EKF)is extensively applied in integrated navigation systems that combine the global navigation satellite system(GNSS)and strap-down inertial navigation system(SINS).However,the performance of the EKF can be severely impacted by non-Gaussian noise and measurement noise uncertainties,making it difficult to achieve optimal GNSS/INS integration.Dealing with non-Gaussian noise remains a significant challenge in filter development today.Therefore,the maximum correntropy criterion(MCC)is utilized in EKFs to manage heavytailed measurement noise.However,its capability to handle non-Gaussian process noise and unknown disturbances remains largely unexplored.In this paper,we extend correntropy from using a single kernel to a multi-kernel approach.This leads to the development of a multi-kernel maximum correntropy extended Kalman filter(MKMC-EKF),which is designed to effectively manage multivariate non-Gaussian noise and disturbances.Further,theoretical analysis,including advanced stability proofs,can enhance understanding,while hybrid approaches integrating MKMC-EKF with particle filters may improve performance in nonlinear systems.The MKMC-EKF enhances estimation accuracy using a multi-kernel bandwidth approach.As bandwidth increases,the filter’s sensitivity to non-Gaussian features decreases,and its behavior progressively approximates that of the iterated EKF.The proposed approach for enhancing positioning in navigation is validated through performance evaluations,which demonstrate its practical applications in real-world systems like GPS navigation and measuring radar targets.
基金Supported by the State Key Development Program for Basic Research of China （No.2002CB312200） and the National Natural Science Foundation of China （No.60574019）.
文摘Multi-kernel-based support vector machine （SVM） model structure of nonlinear systems and its specific identification method is proposed, which is composed of a SVM with linear kernel function followed in series by a SVM with spline kernel function. With the help of this model, nonlinear model predictive control can be transformed to linear model predictive control, and consequently a unified analytical solution of optimal input of multi-step-ahead predictive control is possible to derive. This algorithm does not require online iterative optimization in order to be suitable for real-time control with less calculation. The simulation results of pH neutralization process and CSTR reactor show the effectiveness and advantages of the presented algorithm.
基金financially supported by the National Natural Science Foundation of China (41774129, 41904116)the Foundation Research Project of Shaanxi Provincial Key Laboratory of Geological Support for Coal Green Exploitation (MTy2019-20)。
文摘Lithofacies identification is a crucial work in reservoir characterization and modeling.The vast inter-well area can be supplemented by facies identification of seismic data.However,the relationship between lithofacies and seismic information that is affected by many factors is complicated.Machine learning has received extensive attention in recent years,among which support vector machine(SVM) is a potential method for lithofacies classification.Lithofacies classification involves identifying various types of lithofacies and is generally a nonlinear problem,which needs to be solved by means of the kernel function.Multi-kernel learning SVM is one of the main tools for solving the nonlinear problem about multi-classification.However,it is very difficult to determine the kernel function and the parameters,which is restricted by human factors.Besides,its computational efficiency is low.A lithofacies classification method based on local deep multi-kernel learning support vector machine(LDMKL-SVM) that can consider low-dimensional global features and high-dimensional local features is developed.The method can automatically learn parameters of kernel function and SVM to build a relationship between lithofacies and seismic elastic information.The calculation speed will be expedited at no cost with respect to discriminant accuracy for multi-class lithofacies identification.Both the model data test results and the field data application results certify advantages of the method.This contribution offers an effective method for lithofacies recognition and reservoir prediction by using SVM.
基金supported by the National Natural Science Foundation of China(6100115361271415)+2 种基金the Opening Research Foundation of State Key Laboratory of Underwater Information Processing and Control(9140C231002130C23085)the Fundamental Research Funds for the Central Universities(3102014JCQ010103102014ZD0041)
文摘Although a various of existing techniques are able to improve the performance of detection of the weak interesting sig- nal, how to adaptively and efficiently attenuate the intricate noises especially in the case of no available reference noise signal is still the bottleneck to be overcome. According to the characteristics of sonar arrays, a multi-channel differencing method is presented to provide the prerequisite reference noise. However, the ingre- dient of obtained reference noise is too complicated to be used to effectively reduce the interference noise only using the clas- sical linear cancellation methods. Hence, a novel adaptive noise cancellation method based on the multi-kernel normalized least- mean-square algorithm consisting of weighted linear and Gaussian kernel functions is proposed, which allows to simultaneously con- sider the cancellation of linear and nonlinear components in the reference noise. The simulation results demonstrate that the out- put signal-to-noise ratio （SNR） of the novel multi-kernel adaptive filtering method outperforms the conventional linear normalized least-mean-square method and the mono-kernel normalized least- mean-square method using the realistic noise data measured in the lake experiment.
文摘滚动轴承是机械设备中的常见关键部件,准确预测其剩余使用寿命对机械设备的安全稳定运行至关重要。针对目前轴承寿命预测存在的轴承退化特征不明显、模型泛化能力差以及数据长期依赖关系难以捕捉的问题,提出基于时频域信号优化器(Time-Frequency domain signal Ratio Optimizer,TFRO)的多重膨胀多核时间卷积网络(Multi inflated Multi kernel Time Convolutional Network,Mi-MkTCN)模型。TFRO优化器为了精准记忆重要信息,在每一个时间节点上,将过去信息和当前信息重组,其中过去信息中的重要的时频域特征经过了有比例的分配。Mi-MkTCN利用多重膨胀确保重要特征不丢失,再利用多核时间卷积网络实现对不同尺度特征的提取。最终的消融对比实验验证了改进方法的有效性,模型的平均绝对误差、均方误差及均方根误差指标分别为0.00145、0.05069和0.12045。实验结果表明,所提方法显著提升了轴承剩余使用寿命的预测精度,为轴承剩余使用寿命预测提供了高精度、高鲁棒性的解决方案。
基金supported by National Key Technology Research and Development Program (No. 2015BAA06B03)
文摘In order to accurately identify a bearing fault on a wind turbine, a novel fault diagnosis method based on stochastic subspace identification(SSI) and multi-kernel support vector machine(MSVM) is proposed. Firstly, the collected vibration signal of the wind turbine bearing is processed by the SSI method to extract fault feature vectors. Then, the MSVM is constructed based on Gauss kernel support vector machine(SVM) and polynomial kernel SVM. Finally, fault feature vectors which indicate the condition of the wind turbine bearing are inputted to the MSVM for fault pattern recognition. The results indicate that the SSI-MSVM method is effective in fault diagnosis for a wind turbine bearing and can successfully identify fault types of bearing and achieve higher diagnostic accuracy than that of K-means clustering, fuzzy means clustering and traditional SVM.
文摘Robot recognition tasks usually require multiple homogeneous or heterogeneous sensors which intrinsically generate sequential, redundant, and storage demanding data with various noise pollution. Thus, online machine learning algorithms performing efficient sensory feature fusion have become a hot topic in robot recognition domain. This paper proposes an online multi-kernel extreme learning machine （OM-ELM） which assembles multiple ELM classifiers and optimizes the kernel weights with a p-norm formulation of multi-kernel learning （MKL） problem. It can be applied in feature fusion applications that require incremental learning over multiple sequential sensory readings. The performance of OM-ELM is tested towards four different robot recognition tasks. By comparing to several state-of-the-art online models for multi-kernel learning, we claim that our method achieves a superior or equivalent training accuracy and generalization ability with less training time. Practical suggestions are also given to aid effective online fusion of robot sensory features.
基金supported by the National Natural Science Foundation of China(Nos.61370165,U1636103,and 61632011)Shenzhen Foundational Research Funding(Nos.JCYJ20150625142543470 and JCYJ20170307150024907)Guangdong Provincial Engineering Technology Research Center for Data Science(No.2016KF09)
文摘In this paper, we present a new challenging task for emotion analysis, namely emotion cause extraction.In this task, we focus on the detection of emotion cause a.k.a the reason or the stimulant of an emotion, rather than the regular emotion classification or emotion component extraction. Since there is no open dataset for this task available, we first designed and annotated an emotion cause dataset which follows the scheme of W3 C Emotion Markup Language. We then present an emotion cause detection method by using event extraction framework,where a tree structure-based representation method is used to represent the events. Since the distribution of events is imbalanced in the training data, we propose an under-sampling-based bagging algorithm to solve this problem. Even with a limited training set, the proposed approach may still extract sufficient features for analysis by a bagging of multi-kernel based SVMs method. Evaluations show that our approach achieves an F-measure 7.04%higher than the state-of-the-art methods.
基金Supported by National Natural Science Foundation of China (Grant No.11071276)
文摘In regularized kernel methods, the solution of a learning problem is found by minimizing a functional consisting of a empirical risk and a regularization term. In this paper, we study the existence of optimal solution of multi-kernel regularization learning. First, we ameliorate a previous conclusion about this problem given by Micchelli and Pontil, and prove that the optimal solution exists whenever the kernel set is a compact set. Second, we consider this problem for Gaussian kernels with variance σ∈（0,∞）, and give some conditions under which the optimal solution exists.
基金We acknowledge that this work was financially supported by the National Natural Science Foundation of China(Grant No.61472172,61673200 and 61471185)by the Natural Science Foundation of Shandong Province of China(Grant No.ZR2016FM15).
文摘The automatic classification and identification of maize varieties is one of the important research contents in agriculture.A multi-kernel maize varieties classification approach was proposed in this paper in order to improve the recognition rate of maize varieties.In this approach,four kinds of maize varieties were selected,in each variety 200 grains were selected randomly as the samples,and in each sample 160 grains were taken as the training samples randomly;the characteristics of maize grain were extracted as the typical characteristics to distinguish maize varieties,by which the dictionary required by K-SVD was constructed;for the test samples,the feature-matrixes were extracted by dimension reduction method which were mapped to the high-dimension space by muti-kernel function mapping.The high-dimension characteristic matrixes were trained by K-SVD method and the corresponding feature dictionary was obtained respectively.Finally,the test samples representing were trained and classified by l2,1 minimization sparse coefficient.The experiment results showed that recognition rate was improved obviously through this approach,and the poor-effect to maize variety identification from partial occlusion can be eliminated effectively.
基金supported by the National Natural Science Foundation of China under Grant Nos. 61402203, 61273251, and 61170120the Fundamental Research Funds for the Central Universities under Grant No. JUSRP11458the Program for New Century Excellent Talents in University under Grant No. NCET-12-0881
文摘In this paper, we propose a multi-kernel multi-view canonical correlations(M2CCs) framework for subspace learning. In the proposed framework,the input data of each original view are mapped into multiple higher dimensional feature spaces by multiple nonlinear mappings determined by different kernels. This makes M2 CC can discover multiple kinds of useful information of each original view in the feature spaces. With the framework, we further provide a specific multi-view feature learning method based on direct summation kernel strategy and its regularized version. The experimental results in visual recognition tasks demonstrate the effectiveness and robustness of the proposed method.
