Wavelet, a powerful tool for signal processing, can be used to approximate the target func-tion. For enhancing the sparse property of wavelet approximation, a new algorithm was proposed by using wavelet kernel Support...Wavelet, a powerful tool for signal processing, can be used to approximate the target func-tion. For enhancing the sparse property of wavelet approximation, a new algorithm was proposed by using wavelet kernel Support Vector Machines (SVM), which can converge to minimum error with bet-ter sparsity. Here, wavelet functions would be firstly used to construct the admitted kernel for SVM according to Mercy theory; then new SVM with this kernel can be used to approximate the target fun-citon with better sparsity than wavelet approxiamtion itself. The results obtained by our simulation ex-periment show the feasibility and validity of wavelet kernel support vector machines.展开更多
By combining the wavelet decomposition with kernel method, a practical approach of universal multiscale wavelet kernels constructed in reproducing kernel Hilbert space （RKHS） is discussed, and an identification sche...By combining the wavelet decomposition with kernel method, a practical approach of universal multiscale wavelet kernels constructed in reproducing kernel Hilbert space （RKHS） is discussed, and an identification scheme using wavelet support vector machines （WSVM） estimator is proposed for nordinear dynamic systems. The good approximating properties of wavelet kernel function enhance the generalization ability of the proposed method, and the comparison of some numerical experimental results between the novel approach and some existing methods is encouraging.展开更多
To enhance the detection accuracy and deduce false positive rate of distributed denial of service （DDoS） attack detection, a new machine learning method was proposed. With the analysis of support vector machine （SV...To enhance the detection accuracy and deduce false positive rate of distributed denial of service （DDoS） attack detection, a new machine learning method was proposed. With the analysis of support vector machine （SVM） and the wavelet kernel function theory, an admissive support vector kernel, which is a wavelet kernel constructed in this article, implements the combination of the wavelet technique with SVM. Then, wavelet support vector machine （WSVM） is applied to DDoS attack detections and as a classifying means to test the validity of the wavelet kernel function. Simulation experiments show that under the same conditions, the predictive ability of WSVM is improved and the computation burden is alleviated. The detection accuracy of WSVM is higher than the traditional SVM by about 4%, while its false positive is lower than the traditional SVM. Thus, for DDoS detections, WSVM shows better detection performance and is more adaptive to the changing network environment.展开更多
The relationship among Mercer kernel, reproducing kernel and positive definite kernel in support vector machine （SVM） is proved and their roles in SVM are discussed. The quadratic form of the kernel matrix is used t...The relationship among Mercer kernel, reproducing kernel and positive definite kernel in support vector machine （SVM） is proved and their roles in SVM are discussed. The quadratic form of the kernel matrix is used to confirm the positive definiteness and their construction. Based on the Bochner theorem, some translation invariant kernels are checked in their Fourier domain. Some rotation invariant radial kernels are inspected according to the Schoenberg theorem. Finally, the construction of discrete scaling and wavelet kernels, the kernel selection and the kernel parameter learning are discussed.展开更多
We present wavelet bases made of piecewise (low degree) polynomial functions with an (arbitrary) assigned number of vanishing moments. We study some of the properties of these wavelet bases;in particular we consider t...We present wavelet bases made of piecewise (low degree) polynomial functions with an (arbitrary) assigned number of vanishing moments. We study some of the properties of these wavelet bases;in particular we consider their use in the approximation of functions and in numerical quadrature. We focus on two applications: integral kernel sparsification and digital image compression and reconstruction. In these application areas the use of these wavelet bases gives very satisfactory results.展开更多
A new filtering method for SAR data de-noising using wavelet support vector regression （WSVR） is developed. On the basis of the grey scale distribution character of SAR imagery, the logarithmic SAR image as a noise ...A new filtering method for SAR data de-noising using wavelet support vector regression （WSVR） is developed. On the basis of the grey scale distribution character of SAR imagery, the logarithmic SAR image as a noise polluted signal is taken and the noise model assumption in logarithmic domain with Gaussian noise and impact noise is proposed. Based on the better per- formance of support vector regression （SVR） for complex signal approximation and the wavelet for signal detail expression, the wavelet kernel function is chosen as support vector kernel func- tion. Then the logarithmic SAR image is regressed with WSVR. Furthermore the regression distance is used as a judgment index of the noise type. According to the judgment of noise type every pixel can be adaptively de-noised with different filters. Through an approximation experiment for a one-dimensional complex signal, the feasibility of SAR data regression based on WSVR is con- firmed. Afterward the SAR image is treated as a two-dimensional continuous signal and filtered by an SVR with wavelet kernel function. The results show that the method proposed here reduces the radar speckle noise effectively while maintaining edge features and details well.展开更多
In this article, we consider a fast algorithm for first generation Calderon-Zygmund operators. First, we estimate the convergence speed of the relative approximation algorithm. Then, we establish the continuity on Bes...In this article, we consider a fast algorithm for first generation Calderon-Zygmund operators. First, we estimate the convergence speed of the relative approximation algorithm. Then, we establish the continuity on Besov spaces and Triebel-Lizorkin spaces for the oper- ators with rough kernel.展开更多
The vector sampling theorem has been investigated and widely used by multi-channel deconvolution, multi-source separation and multi-input multi-output （MIh40） systems. Commonly, for most of the results on MIMO syste...The vector sampling theorem has been investigated and widely used by multi-channel deconvolution, multi-source separation and multi-input multi-output （MIh40） systems. Commonly, for most of the results on MIMO systems, the input signals are supposed to be band-limited. In this paper, we study the vector sampling theorem for the wavelet subspaces with reproducing kernel. The case of uniform sampling is discussed, and the necessary and sufficient conditions for reconstruction are given. Examples axe also presented.展开更多
为提高月径流时间序列预测精度,改进最小二乘孪生支持向量回归机(Least Squares Twin Support Vector Regression,LSTSVR)性能,首次基于高斯核函数、多项式核函数、线性核函数构建混合核函数,提出4种季节趋势分解(Seasonal and Trend de...为提高月径流时间序列预测精度,改进最小二乘孪生支持向量回归机(Least Squares Twin Support Vector Regression,LSTSVR)性能,首次基于高斯核函数、多项式核函数、线性核函数构建混合核函数,提出4种季节趋势分解(Seasonal and Trend decomposition using Loess,STL)-小波包变换(Wavelet Packet Transform,WPT)-裂狐优化(Rüppell's Fox Optimizer,RFO)算法-混合核最小二乘孪生支持向量回归机(Hybrid Kernel Least Squares Twin Support Vector Regression,HLSTSVR)模型,并构建STL-WPT-RFO-LSTSVR、STL-WPT-RFO-混合核最小二乘支持向量回归机(Hybrid Kerllel Least Squares Twin Suppart Vector Regression,HLSSVR)、STL-WPT-RFO-最小二乘支持向量回归机(Least Squares Support Vector Regression,LSSVR)等17种对比分析模型,通过云南省高桥、凤屯水文站月径流时间序列预测实例对21种模型进行验证。首先利用STL-WPT二次分解技术对月径流序列进行分解处理,合理划分训练集和验证集;然后基于高斯核函数、多项式核函数、线性核函数,采用“三三”线性组合和“两两”线性组合的方式构建4种混合核函数对月径流分解分量进行空间映射;最后利用RFO寻优HLSTSVR/LSTSVR/HLSSVR/LSSVR最佳超参数,利用最佳超参数建立21种模型对实例月径流序列各分解分量进行训练、预测和重构。结果表明:①4种STL-WPT-RFO-HLSTSVR模型能适应不同尺度的月径流数据分布,具有较好的模型性能和较小的预测误差,其中STL-WPT-RFO-HLSTSVR(高斯+多项式+线性)模型对高桥、凤屯站月径流预测的平均绝对百分比误差MAPE分别为2.85%、2.19%,决定系数R2均为0.9994,预测精度最高、效果最好;②混合核函数兼顾了不同核函数优势,能在模型复杂度与泛化能力之间取得平衡,显著提升模型性能和预测精度;③STL-WPT二次分解技术能有效解决复杂时间序列的非平稳性、非线性和多尺度特征,较STL更具分解优势;④组合模型融合了STL-WPT、RFO和HLSTSVR优点,具有较好的普适性和参考价值。展开更多
针对核电多回路耦合系统在升功率运行中异常传感器检测困难、检测延时及检测精度低等问题,提出了一种自联想核回归模型(auto-associative kernel regression,简称AAKR)与修正序贯概率比检验(sequential probability ratio test,简称SPRT...针对核电多回路耦合系统在升功率运行中异常传感器检测困难、检测延时及检测精度低等问题,提出了一种自联想核回归模型(auto-associative kernel regression,简称AAKR)与修正序贯概率比检验(sequential probability ratio test,简称SPRT)相结合的方法。首先,利用小波软阈值降噪方法对监测数据预处理,获取高质量的多源传感器解调信号;其次,采用AAKR构造传感器正常运行数据的估计值,并获取多源传感器测量值与估计值之间的残差;然后,运用滑动时间窗获取不同阶段残差向量的均值和方差,设计一种SPRT检测规则对传感器残差进行异常检测;最后,用核电一、二回路耦合系统模拟机实验数据进行方法验证与性能分析。结果表明,所提传感器异常检测方法的准确率达到99.52%,异常检测延时降低了81.73%,可有效提高现有核电厂传感器异常检测的稳定性。展开更多
文摘Wavelet, a powerful tool for signal processing, can be used to approximate the target func-tion. For enhancing the sparse property of wavelet approximation, a new algorithm was proposed by using wavelet kernel Support Vector Machines (SVM), which can converge to minimum error with bet-ter sparsity. Here, wavelet functions would be firstly used to construct the admitted kernel for SVM according to Mercy theory; then new SVM with this kernel can be used to approximate the target fun-citon with better sparsity than wavelet approxiamtion itself. The results obtained by our simulation ex-periment show the feasibility and validity of wavelet kernel support vector machines.
基金the National 973 Key Fundamental Research Project of China (Grant No.2002CB312200)
文摘By combining the wavelet decomposition with kernel method, a practical approach of universal multiscale wavelet kernels constructed in reproducing kernel Hilbert space （RKHS） is discussed, and an identification scheme using wavelet support vector machines （WSVM） estimator is proposed for nordinear dynamic systems. The good approximating properties of wavelet kernel function enhance the generalization ability of the proposed method, and the comparison of some numerical experimental results between the novel approach and some existing methods is encouraging.
基金National Natural Science Foundation of China (60573141, 60773041)the Hi-Tech Research and Development Program of China (2006AA01Z439)+5 种基金Natural Science Foundation of Jiangsu Province (BK2005146)High Technology Research Program of Jiangsu Province (BG2005037, BG2006001)Key Laboratory of Information Technology Processing of Jiangsu Province (kjs0606)High Technology Research Program of Nanjing City (2006RZ105)State Key Laboratory of Modern Communication (9140C1101010603)Jiangsu Provincial Research Scheme of Natural Science for Higher Education Institutions (07KJB520083)
文摘To enhance the detection accuracy and deduce false positive rate of distributed denial of service （DDoS） attack detection, a new machine learning method was proposed. With the analysis of support vector machine （SVM） and the wavelet kernel function theory, an admissive support vector kernel, which is a wavelet kernel constructed in this article, implements the combination of the wavelet technique with SVM. Then, wavelet support vector machine （WSVM） is applied to DDoS attack detections and as a classifying means to test the validity of the wavelet kernel function. Simulation experiments show that under the same conditions, the predictive ability of WSVM is improved and the computation burden is alleviated. The detection accuracy of WSVM is higher than the traditional SVM by about 4%, while its false positive is lower than the traditional SVM. Thus, for DDoS detections, WSVM shows better detection performance and is more adaptive to the changing network environment.
基金Supported by the National Natural Science Foundation of China(60473035)~~
文摘The relationship among Mercer kernel, reproducing kernel and positive definite kernel in support vector machine （SVM） is proved and their roles in SVM are discussed. The quadratic form of the kernel matrix is used to confirm the positive definiteness and their construction. Based on the Bochner theorem, some translation invariant kernels are checked in their Fourier domain. Some rotation invariant radial kernels are inspected according to the Schoenberg theorem. Finally, the construction of discrete scaling and wavelet kernels, the kernel selection and the kernel parameter learning are discussed.
文摘We present wavelet bases made of piecewise (low degree) polynomial functions with an (arbitrary) assigned number of vanishing moments. We study some of the properties of these wavelet bases;in particular we consider their use in the approximation of functions and in numerical quadrature. We focus on two applications: integral kernel sparsification and digital image compression and reconstruction. In these application areas the use of these wavelet bases gives very satisfactory results.
基金supported by Shanghai Science and Technology Commission Innovation Action Plan(08DZ1205708)
文摘A new filtering method for SAR data de-noising using wavelet support vector regression （WSVR） is developed. On the basis of the grey scale distribution character of SAR imagery, the logarithmic SAR image as a noise polluted signal is taken and the noise model assumption in logarithmic domain with Gaussian noise and impact noise is proposed. Based on the better per- formance of support vector regression （SVR） for complex signal approximation and the wavelet for signal detail expression, the wavelet kernel function is chosen as support vector kernel func- tion. Then the logarithmic SAR image is regressed with WSVR. Furthermore the regression distance is used as a judgment index of the noise type. According to the judgment of noise type every pixel can be adaptively de-noised with different filters. Through an approximation experiment for a one-dimensional complex signal, the feasibility of SAR data regression based on WSVR is con- firmed. Afterward the SAR image is treated as a two-dimensional continuous signal and filtered by an SVR with wavelet kernel function. The results show that the method proposed here reduces the radar speckle noise effectively while maintaining edge features and details well.
基金Supported by NNSF of China(11271209,1137105,11571261)and SRFDP(20130003110003)
文摘In this article, we consider a fast algorithm for first generation Calderon-Zygmund operators. First, we estimate the convergence speed of the relative approximation algorithm. Then, we establish the continuity on Besov spaces and Triebel-Lizorkin spaces for the oper- ators with rough kernel.
基金supported by the National Natural Science Foundation of China (Grant No.60873130)the Shanghai Leading Academic Discipline Project (Grant No.J50104)
文摘The vector sampling theorem has been investigated and widely used by multi-channel deconvolution, multi-source separation and multi-input multi-output （MIh40） systems. Commonly, for most of the results on MIMO systems, the input signals are supposed to be band-limited. In this paper, we study the vector sampling theorem for the wavelet subspaces with reproducing kernel. The case of uniform sampling is discussed, and the necessary and sufficient conditions for reconstruction are given. Examples axe also presented.
文摘为提高月径流时间序列预测精度,改进最小二乘孪生支持向量回归机(Least Squares Twin Support Vector Regression,LSTSVR)性能,首次基于高斯核函数、多项式核函数、线性核函数构建混合核函数,提出4种季节趋势分解(Seasonal and Trend decomposition using Loess,STL)-小波包变换(Wavelet Packet Transform,WPT)-裂狐优化(Rüppell's Fox Optimizer,RFO)算法-混合核最小二乘孪生支持向量回归机(Hybrid Kernel Least Squares Twin Support Vector Regression,HLSTSVR)模型,并构建STL-WPT-RFO-LSTSVR、STL-WPT-RFO-混合核最小二乘支持向量回归机(Hybrid Kerllel Least Squares Twin Suppart Vector Regression,HLSSVR)、STL-WPT-RFO-最小二乘支持向量回归机(Least Squares Support Vector Regression,LSSVR)等17种对比分析模型,通过云南省高桥、凤屯水文站月径流时间序列预测实例对21种模型进行验证。首先利用STL-WPT二次分解技术对月径流序列进行分解处理,合理划分训练集和验证集;然后基于高斯核函数、多项式核函数、线性核函数,采用“三三”线性组合和“两两”线性组合的方式构建4种混合核函数对月径流分解分量进行空间映射;最后利用RFO寻优HLSTSVR/LSTSVR/HLSSVR/LSSVR最佳超参数,利用最佳超参数建立21种模型对实例月径流序列各分解分量进行训练、预测和重构。结果表明:①4种STL-WPT-RFO-HLSTSVR模型能适应不同尺度的月径流数据分布,具有较好的模型性能和较小的预测误差,其中STL-WPT-RFO-HLSTSVR(高斯+多项式+线性)模型对高桥、凤屯站月径流预测的平均绝对百分比误差MAPE分别为2.85%、2.19%,决定系数R2均为0.9994,预测精度最高、效果最好;②混合核函数兼顾了不同核函数优势,能在模型复杂度与泛化能力之间取得平衡,显著提升模型性能和预测精度;③STL-WPT二次分解技术能有效解决复杂时间序列的非平稳性、非线性和多尺度特征,较STL更具分解优势;④组合模型融合了STL-WPT、RFO和HLSTSVR优点,具有较好的普适性和参考价值。
文摘针对核电多回路耦合系统在升功率运行中异常传感器检测困难、检测延时及检测精度低等问题,提出了一种自联想核回归模型(auto-associative kernel regression,简称AAKR)与修正序贯概率比检验(sequential probability ratio test,简称SPRT)相结合的方法。首先,利用小波软阈值降噪方法对监测数据预处理,获取高质量的多源传感器解调信号;其次,采用AAKR构造传感器正常运行数据的估计值,并获取多源传感器测量值与估计值之间的残差;然后,运用滑动时间窗获取不同阶段残差向量的均值和方差,设计一种SPRT检测规则对传感器残差进行异常检测;最后,用核电一、二回路耦合系统模拟机实验数据进行方法验证与性能分析。结果表明,所提传感器异常检测方法的准确率达到99.52%,异常检测延时降低了81.73%,可有效提高现有核电厂传感器异常检测的稳定性。
