期刊文献+

基于零范数特征选择的支持向量机模型 被引量:9

Zero-norm Penalized Feature Selection Support Vector Machine
在线阅读 下载PDF
导出
摘要 为解决高维稀疏建模问题,本文从经验风险最小化原则出发推导出一个基于零范数约束的特征选择判据,并利用嵌入式设计模式的特点将其与支持向量机方法相结合.仿真实验和真实数据实验表明,该方法不仅具备良好的特征选择性能,而且在稀疏建模问题中表现出良好的分类准确性和泛化能力. To deal with the high-dimensional sparse modeling problem, this paper derives a zero-norm penalized feature selection criterion based on the the empirical risk minimization principle, and combines it with support vector machines through an embedded paradigm. Numerical results on both synthetic and real data sets show that the proposed approach does not only perform well for feature selection tasks, but also shows good performance compared to the conventional sparse modeling techniques, in the sense of classification accuracy and generalization capability.
出处 《自动化学报》 EI CSCD 北大核心 2011年第2期252-256,共5页 Acta Automatica Sinica
基金 国家高技术研究发展计划(863计划)(2006AA01Z411)资助~~
关键词 机器学习 特征选择 支持向量机 稀疏建模 正则化 Machine learning, feature selection, support vector machine (SVM), sparse modeling, regularization
  • 相关文献

参考文献13

  • 1王红卫,祁超,魏永长,李彬,朱松.基于数据的决策方法综述[J].自动化学报,2009,35(6):820-833. 被引量:30
  • 2Forman G. An extensive empirical study of feature selection metrics for text classification. The Journal of Machine Learning Research, 2003, 3:1289-1305.
  • 3Guyon I, Weston J, Barnhill S, Vapnik V. Gene selection for cancer classification using support vector machines. Machine learning, 2002, 46(1-3): 389-422.
  • 4Li T, Zhang C L, Ogihara M. A comparative study of feature selection and multiclass classification methods for tissue classification based on gene expression. Bioinformatics, 2004, 20(15): 2429-2437.
  • 5Zhu J, Rosset S, Hastie T, Tibshirani R. 1-norm support vector machines. In: Proceedings of the Advances in Neural Information Processing Systems. Cambridge, USA: The MIT Press. 2004. 49--56.
  • 6Kujala J, Aho T, Elomaa T. A walk from 2-norm SVM to 1-norm SVM. In: Proceedings of the 9th IEEE International Conference on Data Mining. Miami, USA: IEEE, 2009. 836-841.
  • 7Zou H, Hastie T. Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society Series B, 2005, 67(2): 301-320.
  • 8Lin D, Pitler E, Foster D P, Ungar L H. In defense of l. In: Proceedings of ICML Workshop on Sparse Optimization and Variable Selection. Helsinki, Finland: The Omnipress, 2008.
  • 9Guyon I, Elisseeff A. An introduction to variable and feature selection. The Journal of Machine Learning Research, 2003, 3:1157-1182.
  • 10Myung J I, Navarro D J, Pitt M A. Model selection by normalized maximum likelihood. Journal of Mathematical Psychology, 2006, 50(2): 167-179.

二级参考文献215

  • 1陈春雨,林茂六,张喆.基于支持向量机的信号滤波研究[J].西安交通大学学报,2006,40(4):427-431. 被引量:4
  • 2朱嘉钢,王士同.用于图像恢复的基于SVR的自适应新滤波器的研究[J].计算机应用研究,2006,23(9):253-255. 被引量:5
  • 3董艺秋,徐树方.一个高效的椒盐噪声去除方法(英文)[J].北京大学学报(自然科学版),2006,42(5):604-612. 被引量:6
  • 4宋宇,李满天,孙立宁.基于相似度函数的图像椒盐噪声自适应滤除算法[J].自动化学报,2007,33(5):474-479. 被引量:42
  • 5Ramsey J B, Zaslavsky G M, Usikov D. An analysis of US stock price behavior using wavelets. Fractals, 1995, 3(2): 377-389
  • 6Sauter V L. Intuitive decision-making. Communications of the ACM, 1999, 42(6): 109-115
  • 7Russell S, Gangopadhyay A, Yoon V. Assisting decision making in the event-driven enterprise using wavelets. Decision Support Systems, 2008, 46(1): 14-28
  • 8MacQueen J B. Some methods for classification and analysis of multivariate observations. In: Proceedings of the 5th Berkeley Symposium on Mathematical Statistics and Probability. Berkeley, USA: University of California Press, 1967. 281-297
  • 9Ben-Hur A, Horn D, Siegelmann H T, Vapnik V N. Support vector clustering. The Journa! of Machine Learning Research, 2001, 2:125-137
  • 10Roy P P. Breakage assessment through cluster analysis of joint set orientations of exposed benches of opencast mines. Geotechnical and Geological Engineering, 1995, 13(2): 79-92

共引文献31

同被引文献104

引证文献9

二级引证文献140

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部