期刊文献+

一种模糊-证据kNN分类方法 被引量:13

A Fuzzy-Evidential k Nearest Neighbor Classification Algorithm
在线阅读 下载PDF
导出
摘要 已有的以k-最近邻(kNearest Neighbor,kNN)规则为核心的分类算法,如模糊kNN(FuzzykNN,FkNN)和证据kNN(EvidentialkNN,EkNN)等,存在着两个问题:无法区别出样本特征的差异以及忽略了邻居距训练样本类中心距离的不同所带来的影响.为此,本文提出一种模糊-证据kNN算法.首先,利用特征的模糊熵值确定每个特征的权重,基于加权欧氏距离选取k个邻居;然后,利用邻居的信息熵区别对待邻居并结合FkNN在表示信息和EkNN在融合决策方面的优势,采取先模糊化再融合的方法确定待分类样本的类别.本文的方法在UCI标准数据集上进行了测试,结果表明该方法优于已有算法. The classification algorithms based on k Nearest Neighbor (kNN) rule, such as Fuzzy kNN (FkNN) and Evi- dential kNN (EkNN), has two problems:the differences of the sample features cannot be recognized and the effect of fuzziness that aroused by the different distances between neighbors and the center of classes is not taken into account. In order to overcome the limitations, the fuzzy-evidential kNN(FEkNN)algorithm is proposed. First, the features' weights are determined by the features' fuzzy entropy values and k neighbors are selected according to the weighted Euclidean distance. Then samples are classified by the method, which fuzzify memberships of its neighbors first and then fuse the information. And this method combines the advantage of FkNN in information expression with that of EkNN in decision-making. Meanwhile, neighbors are distinguished by their informa- tion entropy values. The presented method is tested on the UCI datasets,and the results show that the proposed method outperforms the other kNN-based classification algorithms.
出处 《电子学报》 EI CAS CSCD 北大核心 2012年第12期2390-2395,共6页 Acta Electronica Sinica
基金 国家自然科学基金(No.60974063 No.61175059)
关键词 k-最近邻(k-NN) 加权欧氏距离 模糊熵 折扣因子 证据理论 k nearest neighbor (k-NN) weighted-Euclidean distance fuzzy entropy discount factor evidence theory
  • 相关文献

参考文献14

  • 1Keller J M,Gray M R,Givens J A. A fuzzy k-nearest neighbor algorithm[J].IEEE Transactions on Systems Man and Cybernetics,1985,(04):580-585.
  • 2王熙照.模糊测度和模糊积分及在分类技术中的应用[M]北京:科学出版社,2008207-208.
  • 3Wu Y Q,Ianakiev K,Govindaraju V. Improved k-nearest neighbor classification[J].Pattern Recognition,2002,(10):121-146.
  • 4赵莹,高隽,汪荣贵,胡静.一种新的广义最近邻方法研究[J].电子学报,2004,32(F12):196-198. 被引量:13
  • 5朱明旱,罗大庸,易励群.一种序列的加权kNN分类方法[J].电子学报,2009,37(11):2584-2588. 被引量:15
  • 6刘松华,张军英,许进,贾宏恩.Kernel-kNN:基于信息能度量的核k-最近邻算法[J].自动化学报,2010,36(12):1681-1688. 被引量:16
  • 7Denoeux T. A k-nearest neighbor classification rule based on Dempster-Shafer theory[J].IEEE Transactions on Systems Man and Cybernetics,1995.804-813.
  • 8刘明,袁保宗,唐晓芳.证据理论k-NN规则中确定相似度参数的新方法[J].电子学报,2005,33(4):766-768. 被引量:8
  • 9Anil K G. On optimum choice of k in nearest neighbor classification[J].Computational Statistics and Data Analysis,2006.3113-3123.
  • 10Zouhal L M,Denoeux T. An evidence-theoretic k-NN rule with parameter optimization[J].IEEE Transactions on Systems Man and Cybernetics,1998,(02):263-271.doi:10.1109/5326.669565.

二级参考文献47

  • 1陈振洲,李磊,姚正安.基于SVM的特征加权KNN算法[J].中山大学学报(自然科学版),2005,44(1):17-20. 被引量:53
  • 2刘明,袁保宗,唐晓芳.证据理论k-NN规则中确定相似度参数的新方法[J].电子学报,2005,33(4):766-768. 被引量:8
  • 3周晓飞,杨静宇,姜文瀚.核最近邻凸包分类算法[J].中国图象图形学报,2007,12(7):1209-1213. 被引量:6
  • 4T M Cover, P E Hart. Nearest neighbor pattern classification [J]. IEEE Trans. on Information Theory, 1967, 13( 1 ):21 - 27.
  • 5Y Yang, X Lin. A re-examination of text categorization methods[ A ]. Proceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval [C]. New York: ACM, 1999,42 - 49.
  • 6Li Baoli, Chen Yuzhong, Yu Shiwen. A comparative study on automatic categorization methods for Chinese search engine [A]. Proceedings of the Eighth Joint International Computer Conference[ C ]. Hangzhou: Zhejiang University Press, 2002. 117 - 120.
  • 7G Gora, A Wojna. A classifier combining rule induction and k- NN method with automated selection of optimal neighbourhood [ A ]. Proceedings of the Thirteenth European Conference on Machine Learning [C]. Heidelberg: Springer Berlin, 2002, 2430:111 - 123.
  • 8C D' Amato, D Malerba, F Esposito, et al. Extending the k- nearest neighbour classification algorithm to symbolic objects [A]. Atti del Convegno Intermedio della Societa Italiana di Statisfica "Analisi Statisfica Multivariata per le scienze economico-sociali,le scienze naturali e la tecnologia" [C]. Italia: Napoli, 2003.
  • 9W Hechenbichler, K Schliep. Weighted k-nearest-neighbor techniques and, ordinal classification [OL]. http://epub. ub.uni-muenchen.de/1769/, 2007-4-10/2008-9-12.
  • 10D P Vivencio, E R Hruschka, M C Nicoletti, et al. Featureweighted k-nearest neighbor classifier[A]. Proceedings of the IEEE Symposium on Foundations of Computational Intelligence [C], Wsdhington DC, USA: IEEE Communications Society, 2007.481- 486.

共引文献47

同被引文献107

引证文献13

二级引证文献43

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部