期刊文献+

采用互补信息熵的分类器集成差异性度量方法 被引量:4

A Novel Measure Method for Diversity of Classifier Integrations Using Complement Information Entropy
在线阅读 下载PDF
导出
摘要 针对多分类器系统差异性评价中无法直接处理模糊数据的问题,提出了一种采用互补信息熵的分类器集成差异性度量(CIE)方法。首先利用训练数据生成一系列基分类器,并对测试数据进行分类,将分类结果依次组合生成分类数据空间;然后采用模糊关系条件下的互补信息熵度量分类数据空间蕴含的不确定信息量,据此信息量判断基分类器间的差异性;最后以加入基分类器后数据空间差异性增加为选择分类器的基本准则,构建集成分类器系统,用于验证CIE差异性度量与集成分类精度之间的关系。实验结果表明,与Q统计方法相比,利用CIE方法进行分类器集成,平均集成分类精度提高了2.03%,分类器系统集成规模降低约17%,而且提高了集成系统处理多样化数据的能力。 A novel diversity measure method using complement information entropy(CIE)is proposed to solve the problem that the diversity estimation of multiple classifier systems is unable to deal directly with fuzzy data.A set of base classifiers is generated by using training data,and then is used to label test data.The outputs of the classifiers are reorganized into a new classification data space.Then the complement information entropy model is introduced under fuzzy relation to measure uncertainty information of the new space and the uncertainty information is used to estimate the diversity of base classifiers.Finally,an ensemble system is constructed based on the criterion that the ensemble diversity of the classifier set increases when a base classifier is added,and the ensemble system is used to validate the performance of CIE.Experimental results and a comparison with the Q-statistic method show that the average classification accuracy of CIE increases by 2.03%,and the number of ensemble classifiers reduces by 17%.Moreover,CIE also improves the ability of ensemble systems to process diverse data.
出处 《西安交通大学学报》 EI CAS CSCD 北大核心 2016年第2期13-19,共7页 Journal of Xi'an Jiaotong University
基金 国家自然科学基金资助项目(61074176 41174162) 中国博士后科学基金资助项目(2013M532048)
关键词 分类器集成 差异性 互补信息熵 模糊关系 classifier ensemble diversity complement information entropy fuzzy relation
  • 相关文献

参考文献20

  • 1KUNCHEVA L I,SKURICHINA M,DUIN R P W.An experimental study on diversity for bagging and boosting with linear classifiers[J].Information Fusion,2002,3(4):245-258.
  • 2BROWN G,KUNCHEVA L I.“Good”and“bad”diversity in majority vote ensembles[C]∥Proceedings of International Conference on Multiple Classifier Systems.Berlin,Germany:Springer,2010:124-133.
  • 3张宏达,王晓丹,韩钧,徐海龙.分类器集成差异性研究[J].系统工程与电子技术,2009,31(12):3007-3012. 被引量:10
  • 4NASCIMENTO D,COELHO A,CANUTO A.Integrating complementary techniques for promoting diversity in classifier ensembles:a systematic study[J].Neurocomputing,2014,138:347-357.
  • 5KUNCHEVA L I,WHITAKER C J.Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy[J].Machine Learning,2003,51:181-207.
  • 6WINDEATT T.Diversity measures for multiple classifier system analysis and design[J].Information Fusion,2005,6(1):21-36.
  • 7HAGHIGHI M S,VAHEDIAN A,YAZDI H S.Creating and measuring diversity in multiple classifier systems using support vector data description[J].Applied Soft Computing,2011,11(8):4931-4942.
  • 8KRAWCZYK B,WOZNIAK M.Diversity measures for one-class classifier ensembles[J].Neurocomputing,2004,126:36-44.
  • 9YIN X C,HUANG K Z,HAO H W,et al.A novel classifier ensemble method with sparsity and diversity[J].Neurocomputing,2014,134:214-221.
  • 10BI Y X.The impact of diversity on the accuracy of evidential classifier ensembles[J].International Journal of Approximate Reasoning,2012,53(4):584-607.

二级参考文献140

  • 1李凯,黄厚宽.一种提高神经网络集成差异性的学习方法[J].电子学报,2005,33(8):1387-1390. 被引量:9
  • 2于玲,吴铁军.LS-Ensem:一种用于回归的集成算法[J].计算机学报,2006,29(5):719-726. 被引量:3
  • 3Hansen L K, Salamon P. Neural network ensembles[J]. IEEE Trans. on Pattern AnaLysis and Machine Intelligence, 1990, 12(10) :993 - 1001.
  • 4Dietterich T G. Machine learning research: four current directions[J]. AI Magazine, 1997,18(4) : 97 - 136.
  • 5Dietterich T G. An experimental comparison of three methods for constructing ensembles of decision trees: bagging, boosting, and randomization[J]. Machine Learning, 2000,40(2) : 139 - 158.
  • 6Kohavi R, Wolpert D H. Bias plus variance decomposition for zero-one loss functions[C]//Saitta L. Machine learning: Proc. of the 13th International Conference, Morgan Kau f mann , Los Altos, CA, 1996:275 - 283.
  • 7Shipp C A, Kuncheva L I. Relationships between combination methods and measures of diversity in combining classifiers[J].Information Fusion ,2002,3(2) : 135 - 148.
  • 8Chandra A, Yao X. DIVACE: diverse and accurate ensemble learning algorithm[M]. Yang Z R, et al. IDEAL, LNCS 3177, Heidelberg: Springer, 2004 : 619 - 625.
  • 9Melville P, Mooney R J. Creating diversity in ensembles using artificial data[J].Information Fusion, 2005,6(1) : 99 - 111.
  • 10Breiman L. Bagging predietors[J]. Machine Learning, 1996, 24(2) :123 - 140.

共引文献36

同被引文献27

引证文献4

二级引证文献10

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部