期刊文献+

一种基于随机抽样的贝叶斯网络结构学习算法 被引量:2

Stochastic Sample Based Algorithm for Learning Bayesian Networks
在线阅读 下载PDF
导出
摘要 针对贝叶斯网络的结构学习问题,基于并行随机抽样的思想提出了结构学习算法PCMHS,构建多条并行的收敛于Boltzmann分布的马尔可夫链。首先基于节点之间的互信息,进行所有马尔可夫链的初始化,在其迭代过程中,基于并行的MHS抽样总体得到产生下一代个体的建议分布,并通过对网络中弧和子结构的抽样产生下一代个体。算法PCMHS收敛于平稳分布,具有良好的学习精度,而该算法又通过使其初始分布和建议分布近似于其平稳分布,有效提高了马尔可夫链的收敛速度。在标准数据集上的实验结果验证了算法PCMHS的学习效率和学习精度明显优于经典算法MHS和PopMCMC。 Based on the ideas of parallel stochastic sampling, this paper put forward an algorithm PCMHS for learning Bayesian networks. The PCMHS algorithm runs multi parallel Markov chains converging to Boltzmann distributions. The algorithm PCMHS, based on the mutual information between nodes, initializes all Markov chains. In the process of iteration, the algorithm, based on the population from parallel Metropolis-Hasting samplers, generates the proposal distribution for the next generation,and uses arc sample and sub-structure sample to produce the individuals of the next generation. The algorithm PCMHS converges to stationary distribution and its learning accuracy is high. In addition, it designs initial sample and proposal distribution as close as possible to the stationary distribution, and greatly improves the convergence rate. The experimental results on standard data set prove that the learning accuracy and efficiency of the algorithm PCMHS greatly outperform the classical algorithms MHS and PopMCMC.
出处 《计算机科学》 CSCD 北大核心 2009年第2期199-202,共4页 Computer Science
基金 安徽省自然科学基金课题(编号050420207)资助
关键词 贝叶斯网络 结构学习 随机抽样 马尔可夫链 建议分布 Bayesian networks, Structure learning, Stochastic sampling, Markov chain, Proposal distribution
  • 相关文献

参考文献13

  • 1Chickering D, Herkerman D, Meek C. Large-sample Learning of Bayesian Networks is NP-Hard. Machine Learning Research[J].2004,5:1287-1330
  • 2Ellis B,Wong W. Sampling Bayesian Networks Quickly[C]//Interface. 2006
  • 3Wong M L , Leung K S. An efficient data mining method for learning Bayesian Networks using an evolutionary algorithmbased hybrid approach[J].IEEE Transactions on Evolutionary Computation, 2004,8 : 378-404
  • 4Peng H,Ding C. Structure search and stability enhancement of Bayesian networks[C]//Proc, of the Third IEEE International Conference on Data Mining. 2003:621-624
  • 5Andrieu C, Freitas N D, Doucet A, et al. An introduction to MCMC for machine learning[J]. Machine Learning,2003,50:5-43
  • 6Robert C,Casella G. Monte Carlo statistical methods[M]. 2nd edition. Springer, 2004
  • 7Gilks W, Richardson S, Spiegelhalter D. Markov Chain Monte Carlo methods. Practice[M]. CRC Press, 1996
  • 8Madigan D, York J. Bayesian graphical models for discrete data[J].Intl. Statistical Review, 1995,63 : 215-232
  • 9Beichl I,Sullivan F. The Metropolis algorithm[J].Computing in Science & Engineering, 2000 :65-69
  • 10Giudici P , Castelo R . Improving Markov Chain Monte Carlo Model Search for Data Mining[J]. Machine Learning, 2003,50 (1/2) : 127-158

同被引文献8

引证文献2

二级引证文献8

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部