期刊文献+

基于强化学习的航空兵认知行为模型 被引量:14

Cognition behavior model for air combat based on reinforcement learning
原文传递
导出
摘要 航空兵的认知行为模型为仿真航空兵的空战决策提供支持,通过强化学习积累战术决策经验.在虚拟战场环境中,作战态势通过多个属性进行描述,这使得强化学习过程将面临一个高维度的问题空间.传统的空间离散化方法处理高维空间时将对计算资源和存储资源产生极大需求,因此不可用.通过构造一个基于高斯径向基函数的拟合网络解决了这个问题,大大减少了对资源的需求以及强化学习周期,并最终产生了合理的机动策略.模型的有效性和自适应性通过一对一的空战仿真进行了验证,产生的交战轨迹与人类飞行员产生的交战轨迹类似. A cognition model was proposed to support tactical decisions for simulated fighters to fight with each other in a virtual combat,and reinforcement learning(RL) technology was used to acquire knowledge.The combat situation was described by multi-attributes,which resulted in a high dimensional problem space in which the fighters learned to find action policies.The traditional approach that partitioned the problem space would impose demand on huge computation and storage resource.An approximation network is constructed based on Gaussian radial basis function to approximate the state value,which greatly reduced the resource demand and learning cycle time,and produced reasonable maneuver strategy.The model was verified by a one-to-one air combat simulation,and the produced trajectories are similar with those that human pilots flied in real combat.
出处 《北京航空航天大学学报》 EI CAS CSCD 北大核心 2010年第4期379-383,共5页 Journal of Beijing University of Aeronautics and Astronautics
基金 装备预研重点基金资助项目(9140A04040106HT0801)
关键词 强化学习 自适应系统 仿真 reinforcement learning adaptive systems simulation
  • 相关文献

参考文献8

  • 1Howard R A. Dynamic programming and markov processes[ M ]. Cambridge: MIT Press, 1960.
  • 2Sutton R S, Barto A G. Time derivative models of pavlovian rein- forcement,learning and computational neuroscience : foundations of adaptive networks [ M ]. Cambridge : MIT Press, 1990 : 497 - 537.
  • 3Baron Sheldon,Kelinman D L,Serben Saul. A study of the markov game approach to tactical maneuvering problems [ R ]. NASA CR-1979,1972.
  • 4Moore A W, Atkeson C G. The patti-game algorithm for variable resolution reinforcement learning in multidimensional statespaces [ J]. Machine Learning, 1995,21 ( 3 ) : 199 - 233.
  • 5Park J, Sandberg I W. Universal approximation using radial-basis function network [ J]. Neural Computation, 1991 (3) :246 - 257.
  • 6Schaal S, Atkeson C G. From isolation to cooperation : an alternative view of a system of experts [ C ]//Touretzky D S, Hasselmo M E. Advances in Neural Information Processing Systems 8. MA : MIT Press, 1996 : 605 - 611.
  • 7Virtanen K, Raivio T, Hamalainen R P. A decision analytic simulation approach to flight simulation [ EB/OL ]. Helsinki: System Analysis Laboratory ,2007 [ 2007 - 06 - 20 ]. http ://www. sal. tkk. fi/Opinnot/Mat -2. 108/pdf-files/ cham02. pdf.
  • 8Kaebling L P,Littman M L,Moore A W. Reinforcement: a survey [ J ]. Journal of Artificial Intelligence Research, 1996 (4) : 237 - 285.

同被引文献178

引证文献14

二级引证文献146

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部