摘要
针对学习未知动态的干扰图样问题,提出一种基于核函数强化学习的雷达与通信抗干扰频点协作算法。与需要获得干扰模式、参数等先验知识的研究相反,所提算法能够利用过去时隙中频点的使用情况来优化抗干扰频点分配策略。首先,通过核函数的强化学习来应对维度诅咒问题。其次,基于近似线性相关性的在线内核稀疏化方法,确保了抗干扰频点分配算法的稀疏性。最后,仿真结果验证了所提算法的有效性。得益于稀疏化码字对于系统动态特性的学习,所提算法与传统基于Q学习的抗干扰频点分配算法相比,收敛时间更短,并且可以快速规避外部未知干扰源的干扰。
Aiming at the problem of learning unknown dynamic interference patterns,a frequency point cooperation algorithm for radar and communication anti-interference based on kernel function reinforcement learning is proposed.On the contrary,the proposed algorithm can optimize the anti-interference frequency allocation strategy by using the usage of the intermediate frequency points in the past slots.Firstly,the problem of curse of dimensions is solved by reinforcement learning of kernel function.Secondly,the online kernel sparsity method based on approximate linear correlation ensures the sparsity of anti-interference frequency assignment algorithm.Finally,simulation results verify the effectiveness of the proposed algorithm.Due to the learning of sparse codewords for the dynamic characteristics of the system,compared with the traditional anti-interference frequency assignment algorithm based on Q-learning,the proposed algorithm has shorter convergence time and can quickly avoid the interference of external unknown interference sources.
作者
江志炜
黄洋
吴启晖
JIANG Zhiwei;HUANG Yang;WU Qihui(Key Laboratory of Ministry of Industry and Information Technology on Electromagnetic Spectrum Spatial Cognitive Dynamic Systems,Nanjing University of Aeronautics and Astronautics,Nanjing 211106,China;National Mobile Communications Research Laboratory,Southeast University,Nanjing 211189,China)
出处
《系统工程与电子技术》
EI
CSCD
北大核心
2021年第6期1547-1556,共10页
Systems Engineering and Electronics
基金
国家自然科学基金(61827801,61631020,61901216)
江苏省自然科学基金(BK20190400)
东南大学移动通信国家重点实验室开放研究基金(2020D08)资助课题。
关键词
抗干扰
强化学习
核方法
Q学习
anti-interference
reinforcement learning
kernel method
Q-learning
