摘要
在基站无法提供通信支撑区域,可引入无人机群作为中继节点来搭建无人机应急通信网络。针对无人机如何高效选择最优中继节点及保证系统吞吐量最大化问题,提出一种基于SA-SARSA强化学习算法的无人机中继选择策略。在所有的中继节点通过解码重传(DF)之后进行转发,得到用户端最大比合并后的平均吞吐量的表达式,通过设定SARSA算法的状态、动作、奖励函数,选择回报值最大的中继节点。同时,引入退火算法来使源节点探索到更多的中继节点,从而使无人机群通信网络性能达到最优状态。仿真结果表明,与改进前的SARSA中继选择策略相比,所提的SA-SARSA中继选择策略占理想算法比例提升10%。同时,在相同总功率条件下,所提策略所选的中继节点的吞吐量比Q-learning中继选择策略、SARSA中继选择策略分别提升了8%、13%。
A UAV group can be introduced as a relay node in the base station that cannot provide a communication support area to build a UAV emergency communication network.To solve the problem of how to efficiently select the optimal relay node and maximize the system throughput,we propose a relay selection strategy for UAVs based on the SA-SARSA reinforcement learning algorithm.After all the relay nodes are forwarded after decoding retransmission(DF),the expression of the maximum average throughput of the user is obtained.The relay node with the maximum return value is selected by setting the SARSA algorithm’s state,action,and reward function.At the same time,the annealing algorithm is introduced to make the source node explore more relay nodes so that the performance of the UAV swarm communication network can reach the optimal state.The simulation results show that compared with the previous SARSA relay selection strategy,the proposed SA-SARSA relay selection strategy increases the proportion of the ideal algorithm by 10%.At the same time,under the same total power condition,the throughput of relay nodes selected by the proposed strategy is 8%and 13%higher than that of the Q-learning relay selection strategy and SARSA relay selection strategy,respectively.
作者
彭艺
唐剑
杨青青
李睿
Peng Yi;Tang Jian;Yang Qingqing;Li Rui(School of Information Engineering and Automation,Kunming University of Science and Technology,Kunming 650031,China;Yunnan Key Laboratory of Computer Technologies Application,Kunming University of Science and Technology,Kunming 650500,China)
出处
《电子测量与仪器学报》
CSCD
北大核心
2022年第7期9-15,共7页
Journal of Electronic Measurement and Instrumentation
基金
国家自然科学基金(61761025)
云南计算机技术应用重点实验室开放基金项目资助。
关键词
应急通信
无人机
中继选择
SA-SARSA
吞吐量
UAV
emergency communication
relay selection
SA-SARSA
simulated annealing arithmetic
