期刊文献+

基于双延迟深度确定性策略梯度的路由优化算法

Routing Optimization Algorithm Based on Twin Delayed Deep Deterministic Policy Gradient
在线阅读 下载PDF
导出
摘要 随着人工智能、网络通信、网络应用的飞速发展,传统的路由算法如RIP、OSPF在面对网络流量的指数级增长以及不同服务需求的情况下存在收敛慢、平均时延高等一系列问题。而近年来深度强化学习在复杂控制领域取得巨大发展。路由优化算法本质上讲就是一个控制优化问题。所以为了克服现有路由算法在某些场合下的弊端,将深度强化学习与计算机路由优化相结合。论文提出一种利用改进的DDPG算法,并命名为TD3OR算法去解决传统路由在某些场合下的弊端。实验表明,采用TD3OR算法的路由对比单纯DDPG算法以及传统OSPF算法的路由具有更低的延时,证明其是有效的。 With the rapid development of artificial intelligence,network communication,network application,traditional routing algorithms such as RIP and OSPF have a series of problems such as slow convergence and high average delay in the face of expo-nential growth of network traffic and different service requirements.In recent years,deep reinforcement learning has made great progress in the field of complex control.Routing optimization algorithm is essentially a control optimization problem.In order to over-come the drawbacks of existing routing algorithms in some situations,and combine deep reinforcement learning with computer routing optimization,this paper proposes an improved DDPG algorithm named TD3OR algorithm to solve the drawbacks of traditional routing in some situations.The experiment shows that the route using TD3OR algorithm has lower delay than that using DDPG algo-rithm and traditional OSPF algorithm,which proves that TD3OR algorithm is effective.
作者 郑艺 韩永国 ZHENG Yi;HAN Yongguo(School of Computer and Software,Chengdu Neusoft University,Chengdu 611844)
出处 《计算机与数字工程》 2025年第8期2117-2121,共5页 Computer & Digital Engineering
关键词 深度强化学习 DDPG TD3OR 路由优化 deep reinforcement learning DDPG TD3OR routing optimization
  • 相关文献

参考文献6

二级参考文献67

  • 1王飞跃.平行系统方法与复杂系统的管理和控制[J].控制与决策,2004,19(5):485-489. 被引量:378
  • 2魏英姿 ,赵明扬 .一种基于强化学习的作业车间动态调度方法[J].自动化学报,2005,31(5):765-771. 被引量:19
  • 3高阳,周如益,王皓,曹志新.平均奖赏强化学习算法研究[J].计算机学报,2007,30(8):1372-1378. 被引量:38
  • 4McKEOWN N, ANDERSON T, BALAKRISHNAN H, et al. Open- Flow : enabling innovation in campus networks [ J ]. ACM SIGCOMM Computer Communication Review,2008,38(2) :69-75.
  • 5IONA Technologies. Technology review [ EB/OL]. http://www, techn- ologyreview, corn/article/412194/tr10-software-defined-networking/.
  • 6Open Network Foundation (ONF). Software defined networking:the new norm for networks[ EB/OL]. https ://www. opennetworking, org/ images/stories/dowuloads/white-papers/wp-sdn-newnorm, pdf.
  • 7Open Network Foundation (ONF), OpenFlow switch specification vl. 3.0 [ EB/OL]. https://www, opennetworking, org/images/sto- ries/downloads/speciflcation/openflow-spec-vl. 3.0. pdf.
  • 8Open Network Foundation (ONF). OpenFlow switch specification, vl. 1.0 [ EB/OL]. https://www, opennetworking, org/images/sto- ries/downloads/specifieation/openflow-spec-vl. 0. 0. pdf.
  • 9Open Network Foundation (0NF). 0penFlow configuration and man- agement protocol vl. 1 [ EB/OL]. https://www, opennetworking, org/ images/stories/downloads/of-config/of-config- 1.1. pdf.
  • 10CASADO M, FREEDMAN M J, PETIT J, et al. Ethane: taking control of the enterprise[ J]. ACM S1GCOMM Computer Commu- nication Review,2007,37(4) : 1-12.

共引文献1018

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部