摘要
软件定义网络(software-defined networking,SDN)凭借其全局化、集中式的管理架构,为复杂动态网络管理带来了革命性变化,也为实施网络流量工程创造了便利条件。与此同时,强化学习因其在决策优化方面具备显著优势而备受关注。将强化学习与SDN独特架构相结合,应用于流量工程具有重要的现实意义。从理论和应用两个层面,依据技术发展脉络,全面梳理了强化学习、深度强化学习、多智能体深度强化学习在SDN流量工程中的研究进展;从方法分类、网络场景、强化学习算法、流量工程目标等多个维度,对现有研究成果进行了归纳、整理与分析,为实施SDN流量工程方法策略提供了多维视角;进一步归纳整理了强化学习与其他技术结合的研究进展,显示出其在提升流量工程策略性能方面的潜力。在总结现有研究进展的基础上,剖析了当前面临的挑战,并提出了未来的研究方向,为促进该领域的深化探索提供一定参考。
Software-defined networking(SDN),with its global and centralized management architecture,has brought revolutionary changes to the management of complex and dynamic networks,and has also created favorable conditions for network traffic engineering.Concurrently,reinforcement learning has garnered significant attention due to its pronounced advantages in decision optimization.The integration of reinforcement learning with the unique architecture of SDN and its application to SDN traffic engineering holds substantial practical significance.Firstly,from both theoretical and practical perspectives,based on the trajectory of technological development,the paper reviews the advancements in reinforcement learning,deep reinforcement learning,and multi-agent deep reinforcement learning in SDN traffic engineering.Additionally,it conducts a thorough synthesis and analysis of existing research outcomes across various dimensions,including methodological categorization,network scenarios,reinforcement learning algorithms,and traffic engineering objectives,providing a multidimensional perspective on the integration of reinforcement learning with SDN traffic engineering.Subsequently,it further summarizes the research progress of reinforcement learning combined with other technologies,demonstrating its potential to enhance the performance of traffic engineering.Ultimately,based on a summary of the current research progress,the paper analyzes the challenges faced and proposes future research directions,providing some reference for deepening exploration in this domain.
作者
刘延飞
王程锦
李超
LIU Yanfei;WANG Chengjin;LI Chao(Department of Basic Courses,Rocket Force University of Engineering,Xi’an 710025,China;School of Information and Communication,National University of Defense Technology,Wuhan 430000,China)
出处
《计算机工程与应用》
北大核心
2025年第24期1-28,共28页
Computer Engineering and Applications
基金
国家自然科学基金青年基金(62301596)
国家自然科学基金面上项目(U23B2064)。
关键词
强化学习
软件定义网络
流量工程
路由算法
reinforcement learning
software-defined networking
traffic engineering
routing algorithm
