Scalable simulation leveraging real-world data plays an essential role in advancing autonomous driving,owing to its efficiency and applicability in both training and evaluating algorithms.Consequently,there has been i...Scalable simulation leveraging real-world data plays an essential role in advancing autonomous driving,owing to its efficiency and applicability in both training and evaluating algorithms.Consequently,there has been increasing attention on generating highly realistic and consistent driving videos,particularly those involving viewpoint changes guided by the control commands or trajectories of ego vehicles.However,current reconstruction approaches,such as Neural Radiance Fields and 3D Gaussian Splatting,frequently suffer from limited generalization and depend on substantial input data.Meanwhile,2D generative models,though capable of producing unknown scenes,still have room for improvement in terms of coherence and visual realism.To overcome these challenges,we introduce GenScene,a world model that synthesizes front-view driving videos conditioned on trajectories.A new temporal module is presented to improve video consistency by extracting the global context of each frame,calculating relationships of frames using these global representations,and fusing frame contexts accordingly.Moreover,we propose an innovative attention mechanism that computes relations of pixels within each frame and pixels in the corresponding window range of the initial frame.Extensive experiments show that our approach surpasses various state-of-the-art models in driving video generation,and the introduced modules contribute significantly to model performance.This work establishes a new paradigm for goal-oriented video synthesis in autonomous driving,which facilitates on-demand simulation to expedite algorithm development.展开更多
This survey presents a comprehensive examination of sensor fusion research spanning four decades,tracing the methodological evolution,application domains,and alignment with classical hierarchical models.Building on th...This survey presents a comprehensive examination of sensor fusion research spanning four decades,tracing the methodological evolution,application domains,and alignment with classical hierarchical models.Building on this long-term trajectory,the foundational approaches such as probabilistic inference,early neural networks,rulebasedmethods,and feature-level fusion established the principles of uncertainty handling andmulti-sensor integration in the 1990s.The fusion methods of 2000s marked the consolidation of these ideas through advanced Kalman and particle filtering,Bayesian–Dempster–Shafer hybrids,distributed consensus algorithms,and machine learning ensembles for more robust and domain-specific implementations.From 2011 to 2020,the widespread adoption of deep learning transformed the field driving some major breakthroughs in the autonomous vehicles domain.A key contribution of this work is the assessment of contemporary methods against the JDL model,revealing gaps at higher levels-especially in situation and impact assessment.Contemporary methods offer only limited implementation of higher-level fusion.The survey also reviews the benchmark multi-sensor datasets,noting their role in advancing the field while identifying major shortcomings like the lack of domain diversity and hierarchical coverage.By synthesizing developments across decades and paradigms,this survey provides both a historical narrative and a forward-looking perspective.It highlights unresolved challenges in transparency,scalability,robustness,and trustworthiness,while identifying emerging paradigms such as neuromorphic fusion and explainable AI as promising directions.This paves the way forward for advancing sensor fusion towards transparent and adaptive next-generation autonomous systems.展开更多
As carrier aircraft sortie frequency and flight deck operational density increase,autonomous dispatch trajectory planning for carrier-based vehicles demands efficient,safe,and kinematically feasible solutions.This pap...As carrier aircraft sortie frequency and flight deck operational density increase,autonomous dispatch trajectory planning for carrier-based vehicles demands efficient,safe,and kinematically feasible solutions.This paper presents an Iterative Safe Dispatch Corridor(iSDC)framework,addressing the suboptimality of the traditional SDC method caused by static corridor construction and redundant obstacle exploration.First,a Kinodynamic-Informed-Bidirectional Rapidly-exploring Random Tree Star(KIBRRT^(*))algorithm is proposed for the front-end coarse planning.By integrating bidirectional tree expansion,goal-biased elliptical sampling,and artificial potential field guidance,it reduces unnecessary exploration near concave obstacles and generates kinematically admissible paths.Secondly,the traditional SDC is implemented in an iterative manner,and the obtained trajectory in the current iteration is fed into the next iteration for corridor generation,thus progressively improving the quality of withincorridor constraints.For tractors,a reverse-motion penalty function is incorporated into the back-end optimizer to prioritize forward driving,aligning with mechanical constraints and human operational preferences.Numerical validations on the data of Gerald R.Ford-class carrier demonstrate that the KIBRRT^(*)reduces average computational time by 75%and expansion nodes by 25%compared to conventional RRT^(*)algorithms.Meanwhile,the iSDC framework yields more time-efficient trajectories for both carrier aircraft and tractors,with the dispatch time reduced by 31.3%and tractor reverse motion proportion decreased by 23.4%relative to traditional SDC.The presented framework offers a scalable solution for autonomous dispatch in confined and safety-critical environment,and an illustrative animation is available at bilibili.com/video/BV1tZ7Zz6Eyz.Moreover,the framework can be easily extended to three-dimension scenarios,and thus applicable for trajectory planning of aerial and underwater vehicles.展开更多
At present,energy consumption is one of the main bottlenecks in autonomous mobile robot development.To address the challenge of high energy consumption in path planning for autonomous mobile robots navigating unknown ...At present,energy consumption is one of the main bottlenecks in autonomous mobile robot development.To address the challenge of high energy consumption in path planning for autonomous mobile robots navigating unknown and complex environments,this paper proposes an Attention-Enhanced Dueling Deep Q-Network(ADDueling DQN),which integrates a multi-head attention mechanism and a prioritized experience replay strategy into a Dueling-DQN reinforcement learning framework.A multi-objective reward function,centered on energy efficiency,is designed to comprehensively consider path length,terrain slope,motion smoothness,and obstacle avoidance,enabling optimal low-energy trajectory generation in 3D space from the source.The incorporation of a multihead attention mechanism allows the model to dynamically focus on energy-critical state features—such as slope gradients and obstacle density—thereby significantly improving its ability to recognize and avoid energy-intensive paths.Additionally,the prioritized experience replay mechanism accelerates learning from key decision-making experiences,suppressing inefficient exploration and guiding the policy toward low-energy solutions more rapidly.The effectiveness of the proposed path planning algorithm is validated through simulation experiments conducted in multiple off-road scenarios.Results demonstrate that AD-Dueling DQN consistently achieves the lowest average energy consumption across all tested environments.Moreover,the proposed method exhibits faster convergence and greater training stability compared to baseline algorithms,highlighting its global optimization capability under energy-aware objectives in complex terrains.This study offers an efficient and scalable intelligent control strategy for the development of energy-conscious autonomous navigation systems.展开更多
Unmanned Aerial Vehicle(UAV)plays a prominent role in various fields,and autonomous navigation is a crucial component of UAV intelligence.Deep Reinforcement Learning(DRL)has expanded the research avenues for addressin...Unmanned Aerial Vehicle(UAV)plays a prominent role in various fields,and autonomous navigation is a crucial component of UAV intelligence.Deep Reinforcement Learning(DRL)has expanded the research avenues for addressing challenges in autonomous navigation.Nonetheless,challenges persist,including getting stuck in local optima,consuming excessive computations during action space exploration,and neglecting deterministic experience.This paper proposes a noise-driven enhancement strategy.In accordance with the overall learning phases,a global noise control method is designed,while a differentiated local noise control method is developed by analyzing the exploration demands of four typical situations encountered by UAV during navigation.Both methods are integrated into a dual-model for noise control to regulate action space exploration.Furthermore,noise dual experience replay buffers are designed to optimize the rational utilization of both deterministic and noisy experience.In uncertain environments,based on the Twin Delay Deep Deterministic Policy Gradient(TD3)algorithm with Long Short-Term Memory(LSTM)network and Priority Experience Replay(PER),a Noise-Driven Enhancement Priority Memory TD3(NDE-PMTD3)is developed.We established a simulation environment to compare different algorithms,and the performance of the algorithms is analyzed in various scenarios.The training results indicate that the proposed algorithm accelerates the convergence speed and enhances the convergence stability.In test experiments,the proposed algorithm successfully and efficiently performs autonomous navigation tasks in diverse environments,demonstrating superior generalization results.展开更多
针对复杂水下环境中水下自主航行器(autonomous underwater vehicle,AUV)路径规划问题,提出一种改进启发式快速随机扩展树(rapidly-exploring random trees,RRT)的路径规划算法。针对路径点采样过程中缺乏目标导向性的问题,采用目标点...针对复杂水下环境中水下自主航行器(autonomous underwater vehicle,AUV)路径规划问题,提出一种改进启发式快速随机扩展树(rapidly-exploring random trees,RRT)的路径规划算法。针对路径点采样过程中缺乏目标导向性的问题,采用目标点概率偏置采样策略与目标偏向扩展策略,可使目标节点在随机采样时成为采样点。在路径点扩展过程中,使非目标采样点的扩展结点位置偏向于目标点的方向,从而增强算法在随机采样与扩展过程中的目标搜索能力。为解决水下路径规划过程中存在过多无效搜索空间的问题,在随机采样过程中引入启发式采样策略,构建包含所有初始路径的采样空间子集,减小采样空间范围,从而提高算法的空间搜索效率。针对AUV在水下环境中抗洋流扰动能力不足的问题,采用速度矢量合成法,使AUV速度矢量与洋流速度矢量合成后指向期望路径的方向,从而抵消水流的影响。在山峰地形中叠加多个Lamb涡流模拟水下流场环境,进行多次仿真实验。实验结果表明:改进启发式RRT算法解决了采样过程中随机性问题,显著缩小了搜索空间,兼顾了路径的安全性与平滑性,并使AUV具有良好的抗洋流扰动能力。展开更多
针对多自主水下航行器(Autonomous Underwater Vehicle,AUV)的全覆盖路径规划问题,提出了一种考虑随机初始位置约束的多AUV覆盖路径规划方法(Dividing Areas based on Robots Initial Positions CPP,DARIP-CPP)。根据多自主水下机器人...针对多自主水下航行器(Autonomous Underwater Vehicle,AUV)的全覆盖路径规划问题,提出了一种考虑随机初始位置约束的多AUV覆盖路径规划方法(Dividing Areas based on Robots Initial Positions CPP,DARIP-CPP)。根据多自主水下机器人的随机初始位置对工作海域进行均衡区域划分,将划分所得的不重叠区域分配给多AUV进行独立覆盖路径规划,每台AUV利用生物启发神经网络(Bio-inspired Neural Network)优化各个区域的全覆盖路径。为了克服传统全覆盖路径规划中的“死区”问题,采用A^(*)路径规划算法进行“死区”逃离,沿着较短的路径快速到达未覆盖区域点。仿真结果表明,所提出的DARIPCPP方法可有效提高多AUV全覆盖目标区域的工作效率。展开更多
为解决基于深度强化学习的AUV跟踪控制器在面临新任务时需从零开始训练、训练速度慢、稳定性差等问题,设计一种基于元强化学习的AUV多任务快速自适应控制算法——R-SAC(Reptile-Soft Actor Critic)算法。R-SAC算法将元学习与强化学习相...为解决基于深度强化学习的AUV跟踪控制器在面临新任务时需从零开始训练、训练速度慢、稳定性差等问题,设计一种基于元强化学习的AUV多任务快速自适应控制算法——R-SAC(Reptile-Soft Actor Critic)算法。R-SAC算法将元学习与强化学习相结合,结合水下机器人运动学及动力学方程对跟踪任务进行建模,利用RSAC算法在训练阶段为AUV跟踪控制器获得一组最优初始值模型参数,使模型在面临不同的任务时,基于该组参数进行训练时能够快速收敛,实现快速自适应不同任务。仿真结果表明,所提出的方法与随机初始化强化学习控制器相比,收敛速度最低提高了1.6倍,跟踪误差保持在2.8%以内。展开更多
Autonomous underwater vehicles （AUVs） navigating on the sea surface are usually required to complete the communication tasks in complex sea conditions. The movement forms and flow field characteristics of a multi-mo...Autonomous underwater vehicles （AUVs） navigating on the sea surface are usually required to complete the communication tasks in complex sea conditions. The movement forms and flow field characteristics of a multi-moving state AUV navigating in head sea at high speed were studied. The mathematical model on longitudinal motion of the high-speed AUV in head sea was established with considering the hydrodynamic lift based on strip theory, which was solved to get the heave and pitch of the AUV by Gaussian elimination method. Based on this, computational fluid dynamics （CFD） method was used to establish the mathematical model of the unsteady viscous flow around the AUV with considering free surface effort by using the Reynolds-averaged Navier-Stokes （RANS） equations, shear-stress transport （SST） k-w model and volume of fluid （VOF） model. The three-dimensional numerical wave in the computational field was realized through defining the unsteady inlet boundary condition. The motion forms of the AUV navigating in head sea at high speed were carried out by the program source code of user-defined function （UDF） based on dynamic mesh. The hydrodynamic parameters of the AUV such as drag, lift, pitch torque, velocity, pressure and wave profile were got, which reflect well the real ambient flow field of the AUV navigating in head sea at high speed. The computational wave profile agrees well with the experimental phenomenon of a wave-piercing surface vehicle. The force law of the AUV under the impacts of waves was analyzed qualitatively and quantitatively, which provides an effective theoretical guidance and technical support for the dynamics research and shape design of the AUV in real complex environnaent.展开更多
基金supported by the Cultivation Program for Major Scientific Research Projects of Harbin Institute of Technology(ZDXMPY20180109).
文摘Scalable simulation leveraging real-world data plays an essential role in advancing autonomous driving,owing to its efficiency and applicability in both training and evaluating algorithms.Consequently,there has been increasing attention on generating highly realistic and consistent driving videos,particularly those involving viewpoint changes guided by the control commands or trajectories of ego vehicles.However,current reconstruction approaches,such as Neural Radiance Fields and 3D Gaussian Splatting,frequently suffer from limited generalization and depend on substantial input data.Meanwhile,2D generative models,though capable of producing unknown scenes,still have room for improvement in terms of coherence and visual realism.To overcome these challenges,we introduce GenScene,a world model that synthesizes front-view driving videos conditioned on trajectories.A new temporal module is presented to improve video consistency by extracting the global context of each frame,calculating relationships of frames using these global representations,and fusing frame contexts accordingly.Moreover,we propose an innovative attention mechanism that computes relations of pixels within each frame and pixels in the corresponding window range of the initial frame.Extensive experiments show that our approach surpasses various state-of-the-art models in driving video generation,and the introduced modules contribute significantly to model performance.This work establishes a new paradigm for goal-oriented video synthesis in autonomous driving,which facilitates on-demand simulation to expedite algorithm development.
文摘This survey presents a comprehensive examination of sensor fusion research spanning four decades,tracing the methodological evolution,application domains,and alignment with classical hierarchical models.Building on this long-term trajectory,the foundational approaches such as probabilistic inference,early neural networks,rulebasedmethods,and feature-level fusion established the principles of uncertainty handling andmulti-sensor integration in the 1990s.The fusion methods of 2000s marked the consolidation of these ideas through advanced Kalman and particle filtering,Bayesian–Dempster–Shafer hybrids,distributed consensus algorithms,and machine learning ensembles for more robust and domain-specific implementations.From 2011 to 2020,the widespread adoption of deep learning transformed the field driving some major breakthroughs in the autonomous vehicles domain.A key contribution of this work is the assessment of contemporary methods against the JDL model,revealing gaps at higher levels-especially in situation and impact assessment.Contemporary methods offer only limited implementation of higher-level fusion.The survey also reviews the benchmark multi-sensor datasets,noting their role in advancing the field while identifying major shortcomings like the lack of domain diversity and hierarchical coverage.By synthesizing developments across decades and paradigms,this survey provides both a historical narrative and a forward-looking perspective.It highlights unresolved challenges in transparency,scalability,robustness,and trustworthiness,while identifying emerging paradigms such as neuromorphic fusion and explainable AI as promising directions.This paves the way forward for advancing sensor fusion towards transparent and adaptive next-generation autonomous systems.
基金support of the National Key Research and Development Plan(Grant No.2021YFB3302501)the financial support of the National Science Foundation of China(Grant No.12161076)the financial support of the Fundamental Research Funds for the Central Universities(Grant No.DUT24LAB129).
文摘As carrier aircraft sortie frequency and flight deck operational density increase,autonomous dispatch trajectory planning for carrier-based vehicles demands efficient,safe,and kinematically feasible solutions.This paper presents an Iterative Safe Dispatch Corridor(iSDC)framework,addressing the suboptimality of the traditional SDC method caused by static corridor construction and redundant obstacle exploration.First,a Kinodynamic-Informed-Bidirectional Rapidly-exploring Random Tree Star(KIBRRT^(*))algorithm is proposed for the front-end coarse planning.By integrating bidirectional tree expansion,goal-biased elliptical sampling,and artificial potential field guidance,it reduces unnecessary exploration near concave obstacles and generates kinematically admissible paths.Secondly,the traditional SDC is implemented in an iterative manner,and the obtained trajectory in the current iteration is fed into the next iteration for corridor generation,thus progressively improving the quality of withincorridor constraints.For tractors,a reverse-motion penalty function is incorporated into the back-end optimizer to prioritize forward driving,aligning with mechanical constraints and human operational preferences.Numerical validations on the data of Gerald R.Ford-class carrier demonstrate that the KIBRRT^(*)reduces average computational time by 75%and expansion nodes by 25%compared to conventional RRT^(*)algorithms.Meanwhile,the iSDC framework yields more time-efficient trajectories for both carrier aircraft and tractors,with the dispatch time reduced by 31.3%and tractor reverse motion proportion decreased by 23.4%relative to traditional SDC.The presented framework offers a scalable solution for autonomous dispatch in confined and safety-critical environment,and an illustrative animation is available at bilibili.com/video/BV1tZ7Zz6Eyz.Moreover,the framework can be easily extended to three-dimension scenarios,and thus applicable for trajectory planning of aerial and underwater vehicles.
文摘At present,energy consumption is one of the main bottlenecks in autonomous mobile robot development.To address the challenge of high energy consumption in path planning for autonomous mobile robots navigating unknown and complex environments,this paper proposes an Attention-Enhanced Dueling Deep Q-Network(ADDueling DQN),which integrates a multi-head attention mechanism and a prioritized experience replay strategy into a Dueling-DQN reinforcement learning framework.A multi-objective reward function,centered on energy efficiency,is designed to comprehensively consider path length,terrain slope,motion smoothness,and obstacle avoidance,enabling optimal low-energy trajectory generation in 3D space from the source.The incorporation of a multihead attention mechanism allows the model to dynamically focus on energy-critical state features—such as slope gradients and obstacle density—thereby significantly improving its ability to recognize and avoid energy-intensive paths.Additionally,the prioritized experience replay mechanism accelerates learning from key decision-making experiences,suppressing inefficient exploration and guiding the policy toward low-energy solutions more rapidly.The effectiveness of the proposed path planning algorithm is validated through simulation experiments conducted in multiple off-road scenarios.Results demonstrate that AD-Dueling DQN consistently achieves the lowest average energy consumption across all tested environments.Moreover,the proposed method exhibits faster convergence and greater training stability compared to baseline algorithms,highlighting its global optimization capability under energy-aware objectives in complex terrains.This study offers an efficient and scalable intelligent control strategy for the development of energy-conscious autonomous navigation systems.
基金the Collaborative Innovation Project of Shanghai,China for the financial support。
文摘Unmanned Aerial Vehicle(UAV)plays a prominent role in various fields,and autonomous navigation is a crucial component of UAV intelligence.Deep Reinforcement Learning(DRL)has expanded the research avenues for addressing challenges in autonomous navigation.Nonetheless,challenges persist,including getting stuck in local optima,consuming excessive computations during action space exploration,and neglecting deterministic experience.This paper proposes a noise-driven enhancement strategy.In accordance with the overall learning phases,a global noise control method is designed,while a differentiated local noise control method is developed by analyzing the exploration demands of four typical situations encountered by UAV during navigation.Both methods are integrated into a dual-model for noise control to regulate action space exploration.Furthermore,noise dual experience replay buffers are designed to optimize the rational utilization of both deterministic and noisy experience.In uncertain environments,based on the Twin Delay Deep Deterministic Policy Gradient(TD3)algorithm with Long Short-Term Memory(LSTM)network and Priority Experience Replay(PER),a Noise-Driven Enhancement Priority Memory TD3(NDE-PMTD3)is developed.We established a simulation environment to compare different algorithms,and the performance of the algorithms is analyzed in various scenarios.The training results indicate that the proposed algorithm accelerates the convergence speed and enhances the convergence stability.In test experiments,the proposed algorithm successfully and efficiently performs autonomous navigation tasks in diverse environments,demonstrating superior generalization results.
文摘针对复杂水下环境中水下自主航行器(autonomous underwater vehicle,AUV)路径规划问题,提出一种改进启发式快速随机扩展树(rapidly-exploring random trees,RRT)的路径规划算法。针对路径点采样过程中缺乏目标导向性的问题,采用目标点概率偏置采样策略与目标偏向扩展策略,可使目标节点在随机采样时成为采样点。在路径点扩展过程中,使非目标采样点的扩展结点位置偏向于目标点的方向,从而增强算法在随机采样与扩展过程中的目标搜索能力。为解决水下路径规划过程中存在过多无效搜索空间的问题,在随机采样过程中引入启发式采样策略,构建包含所有初始路径的采样空间子集,减小采样空间范围,从而提高算法的空间搜索效率。针对AUV在水下环境中抗洋流扰动能力不足的问题,采用速度矢量合成法,使AUV速度矢量与洋流速度矢量合成后指向期望路径的方向,从而抵消水流的影响。在山峰地形中叠加多个Lamb涡流模拟水下流场环境,进行多次仿真实验。实验结果表明:改进启发式RRT算法解决了采样过程中随机性问题,显著缩小了搜索空间,兼顾了路径的安全性与平滑性,并使AUV具有良好的抗洋流扰动能力。
文摘针对多自主水下航行器(Autonomous Underwater Vehicle,AUV)的全覆盖路径规划问题,提出了一种考虑随机初始位置约束的多AUV覆盖路径规划方法(Dividing Areas based on Robots Initial Positions CPP,DARIP-CPP)。根据多自主水下机器人的随机初始位置对工作海域进行均衡区域划分,将划分所得的不重叠区域分配给多AUV进行独立覆盖路径规划,每台AUV利用生物启发神经网络(Bio-inspired Neural Network)优化各个区域的全覆盖路径。为了克服传统全覆盖路径规划中的“死区”问题,采用A^(*)路径规划算法进行“死区”逃离,沿着较短的路径快速到达未覆盖区域点。仿真结果表明,所提出的DARIPCPP方法可有效提高多AUV全覆盖目标区域的工作效率。
文摘为解决基于深度强化学习的AUV跟踪控制器在面临新任务时需从零开始训练、训练速度慢、稳定性差等问题,设计一种基于元强化学习的AUV多任务快速自适应控制算法——R-SAC(Reptile-Soft Actor Critic)算法。R-SAC算法将元学习与强化学习相结合,结合水下机器人运动学及动力学方程对跟踪任务进行建模,利用RSAC算法在训练阶段为AUV跟踪控制器获得一组最优初始值模型参数,使模型在面临不同的任务时,基于该组参数进行训练时能够快速收敛,实现快速自适应不同任务。仿真结果表明,所提出的方法与随机初始化强化学习控制器相比,收敛速度最低提高了1.6倍,跟踪误差保持在2.8%以内。
基金Project(2006AA09Z235)supported by the National High Technology Research and Development Program of ChinaProject(CX2009B003)supported by Hunan Provincial Innovation Foundation For Postgraduate,China
文摘Autonomous underwater vehicles （AUVs） navigating on the sea surface are usually required to complete the communication tasks in complex sea conditions. The movement forms and flow field characteristics of a multi-moving state AUV navigating in head sea at high speed were studied. The mathematical model on longitudinal motion of the high-speed AUV in head sea was established with considering the hydrodynamic lift based on strip theory, which was solved to get the heave and pitch of the AUV by Gaussian elimination method. Based on this, computational fluid dynamics （CFD） method was used to establish the mathematical model of the unsteady viscous flow around the AUV with considering free surface effort by using the Reynolds-averaged Navier-Stokes （RANS） equations, shear-stress transport （SST） k-w model and volume of fluid （VOF） model. The three-dimensional numerical wave in the computational field was realized through defining the unsteady inlet boundary condition. The motion forms of the AUV navigating in head sea at high speed were carried out by the program source code of user-defined function （UDF） based on dynamic mesh. The hydrodynamic parameters of the AUV such as drag, lift, pitch torque, velocity, pressure and wave profile were got, which reflect well the real ambient flow field of the AUV navigating in head sea at high speed. The computational wave profile agrees well with the experimental phenomenon of a wave-piercing surface vehicle. The force law of the AUV under the impacts of waves was analyzed qualitatively and quantitatively, which provides an effective theoretical guidance and technical support for the dynamics research and shape design of the AUV in real complex environnaent.
