Learning and self-adaptation ability is highly required to be integrated in path planning algorithm for underwater robot during navigation through an unspecified underwater environment. High frequency oscillations dur...Learning and self-adaptation ability is highly required to be integrated in path planning algorithm for underwater robot during navigation through an unspecified underwater environment. High frequency oscillations during underwater motion are responsible for nonlinearities in dynamic behavior of underwater robot as well as uncertainties in hydrodynamic coefficients. Reactive behaviors of underwater robot are designed considering the position and orientation of both target and nearest obstacle from robot s current position. Human like reasoning power and approximation based learning skill of neural based adaptive fuzzy inference system（ANFIS）has been found to be effective for underwater multivariable motion control. More than one ANFIS models are used here for achieving goal and obstacle avoidance while avoiding local minima situation in both horizontal and vertical plane of three dimensional workspace.An error gradient approach based on input-output training patterns for learning purpose has been promoted to spawn trajectory of underwater robot optimizing path length as well as time taken. The simulation and experimental results endorse sturdiness and viability of the proposed method in comparison with other navigational methodologies to negotiate with hectic conditions during motion of underwater mobile robot.展开更多
In the paper,a novel self-learning energy management strategy(EMS)is proposed for fuel cell hybrid electric vehicles(FCHEV)to achieve the hydrogen saving and maintain the battery operation.In the EMS,it is proposed to...In the paper,a novel self-learning energy management strategy(EMS)is proposed for fuel cell hybrid electric vehicles(FCHEV)to achieve the hydrogen saving and maintain the battery operation.In the EMS,it is proposed to approximate the EMS policy function with fuzzy inference system(FIS)and learn the policy parameters through policy gradient reinforcement learning(PGRL).Thus,a so-called Fuzzy REINFORCE algorithm is first proposed and studied for EMS problem in the paper.Fuzzy REINFORCE is a model-free method that the EMS agent can learn itself through interactions with environment,which makes it independent of model accuracy,prior knowledge,and expert experience.Meanwhile,to stabilize the training process,a fuzzy baseline function is adopted to approximate the value function based on FIS without affecting the policy gradient direction.More-over,the drawbacks of traditional reinforcement learning such as high computation burden,long convergence time,can also be overcome.The effectiveness of the proposed methods were verified by Hardware-in-Loop ex-periments.The adaptability of the proposed method to the changes of driving conditions and system states is also verified.展开更多
文摘Learning and self-adaptation ability is highly required to be integrated in path planning algorithm for underwater robot during navigation through an unspecified underwater environment. High frequency oscillations during underwater motion are responsible for nonlinearities in dynamic behavior of underwater robot as well as uncertainties in hydrodynamic coefficients. Reactive behaviors of underwater robot are designed considering the position and orientation of both target and nearest obstacle from robot s current position. Human like reasoning power and approximation based learning skill of neural based adaptive fuzzy inference system（ANFIS）has been found to be effective for underwater multivariable motion control. More than one ANFIS models are used here for achieving goal and obstacle avoidance while avoiding local minima situation in both horizontal and vertical plane of three dimensional workspace.An error gradient approach based on input-output training patterns for learning purpose has been promoted to spawn trajectory of underwater robot optimizing path length as well as time taken. The simulation and experimental results endorse sturdiness and viability of the proposed method in comparison with other navigational methodologies to negotiate with hectic conditions during motion of underwater mobile robot.
基金This work has been supported by the ANR DEAL(contract ANR-20-CE05-0016-01)This work has also been partially funded by Region Sud Provence-Alpes-Cote d’Azur via project AMULTI(2021_02918).
文摘In the paper,a novel self-learning energy management strategy(EMS)is proposed for fuel cell hybrid electric vehicles(FCHEV)to achieve the hydrogen saving and maintain the battery operation.In the EMS,it is proposed to approximate the EMS policy function with fuzzy inference system(FIS)and learn the policy parameters through policy gradient reinforcement learning(PGRL).Thus,a so-called Fuzzy REINFORCE algorithm is first proposed and studied for EMS problem in the paper.Fuzzy REINFORCE is a model-free method that the EMS agent can learn itself through interactions with environment,which makes it independent of model accuracy,prior knowledge,and expert experience.Meanwhile,to stabilize the training process,a fuzzy baseline function is adopted to approximate the value function based on FIS without affecting the policy gradient direction.More-over,the drawbacks of traditional reinforcement learning such as high computation burden,long convergence time,can also be overcome.The effectiveness of the proposed methods were verified by Hardware-in-Loop ex-periments.The adaptability of the proposed method to the changes of driving conditions and system states is also verified.
