Plug-in Hybrid Electric Vehicles(PHEVs)represent an innovative breed of transportation,harnessing diverse power sources for enhanced performance.Energy management strategies(EMSs)that coordinate and control different ...Plug-in Hybrid Electric Vehicles(PHEVs)represent an innovative breed of transportation,harnessing diverse power sources for enhanced performance.Energy management strategies(EMSs)that coordinate and control different energy sources is a critical component of PHEV control technology,directly impacting overall vehicle performance.This study proposes an improved deep reinforcement learning(DRL)-based EMSthat optimizes realtime energy allocation and coordinates the operation of multiple power sources.Conventional DRL algorithms struggle to effectively explore all possible state-action combinations within high-dimensional state and action spaces.They often fail to strike an optimal balance between exploration and exploitation,and their assumption of a static environment limits their ability to adapt to changing conditions.Moreover,these algorithms suffer from low sample efficiency.Collectively,these factors contribute to convergence difficulties,low learning efficiency,and instability.To address these challenges,the Deep Deterministic Policy Gradient(DDPG)algorithm is enhanced using entropy regularization and a summation tree-based Prioritized Experience Replay(PER)method,aiming to improve exploration performance and learning efficiency from experience samples.Additionally,the correspondingMarkovDecision Process(MDP)is established.Finally,an EMSbased on the improvedDRLmodel is presented.Comparative simulation experiments are conducted against rule-based,optimization-based,andDRL-based EMSs.The proposed strategy exhibitsminimal deviation fromthe optimal solution obtained by the dynamic programming(DP)strategy that requires global information.In the typical driving scenarios based onWorld Light Vehicle Test Cycle(WLTC)and New European Driving Cycle(NEDC),the proposed method achieved a fuel consumption of 2698.65 g and an Equivalent Fuel Consumption(EFC)of 2696.77 g.Compared to the DP strategy baseline,the proposed method improved the fuel efficiency variances(FEV)by 18.13%,15.1%,and 8.37%over the Deep QNetwork(DQN),Double DRL(DDRL),and original DDPG methods,respectively.The observational outcomes demonstrate that the proposed EMS based on improved DRL framework possesses good real-time performance,stability,and reliability,effectively optimizing vehicle economy and fuel consumption.展开更多
Surface and borehole gravity data contain complementary information.Thus,the joint inversion of these two data types can help retrieve the real spatial distributions of density bodies.When a sharp boundary exists betw...Surface and borehole gravity data contain complementary information.Thus,the joint inversion of these two data types can help retrieve the real spatial distributions of density bodies.When a sharp boundary exists between an anomalous density body and its surrounding rock,the interface recovered by smooth inversion with Tikhonov regularization is not clear,leading to difficulties in the subsequent geological interpretation.In this work,we develop a joint inversion of surface and borehole gravity data using zeroth-order minimum entropy regularization.The method takes advantage of the complementary information from surface and borehole gravity data to enhance the imaging resolution of density bodies.It also produces a focused imaging of bodies through the zeroth-order minimum entropy regularization without requiring a preselection of a proper focusing parameter.We apply the developed joint inversion approach to three diff erent synthetic data sets.Inversion results show that the focusing inversion with the zeroth-order minimum entropy regularization provides a good description of the true spatial extent of anomalous density bodies.Meanwhile,the joint focusing inversion reconstructs a more reliable density model with a relatively high resolution when a density body is passed through by one or more boreholes.展开更多
文摘Plug-in Hybrid Electric Vehicles(PHEVs)represent an innovative breed of transportation,harnessing diverse power sources for enhanced performance.Energy management strategies(EMSs)that coordinate and control different energy sources is a critical component of PHEV control technology,directly impacting overall vehicle performance.This study proposes an improved deep reinforcement learning(DRL)-based EMSthat optimizes realtime energy allocation and coordinates the operation of multiple power sources.Conventional DRL algorithms struggle to effectively explore all possible state-action combinations within high-dimensional state and action spaces.They often fail to strike an optimal balance between exploration and exploitation,and their assumption of a static environment limits their ability to adapt to changing conditions.Moreover,these algorithms suffer from low sample efficiency.Collectively,these factors contribute to convergence difficulties,low learning efficiency,and instability.To address these challenges,the Deep Deterministic Policy Gradient(DDPG)algorithm is enhanced using entropy regularization and a summation tree-based Prioritized Experience Replay(PER)method,aiming to improve exploration performance and learning efficiency from experience samples.Additionally,the correspondingMarkovDecision Process(MDP)is established.Finally,an EMSbased on the improvedDRLmodel is presented.Comparative simulation experiments are conducted against rule-based,optimization-based,andDRL-based EMSs.The proposed strategy exhibitsminimal deviation fromthe optimal solution obtained by the dynamic programming(DP)strategy that requires global information.In the typical driving scenarios based onWorld Light Vehicle Test Cycle(WLTC)and New European Driving Cycle(NEDC),the proposed method achieved a fuel consumption of 2698.65 g and an Equivalent Fuel Consumption(EFC)of 2696.77 g.Compared to the DP strategy baseline,the proposed method improved the fuel efficiency variances(FEV)by 18.13%,15.1%,and 8.37%over the Deep QNetwork(DQN),Double DRL(DDRL),and original DDPG methods,respectively.The observational outcomes demonstrate that the proposed EMS based on improved DRL framework possesses good real-time performance,stability,and reliability,effectively optimizing vehicle economy and fuel consumption.
基金financially supported by the National Key Research and Development Program of China(no.2018YFC0603300)the National Natural Science Foundation of China(no.42004054)。
文摘Surface and borehole gravity data contain complementary information.Thus,the joint inversion of these two data types can help retrieve the real spatial distributions of density bodies.When a sharp boundary exists between an anomalous density body and its surrounding rock,the interface recovered by smooth inversion with Tikhonov regularization is not clear,leading to difficulties in the subsequent geological interpretation.In this work,we develop a joint inversion of surface and borehole gravity data using zeroth-order minimum entropy regularization.The method takes advantage of the complementary information from surface and borehole gravity data to enhance the imaging resolution of density bodies.It also produces a focused imaging of bodies through the zeroth-order minimum entropy regularization without requiring a preselection of a proper focusing parameter.We apply the developed joint inversion approach to three diff erent synthetic data sets.Inversion results show that the focusing inversion with the zeroth-order minimum entropy regularization provides a good description of the true spatial extent of anomalous density bodies.Meanwhile,the joint focusing inversion reconstructs a more reliable density model with a relatively high resolution when a density body is passed through by one or more boreholes.
