Decision-making of connected and automated vehicles(CAV)includes a sequence of driving maneuvers that improve safety and efficiency,characterized by complex scenarios,strong uncertainty,and high real-time requirements...Decision-making of connected and automated vehicles(CAV)includes a sequence of driving maneuvers that improve safety and efficiency,characterized by complex scenarios,strong uncertainty,and high real-time requirements.Deep reinforcement learning(DRL)exhibits excellent capability of real-time decision-making and adaptability to complex scenarios,and generalization abilities.However,it is arduous to guarantee complete driving safety and efficiency under the constraints of training samples and costs.This paper proposes a Mixture of Expert method(MoE)based on Soft Actor-Critic(SAC),where the upper-level discriminator dynamically decides whether to activate the lower-level DRL expert or the heuristic expert based on the features of the input state.To further enhance the performance of the DRL expert,a buffer zone is introduced in the reward function,preemptively applying penalties before insecure situations occur.In order to minimize collision and off-road rates,the Intelligent Driver Model(IDM)and Minimizing Overall Braking Induced by Lane changes(MOBIL)strategy are designed by heuristic experts.Finally,tested in typical simulation scenarios,MOE shows a 13.75%improvement in driving efficiency compared with the traditional DRL method with continuous action space.It ensures high safety with zero collision and zero off-road rates while maintaining high adaptability.展开更多
Peer-to-peer(P2P)energy trading in active distribution networks(ADNs)plays a pivotal role in promoting the efficient consumption of renewable energy sources.However,it is challenging to effectively coordinate the powe...Peer-to-peer(P2P)energy trading in active distribution networks(ADNs)plays a pivotal role in promoting the efficient consumption of renewable energy sources.However,it is challenging to effectively coordinate the power dispatch of ADNs and P2P energy trading while preserving the privacy of different physical interests.Hence,this paper proposes a soft actor-critic algorithm incorporating distributed trading control(SAC-DTC)to tackle the optimal power dispatch of ADNs and the P2P energy trading considering privacy preservation among prosumers.First,the soft actor-critic(SAC)algorithm is used to optimize the control strategy of device in ADNs to minimize the operation cost,and the primary environmental information of the ADN at this point is published to prosumers.Then,a distributed generalized fast dual ascent method is used to iterate the trading process of prosumers and maximize their revenues.Subsequently,the results of trading are encrypted based on the differential privacy technique and returned to the ADN.Finally,the social welfare value consisting of ADN operation cost and P2P market revenue is utilized as a reward value to update network parameters and control strategies of the deep reinforcement learning.Simulation results show that the proposed SAC-DTC algorithm reduces the ADN operation cost,boosts the P2P market revenue,maximizes the social welfare,and exhibits high computational accuracy,demonstrating its practical application to the operation of power systems and power markets.展开更多
Wireless Sensor Networks(WSNs)play a crucial role in numerous Internet of Things(IoT)applications and next-generation communication systems,yet they continue to face challenges in balancing energy efficiency and relia...Wireless Sensor Networks(WSNs)play a crucial role in numerous Internet of Things(IoT)applications and next-generation communication systems,yet they continue to face challenges in balancing energy efficiency and reliable connectivity.This study proposes SAC-HTC(Soft Actor-Critic-based High-performance Topology Control),a deep reinforcement learning(DRL)method based on the Actor-Critic framework,implemented within a Software Defined Wireless Sensor Network(SDWSN)architecture.In this approach,sensor nodes periodically transmit state information,including coordinates,node degree,transmission power,and neighbor lists,to a centralized controller.The controller acts as the reinforcement learning(RL)agent,with the Actor generating decisions to adjust transmission ranges,while the Critic evaluates action values to reflect the overall network performance.The bidirectional Node-Controller feedback mechanism enables the controller to issue appropriate control commands to each node,ensuring the maintenance of the desired node degree,reducing energy consumption,and preserving network connectivity.The algorithmfurther incorporates soft entropy adjustment to balance exploration and exploitation,alongwith an off-policy mechanism for efficient data reuse,making it well-suited to the resource-constrained conditions ofWSNs.Simulation results demonstrate that SAC-HTC not only outperforms traditional methods and several existing RL algorithms but also achieves faster convergence,optimized communication range control,global connectivity maintenance,and extended network lifetime.The key novelty of this research lies in the integration of the SAC method with the SDWSN architecture forWSNs topology control,providing an adaptive,efficient,and highly promisingmechanism for large-scale,dynamic,and high-performance sensor networks.展开更多
With the rapid development of artificial intelligence,intelligent air combat maneuver decision-making(ACMD)has garnered global attention.Although deep reinforcement learning provides a promising approach to ACMD,exist...With the rapid development of artificial intelligence,intelligent air combat maneuver decision-making(ACMD)has garnered global attention.Although deep reinforcement learning provides a promising approach to ACMD,existing methods often suffer from rigid reward functions and limited adaptability to evolving adversarial strategies.Moreover,most research assumes open airspace,overlooking the influence of potential obstacles.In this paper,we address one-on-one within-visual-range ACMD in obstructed environments,and propose an improved Soft Actor-Critic(SAC)algorithm trained under a curriculum self-play framework.A maneuver strategy mirroring inference module is integrated to estimate each other's likely positions when visual obstruction occurs.By leveraging curriculum learning to guide progressive experience accumulation and self-play for adversarial evolution,our method enhances both training efficiency and tactical diversity.We further integrate an attention mechanism that dynamically adjusts the weights of sub-rewards,enabling the learned policy to adapt to rapidly changing air combat situations.Numerical simulations demonstrate that our enhanced SAC converges more quickly and achieves higher win rates than other baseline methods.An animation is available at bilibili.com/video/BV1BHVszHE98 for better illustration.展开更多
Building integrated energy systems(BIESs)are pivotal for enhancing energy efficiency by accounting for a significant proportion of global energy consumption.Two key barriers that reduce the BIES operational efficiency...Building integrated energy systems(BIESs)are pivotal for enhancing energy efficiency by accounting for a significant proportion of global energy consumption.Two key barriers that reduce the BIES operational efficiency mainly lie in the renewable generation uncertainty and operational non-convexity of combined heat and power(CHP)units.To this end,this paper proposes a soft actor-critic(SAC)algorithm to solve the scheduling problem of BIES,which overcomes the model non-convexity and shows advantages in robustness and generalization.This paper also adopts a temporal fusion transformer(TFT)to enhance the optimal solution for the SAC algorithm by forecasting the renewable generation and energy demand.The TFT can effectively capture the complex temporal patterns and dependencies that span multiple steps.Furthermore,its forecasting results are interpretable due to the employment of a self-attention layer so as to assist in more trustworthy decision-making in the SAC algorithm.The proposed hybrid data-driven approach integrating TFT and SAC algorithm,i.e.,TFT-SAC approach,is trained and tested on a real-world dataset to validate its superior performance in reducing the energy cost and computational time compared with the benchmark approaches.The generalization performance for the scheduling policy,as well as the sensitivity analysis,are examined in the case studies.展开更多
Parking in a small parking lot within limited space poses a difficult task. It often leads to deviations between the final parking posture and the target posture. These deviations can lead to partial occupancy of adja...Parking in a small parking lot within limited space poses a difficult task. It often leads to deviations between the final parking posture and the target posture. These deviations can lead to partial occupancy of adjacent parking lots, which poses a safety threat to vehicles parked in these parking lots. However, previous studies have not addressed this issue. In this paper, we aim to evaluate the impact of parking deviation of existing vehicles next to the target parking lot(PDEVNTPL) on the automatic ego vehicle(AEV) parking, in terms of safety, comfort, accuracy, and efficiency of parking. A segmented parking training framework(SPTF) based on soft actor-critic(SAC) is proposed to improve parking performance. In the proposed method, the SAC algorithm incorporates strategy entropy into the objective function, to enable the AEV to learn parking strategies based on a more comprehensive understanding of the environment. Additionally, the SPTF simplifies complex parking tasks to maintain the high performance of deep reinforcement learning(DRL). The experimental results reveal that the PDEVNTPL has a detrimental influence on the AEV parking in terms of safety, accuracy, and comfort, leading to reductions of more than 27%, 54%, and 26%respectively. However, the SAC-based SPTF effectively mitigates this impact, resulting in a considerable increase in the parking success rate from 71% to 93%. Furthermore, the heading angle deviation is significantly reduced from 2.25 degrees to 0.43degrees.展开更多
In this study,a novel residential virtual power plant(RVPP)scheduling method that leverages a gate recurrent unit(GRU)-integrated deep reinforcement learning(DRL)algorithm is proposed.In the proposed scheme,the GRU-in...In this study,a novel residential virtual power plant(RVPP)scheduling method that leverages a gate recurrent unit(GRU)-integrated deep reinforcement learning(DRL)algorithm is proposed.In the proposed scheme,the GRU-integrated DRL algorithm guides the RVPP to participate effectively in both the day-ahead and real-time markets,lowering the electricity purchase costs and consumption risks for end-users.The Lagrangian relaxation technique is introduced to transform the constrained Markov decision process(CMDP)into an unconstrained optimization problem,which guarantees that the constraints are strictly satisfied without determining the penalty coefficients.Furthermore,to enhance the scalability of the constrained soft actor-critic(CSAC)-based RVPP scheduling approach,a fully distributed scheduling architecture was designed to enable plug-and-play in the residential distributed energy resources(RDER).Case studies performed on the constructed RVPP scenario validated the performance of the proposed methodology in enhancing the responsiveness of the RDER to power tariffs,balancing the supply and demand of the power grid,and ensuring customer comfort.展开更多
To decrease the complexity of MAP algorithm, reduced state or reduced search techniques can be applied. In this paper we propose a reduced search soft output detection algorithm fully based on the principle of M a...To decrease the complexity of MAP algorithm, reduced state or reduced search techniques can be applied. In this paper we propose a reduced search soft output detection algorithm fully based on the principle of M algorithm for turbo equalization, which is a suboptimum version of the Lee algorithm. This algorithm is called soft output M algorithm (denoted as SO M algorithm), which applies the M strategy to both the forward recursion and the extended forward recursion of the Lee algorithm. Computer simulation results show that, by properly selecting and adjusting the breadth parameter and depth parameter during the iteration of turbo equalization, this algorithm can obtain good performance and complexity trade off.展开更多
In order to fully utilize the soft decision ability of the outer decoder in a concatenated system, reliability information (called soft output) from the inner decoder or equalizer is required. In this paper, based on...In order to fully utilize the soft decision ability of the outer decoder in a concatenated system, reliability information (called soft output) from the inner decoder or equalizer is required. In this paper, based on the analysis of typical implementations of soft output VA, a novel algorithm is proposed by utilizing the property of Viterbi algorithm. Compared with the typical implementations, less processing expense is required by the new algorithm for weighting the hard decisions of VA. Meanwhile, simulation results show that, deterioration in performance of this algorithm is usually small for decoding of convolutional code and negligible for equalization.展开更多
In order to solve the problem of high computing cost and low simulation accuracy caused by discontinuity of incision in traditional meshless model,this paper proposes a soft tissue deformation model based on the Marqu...In order to solve the problem of high computing cost and low simulation accuracy caused by discontinuity of incision in traditional meshless model,this paper proposes a soft tissue deformation model based on the Marquardt algorithm and enrichment function.The model is based on the element-free Galerkin method,in which Kelvin viscoelastic model and adjustment function are integrated.Marquardt algorithm is applied to fit the relation between force and displacement caused by surface deformation,and the enrichment function is applied to deal with the discontinuity in the meshless method.To verify the validity of the model,the Sensable Phantom Omni force tactile interactive device is used to simulate the deformations of stomach and heart.Experimental results show that the proposed model improves the real-time performance and accuracy of soft tissue deformation simulation,which provides a new perspective for the application of the meshless method in virtual surgery.展开更多
Vertical hot ring rolling(VHRR) process has the characteristics of nonlinearity,time-variation and being susceptible to disturbance.Furthermore,the ring's growth is quite fast within a short time,and the rolled ri...Vertical hot ring rolling(VHRR) process has the characteristics of nonlinearity,time-variation and being susceptible to disturbance.Furthermore,the ring's growth is quite fast within a short time,and the rolled ring's position is asymmetrical.All of these cause that the ring's dimensions cannot be measured directly.Through analyzing the relationships among the dimensions of ring blanks,the positions of rolls and the ring's inner and outer diameter,the soft measurement model of ring's dimensions is established based on the radial basis function neural network(RBFNN).A mass of data samples are obtained from VHRR finite element(FE) simulations to train and test the soft measurement NN model,and the model's structure parameters are deduced and optimized by genetic algorithm(GA).Finally,the soft measurement system of ring's dimensions is established and validated by the VHRR experiments.The ring's dimensions were measured artificially and calculated by the soft measurement NN model.The results show that the calculation values of GA-RBFNN model are close to the artificial measurement data.In addition,the calculation accuracy of GA-RBFNN model is higher than that of RBFNN model.The research results suggest that the soft measurement NN model has high precision and flexibility.The research can provide practical methods and theoretical guidance for the accurate measurement of VHRR process.展开更多
An improved immune algorithm is proposed in this paper. The problems, such as convergence speed and optimization precision, existing in the basic immune algorithm are well addressed. Besides, a fuzzy adaptive method i...An improved immune algorithm is proposed in this paper. The problems, such as convergence speed and optimization precision, existing in the basic immune algorithm are well addressed. Besides, a fuzzy adaptive method is presented by using the fuzzy system to realize the adaptive selection of two key parameters （possibility of crossover and mutation）. By comparing and analyzing the results of several benchmark functions, the performance of fuzzy immune algorithm （FIA） is approved. Not only the difficulty of parameters selection is relieved, but also the precision and stability are improved. At last, the FIA is ap- plied to optimization of the structure and parameters in radial basis function neural network （RBFNN） based on an orthogonal sequential method. And the availability of algorithm is proved by applying RBFNN in modeling in soft sensor of solvent tower.展开更多
In recent years,the soft subspace clustering algorithm has shown good results for high-dimensional data,which can assign different weights to each cluster class and use weights to measure the contribution of each dime...In recent years,the soft subspace clustering algorithm has shown good results for high-dimensional data,which can assign different weights to each cluster class and use weights to measure the contribution of each dimension in various features.The enhanced soft subspace clustering algorithm combines interclass separation and intraclass tightness information,which has strong results for image segmentation,but the clustering algorithm is vulnerable to noisy data and dependence on the initialized clustering center.However,the clustering algorithmis susceptible to the influence of noisydata and reliance on initializedclustering centers andfalls into a local optimum;the clustering effect is poor for brain MR images with unclear boundaries and noise effects.To address these problems,a soft subspace clustering algorithm for brain MR images based on genetic algorithm optimization is proposed,which combines the generalized noise technique,relaxes the equational weight constraint in the objective function as the boundary constraint,and uses a genetic algorithm as a method to optimize the initialized clustering center.The genetic algorithm finds the best clustering center and reduces the algorithm’s dependence on the initial clustering center.The experiment verifies the robustness of the algorithm,as well as the noise immunity in various ways and shows good results on the common dataset and the brain MR images provided by the Changshu First People’s Hospital with specific high accuracy for clinical medicine.展开更多
A computationally efficient soft-output detector with lattice-reduction （LR） for the multiple-input multiple-output （MIMO） systems is proposed. In the proposed scheme, the sorted QR de- composition is applied on t...A computationally efficient soft-output detector with lattice-reduction （LR） for the multiple-input multiple-output （MIMO） systems is proposed. In the proposed scheme, the sorted QR de- composition is applied on the lattice-reduced equivalent channel to obtain the tree structure. With the aid of the boundary control, the stack algorithm searches a small part of the whole search tree to generate a handful of candidate lists in the reduced lattice. The proposed soft-output algorithm achieves near-optimal perfor- mance in a coded MIMO system and the associated computational complexity is substantially lower than that of previously proposed methods.展开更多
It is well known that the kit completeness of parts processed in the previous stage is crucial for the subsequent manufacturing stage.This paper studies the flexible job shop scheduling problem(FJSP)with the objective...It is well known that the kit completeness of parts processed in the previous stage is crucial for the subsequent manufacturing stage.This paper studies the flexible job shop scheduling problem(FJSP)with the objective of material kitting,where a material kit is a collection of components that ensures that a batch of components can be ready at the same time during the product assembly process.In this study,we consider completion time variance and maximumcompletion time as scheduling objectives,continue the weighted summation process formultiple objectives,and design adaptive weighted summation parameters to optimize productivity and reduce the difference in completion time between components in the same kit.The Soft Actor Critic(SAC)algorithm is designed to be combined with the Adaptive Multi-Buffer Experience Replay(AMBER)mechanism to propose the SAC-AMBER algorithm.The AMBER mechanism optimizes the experience sampling and policy updating process and enhances learning efficiency by categorically storing the experience into the standard buffer,the high equipment utilization buffer,and the high productivity buffer.Experimental results show that the SAC-AMBER algorithm can effectively reduce the maximum completion time on multiple datasets,reduce the difference in component completion time in the same kit,and thus optimize the readiness of the part kits,demonstrating relatively good stability and convergence.Compared with traditional heuristics,meta-heuristics,and other deep reinforcement learning methods,the SAC-AMBER algorithm performs better in terms of solution quality and computational efficiency,and through extensive testing on multiple datasets,the algorithm has been confirmed to have good generalization ability,providing an effective solution to the FJSP problem.展开更多
This paper introduces fuzzy N-bipolar soft(FN-BS)sets,a novel mathematical framework designed to enhance multi-criteria decision-making(MCDM)processes under uncertainty.The study addresses a significant limitation in ...This paper introduces fuzzy N-bipolar soft(FN-BS)sets,a novel mathematical framework designed to enhance multi-criteria decision-making(MCDM)processes under uncertainty.The study addresses a significant limitation in existing models by unifying fuzzy logic,the consideration of bipolarity,and the ability to evaluate attributes on a multinary scale.The specific contributions of the FN-BS framework include:(1)a formal definition and settheoretic foundation,(2)the development of two innovative algorithms for solving decision-making(DM)problems,and(3)a comparative analysis demonstrating its superiority over established models.The proposed framework is applied to a real-world case study on selecting vaccination programs across multiple countries,showcasing consistent DM outcomes and exceptional adaptability to complex and uncertain scenarios.These results position FN-BS sets as a versatile and powerful tool for addressing dynamic DM challenges.展开更多
To address the stochasticity and nonlinearity of solar collector power systems,a soft sensor prediction model with a hybrid convolutional neural network(CNN)and long short-term memory network(LSTM)was constructed,and ...To address the stochasticity and nonlinearity of solar collector power systems,a soft sensor prediction model with a hybrid convolutional neural network(CNN)and long short-term memory network(LSTM)was constructed,and the hyperparameter optimization of the hybrid neural network(CNN-LSTM)was carried out by using the sparrow search algorithm(SSA).The model utilized the powerful feature extraction and non-linear mapping capabilities of deep learning to effectively handle the complex relationship between input and target variables.The batch normalization technique was used to speed up the training and improve the stability of the soft-sensing model,and the random discard technique was used to prevent the soft-sensing model from overfitting.Finally,the mean absolute error(MAE)was used to assess the accuracy of the soft sensor model predictions.This study compared the proposed model with soft sensor prediction models like Bp,Elman,CNN,LSTM,and CNN-LSTM,using dynamic thermal performance data from the solar collector field of the molten salt linear Fresnel photovoltaic demonstration power plant.The deep learning-based soft sensor model outperformed the other models according to the experimental data.Its coefficients of determination(namely R^(2))are higher by 6.35%,8.42%,5.69%,6.90%,and 3.67%,respectively.The accuracy and robustness have been significantly improved.展开更多
基金Supported by National Key R&D Program of China(Grant No.2022YFB2503203)National Natural Science Foundation of China(Grant No.U1964206).
文摘Decision-making of connected and automated vehicles(CAV)includes a sequence of driving maneuvers that improve safety and efficiency,characterized by complex scenarios,strong uncertainty,and high real-time requirements.Deep reinforcement learning(DRL)exhibits excellent capability of real-time decision-making and adaptability to complex scenarios,and generalization abilities.However,it is arduous to guarantee complete driving safety and efficiency under the constraints of training samples and costs.This paper proposes a Mixture of Expert method(MoE)based on Soft Actor-Critic(SAC),where the upper-level discriminator dynamically decides whether to activate the lower-level DRL expert or the heuristic expert based on the features of the input state.To further enhance the performance of the DRL expert,a buffer zone is introduced in the reward function,preemptively applying penalties before insecure situations occur.In order to minimize collision and off-road rates,the Intelligent Driver Model(IDM)and Minimizing Overall Braking Induced by Lane changes(MOBIL)strategy are designed by heuristic experts.Finally,tested in typical simulation scenarios,MOE shows a 13.75%improvement in driving efficiency compared with the traditional DRL method with continuous action space.It ensures high safety with zero collision and zero off-road rates while maintaining high adaptability.
基金supported by the National Natural Science Foundation of China(No.52177085).
文摘Peer-to-peer(P2P)energy trading in active distribution networks(ADNs)plays a pivotal role in promoting the efficient consumption of renewable energy sources.However,it is challenging to effectively coordinate the power dispatch of ADNs and P2P energy trading while preserving the privacy of different physical interests.Hence,this paper proposes a soft actor-critic algorithm incorporating distributed trading control(SAC-DTC)to tackle the optimal power dispatch of ADNs and the P2P energy trading considering privacy preservation among prosumers.First,the soft actor-critic(SAC)algorithm is used to optimize the control strategy of device in ADNs to minimize the operation cost,and the primary environmental information of the ADN at this point is published to prosumers.Then,a distributed generalized fast dual ascent method is used to iterate the trading process of prosumers and maximize their revenues.Subsequently,the results of trading are encrypted based on the differential privacy technique and returned to the ADN.Finally,the social welfare value consisting of ADN operation cost and P2P market revenue is utilized as a reward value to update network parameters and control strategies of the deep reinforcement learning.Simulation results show that the proposed SAC-DTC algorithm reduces the ADN operation cost,boosts the P2P market revenue,maximizes the social welfare,and exhibits high computational accuracy,demonstrating its practical application to the operation of power systems and power markets.
文摘Wireless Sensor Networks(WSNs)play a crucial role in numerous Internet of Things(IoT)applications and next-generation communication systems,yet they continue to face challenges in balancing energy efficiency and reliable connectivity.This study proposes SAC-HTC(Soft Actor-Critic-based High-performance Topology Control),a deep reinforcement learning(DRL)method based on the Actor-Critic framework,implemented within a Software Defined Wireless Sensor Network(SDWSN)architecture.In this approach,sensor nodes periodically transmit state information,including coordinates,node degree,transmission power,and neighbor lists,to a centralized controller.The controller acts as the reinforcement learning(RL)agent,with the Actor generating decisions to adjust transmission ranges,while the Critic evaluates action values to reflect the overall network performance.The bidirectional Node-Controller feedback mechanism enables the controller to issue appropriate control commands to each node,ensuring the maintenance of the desired node degree,reducing energy consumption,and preserving network connectivity.The algorithmfurther incorporates soft entropy adjustment to balance exploration and exploitation,alongwith an off-policy mechanism for efficient data reuse,making it well-suited to the resource-constrained conditions ofWSNs.Simulation results demonstrate that SAC-HTC not only outperforms traditional methods and several existing RL algorithms but also achieves faster convergence,optimized communication range control,global connectivity maintenance,and extended network lifetime.The key novelty of this research lies in the integration of the SAC method with the SDWSN architecture forWSNs topology control,providing an adaptive,efficient,and highly promisingmechanism for large-scale,dynamic,and high-performance sensor networks.
基金support of the National Key Research and Development Plan(No.2021YFB3302501)the financial support of the National Science Foundation of China(No.12161076)the financial support of the Fundamental Research Funds for the Central Universities(No.DUT25GF207).
文摘With the rapid development of artificial intelligence,intelligent air combat maneuver decision-making(ACMD)has garnered global attention.Although deep reinforcement learning provides a promising approach to ACMD,existing methods often suffer from rigid reward functions and limited adaptability to evolving adversarial strategies.Moreover,most research assumes open airspace,overlooking the influence of potential obstacles.In this paper,we address one-on-one within-visual-range ACMD in obstructed environments,and propose an improved Soft Actor-Critic(SAC)algorithm trained under a curriculum self-play framework.A maneuver strategy mirroring inference module is integrated to estimate each other's likely positions when visual obstruction occurs.By leveraging curriculum learning to guide progressive experience accumulation and self-play for adversarial evolution,our method enhances both training efficiency and tactical diversity.We further integrate an attention mechanism that dynamically adjusts the weights of sub-rewards,enabling the learned policy to adapt to rapidly changing air combat situations.Numerical simulations demonstrate that our enhanced SAC converges more quickly and achieves higher win rates than other baseline methods.An animation is available at bilibili.com/video/BV1BHVszHE98 for better illustration.
文摘Building integrated energy systems(BIESs)are pivotal for enhancing energy efficiency by accounting for a significant proportion of global energy consumption.Two key barriers that reduce the BIES operational efficiency mainly lie in the renewable generation uncertainty and operational non-convexity of combined heat and power(CHP)units.To this end,this paper proposes a soft actor-critic(SAC)algorithm to solve the scheduling problem of BIES,which overcomes the model non-convexity and shows advantages in robustness and generalization.This paper also adopts a temporal fusion transformer(TFT)to enhance the optimal solution for the SAC algorithm by forecasting the renewable generation and energy demand.The TFT can effectively capture the complex temporal patterns and dependencies that span multiple steps.Furthermore,its forecasting results are interpretable due to the employment of a self-attention layer so as to assist in more trustworthy decision-making in the SAC algorithm.The proposed hybrid data-driven approach integrating TFT and SAC algorithm,i.e.,TFT-SAC approach,is trained and tested on a real-world dataset to validate its superior performance in reducing the energy cost and computational time compared with the benchmark approaches.The generalization performance for the scheduling policy,as well as the sensitivity analysis,are examined in the case studies.
基金supported by National Natural Science Foundation of China(52222215, 52272420, 52072051)。
文摘Parking in a small parking lot within limited space poses a difficult task. It often leads to deviations between the final parking posture and the target posture. These deviations can lead to partial occupancy of adjacent parking lots, which poses a safety threat to vehicles parked in these parking lots. However, previous studies have not addressed this issue. In this paper, we aim to evaluate the impact of parking deviation of existing vehicles next to the target parking lot(PDEVNTPL) on the automatic ego vehicle(AEV) parking, in terms of safety, comfort, accuracy, and efficiency of parking. A segmented parking training framework(SPTF) based on soft actor-critic(SAC) is proposed to improve parking performance. In the proposed method, the SAC algorithm incorporates strategy entropy into the objective function, to enable the AEV to learn parking strategies based on a more comprehensive understanding of the environment. Additionally, the SPTF simplifies complex parking tasks to maintain the high performance of deep reinforcement learning(DRL). The experimental results reveal that the PDEVNTPL has a detrimental influence on the AEV parking in terms of safety, accuracy, and comfort, leading to reductions of more than 27%, 54%, and 26%respectively. However, the SAC-based SPTF effectively mitigates this impact, resulting in a considerable increase in the parking success rate from 71% to 93%. Furthermore, the heading angle deviation is significantly reduced from 2.25 degrees to 0.43degrees.
基金supported by the Sichuan Science and Technology Program(grant number 2022YFG0123).
文摘In this study,a novel residential virtual power plant(RVPP)scheduling method that leverages a gate recurrent unit(GRU)-integrated deep reinforcement learning(DRL)algorithm is proposed.In the proposed scheme,the GRU-integrated DRL algorithm guides the RVPP to participate effectively in both the day-ahead and real-time markets,lowering the electricity purchase costs and consumption risks for end-users.The Lagrangian relaxation technique is introduced to transform the constrained Markov decision process(CMDP)into an unconstrained optimization problem,which guarantees that the constraints are strictly satisfied without determining the penalty coefficients.Furthermore,to enhance the scalability of the constrained soft actor-critic(CSAC)-based RVPP scheduling approach,a fully distributed scheduling architecture was designed to enable plug-and-play in the residential distributed energy resources(RDER).Case studies performed on the constructed RVPP scenario validated the performance of the proposed methodology in enhancing the responsiveness of the RDER to power tariffs,balancing the supply and demand of the power grid,and ensuring customer comfort.
文摘To decrease the complexity of MAP algorithm, reduced state or reduced search techniques can be applied. In this paper we propose a reduced search soft output detection algorithm fully based on the principle of M algorithm for turbo equalization, which is a suboptimum version of the Lee algorithm. This algorithm is called soft output M algorithm (denoted as SO M algorithm), which applies the M strategy to both the forward recursion and the extended forward recursion of the Lee algorithm. Computer simulation results show that, by properly selecting and adjusting the breadth parameter and depth parameter during the iteration of turbo equalization, this algorithm can obtain good performance and complexity trade off.
文摘In order to fully utilize the soft decision ability of the outer decoder in a concatenated system, reliability information (called soft output) from the inner decoder or equalizer is required. In this paper, based on the analysis of typical implementations of soft output VA, a novel algorithm is proposed by utilizing the property of Viterbi algorithm. Compared with the typical implementations, less processing expense is required by the new algorithm for weighting the hard decisions of VA. Meanwhile, simulation results show that, deterioration in performance of this algorithm is usually small for decoding of convolutional code and negligible for equalization.
基金This work was supported,in part,by the National Nature Science Foundation of China under grant numbers 61502240,61502096,61304205,61773219in part,by the Natural Science Foundation of Jiangsu Province under grant number BK20191401+1 种基金in part,by the Priority Academic Program Development of Jiangsu Higher Education Institutions(PAPD)fundin part,by the Collaborative Innovation Center of Atmospheric Environment and Equipment Technology(CICAEET)fund.
文摘In order to solve the problem of high computing cost and low simulation accuracy caused by discontinuity of incision in traditional meshless model,this paper proposes a soft tissue deformation model based on the Marquardt algorithm and enrichment function.The model is based on the element-free Galerkin method,in which Kelvin viscoelastic model and adjustment function are integrated.Marquardt algorithm is applied to fit the relation between force and displacement caused by surface deformation,and the enrichment function is applied to deal with the discontinuity in the meshless method.To verify the validity of the model,the Sensable Phantom Omni force tactile interactive device is used to simulate the deformations of stomach and heart.Experimental results show that the proposed model improves the real-time performance and accuracy of soft tissue deformation simulation,which provides a new perspective for the application of the meshless method in virtual surgery.
基金Project(51205299)supported by the National Natural Science Foundation of ChinaProject(2015M582643)supported by the China Postdoctoral Science Foundation+2 种基金Project(2014BAA008)supported by the Science and Technology Support Program of Hubei Province,ChinaProject(2014-IV-144)supported by the Fundamental Research Funds for the Central Universities of ChinaProject(2012AAA07-01)supported by the Major Science and Technology Achievements Transformation&Industrialization Program of Hubei Province,China
文摘Vertical hot ring rolling(VHRR) process has the characteristics of nonlinearity,time-variation and being susceptible to disturbance.Furthermore,the ring's growth is quite fast within a short time,and the rolled ring's position is asymmetrical.All of these cause that the ring's dimensions cannot be measured directly.Through analyzing the relationships among the dimensions of ring blanks,the positions of rolls and the ring's inner and outer diameter,the soft measurement model of ring's dimensions is established based on the radial basis function neural network(RBFNN).A mass of data samples are obtained from VHRR finite element(FE) simulations to train and test the soft measurement NN model,and the model's structure parameters are deduced and optimized by genetic algorithm(GA).Finally,the soft measurement system of ring's dimensions is established and validated by the VHRR experiments.The ring's dimensions were measured artificially and calculated by the soft measurement NN model.The results show that the calculation values of GA-RBFNN model are close to the artificial measurement data.In addition,the calculation accuracy of GA-RBFNN model is higher than that of RBFNN model.The research results suggest that the soft measurement NN model has high precision and flexibility.The research can provide practical methods and theoretical guidance for the accurate measurement of VHRR process.
文摘An improved immune algorithm is proposed in this paper. The problems, such as convergence speed and optimization precision, existing in the basic immune algorithm are well addressed. Besides, a fuzzy adaptive method is presented by using the fuzzy system to realize the adaptive selection of two key parameters （possibility of crossover and mutation）. By comparing and analyzing the results of several benchmark functions, the performance of fuzzy immune algorithm （FIA） is approved. Not only the difficulty of parameters selection is relieved, but also the precision and stability are improved. At last, the FIA is ap- plied to optimization of the structure and parameters in radial basis function neural network （RBFNN） based on an orthogonal sequential method. And the availability of algorithm is proved by applying RBFNN in modeling in soft sensor of solvent tower.
基金This work was supported in part by the National Natural Science Foundation of China under Grant 62171203in part by the Suzhou Key Supporting Subjects[Health Informatics(No.SZFCXK202147)]+2 种基金in part by the Changshu Science and Technology Program[No.CS202015,CS202246]in part by the Changshu City Health and Health Committee Science and Technology Program[No.csws201913]in part by the“333 High Level Personnel Training Project of Jiangsu Province”.
文摘In recent years,the soft subspace clustering algorithm has shown good results for high-dimensional data,which can assign different weights to each cluster class and use weights to measure the contribution of each dimension in various features.The enhanced soft subspace clustering algorithm combines interclass separation and intraclass tightness information,which has strong results for image segmentation,but the clustering algorithm is vulnerable to noisy data and dependence on the initialized clustering center.However,the clustering algorithmis susceptible to the influence of noisydata and reliance on initializedclustering centers andfalls into a local optimum;the clustering effect is poor for brain MR images with unclear boundaries and noise effects.To address these problems,a soft subspace clustering algorithm for brain MR images based on genetic algorithm optimization is proposed,which combines the generalized noise technique,relaxes the equational weight constraint in the objective function as the boundary constraint,and uses a genetic algorithm as a method to optimize the initialized clustering center.The genetic algorithm finds the best clustering center and reduces the algorithm’s dependence on the initial clustering center.The experiment verifies the robustness of the algorithm,as well as the noise immunity in various ways and shows good results on the common dataset and the brain MR images provided by the Changshu First People’s Hospital with specific high accuracy for clinical medicine.
文摘A computationally efficient soft-output detector with lattice-reduction （LR） for the multiple-input multiple-output （MIMO） systems is proposed. In the proposed scheme, the sorted QR de- composition is applied on the lattice-reduced equivalent channel to obtain the tree structure. With the aid of the boundary control, the stack algorithm searches a small part of the whole search tree to generate a handful of candidate lists in the reduced lattice. The proposed soft-output algorithm achieves near-optimal perfor- mance in a coded MIMO system and the associated computational complexity is substantially lower than that of previously proposed methods.
文摘It is well known that the kit completeness of parts processed in the previous stage is crucial for the subsequent manufacturing stage.This paper studies the flexible job shop scheduling problem(FJSP)with the objective of material kitting,where a material kit is a collection of components that ensures that a batch of components can be ready at the same time during the product assembly process.In this study,we consider completion time variance and maximumcompletion time as scheduling objectives,continue the weighted summation process formultiple objectives,and design adaptive weighted summation parameters to optimize productivity and reduce the difference in completion time between components in the same kit.The Soft Actor Critic(SAC)algorithm is designed to be combined with the Adaptive Multi-Buffer Experience Replay(AMBER)mechanism to propose the SAC-AMBER algorithm.The AMBER mechanism optimizes the experience sampling and policy updating process and enhances learning efficiency by categorically storing the experience into the standard buffer,the high equipment utilization buffer,and the high productivity buffer.Experimental results show that the SAC-AMBER algorithm can effectively reduce the maximum completion time on multiple datasets,reduce the difference in component completion time in the same kit,and thus optimize the readiness of the part kits,demonstrating relatively good stability and convergence.Compared with traditional heuristics,meta-heuristics,and other deep reinforcement learning methods,the SAC-AMBER algorithm performs better in terms of solution quality and computational efficiency,and through extensive testing on multiple datasets,the algorithm has been confirmed to have good generalization ability,providing an effective solution to the FJSP problem.
文摘This paper introduces fuzzy N-bipolar soft(FN-BS)sets,a novel mathematical framework designed to enhance multi-criteria decision-making(MCDM)processes under uncertainty.The study addresses a significant limitation in existing models by unifying fuzzy logic,the consideration of bipolarity,and the ability to evaluate attributes on a multinary scale.The specific contributions of the FN-BS framework include:(1)a formal definition and settheoretic foundation,(2)the development of two innovative algorithms for solving decision-making(DM)problems,and(3)a comparative analysis demonstrating its superiority over established models.The proposed framework is applied to a real-world case study on selecting vaccination programs across multiple countries,showcasing consistent DM outcomes and exceptional adaptability to complex and uncertain scenarios.These results position FN-BS sets as a versatile and powerful tool for addressing dynamic DM challenges.
基金supported by National Natural Science Foundation of China(No.52266012)Gansu Province College Industry Support Plan Project(No.2022CYZC-34)+1 种基金Gansu Province Major Science and Technology Special Project(Nos.20ZD7GF011,22ZD6GA063)Jiuquan City Science and Technology Programme Project(No.2023CA3058).
文摘To address the stochasticity and nonlinearity of solar collector power systems,a soft sensor prediction model with a hybrid convolutional neural network(CNN)and long short-term memory network(LSTM)was constructed,and the hyperparameter optimization of the hybrid neural network(CNN-LSTM)was carried out by using the sparrow search algorithm(SSA).The model utilized the powerful feature extraction and non-linear mapping capabilities of deep learning to effectively handle the complex relationship between input and target variables.The batch normalization technique was used to speed up the training and improve the stability of the soft-sensing model,and the random discard technique was used to prevent the soft-sensing model from overfitting.Finally,the mean absolute error(MAE)was used to assess the accuracy of the soft sensor model predictions.This study compared the proposed model with soft sensor prediction models like Bp,Elman,CNN,LSTM,and CNN-LSTM,using dynamic thermal performance data from the solar collector field of the molten salt linear Fresnel photovoltaic demonstration power plant.The deep learning-based soft sensor model outperformed the other models according to the experimental data.Its coefficients of determination(namely R^(2))are higher by 6.35%,8.42%,5.69%,6.90%,and 3.67%,respectively.The accuracy and robustness have been significantly improved.
