Model predictive control(MPC)has been deemed as an attractive control method in motor drives by virtue of its simple structure,convenient multi-objective optimization,and satisfactory dynamic performance.However,the s...Model predictive control(MPC)has been deemed as an attractive control method in motor drives by virtue of its simple structure,convenient multi-objective optimization,and satisfactory dynamic performance.However,the strong reliance on mathematical models seriously restrains its practical application.Therefore,improving the robustness of MPC has attained significant attentions in the last two decades,followed by which,model-free predictive control(MFPC)comes into existence.This article aims to reveal the current state of MFPC strategies for motor drives and give the categorization from the perspective of implementation.Based on this review,the principles of the reported MFPC strategies are introduced in detail,as well as the challenges encountered in technology realization.In addition,some of typical and important concepts are experimentally validated via case studies to evaluate the performance and highlight their features.Finally,the future trends of MFPC are discussed based on the current state and reported developments.展开更多
The increasing penetration of second-life battery energy storage systems(SLBESS)in power grids presents substantial challenges to system operation and control due to the heterogeneous characteristics and uncertain deg...The increasing penetration of second-life battery energy storage systems(SLBESS)in power grids presents substantial challenges to system operation and control due to the heterogeneous characteristics and uncertain degradation patterns of repurposed batteries.This paper presents a novel model-free adaptive voltage controlembedded dung beetle-inspired heuristic optimization algorithmfor optimal SLBESS capacity configuration and power dispatch.To simultaneously address the computational complexity and ensure system stability,this paper develops a comprehensive bilevel optimization framework.At the upper level,a dung beetle optimization algorithmdetermines the optimal SLBESS capacity configuration byminimizing total lifecycle costswhile incorporating the charging/discharging power trajectories derived from the model-free adaptive voltage control strategy.At the lower level,a health-priority power dispatch optimization model intelligently allocates power demands among heterogeneous battery groups based on their real-time operational states,state-of-health variations,and degradation constraints.The proposed model-free approach circumvents the need for complex battery charging/discharging power controlmodels and extensive historical data requirements whilemaintaining system stability through adaptive controlmechanisms.A novel cycle life degradation model is developed to quantify the relationship between remaining useful life,depth of discharge,and operational patterns.The integrated framework enables simultaneous strategic planning and operational control,ensuring both economic efficiency and extended battery lifespan.The effectiveness of the proposed method is validated through comprehensive case studies on hybrid energy storage systems,demonstrating superior computational efficiency,robust performance across different network configurations,and significant improvements in battery utilization compared to conventional approaches.展开更多
In this paper, the containment control problem in nonlinear multi-agent systems(NMASs) under denial-of-service(DoS) attacks is addressed. Firstly, a prediction model is obtained using the broad learning technique to t...In this paper, the containment control problem in nonlinear multi-agent systems(NMASs) under denial-of-service(DoS) attacks is addressed. Firstly, a prediction model is obtained using the broad learning technique to train historical data generated by the system offline without DoS attacks. Secondly, the dynamic linearization method is used to obtain the equivalent linearization model of NMASs. Then, a novel model-free adaptive predictive control(MFAPC) framework based on historical and online data generated by the system is proposed, which combines the trained prediction model with the model-free adaptive control method. The development of the MFAPC method motivates a much simpler robust predictive control solution that is convenient to use in the case of DoS attacks. Meanwhile, the MFAPC algorithm provides a unified predictive framework for solving consensus tracking and containment control problems. The boundedness of the containment error can be proven by using the contraction mapping principle and the mathematical induction method. Finally, the proposed MFAPC is assessed through comparative experiments.展开更多
This paper develops a novel hierarchical control strategy for improving the trajectory tracking capability of aerial robots under parameter uncertainties.The hierarchical control strategy is composed of an adaptive sl...This paper develops a novel hierarchical control strategy for improving the trajectory tracking capability of aerial robots under parameter uncertainties.The hierarchical control strategy is composed of an adaptive sliding mode controller and a model-free iterative sliding mode controller(MFISMC).A position controller is designed based on adaptive sliding mode control(SMC)to safely drive the aerial robot and ensure fast state convergence under external disturbances.Additionally,the MFISMC acts as an attitude controller to estimate the unmodeled dynamics without detailed knowledge of aerial robots.Then,the adaption laws are derived with the Lyapunov theory to guarantee the asymptotic tracking of the system state.Finally,to demonstrate the performance and robustness of the proposed control strategy,numerical simulations are carried out,which are also compared with other conventional strategies,such as proportional-integralderivative(PID),backstepping(BS),and SMC.The simulation results indicate that the proposed hierarchical control strategy can fulfill zero steady-state error and achieve faster convergence compared with conventional strategies.展开更多
This paper proposes and implements a model-free open-loop iterative learning control(ILC)strategy to realize the speed control of the single-phase flux switching motor(FSM)with an asymmetrical rotor.Base on the propos...This paper proposes and implements a model-free open-loop iterative learning control(ILC)strategy to realize the speed control of the single-phase flux switching motor(FSM)with an asymmetrical rotor.Base on the proposed winding control method,the asymmetrical rotor enables the motor to generate continuous positive torque for positive rotation,and relatively small resistance torque for negative rotation.An initial iteration coefficient and variable iteration coefficient optimized scheme was proposed based on the characteristics of the hardware circuit,thereby forming the model-free strategy.A series of prototype experiments was carried out.Experimental results verify the effectiveness and practicability of the proposed ILC strategy.展开更多
This paper introduces a model-free reinforcement learning technique that is used to solve a class of dynamic games known as dynamic graphical games. The graphical game results from to make all the agents synchronize t...This paper introduces a model-free reinforcement learning technique that is used to solve a class of dynamic games known as dynamic graphical games. The graphical game results from to make all the agents synchronize to the state of a command multi-agent dynamical systems, where pinning control is used generator or a leader agent. Novel coupled Bellman equations and Hamiltonian functions are developed for the dynamic graphical games. The Hamiltonian mechanics are used to derive the necessary conditions for optimality. The solution for the dynamic graphical game is given in terms of the solution to a set of coupled Hamilton-Jacobi-Bellman equations developed herein. Nash equilibrium solution for the graphical game is given in terms of the solution to the underlying coupled Hamilton-Jacobi-Bellman equations. An online model-free policy iteration algorithm is developed to learn the Nash solution for the dynamic graphical game. This algorithm does not require any knowledge of the agents＇ dynamics. A proof of convergence for this multi-agent learning algorithm is given under mild assumption about the inter-connectivity properties of the graph. A gradient descent technique with critic network structures is used to implement the policy iteration algorithm to solve the graphical game online in real-time.展开更多
An adaptive optimal trajectory tracking controller is presented for the Solid-RocketPowered Vehicle(SRPV)with uncertain nonlinear non-affine dynamics in the framework of adaptive dynamic programming.First,considering ...An adaptive optimal trajectory tracking controller is presented for the Solid-RocketPowered Vehicle(SRPV)with uncertain nonlinear non-affine dynamics in the framework of adaptive dynamic programming.First,considering that the ascent model of the SRPV is non-affine,a model-free Single Network Adaptive Critic(SNAC)method is developed based on the dynamic neural network and the traditional SNAC method.This developed model-free SNAC method overcomes the limitation of the traditional SNAC method that can only be applied to affine systems.Then,a closed-form adaptive optimal controller is designed for the non-affine dynamics of SRPVs.This controller can adjust its parameters under different flight conditions and converge to the approximate optimal controller through online self-learning.Finally,the convergence to the approximate optimal controller is proved.The theoretical analysis of the uniformly ultimate boundedness of the tracking error is also presented.Simulation results demonstrate the effectiveness of the proposed controller.展开更多
The rapid growth of distributed generator(DG)capacities has introduced additional controllable assets to improve the performance of distribution systems in terms of service restoration.Renewable DGs are of particular ...The rapid growth of distributed generator(DG)capacities has introduced additional controllable assets to improve the performance of distribution systems in terms of service restoration.Renewable DGs are of particular interest to utility companies,but the stochastic nature of intermittent renewable DGs could have a negative impact on the electric grid if they are not properly handled.In this study,we investigate distribution system service restoration using DGs as the primary power source,and we develop an effective approach to handle the uncertainty of renewable DGs under extreme conditions.The distribution system service restoration problem can be described as a mixed-integer second-order cone programming model by modifying the radial topology constraints and power flow equations.The uncertainty of renewable DGs will be modeled using a chance-constrained approach.Furthermore,the forecast errors and noises in real-time operation are solved using a novel model-free control algorithm that can automatically track the trajectory of real-time DG output.The proposed service restoration strategy and model-free control algorithm are validated using an IEEE 123-bus test system.展开更多
A model-flee compound controller design method is proposed to achieve the wide frequency bandwidth requirement of flight simulators. The method based on quantitative feedback theory, acquires system uncertainty under ...A model-flee compound controller design method is proposed to achieve the wide frequency bandwidth requirement of flight simulators. The method based on quantitative feedback theory, acquires system uncertainty under different working conditions through closed-loop identification with power spectrum estimation. Then in controller designing, it makes a trade, off between the strict requirements for magnitude-frequency characteristics and those for phase-frequency characteristics of flight simulators, by converting the indices of magnitude-frequency characteristics of flight simulators into quantitative feedback theory-based tracking specification bounds and using feedforward controller to attain the required phase-flequency characteristics. Simulation and experimental results indicate that, when used to design inner flame controller of flight simulator, the proposed method can fulfill the requirements for wide frequency bandwidth indices. Compared with other controller design methods, it has the property of model-free and transparency.展开更多
In this paper,an asymmetric bipartite consensus problem for the nonlinear multi-agent systems with cooperative and antagonistic interactions is studied under the event-triggered mechanism.For the agents described by a...In this paper,an asymmetric bipartite consensus problem for the nonlinear multi-agent systems with cooperative and antagonistic interactions is studied under the event-triggered mechanism.For the agents described by a structurally balanced signed digraph,the asymmetric bipartite consensus objective is firstly defined,assigning the agents'output to different signs and module values.Considering with the completely unknown dynamics of the agents,a novel event-triggered model-free adaptive bipartite control protocol is designed based on the agents'triggered outputs and an equivalent compact form data model.By utilizing the Lyapunov analysis method,the threshold of the triggering condition is obtained.Subsequently,the asymptotic convergence of the tracking error is deduced and a sufficient condition is obtained based on the contraction mapping principle.Finally,the simulation example further demonstrates the effectiveness of the protocol.展开更多
In this paper, we apply the recursive genetic programming (RGP) approach to the cognition of a system, and then proceed to the detecting procedure for structural changes in the system whose components are of long memo...In this paper, we apply the recursive genetic programming (RGP) approach to the cognition of a system, and then proceed to the detecting procedure for structural changes in the system whose components are of long memory. This approach is adaptive and model-free, which can simulate the individual activities of the system's participants, therefore, it has strong ability to recognize the operating mechanism of the system. Based on the previous cognition about the system, a testing statistic is developed for the detection of structural changes in the system. Furthermore, an example is presented to illustrate the validity and practical value of the proposed.展开更多
In this work, a Revisited form of the so-called Model-Free Control（R-MFC） is derived.Herein, the MFC principle is employed to deal with the unknown part of a plant only（i.e., unmodeled dynamics, disturbances, etc....In this work, a Revisited form of the so-called Model-Free Control（R-MFC） is derived.Herein, the MFC principle is employed to deal with the unknown part of a plant only（i.e., unmodeled dynamics, disturbances, etc.） and occurs beside an Interconnection and Damping AssignmentPassivity Based Control（IDA-PBC） strategy. Using the proposed formulation, it is shown that we can significantly improve the performance of the control through the reshaping properties of the IDA-PBC technique. Moreover, the control robustness level is increased via a compensation of the time-varying disturbances and the unmodeled system dynamics. This on-line compensation capability is provided by the MFC principle. The problem is studied in the case of Multi-Input Multi-Output（MIMO） mechanical systems with an explicit application to a small Vertical Take-Off and Landing（VTOL） Unmanned Aerial Vehicle（UAV） where a stability analysis is also provided. Numerical simulations have shown satisfactory results, in comparison with some other control strategies, where an in-depth discussion with respect to the control performance is highlighted by considering several scenarios and using several metrics.展开更多
Reinforcement Learning(RL)based control algorithms can learn the control strategies for nonlinear and uncertain environment during interacting with it.Guided by the rewards generated by environment,a RL agent can lear...Reinforcement Learning(RL)based control algorithms can learn the control strategies for nonlinear and uncertain environment during interacting with it.Guided by the rewards generated by environment,a RL agent can learn the control strategy directly in a model-free way instead of investigating the dynamic model of the environment.In the paper,we propose the sampled-data RL control strategy to reduce the computational demand.In the sampled-data control strategy,the whole control system is of a hybrid structure,in which the plant is of continuous structure while the controller(RL agent)adopts a discrete structure.Given that the continuous states of the plant will be the input of the agent,the state–action value function is approximated by the fully connected feed-forward neural networks(FCFFNN).Instead of learning the controller at every step during the interaction with the environment,the learning and acting stages are decoupled to learn the control strategy more effectively through experience replay.In the acting stage,the most effective experience obtained during the interaction with the environment will be stored and during the learning stage,the stored experience will be replayed to customized times,which helps enhance the experience replay process.The effectiveness of proposed approach will be verified by simulation examples.展开更多
A kind of adaptive sliding model control algorithm is developed to solve and improve the mathematical model dependency and un-modeled dynamics of a controlled system. The control strategy derived from a kind of data-d...A kind of adaptive sliding model control algorithm is developed to solve and improve the mathematical model dependency and un-modeled dynamics of a controlled system. The control strategy derived from a kind of data-driven control method in essence, thereby the input and output data are utilized by the controller with no information about the control system model. Theoretical analysis proves that this proposed control algorithm can improve the utilization of the estimated pseudo partial derivative information and accelerate the velocity of the convergence. The stability of the control system is further verified by rigorous mathematical analysis. This new discrete-time nonlinear systems model-free control algorithm obtained better control performance through the simulations for the linear motor position and the information tracking speed, which also achieved robust and accurate traceability.展开更多
The operating frequency accuracy of the local oscillators is critical for the overall system performance in the communication systems.However,the high-precision oscillators could be too expensive for civil application...The operating frequency accuracy of the local oscillators is critical for the overall system performance in the communication systems.However,the high-precision oscillators could be too expensive for civil applications.In this paper,we propose a model-free adaptive frequency calibration framework for a voltage-controlled crystal oscillator(VCO)equipped with a time to digital converter(TDC),which can significantly improve the frequency accuracy of the VCO thus calibrated.The idea is to utilize a high-precision TDC to directly measure the VCO period which is then passed to a model-free method for working frequency calibration.One advantage of this method is that the working frequency calibration employs the system history of input/output(I/O)data,instead of establishing an accurate VCO voltagecontrolled oscillator model.Another advantage is the lightweight calibration method with low complexity such that it can be implemented on an MCU with limited computation capabilities.Experimental results show that the proposed calibration method can improve the frequency accuracy of a VCO from±20 ppm to±10 ppb,which indicates the promise of the modelfree adaptive frequency calibrator for VCOs.展开更多
This paper provides an improved model-free adaptive control(IMFAC)strategy for solving the surface vessel trajectory tracking issue with time delay and restricted disturbance.Firstly,the original nonlinear time-delay ...This paper provides an improved model-free adaptive control(IMFAC)strategy for solving the surface vessel trajectory tracking issue with time delay and restricted disturbance.Firstly,the original nonlinear time-delay system is transformed into a structure consisting of an unknown residual term and a parameter term with control inputs using a local compact form dynamic linearization(local-CFDL).To take advantage of the resulting structure,use a discrete-time extended state observer(DESO)to estimate the unknown residual factor.Then,according to the study,the inclusion of a time delay has no effect on the linearization structure,and an improved control approach is provided,in which DESO is used to adjust for uncertainties.Furthermore,a DESO-based event-triggered model-free adaptive control(ET-DESO-MFAC)is established by designing event-triggered conditions to assure Lyapunov stability.Only when the system’s indicator fulfills the provided event-triggered condition will the control input signal be updated;otherwise,the control input will stay the same as it is at the last trigger moment.A coordinate compensation approach is developed to reduce the steady-state inaccuracy of trajectory tracking.Finally,simulation experiments are used to assess the effectiveness of the proposed technique for trajectory tracking.展开更多
Polyvinyl chloride （PVC） polymerizing process is a typical complicated industrial process with the characteristics of large inertia, big time delay and nonlinearity. Firstly, for the general nonlinear and discrete t...Polyvinyl chloride （PVC） polymerizing process is a typical complicated industrial process with the characteristics of large inertia, big time delay and nonlinearity. Firstly, for the general nonlinear and discrete time system, a design scheme of model-free adaptive （MFA） controller is given. Then, particle swarm optimization （PSO） algorithm is applied to optimizing and setting the key parameters for controller tuning. After that, the MFA controller is used to control the system of polymerizing temperature. Finally, simulation results are given to show that the MAC strategy based on PSO obtains a good controlling performance index.展开更多
Due to the release of gravity in the space environment, the dynamic characteristics of the space manipulator have changed compared with that of the ground, which results in the change of its tracking precision. This p...Due to the release of gravity in the space environment, the dynamic characteristics of the space manipulator have changed compared with that of the ground, which results in the change of its tracking precision. This paper presents a model-free adaptive control(MFAC) strategy to track the desired trajectory under different gravity environment. A dynamic transformation method and full form dynamic linearization(FFDL) approach are selected to dynamicly linearize the system, which can better eliminate the complex dynamics that may exist in the original system. The controlled object uses the two degrees of freedom of space manipulator and the controller only depends on the desired angle and torque of each joint of the space manipulator. Moreover, the proof of stability is also provided. Finally, simulation results are presented to demonstrate the effectiveness of the proposed strategy. It is shown that the proposed approach can achieve better trajectory tracking performance under different gravity environment without changing the control parameters, and the tracking precision can be significantly improved as compared with the proportional differential(PD) control results.展开更多
A model-free adaptive control method is proposed for the spacecrafts whose dynamical parameters change over time and cannot be acquired accurately. The algorithm is based on full form dynamic linearization.A dimension...A model-free adaptive control method is proposed for the spacecrafts whose dynamical parameters change over time and cannot be acquired accurately. The algorithm is based on full form dynamic linearization.A dimension reduction matrix is introduced to construct an augmented system with the same dimension input and output. The design of the controller depends on the system input and output data rather than the knowledge of the controlled plant. The numerical simulation results show that the improved controller can deal with different models with the same set of controller parameters,and the controller performance is better than that of PD controller for the time-varying system with disturbance.展开更多
基金supported in part by the National Natural Science Foundation of China under Grant 52077002。
文摘Model predictive control(MPC)has been deemed as an attractive control method in motor drives by virtue of its simple structure,convenient multi-objective optimization,and satisfactory dynamic performance.However,the strong reliance on mathematical models seriously restrains its practical application.Therefore,improving the robustness of MPC has attained significant attentions in the last two decades,followed by which,model-free predictive control(MFPC)comes into existence.This article aims to reveal the current state of MFPC strategies for motor drives and give the categorization from the perspective of implementation.Based on this review,the principles of the reported MFPC strategies are introduced in detail,as well as the challenges encountered in technology realization.In addition,some of typical and important concepts are experimentally validated via case studies to evaluate the performance and highlight their features.Finally,the future trends of MFPC are discussed based on the current state and reported developments.
基金Financial support was provided by the State Grid Sichuan Electric Power Company Science and Technology Project“Key Research on Development Path Planning and Key Operation Technologies of New Rural Electrification Construction”under Grant No.52199623000G.
文摘The increasing penetration of second-life battery energy storage systems(SLBESS)in power grids presents substantial challenges to system operation and control due to the heterogeneous characteristics and uncertain degradation patterns of repurposed batteries.This paper presents a novel model-free adaptive voltage controlembedded dung beetle-inspired heuristic optimization algorithmfor optimal SLBESS capacity configuration and power dispatch.To simultaneously address the computational complexity and ensure system stability,this paper develops a comprehensive bilevel optimization framework.At the upper level,a dung beetle optimization algorithmdetermines the optimal SLBESS capacity configuration byminimizing total lifecycle costswhile incorporating the charging/discharging power trajectories derived from the model-free adaptive voltage control strategy.At the lower level,a health-priority power dispatch optimization model intelligently allocates power demands among heterogeneous battery groups based on their real-time operational states,state-of-health variations,and degradation constraints.The proposed model-free approach circumvents the need for complex battery charging/discharging power controlmodels and extensive historical data requirements whilemaintaining system stability through adaptive controlmechanisms.A novel cycle life degradation model is developed to quantify the relationship between remaining useful life,depth of discharge,and operational patterns.The integrated framework enables simultaneous strategic planning and operational control,ensuring both economic efficiency and extended battery lifespan.The effectiveness of the proposed method is validated through comprehensive case studies on hybrid energy storage systems,demonstrating superior computational efficiency,robust performance across different network configurations,and significant improvements in battery utilization compared to conventional approaches.
基金supported in part by the National Natural Science Foundation of China(62403396,62433018,62373113)the Guangdong Basic and Applied Basic Research Foundation(2023A1515011527,2023B1515120010)the Postdoctoral Fellowship Program of CPSF(GZB20240621)
文摘In this paper, the containment control problem in nonlinear multi-agent systems(NMASs) under denial-of-service(DoS) attacks is addressed. Firstly, a prediction model is obtained using the broad learning technique to train historical data generated by the system offline without DoS attacks. Secondly, the dynamic linearization method is used to obtain the equivalent linearization model of NMASs. Then, a novel model-free adaptive predictive control(MFAPC) framework based on historical and online data generated by the system is proposed, which combines the trained prediction model with the model-free adaptive control method. The development of the MFAPC method motivates a much simpler robust predictive control solution that is convenient to use in the case of DoS attacks. Meanwhile, the MFAPC algorithm provides a unified predictive framework for solving consensus tracking and containment control problems. The boundedness of the containment error can be proven by using the contraction mapping principle and the mathematical induction method. Finally, the proposed MFAPC is assessed through comparative experiments.
文摘This paper develops a novel hierarchical control strategy for improving the trajectory tracking capability of aerial robots under parameter uncertainties.The hierarchical control strategy is composed of an adaptive sliding mode controller and a model-free iterative sliding mode controller(MFISMC).A position controller is designed based on adaptive sliding mode control(SMC)to safely drive the aerial robot and ensure fast state convergence under external disturbances.Additionally,the MFISMC acts as an attitude controller to estimate the unmodeled dynamics without detailed knowledge of aerial robots.Then,the adaption laws are derived with the Lyapunov theory to guarantee the asymptotic tracking of the system state.Finally,to demonstrate the performance and robustness of the proposed control strategy,numerical simulations are carried out,which are also compared with other conventional strategies,such as proportional-integralderivative(PID),backstepping(BS),and SMC.The simulation results indicate that the proposed hierarchical control strategy can fulfill zero steady-state error and achieve faster convergence compared with conventional strategies.
文摘This paper proposes and implements a model-free open-loop iterative learning control(ILC)strategy to realize the speed control of the single-phase flux switching motor(FSM)with an asymmetrical rotor.Base on the proposed winding control method,the asymmetrical rotor enables the motor to generate continuous positive torque for positive rotation,and relatively small resistance torque for negative rotation.An initial iteration coefficient and variable iteration coefficient optimized scheme was proposed based on the characteristics of the hardware circuit,thereby forming the model-free strategy.A series of prototype experiments was carried out.Experimental results verify the effectiveness and practicability of the proposed ILC strategy.
基金supported by the Deanship of Scientific Research at King Fahd University of Petroleum & Minerals Project(No.JF141002)the National Science Foundation(No.ECCS-1405173)+3 种基金the Office of Naval Research(Nos.N000141310562,N000141410718)the U.S. Army Research Office(No.W911NF-11-D-0001)the National Natural Science Foundation of China(No.61120106011)the Project 111 from the Ministry of Education of China(No.B08015)
文摘This paper introduces a model-free reinforcement learning technique that is used to solve a class of dynamic games known as dynamic graphical games. The graphical game results from to make all the agents synchronize to the state of a command multi-agent dynamical systems, where pinning control is used generator or a leader agent. Novel coupled Bellman equations and Hamiltonian functions are developed for the dynamic graphical games. The Hamiltonian mechanics are used to derive the necessary conditions for optimality. The solution for the dynamic graphical game is given in terms of the solution to a set of coupled Hamilton-Jacobi-Bellman equations developed herein. Nash equilibrium solution for the graphical game is given in terms of the solution to the underlying coupled Hamilton-Jacobi-Bellman equations. An online model-free policy iteration algorithm is developed to learn the Nash solution for the dynamic graphical game. This algorithm does not require any knowledge of the agents＇ dynamics. A proof of convergence for this multi-agent learning algorithm is given under mild assumption about the inter-connectivity properties of the graph. A gradient descent technique with critic network structures is used to implement the policy iteration algorithm to solve the graphical game online in real-time.
基金supported by the National Key R&D Program of China(No.2016YFB1200100)。
文摘An adaptive optimal trajectory tracking controller is presented for the Solid-RocketPowered Vehicle(SRPV)with uncertain nonlinear non-affine dynamics in the framework of adaptive dynamic programming.First,considering that the ascent model of the SRPV is non-affine,a model-free Single Network Adaptive Critic(SNAC)method is developed based on the dynamic neural network and the traditional SNAC method.This developed model-free SNAC method overcomes the limitation of the traditional SNAC method that can only be applied to affine systems.Then,a closed-form adaptive optimal controller is designed for the non-affine dynamics of SRPVs.This controller can adjust its parameters under different flight conditions and converge to the approximate optimal controller through online self-learning.Finally,the convergence to the approximate optimal controller is proved.The theoretical analysis of the uniformly ultimate boundedness of the tracking error is also presented.Simulation results demonstrate the effectiveness of the proposed controller.
基金the National Renewable Energy Laboratory(NREL)operated by Alliance for Sustainable Energy,LLC,for the U.S.Department of Energy(DOE)under Contract No.DE-AC36-08GO28308the U.S.Department of Energy Office of Electricity AOP Distribution Grid Resilience Project.The views expressed in the article do not necessarily represent the views of the DOE or the U.S.Government.The U.S.Government retains and the publisher,by accepting the article for publication,acknowledges that the U.S.Government retains a nonexclusive,paid-up,irrevocable,worldwide license to publish or reproduce the published form of this work,or allow others to do so,for U.S.Government purposes.
文摘The rapid growth of distributed generator(DG)capacities has introduced additional controllable assets to improve the performance of distribution systems in terms of service restoration.Renewable DGs are of particular interest to utility companies,but the stochastic nature of intermittent renewable DGs could have a negative impact on the electric grid if they are not properly handled.In this study,we investigate distribution system service restoration using DGs as the primary power source,and we develop an effective approach to handle the uncertainty of renewable DGs under extreme conditions.The distribution system service restoration problem can be described as a mixed-integer second-order cone programming model by modifying the radial topology constraints and power flow equations.The uncertainty of renewable DGs will be modeled using a chance-constrained approach.Furthermore,the forecast errors and noises in real-time operation are solved using a novel model-free control algorithm that can automatically track the trajectory of real-time DG output.The proposed service restoration strategy and model-free control algorithm are validated using an IEEE 123-bus test system.
文摘A model-flee compound controller design method is proposed to achieve the wide frequency bandwidth requirement of flight simulators. The method based on quantitative feedback theory, acquires system uncertainty under different working conditions through closed-loop identification with power spectrum estimation. Then in controller designing, it makes a trade, off between the strict requirements for magnitude-frequency characteristics and those for phase-frequency characteristics of flight simulators, by converting the indices of magnitude-frequency characteristics of flight simulators into quantitative feedback theory-based tracking specification bounds and using feedforward controller to attain the required phase-flequency characteristics. Simulation and experimental results indicate that, when used to design inner flame controller of flight simulator, the proposed method can fulfill the requirements for wide frequency bandwidth indices. Compared with other controller design methods, it has the property of model-free and transparency.
基金supported in part by the National Natural Science Foundation of China(U1804147,61833001,61873139,61573129)the Innovative Scientists and Technicians Team of Henan Polytechnic University(T2019-2)the Innovative Scientists and Technicians Team of Henan Provincial High Education(20IRTSTHN019)。
文摘In this paper,an asymmetric bipartite consensus problem for the nonlinear multi-agent systems with cooperative and antagonistic interactions is studied under the event-triggered mechanism.For the agents described by a structurally balanced signed digraph,the asymmetric bipartite consensus objective is firstly defined,assigning the agents'output to different signs and module values.Considering with the completely unknown dynamics of the agents,a novel event-triggered model-free adaptive bipartite control protocol is designed based on the agents'triggered outputs and an equivalent compact form data model.By utilizing the Lyapunov analysis method,the threshold of the triggering condition is obtained.Subsequently,the asymptotic convergence of the tracking error is deduced and a sufficient condition is obtained based on the contraction mapping principle.Finally,the simulation example further demonstrates the effectiveness of the protocol.
文摘In this paper, we apply the recursive genetic programming (RGP) approach to the cognition of a system, and then proceed to the detecting procedure for structural changes in the system whose components are of long memory. This approach is adaptive and model-free, which can simulate the individual activities of the system's participants, therefore, it has strong ability to recognize the operating mechanism of the system. Based on the previous cognition about the system, a testing statistic is developed for the detection of structural changes in the system. Furthermore, an example is presented to illustrate the validity and practical value of the proposed.
文摘In this work, a Revisited form of the so-called Model-Free Control（R-MFC） is derived.Herein, the MFC principle is employed to deal with the unknown part of a plant only（i.e., unmodeled dynamics, disturbances, etc.） and occurs beside an Interconnection and Damping AssignmentPassivity Based Control（IDA-PBC） strategy. Using the proposed formulation, it is shown that we can significantly improve the performance of the control through the reshaping properties of the IDA-PBC technique. Moreover, the control robustness level is increased via a compensation of the time-varying disturbances and the unmodeled system dynamics. This on-line compensation capability is provided by the MFC principle. The problem is studied in the case of Multi-Input Multi-Output（MIMO） mechanical systems with an explicit application to a small Vertical Take-Off and Landing（VTOL） Unmanned Aerial Vehicle（UAV） where a stability analysis is also provided. Numerical simulations have shown satisfactory results, in comparison with some other control strategies, where an in-depth discussion with respect to the control performance is highlighted by considering several scenarios and using several metrics.
基金supported by Imperial College London,UK,King’s College London,UK and Engineering and Physical Sciences Research Council(EPSRC),UK.
文摘Reinforcement Learning(RL)based control algorithms can learn the control strategies for nonlinear and uncertain environment during interacting with it.Guided by the rewards generated by environment,a RL agent can learn the control strategy directly in a model-free way instead of investigating the dynamic model of the environment.In the paper,we propose the sampled-data RL control strategy to reduce the computational demand.In the sampled-data control strategy,the whole control system is of a hybrid structure,in which the plant is of continuous structure while the controller(RL agent)adopts a discrete structure.Given that the continuous states of the plant will be the input of the agent,the state–action value function is approximated by the fully connected feed-forward neural networks(FCFFNN).Instead of learning the controller at every step during the interaction with the environment,the learning and acting stages are decoupled to learn the control strategy more effectively through experience replay.In the acting stage,the most effective experience obtained during the interaction with the environment will be stored and during the learning stage,the stored experience will be replayed to customized times,which helps enhance the experience replay process.The effectiveness of proposed approach will be verified by simulation examples.
基金supported by Key Programs for Science and Technology Development of Henan Province(No.102102210197)the Opening Project of Key Laboratory of Mine Informatization,Henan Polytechnic University and the Doctoral Foundation of Henan Polytechnic University(No.B2010-23)
文摘A kind of adaptive sliding model control algorithm is developed to solve and improve the mathematical model dependency and un-modeled dynamics of a controlled system. The control strategy derived from a kind of data-driven control method in essence, thereby the input and output data are utilized by the controller with no information about the control system model. Theoretical analysis proves that this proposed control algorithm can improve the utilization of the estimated pseudo partial derivative information and accelerate the velocity of the convergence. The stability of the control system is further verified by rigorous mathematical analysis. This new discrete-time nonlinear systems model-free control algorithm obtained better control performance through the simulations for the linear motor position and the information tracking speed, which also achieved robust and accurate traceability.
文摘The operating frequency accuracy of the local oscillators is critical for the overall system performance in the communication systems.However,the high-precision oscillators could be too expensive for civil applications.In this paper,we propose a model-free adaptive frequency calibration framework for a voltage-controlled crystal oscillator(VCO)equipped with a time to digital converter(TDC),which can significantly improve the frequency accuracy of the VCO thus calibrated.The idea is to utilize a high-precision TDC to directly measure the VCO period which is then passed to a model-free method for working frequency calibration.One advantage of this method is that the working frequency calibration employs the system history of input/output(I/O)data,instead of establishing an accurate VCO voltagecontrolled oscillator model.Another advantage is the lightweight calibration method with low complexity such that it can be implemented on an MCU with limited computation capabilities.Experimental results show that the proposed calibration method can improve the frequency accuracy of a VCO from±20 ppm to±10 ppb,which indicates the promise of the modelfree adaptive frequency calibrator for VCOs.
基金supported by the Natural Science Foundation of Jiangsu Province(BK20201159).
文摘This paper provides an improved model-free adaptive control(IMFAC)strategy for solving the surface vessel trajectory tracking issue with time delay and restricted disturbance.Firstly,the original nonlinear time-delay system is transformed into a structure consisting of an unknown residual term and a parameter term with control inputs using a local compact form dynamic linearization(local-CFDL).To take advantage of the resulting structure,use a discrete-time extended state observer(DESO)to estimate the unknown residual factor.Then,according to the study,the inclusion of a time delay has no effect on the linearization structure,and an improved control approach is provided,in which DESO is used to adjust for uncertainties.Furthermore,a DESO-based event-triggered model-free adaptive control(ET-DESO-MFAC)is established by designing event-triggered conditions to assure Lyapunov stability.Only when the system’s indicator fulfills the provided event-triggered condition will the control input signal be updated;otherwise,the control input will stay the same as it is at the last trigger moment.A coordinate compensation approach is developed to reduce the steady-state inaccuracy of trajectory tracking.Finally,simulation experiments are used to assess the effectiveness of the proposed technique for trajectory tracking.
基金supported by University of Science and Technology Liaoning,National Financial Security and System Equipment Engineering Research Center(No.USTLKFGJ201502)
文摘Polyvinyl chloride （PVC） polymerizing process is a typical complicated industrial process with the characteristics of large inertia, big time delay and nonlinearity. Firstly, for the general nonlinear and discrete time system, a design scheme of model-free adaptive （MFA） controller is given. Then, particle swarm optimization （PSO） algorithm is applied to optimizing and setting the key parameters for controller tuning. After that, the MFA controller is used to control the system of polymerizing temperature. Finally, simulation results are given to show that the MAC strategy based on PSO obtains a good controlling performance index.
基金Sponsored by the National Natural Science Foundation of China(No.51605415)Natural Science Foundation of Hebei Province(No.F2016203494,E2017203240)。
文摘Due to the release of gravity in the space environment, the dynamic characteristics of the space manipulator have changed compared with that of the ground, which results in the change of its tracking precision. This paper presents a model-free adaptive control(MFAC) strategy to track the desired trajectory under different gravity environment. A dynamic transformation method and full form dynamic linearization(FFDL) approach are selected to dynamicly linearize the system, which can better eliminate the complex dynamics that may exist in the original system. The controlled object uses the two degrees of freedom of space manipulator and the controller only depends on the desired angle and torque of each joint of the space manipulator. Moreover, the proof of stability is also provided. Finally, simulation results are presented to demonstrate the effectiveness of the proposed strategy. It is shown that the proposed approach can achieve better trajectory tracking performance under different gravity environment without changing the control parameters, and the tracking precision can be significantly improved as compared with the proportional differential(PD) control results.
基金Sponsored by the National Natural Science Foundation of China(Grant No.11102007)the Fundamental Research Fund for the Central Universities(Grant No.YWF-14-YHXY-012)
文摘A model-free adaptive control method is proposed for the spacecrafts whose dynamical parameters change over time and cannot be acquired accurately. The algorithm is based on full form dynamic linearization.A dimension reduction matrix is introduced to construct an augmented system with the same dimension input and output. The design of the controller depends on the system input and output data rather than the knowledge of the controlled plant. The numerical simulation results show that the improved controller can deal with different models with the same set of controller parameters,and the controller performance is better than that of PD controller for the time-varying system with disturbance.
