A new variable structure control algorithm based on sliding mode prediction for a class of discrete-time nonlinear systems is presented. By employing a special model to predict future sliding mode value, and combining...A new variable structure control algorithm based on sliding mode prediction for a class of discrete-time nonlinear systems is presented. By employing a special model to predict future sliding mode value, and combining feedback correction and receding horizon optimization methods which are extensively applied on predictive control strategy, a discrete-time variable structure control law is constructed. The closed-loop systems are proved to have robustness to uncertainties with unspecified boundaries. Numerical simulation and pendulum experiment results illustrate that the closed-loop systems possess desired performance, such as strong robustness, fast convergence and chattering elimination.展开更多
A new type criterion of globally uniformly ultimate boundedness for discrete-time nonlinear systems is introduced. In classical Lyapunov theory about globally uniformly ultimate boundedness, Lyapunov function is assum...A new type criterion of globally uniformly ultimate boundedness for discrete-time nonlinear systems is introduced. In classical Lyapunov theory about globally uniformly ultimate boundedness, Lyapunov function is assumed to be positive definite and its difference at the every latter moment and the former moment is negative definite. In this paper the condition of difference of Lyapunov function is relaxed. Under the relaxed condition, the result of this paper can be considered as the extension of the classical Lyapunov theory about uniformly ultimate boundedness.展开更多
In this paper, some computational tools are proposed to determine the largest invariant set, with respect to either a continuous-time or a discrete-time system, that is contained in an algebraic set. In particular, it...In this paper, some computational tools are proposed to determine the largest invariant set, with respect to either a continuous-time or a discrete-time system, that is contained in an algebraic set. In particular, it is shown that if the vector field governing the dynamics of the system is polynomial and the considered analytic set is a variety, then algorithms from algebraic geometry can be used to solve the considered problem. Examples of applications of the method(spanning from the characterization of the stability to the computation of the zero dynamics) are given all throughout the paper.展开更多
This paper investigates set-valued state estimation of nonlinear systems with unknown-but-bounded(UBB)noises based on constrained polynomial zonotopes which is utilized to characterize non-convex sets.First,properties...This paper investigates set-valued state estimation of nonlinear systems with unknown-but-bounded(UBB)noises based on constrained polynomial zonotopes which is utilized to characterize non-convex sets.First,properties of constrained polynomial zonotopes are provided and the order reduction method is given to reduce the computational complexity.Then,the corresponding improved prediction-update algorithm is proposed so that it can be adapted to non-convex sets.Based on generalized intersection,the utilization of set-based estimation for attack detection is analyzed.Finally,an example is given to show the efficiency of our results.展开更多
Dear Editor,This letter studies the event-triggered adaptive horizon distributed model predictive control problem for discrete-time coupled nonlinear systems with additive disturbances.By constructing a new dualmodel ...Dear Editor,This letter studies the event-triggered adaptive horizon distributed model predictive control problem for discrete-time coupled nonlinear systems with additive disturbances.By constructing a new dualmodel optimal control problem,an event-triggered mechanism and an adaptive prediction horizon scheme are co-designed in the proposed scheme.Notably,the upper bound of the triggering interval remains independent of the dynamically shrinking prediction horizon.This enables the event-triggered mechanism to operate effectively even when the prediction horizon becomes zero,thus achieving cost savings throughout the control process.In addition,the sufficient conditions of the proposed scheme associated with the feasibility and stability are provided.The effectiveness is illustrated through a practical example.展开更多
Trajectory tracking for nonlinear robotic systems remains a fundamental yet challenging problem in control engineering,particularly when both precision and efficiency must be ensured.Conventional control methods are o...Trajectory tracking for nonlinear robotic systems remains a fundamental yet challenging problem in control engineering,particularly when both precision and efficiency must be ensured.Conventional control methods are often effective for stabilization but may not directly optimize long-term performance.To address this limitation,this study develops an integrated framework that combines optimal control principles with reinforcement learning for a single-link robotic manipulator.The proposed scheme adopts an actor–critic structure,where the critic network approximates the value function associated with the Hamilton–Jacobi–Bellman equation,and the actor network generates near-optimal control signals in real time.This dual adaptation enables the controller to refine its policy online without explicit system knowledge.Stability of the closed-loop system is analyzed through Lyapunov theory,ensuring boundedness of the tracking error.Numerical simulations on the single-link manipulator demonstrate that themethod achieves accurate trajectory followingwhile maintaining lowcontrol effort.The results further showthat the actor–critic learning mechanism accelerates convergence of the control policy compared with conventional optimization-based strategies.This work highlights the potential of reinforcement learning integrated with optimal control for robotic manipulators and provides a foundation for future extensions to more complex multi-degree-of-freedom systems.The proposed controller is further validated in a physics-based virtual Gazebo environment,demonstrating stable adaptation and real-time feasibility.展开更多
This study develops an event-triggered control strategy utilizing the fully actuated system approach for nonlinear interconnected large-scale systems containing actuator failures.First,to reduce the complexity of the ...This study develops an event-triggered control strategy utilizing the fully actuated system approach for nonlinear interconnected large-scale systems containing actuator failures.First,to reduce the complexity of the design process,we transform the studied system into the form of a fully actuated system through a state transformation.Then,to address the unknown nonlinear functions and actuator fault parameters,we employ neural networks and adaptive estimation techniques,respectively.Moreover,to reduce the control cost and improve the control efficiency,we introduce event-triggered inputs into the control strategy.It is proved by the Lyapunov stability analysis that all signals of the closed-loop system are bounded and the output of system eventually converge to a bounded region.The efficacy of the control approach is ultimately demonstrated via the simulation of an actual machine feeding system.展开更多
This paper is concerned with event-triggered control of discrete-time systems with or without input saturation.First,an accumulative-error-based event-triggered scheme is devised for control updates.When the accumulat...This paper is concerned with event-triggered control of discrete-time systems with or without input saturation.First,an accumulative-error-based event-triggered scheme is devised for control updates.When the accumulated error between the current state and the latest control update exceeds a certain threshold,an event is triggered.Such a scheme can ensure the event-generator works at a relatively low rate rather than falls into hibernation especially after the system steps into its steady state.Second,the looped functional method for continuous-time systems is extended to discrete-time systems.By introducing an innovative looped functional that links the event-triggered scheme,some sufficient conditions for the co-design of control gain and event-triggered parameters are obtained in terms of linear matrix inequalities with a couple of tuning parameters.Then,the proposed method is applied to discrete-time systems with input saturation.As a result,both suitable control gains and event-triggered parameters are also co-designed to ensure the system trajectories converge to the region of attraction.Finally,an unstable reactor system and an inverted pendulum system are given to show the effectiveness of the proposed method.展开更多
The paper presents an adaptive controller formulated for a class of nonaffine discrete-time systems with non-strict forms and unknown dynamics.The controller operates based solely on the measured output,thus obviating...The paper presents an adaptive controller formulated for a class of nonaffine discrete-time systems with non-strict forms and unknown dynamics.The controller operates based solely on the measured output,thus obviating the need for knowledge of the physical order of the controlled plant.Utilizing an ideal solution and equivalent dynamics,the approach integrates an adaptive network with feedback and robust controllers to establish a closed-loop system.A learning law is derived under practical conditions of the designed parameters,ensuring effective closed-loop performance based on pure-output feedback.The controller’s effectiveness is validated through both numerical and experimental systems,with results meeting the conditions specified in the main theorem.Comparative analysis highlights the controller’s highly satisfactory performance and its advantages.This research offers a promising approach to adaptive control for discrete-time systems with non-strict dynamics,providing practical solutions for systems with unknown dynamics and indeterminate system order.展开更多
Recently,an approach for the rapid detection of small oscillation faults based on deterministic learning theory was proposed for continuous-time systems.In this paper,a fault detection scheme is proposed for a class o...Recently,an approach for the rapid detection of small oscillation faults based on deterministic learning theory was proposed for continuous-time systems.In this paper,a fault detection scheme is proposed for a class of nonlinear discrete-time systems via deterministic learning.By using a discrete-time extension of deterministic learning algorithm,the general fault functions(i.e.,the internal dynamics)underlying normal and fault modes of nonlinear discrete-time systems are locally-accurately approximated by discrete-time dynamical radial basis function(RBF)networks.Then,a bank of estimators with the obtained knowledge of system dynamics embedded is constructed,and a set of residuals are obtained and used to measure the differences between the dynamics of the monitored system and the dynamics of the trained systems.A fault detection decision scheme is presented according to the smallest residual principle,i.e.,the occurrence of a fault can be detected in a discrete-time setting by comparing the magnitude of residuals.The fault detectability analysis is carried out and the upper bound of detection time is derived.A simulation example is given to illustrate the effectiveness of the proposed scheme.展开更多
An indirect adaptive fuzzy control scheme is developed for a class of nonlinear discrete-time systems. In this method, two fuzzy logic systems are used to approximate the unknown functions, and the parameters of membe...An indirect adaptive fuzzy control scheme is developed for a class of nonlinear discrete-time systems. In this method, two fuzzy logic systems are used to approximate the unknown functions, and the parameters of membership functions in fuzzy logic systems are adjusted according to adaptive laws for the purpose of controlling the plant to track a reference trajectory. It is proved that the scheme can not only guarantee the boundedness of the input and output of the closed-loop system, but also make the tracking error converge to a small neighborhood of the origin. Simulation results indicate the effectiveness of this scheme.展开更多
Transient performance for output regulation problems of linear discrete-time systems with input saturation is addressed by using the composite nonlinear feedback（CNF） control technique. The regulator is designed to ...Transient performance for output regulation problems of linear discrete-time systems with input saturation is addressed by using the composite nonlinear feedback（CNF） control technique. The regulator is designed to be an additive combination of a linear regulator part and a nonlinear feedback part. The linear regulator part solves the regulation problem independently which produces a quick output response but large oscillations. The nonlinear feedback part with well-tuned parameters is introduced to improve the transient performance by smoothing the oscillatory convergence. It is shown that the introduction of the nonlinear feedback part does not change the solvability conditions of the linear discrete-time output regulation problem. The effectiveness of transient improvement is illustrated by a numeric example.展开更多
In this paper, a novel iterative Q-learning algorithm, called "policy iteration based deterministic Qlearning algorithm", is developed to solve the optimal control problems for discrete-time deterministic no...In this paper, a novel iterative Q-learning algorithm, called "policy iteration based deterministic Qlearning algorithm", is developed to solve the optimal control problems for discrete-time deterministic nonlinear systems. The idea is to use an iterative adaptive dynamic programming(ADP) technique to construct the iterative control law which optimizes the iterative Q function. When the optimal Q function is obtained, the optimal control law can be achieved by directly minimizing the optimal Q function, where the mathematical model of the system is not necessary. Convergence property is analyzed to show that the iterative Q function is monotonically non-increasing and converges to the solution of the optimality equation. It is also proven that any of the iterative control laws is a stable control law. Neural networks are employed to implement the policy iteration based deterministic Q-learning algorithm, by approximating the iterative Q function and the iterative control law, respectively. Finally, two simulation examples are presented to illustrate the performance of the developed algorithm.展开更多
This paper investigates a sliding-mode model predictive control （MPC） algorithm with auxiliary contractive sliding vector constraint for constrained nonlinear discrete-time systems. By adding contractive constraint ...This paper investigates a sliding-mode model predictive control （MPC） algorithm with auxiliary contractive sliding vector constraint for constrained nonlinear discrete-time systems. By adding contractive constraint into the optimization problem in regular sliding-mode MPC algorithm, the value of the sliding vector is decreased to zero asymptotically, which means that the system state is driven into a vicinity of sliding surface with a certain width. Then, the system state moves along the sliding surface to the equilibrium point within the vicinity. By applying the proposed algorithm, the stability of the closed-loop system is guaranteed. A numerical example of a continuous stirred tank reactor （CSTR） system is given to verify the feasibility and effectiveness of the proposed method.展开更多
This paper presents a robust sliding mode controller for a class of unknown nonlinear discrete-time systems in the presence of fixed time delay. A neural-network approximation and the Lyapunov-Krasovskii functional th...This paper presents a robust sliding mode controller for a class of unknown nonlinear discrete-time systems in the presence of fixed time delay. A neural-network approximation and the Lyapunov-Krasovskii functional theory into the sliding-mode technique is used and a neural-network based sliding mode control scheme is proposed. Because of the novality of Chebyshev Neural Networks (CNNs), that it requires much less computation time as compare to multi layer neural network (MLNN), is preferred to approximate the unknown system functions. By means of linear matrix inequalities, a sufficient condition is derived to ensure the asymptotic stability such that the sliding mode dynamics is restricted to the defined sliding surface. The proposed sliding mode control technique guarantees the system state trajectory to the designed sliding surface. Finally, simulation results illustrate the main characteristics and performance of the proposed approach.展开更多
An uncertain nonlinear discrete-time system model with time-varying input delays for networked control systems (NCSs) is presented. The problem of exponential stability for the system is considered and some new criter...An uncertain nonlinear discrete-time system model with time-varying input delays for networked control systems (NCSs) is presented. The problem of exponential stability for the system is considered and some new criteria of exponential stability are obtained based on norm inequality methods. A numerical example is given todemonstrate that those criteria are useful to analyzing the stability of nonlinear NCSs.展开更多
This paper discusses about the stabilization of unknown nonlinear discrete-time fixed state delay systems. The unknown system nonlinearity is approximated by Chebyshev neural network (CNN), and weight update law is pr...This paper discusses about the stabilization of unknown nonlinear discrete-time fixed state delay systems. The unknown system nonlinearity is approximated by Chebyshev neural network (CNN), and weight update law is presented for approximating the system nonlinearity. Using appropriate Lyapunov-Krasovskii functional the stability of the nonlinear system is ensured by the solution of linear matrix inequalities. Finally, a relevant example is given to illustrate the effectiveness of the proposed control scheme.展开更多
This paper concerns the absolute stability problem of discrete-time descriptor systems with feedback connected ferromagnetic hysteresis nonlinearities. The ferromagnetic hysteresis model satisfies the passivity condit...This paper concerns the absolute stability problem of discrete-time descriptor systems with feedback connected ferromagnetic hysteresis nonlinearities. The ferromagnetic hysteresis model satisfies the passivity conditions of hysteresis operator, that is the input-output relation of the transformed operator is passive. The bound condition of the solution of the ferromagnetic hysteresis model is given. Through the framework of loop transformation, an augmented discrete-time descriptor system model is established for the stability analysis. A new extended Tsypkin criterion for the absolute stability of discrete-time descriptor systems with hysteresis is presented based on the linear matrix inequalities technique. A numerical example is given to illustrate the effectiveness of the extended criterion.展开更多
The left-inverse system with minimal order and its algorithms of discrete-time nonlinear systems are studied in a linear algebraic framework.The general structure of left-inverse system is described and computed in sy...The left-inverse system with minimal order and its algorithms of discrete-time nonlinear systems are studied in a linear algebraic framework.The general structure of left-inverse system is described and computed in symbolic algorithm.Two algorithms are given for constructing left-inverse systems with minimal order.展开更多
基金This work is supported by the National Natural Science Foundation of China (No.60421002) Priority supported financially by the New Century 151 Talent Project of Zhejiang Province.
文摘A new variable structure control algorithm based on sliding mode prediction for a class of discrete-time nonlinear systems is presented. By employing a special model to predict future sliding mode value, and combining feedback correction and receding horizon optimization methods which are extensively applied on predictive control strategy, a discrete-time variable structure control law is constructed. The closed-loop systems are proved to have robustness to uncertainties with unspecified boundaries. Numerical simulation and pendulum experiment results illustrate that the closed-loop systems possess desired performance, such as strong robustness, fast convergence and chattering elimination.
文摘A new type criterion of globally uniformly ultimate boundedness for discrete-time nonlinear systems is introduced. In classical Lyapunov theory about globally uniformly ultimate boundedness, Lyapunov function is assumed to be positive definite and its difference at the every latter moment and the former moment is negative definite. In this paper the condition of difference of Lyapunov function is relaxed. Under the relaxed condition, the result of this paper can be considered as the extension of the classical Lyapunov theory about uniformly ultimate boundedness.
文摘In this paper, some computational tools are proposed to determine the largest invariant set, with respect to either a continuous-time or a discrete-time system, that is contained in an algebraic set. In particular, it is shown that if the vector field governing the dynamics of the system is polynomial and the considered analytic set is a variety, then algorithms from algebraic geometry can be used to solve the considered problem. Examples of applications of the method(spanning from the characterization of the stability to the computation of the zero dynamics) are given all throughout the paper.
基金supported by the National Natural Science Foundation of China(61703286,62394342,61890924,61991404)。
文摘This paper investigates set-valued state estimation of nonlinear systems with unknown-but-bounded(UBB)noises based on constrained polynomial zonotopes which is utilized to characterize non-convex sets.First,properties of constrained polynomial zonotopes are provided and the order reduction method is given to reduce the computational complexity.Then,the corresponding improved prediction-update algorithm is proposed so that it can be adapted to non-convex sets.Based on generalized intersection,the utilization of set-based estimation for attack detection is analyzed.Finally,an example is given to show the efficiency of our results.
基金supported by the National Natural Science Foundation of China(62473265,62476176,12426311).
文摘Dear Editor,This letter studies the event-triggered adaptive horizon distributed model predictive control problem for discrete-time coupled nonlinear systems with additive disturbances.By constructing a new dualmodel optimal control problem,an event-triggered mechanism and an adaptive prediction horizon scheme are co-designed in the proposed scheme.Notably,the upper bound of the triggering interval remains independent of the dynamically shrinking prediction horizon.This enables the event-triggered mechanism to operate effectively even when the prediction horizon becomes zero,thus achieving cost savings throughout the control process.In addition,the sufficient conditions of the proposed scheme associated with the feasibility and stability are provided.The effectiveness is illustrated through a practical example.
基金supported in part by the National Science and Technology Council under Grant NSTC 114-2221-E-027-104.
文摘Trajectory tracking for nonlinear robotic systems remains a fundamental yet challenging problem in control engineering,particularly when both precision and efficiency must be ensured.Conventional control methods are often effective for stabilization but may not directly optimize long-term performance.To address this limitation,this study develops an integrated framework that combines optimal control principles with reinforcement learning for a single-link robotic manipulator.The proposed scheme adopts an actor–critic structure,where the critic network approximates the value function associated with the Hamilton–Jacobi–Bellman equation,and the actor network generates near-optimal control signals in real time.This dual adaptation enables the controller to refine its policy online without explicit system knowledge.Stability of the closed-loop system is analyzed through Lyapunov theory,ensuring boundedness of the tracking error.Numerical simulations on the single-link manipulator demonstrate that themethod achieves accurate trajectory followingwhile maintaining lowcontrol effort.The results further showthat the actor–critic learning mechanism accelerates convergence of the control policy compared with conventional optimization-based strategies.This work highlights the potential of reinforcement learning integrated with optimal control for robotic manipulators and provides a foundation for future extensions to more complex multi-degree-of-freedom systems.The proposed controller is further validated in a physics-based virtual Gazebo environment,demonstrating stable adaptation and real-time feasibility.
基金supported by the Science Center Program of National Natural Science Foundation of China under Grant 62188101the National Natural Science Foundation of China under Grant 62573265.
文摘This study develops an event-triggered control strategy utilizing the fully actuated system approach for nonlinear interconnected large-scale systems containing actuator failures.First,to reduce the complexity of the design process,we transform the studied system into the form of a fully actuated system through a state transformation.Then,to address the unknown nonlinear functions and actuator fault parameters,we employ neural networks and adaptive estimation techniques,respectively.Moreover,to reduce the control cost and improve the control efficiency,we introduce event-triggered inputs into the control strategy.It is proved by the Lyapunov stability analysis that all signals of the closed-loop system are bounded and the output of system eventually converge to a bounded region.The efficacy of the control approach is ultimately demonstrated via the simulation of an actual machine feeding system.
基金supported in part by the National Natural Science Foundation of China(62473221)the Natural Science Foundation of Shandong Province,China(ZR2024MF006)Qingdao Natural Science Foundation(24-4-4-zrjj-165-jch)。
文摘This paper is concerned with event-triggered control of discrete-time systems with or without input saturation.First,an accumulative-error-based event-triggered scheme is devised for control updates.When the accumulated error between the current state and the latest control update exceeds a certain threshold,an event is triggered.Such a scheme can ensure the event-generator works at a relatively low rate rather than falls into hibernation especially after the system steps into its steady state.Second,the looped functional method for continuous-time systems is extended to discrete-time systems.By introducing an innovative looped functional that links the event-triggered scheme,some sufficient conditions for the co-design of control gain and event-triggered parameters are obtained in terms of linear matrix inequalities with a couple of tuning parameters.Then,the proposed method is applied to discrete-time systems with input saturation.As a result,both suitable control gains and event-triggered parameters are also co-designed to ensure the system trajectories converge to the region of attraction.Finally,an unstable reactor system and an inverted pendulum system are given to show the effectiveness of the proposed method.
文摘The paper presents an adaptive controller formulated for a class of nonaffine discrete-time systems with non-strict forms and unknown dynamics.The controller operates based solely on the measured output,thus obviating the need for knowledge of the physical order of the controlled plant.Utilizing an ideal solution and equivalent dynamics,the approach integrates an adaptive network with feedback and robust controllers to establish a closed-loop system.A learning law is derived under practical conditions of the designed parameters,ensuring effective closed-loop performance based on pure-output feedback.The controller’s effectiveness is validated through both numerical and experimental systems,with results meeting the conditions specified in the main theorem.Comparative analysis highlights the controller’s highly satisfactory performance and its advantages.This research offers a promising approach to adaptive control for discrete-time systems with non-strict dynamics,providing practical solutions for systems with unknown dynamics and indeterminate system order.
基金This work was supported by the National Science Fund for Distinguished Young Scholars(No.61225014)the National Major Scientific Instruments Development Project(No.61527811)+2 种基金the National Natural Science Foundation of China(Nos.61304084,61374119)the Guangdong Natural Science Foundation(No.2014A030312005)the Space Intelligent Control Key Laboratory of Science and Technology for National Defense.
文摘Recently,an approach for the rapid detection of small oscillation faults based on deterministic learning theory was proposed for continuous-time systems.In this paper,a fault detection scheme is proposed for a class of nonlinear discrete-time systems via deterministic learning.By using a discrete-time extension of deterministic learning algorithm,the general fault functions(i.e.,the internal dynamics)underlying normal and fault modes of nonlinear discrete-time systems are locally-accurately approximated by discrete-time dynamical radial basis function(RBF)networks.Then,a bank of estimators with the obtained knowledge of system dynamics embedded is constructed,and a set of residuals are obtained and used to measure the differences between the dynamics of the monitored system and the dynamics of the trained systems.A fault detection decision scheme is presented according to the smallest residual principle,i.e.,the occurrence of a fault can be detected in a discrete-time setting by comparing the magnitude of residuals.The fault detectability analysis is carried out and the upper bound of detection time is derived.A simulation example is given to illustrate the effectiveness of the proposed scheme.
基金surported by Tianjin Science and Technology Development for Higher Education(20051206).
文摘An indirect adaptive fuzzy control scheme is developed for a class of nonlinear discrete-time systems. In this method, two fuzzy logic systems are used to approximate the unknown functions, and the parameters of membership functions in fuzzy logic systems are adjusted according to adaptive laws for the purpose of controlling the plant to track a reference trajectory. It is proved that the scheme can not only guarantee the boundedness of the input and output of the closed-loop system, but also make the tracking error converge to a small neighborhood of the origin. Simulation results indicate the effectiveness of this scheme.
基金supported by the National Natural Science Foundation of China(61074004)the Research Fund for the Doctoral Program of Higher Education(20110121110017)
文摘Transient performance for output regulation problems of linear discrete-time systems with input saturation is addressed by using the composite nonlinear feedback（CNF） control technique. The regulator is designed to be an additive combination of a linear regulator part and a nonlinear feedback part. The linear regulator part solves the regulation problem independently which produces a quick output response but large oscillations. The nonlinear feedback part with well-tuned parameters is introduced to improve the transient performance by smoothing the oscillatory convergence. It is shown that the introduction of the nonlinear feedback part does not change the solvability conditions of the linear discrete-time output regulation problem. The effectiveness of transient improvement is illustrated by a numeric example.
基金supported in part by National Natural Science Foundation of China(Grant Nos.6137410561233001+1 种基金61273140)in part by Beijing Natural Science Foundation(Grant No.4132078)
文摘In this paper, a novel iterative Q-learning algorithm, called "policy iteration based deterministic Qlearning algorithm", is developed to solve the optimal control problems for discrete-time deterministic nonlinear systems. The idea is to use an iterative adaptive dynamic programming(ADP) technique to construct the iterative control law which optimizes the iterative Q function. When the optimal Q function is obtained, the optimal control law can be achieved by directly minimizing the optimal Q function, where the mathematical model of the system is not necessary. Convergence property is analyzed to show that the iterative Q function is monotonically non-increasing and converges to the solution of the optimality equation. It is also proven that any of the iterative control laws is a stable control law. Neural networks are employed to implement the policy iteration based deterministic Q-learning algorithm, by approximating the iterative Q function and the iterative control law, respectively. Finally, two simulation examples are presented to illustrate the performance of the developed algorithm.
基金supported by Fundamental Research Funds for the Central Universities(Nos. CDJXS10170008 and CDJXS10171101)
文摘This paper investigates a sliding-mode model predictive control （MPC） algorithm with auxiliary contractive sliding vector constraint for constrained nonlinear discrete-time systems. By adding contractive constraint into the optimization problem in regular sliding-mode MPC algorithm, the value of the sliding vector is decreased to zero asymptotically, which means that the system state is driven into a vicinity of sliding surface with a certain width. Then, the system state moves along the sliding surface to the equilibrium point within the vicinity. By applying the proposed algorithm, the stability of the closed-loop system is guaranteed. A numerical example of a continuous stirred tank reactor （CSTR） system is given to verify the feasibility and effectiveness of the proposed method.
文摘This paper presents a robust sliding mode controller for a class of unknown nonlinear discrete-time systems in the presence of fixed time delay. A neural-network approximation and the Lyapunov-Krasovskii functional theory into the sliding-mode technique is used and a neural-network based sliding mode control scheme is proposed. Because of the novality of Chebyshev Neural Networks (CNNs), that it requires much less computation time as compare to multi layer neural network (MLNN), is preferred to approximate the unknown system functions. By means of linear matrix inequalities, a sufficient condition is derived to ensure the asymptotic stability such that the sliding mode dynamics is restricted to the defined sliding surface. The proposed sliding mode control technique guarantees the system state trajectory to the designed sliding surface. Finally, simulation results illustrate the main characteristics and performance of the proposed approach.
文摘An uncertain nonlinear discrete-time system model with time-varying input delays for networked control systems (NCSs) is presented. The problem of exponential stability for the system is considered and some new criteria of exponential stability are obtained based on norm inequality methods. A numerical example is given todemonstrate that those criteria are useful to analyzing the stability of nonlinear NCSs.
文摘This paper discusses about the stabilization of unknown nonlinear discrete-time fixed state delay systems. The unknown system nonlinearity is approximated by Chebyshev neural network (CNN), and weight update law is presented for approximating the system nonlinearity. Using appropriate Lyapunov-Krasovskii functional the stability of the nonlinear system is ensured by the solution of linear matrix inequalities. Finally, a relevant example is given to illustrate the effectiveness of the proposed control scheme.
基金Project supported by the National Natural Science Foundation of China (Grant Nos. 50977008,60821063 and 61034005)National Basic Research Program of China (Grant No. 2009CB32060)
文摘This paper concerns the absolute stability problem of discrete-time descriptor systems with feedback connected ferromagnetic hysteresis nonlinearities. The ferromagnetic hysteresis model satisfies the passivity conditions of hysteresis operator, that is the input-output relation of the transformed operator is passive. The bound condition of the solution of the ferromagnetic hysteresis model is given. Through the framework of loop transformation, an augmented discrete-time descriptor system model is established for the stability analysis. A new extended Tsypkin criterion for the absolute stability of discrete-time descriptor systems with hysteresis is presented based on the linear matrix inequalities technique. A numerical example is given to illustrate the effectiveness of the extended criterion.
文摘The left-inverse system with minimal order and its algorithms of discrete-time nonlinear systems are studied in a linear algebraic framework.The general structure of left-inverse system is described and computed in symbolic algorithm.Two algorithms are given for constructing left-inverse systems with minimal order.
基金Supported by National Natural science Foundation-of P.R.Chlna （60474038, 60774022）, Specialized Research Fund for the Doctoral Program of Higher Educatlon（20060004002）
