Controlling feedback control systems in continuous action spaces has always been a challenging problem.Nevertheless,reinforcement learning is mainly an area of artificial intelligence(AI)because it has been used in pr...Controlling feedback control systems in continuous action spaces has always been a challenging problem.Nevertheless,reinforcement learning is mainly an area of artificial intelligence(AI)because it has been used in process control for more than a decade.However,the existing algorithms are unable to provide satisfactory results.Therefore,this research uses a reinforcement learning(RL)algorithm to manage the control system.We propose an adaptive speed control of the motor system based on depth deterministic strategy gradient(DDPG).The actor-critic scenario using DDPG is implemented to build the RL agent.In addition,a framework has been created for traditional feedback control systems to make RL implementation easier for control systems.The RL algorithms are robust and proficient in using trial and error to search for the best strategy.Our proposed algorithm is a deep deterministic policy gradient,in which a large amount of training data trains the agent.Once the system is trained,the agent can automatically adjust the control parameters.The algorithm has been developed using Python 3.6 and the simulation results are evaluated in the MATLAB/Simulink environment.The performance of the proposed RL algorithm is compared with a proportional integral derivative(PID)controller and a linear quadratic regulator(LQR)controller.The simulation results of the proposed scheme are promising for the feedback control problems.展开更多
Through a detailed analysis of the construction of HT-7, a decoupling model for heating field and vertical field is given. This paper presents a simple introduction of its basic structure. And with a practical design,...Through a detailed analysis of the construction of HT-7, a decoupling model for heating field and vertical field is given. This paper presents a simple introduction of its basic structure. And with a practical design, this model has been successfully applied to the device, procuring a very good controlling of the plasma parameters of HT-7. The performance of individual feedback systems is also analyzed in detail.展开更多
When a feedback system has components described by non-rational transfer functions, a standard practice in designing such a system is to replace the non-rational functions with rational approximants and then carry out...When a feedback system has components described by non-rational transfer functions, a standard practice in designing such a system is to replace the non-rational functions with rational approximants and then carry out the design with the approximants by means of a method that copes with rational systems. In order to ensure that the design carried out with the approximants still provides satisfactory results for the original system, a criterion of approximation should be explicitly taken into account in the design formulation. This paper derives such a criterion for multi-input multi-output（MIMO） feedback systems whose design objective is to ensure that the absolute values of every error and every controller output components always stay within prescribed bounds whenever the inputs satisfy certain bounding conditions. The obtained criterion generalizes a known result which was derived for single-input single-output（SISO） systems; furthermore, for a given rational approximant matrix, it is expressed as a set of inequalities that can be solved in practice. Finally, a controller for a binary distillation column is designed by using the criterion in conjunction with the method of inequalities. The numerical results clearly demonstrate that the usefulness of the criterion in obtaining a design solution for the original system.展开更多
This paper addresses the composite nonlinear feedback（CNF） control for a class of singleinput single-output nonlinear systems with input saturation to track a time varying reference target with good transient perfor...This paper addresses the composite nonlinear feedback（CNF） control for a class of singleinput single-output nonlinear systems with input saturation to track a time varying reference target with good transient performance. The CNF control law consists of a tracking control law and a performance compensator. The tracking control law is designed to drive the output of the system to track the time varying reference target rapidly, while the performance compensator is used to reduce the overshoot caused by the tracking control law. The stability of the closed-loop system is established. The design procedure and the improvement of transient performance of the closed-loop system are illustrated with a numerical example and the controlled Van del Pol oscillator.展开更多
基金This work was supported by the King Saud University in Riyadh,Saudi Arabia,through the Researchers Supporting Project Number(RSP-2021/387).
文摘Controlling feedback control systems in continuous action spaces has always been a challenging problem.Nevertheless,reinforcement learning is mainly an area of artificial intelligence(AI)because it has been used in process control for more than a decade.However,the existing algorithms are unable to provide satisfactory results.Therefore,this research uses a reinforcement learning(RL)algorithm to manage the control system.We propose an adaptive speed control of the motor system based on depth deterministic strategy gradient(DDPG).The actor-critic scenario using DDPG is implemented to build the RL agent.In addition,a framework has been created for traditional feedback control systems to make RL implementation easier for control systems.The RL algorithms are robust and proficient in using trial and error to search for the best strategy.Our proposed algorithm is a deep deterministic policy gradient,in which a large amount of training data trains the agent.Once the system is trained,the agent can automatically adjust the control parameters.The algorithm has been developed using Python 3.6 and the simulation results are evaluated in the MATLAB/Simulink environment.The performance of the proposed RL algorithm is compared with a proportional integral derivative(PID)controller and a linear quadratic regulator(LQR)controller.The simulation results of the proposed scheme are promising for the feedback control problems.
文摘Through a detailed analysis of the construction of HT-7, a decoupling model for heating field and vertical field is given. This paper presents a simple introduction of its basic structure. And with a practical design, this model has been successfully applied to the device, procuring a very good controlling of the plasma parameters of HT-7. The performance of individual feedback systems is also analyzed in detail.
基金financial support from the honour program of the Department of Electrical Engineering,Faculty of Engineering,Chulalongkorn University
文摘When a feedback system has components described by non-rational transfer functions, a standard practice in designing such a system is to replace the non-rational functions with rational approximants and then carry out the design with the approximants by means of a method that copes with rational systems. In order to ensure that the design carried out with the approximants still provides satisfactory results for the original system, a criterion of approximation should be explicitly taken into account in the design formulation. This paper derives such a criterion for multi-input multi-output（MIMO） feedback systems whose design objective is to ensure that the absolute values of every error and every controller output components always stay within prescribed bounds whenever the inputs satisfy certain bounding conditions. The obtained criterion generalizes a known result which was derived for single-input single-output（SISO） systems; furthermore, for a given rational approximant matrix, it is expressed as a set of inequalities that can be solved in practice. Finally, a controller for a binary distillation column is designed by using the criterion in conjunction with the method of inequalities. The numerical results clearly demonstrate that the usefulness of the criterion in obtaining a design solution for the original system.
基金supported by the National Nature Science Foundation of China under Grant Nos.61374035 and 61733017
文摘This paper addresses the composite nonlinear feedback（CNF） control for a class of singleinput single-output nonlinear systems with input saturation to track a time varying reference target with good transient performance. The CNF control law consists of a tracking control law and a performance compensator. The tracking control law is designed to drive the output of the system to track the time varying reference target rapidly, while the performance compensator is used to reduce the overshoot caused by the tracking control law. The stability of the closed-loop system is established. The design procedure and the improvement of transient performance of the closed-loop system are illustrated with a numerical example and the controlled Van del Pol oscillator.
