In this paper, an online optimal distributed learning algorithm is proposed to solve leader-synchronization problem of nonlinear multi-agent differential graphical games. Each player approximates its optimal control p...In this paper, an online optimal distributed learning algorithm is proposed to solve leader-synchronization problem of nonlinear multi-agent differential graphical games. Each player approximates its optimal control policy using a single-network approximate dynamic programming(ADP) where only one critic neural network(NN) is employed instead of typical actorcritic structure composed of two NNs. The proposed distributed weight tuning laws for critic NNs guarantee stability in the sense of uniform ultimate boundedness(UUB) and convergence of control policies to the Nash equilibrium. In this paper, by introducing novel distributed local operators in weight tuning laws, there is no more requirement for initial stabilizing control policies. Furthermore, the overall closed-loop system stability is guaranteed by Lyapunov stability analysis. Finally, Simulation results show the effectiveness of the proposed algorithm.展开更多
This paper introduces a model-free reinforcement learning technique that is used to solve a class of dynamic games known as dynamic graphical games. The graphical game results from to make all the agents synchronize t...This paper introduces a model-free reinforcement learning technique that is used to solve a class of dynamic games known as dynamic graphical games. The graphical game results from to make all the agents synchronize to the state of a command multi-agent dynamical systems, where pinning control is used generator or a leader agent. Novel coupled Bellman equations and Hamiltonian functions are developed for the dynamic graphical games. The Hamiltonian mechanics are used to derive the necessary conditions for optimality. The solution for the dynamic graphical game is given in terms of the solution to a set of coupled Hamilton-Jacobi-Bellman equations developed herein. Nash equilibrium solution for the graphical game is given in terms of the solution to the underlying coupled Hamilton-Jacobi-Bellman equations. An online model-free policy iteration algorithm is developed to learn the Nash solution for the dynamic graphical game. This algorithm does not require any knowledge of the agents＇ dynamics. A proof of convergence for this multi-agent learning algorithm is given under mild assumption about the inter-connectivity properties of the graph. A gradient descent technique with critic network structures is used to implement the policy iteration algorithm to solve the graphical game online in real-time.展开更多
Fractional order controllers have been used intensively over the last decades in controlling different types of processes. The main methods for tuning such controllers are based on a frequency domain approach followed...Fractional order controllers have been used intensively over the last decades in controlling different types of processes. The main methods for tuning such controllers are based on a frequency domain approach followed by optimization routine, generally in the form of the Matlab fminsearch, but also evolving to more complex routines, such as the genetic algorithms. An alternative to these time consuming optimization routines, a simple graphical method has been proposed. However, these graphical methods are not suitable for all combinations of the imposed performance specifications. To preserve their simplicity, but also to make these graphical methods generally applicable, a modified graphical method using a very straightforward and simple optimization routine is proposed within the paper. Two case studies are presented, for tuning fractional order PI and PD controllers.展开更多
The design of a wireless water level control system is introduced and discussed in detail. In this system, the wireless Proportional Integral (PI) controller is developed using the LabVIEW graphical user programming l...The design of a wireless water level control system is introduced and discussed in detail. In this system, the wireless Proportional Integral (PI) controller is developed using the LabVIEW graphical user programming language. Zigbee wireless technology is chosen for the wireless data transfer system. The experimental testbed was built and the system software and hardware were implemented. In order to compare the performance of the wired and wireless system, a corresponding wired water level control system was built. Experimental results show that under the same PI parameters, the settling time of the wired system is 3.3 times faster than the wireless system. However, the percent overshoot using the wireless controller is 4% smaller.展开更多
Different programming languages can be used for discrete, abstract and process-oriented programming. Depending on the application, there exist additional requirements, which are not fulfilled by every programming lang...Different programming languages can be used for discrete, abstract and process-oriented programming. Depending on the application, there exist additional requirements, which are not fulfilled by every programming language. Flexible programming and maintainability are especially important requirements for process engineers. In this paper, the programming languages Activity Diagram, State Chart Diagram and Sequential Function Chart are compared and evaluated with regard to these requirements. This evaluation is based on the principles of cognitive effectiveness and cognitive dimensions. The aim of this paper is to identify the programming language suited best for controlling sequential processes, e.g. thermomechanical or batch processes.展开更多
如何将数据库中的数据以图形的方式直观地显示出来,一直是程序开发人员努力解决的问题.作者阐述了基于ADO(ActiveX Data Objects)对象的,利用Visual Basic开发环境自带的MSChart控件生成动态统计图的方法,介绍生成动态统计图的具体步骤...如何将数据库中的数据以图形的方式直观地显示出来,一直是程序开发人员努力解决的问题.作者阐述了基于ADO(ActiveX Data Objects)对象的,利用Visual Basic开发环境自带的MSChart控件生成动态统计图的方法,介绍生成动态统计图的具体步骤,指出MSChart控件在生成动态统计图方面的不足之处,并提出相关的改进方法.结合河南省航道基础地理信息系统的开发实例进行分析,表明这种方法具有很好的应用价值.展开更多
文摘In this paper, an online optimal distributed learning algorithm is proposed to solve leader-synchronization problem of nonlinear multi-agent differential graphical games. Each player approximates its optimal control policy using a single-network approximate dynamic programming(ADP) where only one critic neural network(NN) is employed instead of typical actorcritic structure composed of two NNs. The proposed distributed weight tuning laws for critic NNs guarantee stability in the sense of uniform ultimate boundedness(UUB) and convergence of control policies to the Nash equilibrium. In this paper, by introducing novel distributed local operators in weight tuning laws, there is no more requirement for initial stabilizing control policies. Furthermore, the overall closed-loop system stability is guaranteed by Lyapunov stability analysis. Finally, Simulation results show the effectiveness of the proposed algorithm.
基金supported by the Deanship of Scientific Research at King Fahd University of Petroleum & Minerals Project(No.JF141002)the National Science Foundation(No.ECCS-1405173)+3 种基金the Office of Naval Research(Nos.N000141310562,N000141410718)the U.S. Army Research Office(No.W911NF-11-D-0001)the National Natural Science Foundation of China(No.61120106011)the Project 111 from the Ministry of Education of China(No.B08015)
文摘This paper introduces a model-free reinforcement learning technique that is used to solve a class of dynamic games known as dynamic graphical games. The graphical game results from to make all the agents synchronize to the state of a command multi-agent dynamical systems, where pinning control is used generator or a leader agent. Novel coupled Bellman equations and Hamiltonian functions are developed for the dynamic graphical games. The Hamiltonian mechanics are used to derive the necessary conditions for optimality. The solution for the dynamic graphical game is given in terms of the solution to a set of coupled Hamilton-Jacobi-Bellman equations developed herein. Nash equilibrium solution for the graphical game is given in terms of the solution to the underlying coupled Hamilton-Jacobi-Bellman equations. An online model-free policy iteration algorithm is developed to learn the Nash solution for the dynamic graphical game. This algorithm does not require any knowledge of the agents＇ dynamics. A proof of convergence for this multi-agent learning algorithm is given under mild assumption about the inter-connectivity properties of the graph. A gradient descent technique with critic network structures is used to implement the policy iteration algorithm to solve the graphical game online in real-time.
文摘Fractional order controllers have been used intensively over the last decades in controlling different types of processes. The main methods for tuning such controllers are based on a frequency domain approach followed by optimization routine, generally in the form of the Matlab fminsearch, but also evolving to more complex routines, such as the genetic algorithms. An alternative to these time consuming optimization routines, a simple graphical method has been proposed. However, these graphical methods are not suitable for all combinations of the imposed performance specifications. To preserve their simplicity, but also to make these graphical methods generally applicable, a modified graphical method using a very straightforward and simple optimization routine is proposed within the paper. Two case studies are presented, for tuning fractional order PI and PD controllers.
文摘The design of a wireless water level control system is introduced and discussed in detail. In this system, the wireless Proportional Integral (PI) controller is developed using the LabVIEW graphical user programming language. Zigbee wireless technology is chosen for the wireless data transfer system. The experimental testbed was built and the system software and hardware were implemented. In order to compare the performance of the wired and wireless system, a corresponding wired water level control system was built. Experimental results show that under the same PI parameters, the settling time of the wired system is 3.3 times faster than the wireless system. However, the percent overshoot using the wireless controller is 4% smaller.
文摘Different programming languages can be used for discrete, abstract and process-oriented programming. Depending on the application, there exist additional requirements, which are not fulfilled by every programming language. Flexible programming and maintainability are especially important requirements for process engineers. In this paper, the programming languages Activity Diagram, State Chart Diagram and Sequential Function Chart are compared and evaluated with regard to these requirements. This evaluation is based on the principles of cognitive effectiveness and cognitive dimensions. The aim of this paper is to identify the programming language suited best for controlling sequential processes, e.g. thermomechanical or batch processes.
文摘如何将数据库中的数据以图形的方式直观地显示出来,一直是程序开发人员努力解决的问题.作者阐述了基于ADO(ActiveX Data Objects)对象的,利用Visual Basic开发环境自带的MSChart控件生成动态统计图的方法,介绍生成动态统计图的具体步骤,指出MSChart控件在生成动态统计图方面的不足之处,并提出相关的改进方法.结合河南省航道基础地理信息系统的开发实例进行分析,表明这种方法具有很好的应用价值.
