As wireless sensor network becomes pervasive, new requirements have been continuously emerged. How-ever, the most of research efforts in wireless sensor network are focused on energy problem since the nodes are usuall...As wireless sensor network becomes pervasive, new requirements have been continuously emerged. How-ever, the most of research efforts in wireless sensor network are focused on energy problem since the nodes are usually battery-powered. Among these requirements, real-time communication is one of the big research challenges in wireless sensor networks because most of query messages carry time information. To meet this requirement, recently several real-time medium access control protocols have been proposed for wireless sensor networks in the literature because waiting time to share medium on each node is one of main source for end-to-end delay. In this paper, we first introduce the specific requirement of wireless sensor real-time MAC protocol. Then, a collection of recent wireless sensor real-time MAC protocols are surveyed, classified, and described emphasizing their advantages and disadvantages whenever possible. Finally we present a dis-cussion about the challenges of current wireless sensor real-time MAC protocols in the literature, and show the conclusion in the end.展开更多
A parallel neural network-based controller （PNNC） is presented for the motion control of underwater vehicles in this paper. It consists of a real-time part, a self-learning part and a desired-state programmer, and i...A parallel neural network-based controller （PNNC） is presented for the motion control of underwater vehicles in this paper. It consists of a real-time part, a self-learning part and a desired-state programmer, and it is different from normal adaptive neural network controller in structure. Owing to the introduction of the self-learning part, on-line learning can be performed without sample data in several sample periods, resulting in high learning speed of the controller and good control performance. The desired-state programmer is utilized to obtain better learning samples of the neural network to keep the stability of the controller. The developed controller is applied to the 4-degree of freedom control of the AUV “IUV- IV” and is successful on the simulation platform. The control performance is also compared with that of neural network controller with different structures such as normal adaptive neural network and different learning methods. Current effects and surge velocity control are also included to demonstrate the controller＇ s performance. It is shown that the PNNC has a great possibility to solve the problems in the control system design of underwater vehicles.展开更多
With the increasing data volume of train on-board system,real-time performance has become the most critical factor to ensure the safety of train operation.Considering that standard Ethernet cannot meet the real-time r...With the increasing data volume of train on-board system,real-time performance has become the most critical factor to ensure the safety of train operation.Considering that standard Ethernet cannot meet the real-time requirement of existing train communication network(TCN),the time-sensitive network(TSN)technology for TCN is introduced.To solve the time-delay problem,an adaptive switch queue selection mechanism for traffic scheduling is proposed.Firstly,the topology model of TCN based on TSN and the traffic model are described.Then,the K shortest path routing algorithm based on load balancing provides the optimal routing for the scheduling process.Finally,the adaptive switch queue selection mechanism is introduced to solve the aggregation flow conflict problem effectively,queue resources are properly allocated,and the gate control list(GCL)of each frame in the queue is obtained.Experimental results show that compared with the traditional constraint model,the schedulability of the model with an adaptive switch queue selection mechanism increases by 33.0%,and the maximum end-to-end delay and network jitter decrease by 19.1%and 18.6%on average respectively.It can provide theoretical support and application reference for the real-time performance optimization of TCN based on TSN.展开更多
Time-sensitive networks(TSNs)support not only traditional best-effort communications but also deterministic communications,which send each packet at a deterministic time so that the data transmissions of networked con...Time-sensitive networks(TSNs)support not only traditional best-effort communications but also deterministic communications,which send each packet at a deterministic time so that the data transmissions of networked control systems can be precisely scheduled to guarantee hard real-time constraints.No-wait scheduling is suitable for such TSNs and generates the schedules of deterministic communications with the minimal network resources so that all of the remaining resources can be used to improve the throughput of best-effort communications.However,due to inappropriate message fragmentation,the realtime performance of no-wait scheduling algorithms is reduced.Therefore,in this paper,joint algorithms of message fragmentation and no-wait scheduling are proposed.First,a specification for the joint problem based on optimization modulo theories is proposed so that off-the-shelf solvers can be used to find optimal solutions.Second,to improve the scalability of our algorithm,the worst-case delay of messages is analyzed,and then,based on the analysis,a heuristic algorithm is proposed to construct low-delay schedules.Finally,we conduct extensive test cases to evaluate our proposed algorithms.The evaluation results indicate that,compared to existing algorithms,the proposed joint algorithm improves schedulability by up to 50%.展开更多
The COVID-19 pandemic has shown that there is a lack of healthcare facilities to cope with a pandemic.This has also underscored the immediate need to rapidly develop hospitals capable of dealing with infectious patien...The COVID-19 pandemic has shown that there is a lack of healthcare facilities to cope with a pandemic.This has also underscored the immediate need to rapidly develop hospitals capable of dealing with infectious patients and to rapidly change in supply lines to manufacture the prescription goods(including medicines)that is needed to prevent infection and treatment for infected patients.The COVID-19 has shown the utility of intelligent autonomous robots that assist human efforts to combat a pandemic.The artificial intelligence based on neural networks and deep learning can help to fight COVID-19 in many ways,particularly in the control of autonomous medic robots.Health officials aim to curb the spread of COVID-19 among medical,nursing staff and patients by using intelligent robots.We propose an advanced controller for a service robot to be used in hospitals.This type of robot is deployed to deliver food and dispense medications to individual patients.An autonomous line-follower robot that can sense and follow a line drawn on the floor and drive through the rooms of patients with control of its direction.These criteria were met by using two controllers simultaneously:a deep neural network controller to predict the trajectory of movement and a proportional-integral-derivative(PID)controller for automatic steering and speed control.展开更多
Safety-critical applications such as the independently driving systems of electric vehicle （EV） require a high degree of reliability. The controller area network （CAN） is used extensively in the control sectors. A...Safety-critical applications such as the independently driving systems of electric vehicle （EV） require a high degree of reliability. The controller area network （CAN） is used extensively in the control sectors. A new real-time and reliable scheduling algorithm based on time-triggered scheduler with a focus on the CAN-based distributed control systems for independently driving EV is exploited. A distributed control network model for a dual-wheel independendy driving EV is established. The timing and reliabili- ty analysis in the worst case with the algorithm is used to evaluate the predictability and dependability and the simulation based on the algorithm with CANoe software is designed. The results indicate the algorithm is more predicable and dependable.展开更多
A complete scheme for solving the key scientific problems associated with high-standard,high-intensity continuous construction of high arch dams was presented. First,based on a coupling analysis of construction system...A complete scheme for solving the key scientific problems associated with high-standard,high-intensity continuous construction of high arch dams was presented. First,based on a coupling analysis of construction system decomposition and coordination for a high arc dam,a mathematical model for real-time control of construction quality and progress that considers complex constraints was developed. Second,a method of progress control was proposed based on a dynamic simulation. Third,a dynamic quality control mechanism was established based on construction information collected using a PDA. Fourth,a system for integrating collected information,progress simulation and quality control analyses under a network environment was developed. Finally,these methods were applied to a practical project to show that each aspect of a construction process can be managed effectively and that real-time monitoring and feedback control can be realized. Our methods provide new theoretical principles and technical measures for quality and progress control in the high arc dam construction process.展开更多
The increasing integration of intermittent renewable energy sources(RESs)poses great challenges to active distribution networks(ADNs),such as frequent voltage fluctuations.This paper proposes a novel ADN strategy base...The increasing integration of intermittent renewable energy sources(RESs)poses great challenges to active distribution networks(ADNs),such as frequent voltage fluctuations.This paper proposes a novel ADN strategy based on multiagent deep reinforcement learning(MADRL),which harnesses the regulating function of switch state transitions for the realtime voltage regulation and loss minimization.After deploying the calculated optimal switch topologies,the distribution network operator will dynamically adjust the distributed energy resources(DERs)to enhance the operation performance of ADNs based on the policies trained by the MADRL algorithm.Owing to the model-free characteristics and the generalization of deep reinforcement learning,the proposed strategy can still achieve optimization objectives even when applied to similar but unseen environments.Additionally,integrating parameter sharing(PS)and prioritized experience replay(PER)mechanisms substantially improves the strategic performance and scalability.This framework has been tested on modified IEEE 33-bus,IEEE 118-bus,and three-phase unbalanced 123-bus systems.The results demonstrate the significant real-time regulation capabilities of the proposed strategy.展开更多
In this study,a real-time optimal control approach is proposed using an interactive deep reinforcement learning algorithm for the Moon fuel-optimal landing problem.Considering the remote communication restrictions and...In this study,a real-time optimal control approach is proposed using an interactive deep reinforcement learning algorithm for the Moon fuel-optimal landing problem.Considering the remote communication restrictions and environmental uncertainties,advanced landing control techniques are demanded to meet the high requirements of real-time performance and autonomy in the Moon landing missions.Deep reinforcement learning(DRL)algorithms have been recently developed for real-time optimal control but suffer the obstacles of slow convergence and difficult reward function design.To address these problems,a DRL algorithm is developed using an actor-indirect method architecture to achieve the optimal control of the Moon landing mission.In this DRL algorithm,an indirect method is employed to generate the optimal control actions for the deep neural network(DNN)learning,while the trained DNNs provide good initial guesses for the indirect method to promote the efficiency of training data generation.Through sufficient learning of the state-action relationship,the trained DNNs can approximate the optimal actions and steer the spacecraft to the target in real time.Additionally,a nonlinear feedback controller is developed to improve the terminal landing accuracy.Numerical simulations are given to verify the effectiveness of the proposed DRL algorithm and demonstrate the performance of the developed optimal landing controller.展开更多
文摘As wireless sensor network becomes pervasive, new requirements have been continuously emerged. How-ever, the most of research efforts in wireless sensor network are focused on energy problem since the nodes are usually battery-powered. Among these requirements, real-time communication is one of the big research challenges in wireless sensor networks because most of query messages carry time information. To meet this requirement, recently several real-time medium access control protocols have been proposed for wireless sensor networks in the literature because waiting time to share medium on each node is one of main source for end-to-end delay. In this paper, we first introduce the specific requirement of wireless sensor real-time MAC protocol. Then, a collection of recent wireless sensor real-time MAC protocols are surveyed, classified, and described emphasizing their advantages and disadvantages whenever possible. Finally we present a dis-cussion about the challenges of current wireless sensor real-time MAC protocols in the literature, and show the conclusion in the end.
文摘A parallel neural network-based controller （PNNC） is presented for the motion control of underwater vehicles in this paper. It consists of a real-time part, a self-learning part and a desired-state programmer, and it is different from normal adaptive neural network controller in structure. Owing to the introduction of the self-learning part, on-line learning can be performed without sample data in several sample periods, resulting in high learning speed of the controller and good control performance. The desired-state programmer is utilized to obtain better learning samples of the neural network to keep the stability of the controller. The developed controller is applied to the 4-degree of freedom control of the AUV “IUV- IV” and is successful on the simulation platform. The control performance is also compared with that of neural network controller with different structures such as normal adaptive neural network and different learning methods. Current effects and surge velocity control are also included to demonstrate the controller＇ s performance. It is shown that the PNNC has a great possibility to solve the problems in the control system design of underwater vehicles.
基金supported by the National Natural Science Foundation of China(52072081)Major Project of Science and Technology of Guangxi Province of China(Guike AB23075209)+2 种基金Guangxi Manufacturing Systems and Advanced Manufacturing Technology Key Laboratory Director Fund(24050-44-S015)Innovation Project of Guangxi Graduate Education(YCSW2024135)Major Talent Project in Guangxi Zhuang Autonomous Region。
文摘With the increasing data volume of train on-board system,real-time performance has become the most critical factor to ensure the safety of train operation.Considering that standard Ethernet cannot meet the real-time requirement of existing train communication network(TCN),the time-sensitive network(TSN)technology for TCN is introduced.To solve the time-delay problem,an adaptive switch queue selection mechanism for traffic scheduling is proposed.Firstly,the topology model of TCN based on TSN and the traffic model are described.Then,the K shortest path routing algorithm based on load balancing provides the optimal routing for the scheduling process.Finally,the adaptive switch queue selection mechanism is introduced to solve the aggregation flow conflict problem effectively,queue resources are properly allocated,and the gate control list(GCL)of each frame in the queue is obtained.Experimental results show that compared with the traditional constraint model,the schedulability of the model with an adaptive switch queue selection mechanism increases by 33.0%,and the maximum end-to-end delay and network jitter decrease by 19.1%and 18.6%on average respectively.It can provide theoretical support and application reference for the real-time performance optimization of TCN based on TSN.
基金partially supported by National Key Research and Development Program of China(2018YFB1700200)National Natural Science Foundation of China(61972389,61903356,61803368,U1908212)+2 种基金Youth Innovation Promotion Association of the Chinese Academy of Sciences,National Science and Technology Major Project(2017ZX02101007-004)Liaoning Provincial Natural Science Foundation of China(2020-MS-034,2019-YQ-09)China Postdoctoral Science Foundation(2019M661156)。
文摘Time-sensitive networks(TSNs)support not only traditional best-effort communications but also deterministic communications,which send each packet at a deterministic time so that the data transmissions of networked control systems can be precisely scheduled to guarantee hard real-time constraints.No-wait scheduling is suitable for such TSNs and generates the schedules of deterministic communications with the minimal network resources so that all of the remaining resources can be used to improve the throughput of best-effort communications.However,due to inappropriate message fragmentation,the realtime performance of no-wait scheduling algorithms is reduced.Therefore,in this paper,joint algorithms of message fragmentation and no-wait scheduling are proposed.First,a specification for the joint problem based on optimization modulo theories is proposed so that off-the-shelf solvers can be used to find optimal solutions.Second,to improve the scalability of our algorithm,the worst-case delay of messages is analyzed,and then,based on the analysis,a heuristic algorithm is proposed to construct low-delay schedules.Finally,we conduct extensive test cases to evaluate our proposed algorithms.The evaluation results indicate that,compared to existing algorithms,the proposed joint algorithm improves schedulability by up to 50%.
基金the Deanship of Scientific Research at King Saud University for its funding of this research through the Research Group No.RG-1439/007.
文摘The COVID-19 pandemic has shown that there is a lack of healthcare facilities to cope with a pandemic.This has also underscored the immediate need to rapidly develop hospitals capable of dealing with infectious patients and to rapidly change in supply lines to manufacture the prescription goods(including medicines)that is needed to prevent infection and treatment for infected patients.The COVID-19 has shown the utility of intelligent autonomous robots that assist human efforts to combat a pandemic.The artificial intelligence based on neural networks and deep learning can help to fight COVID-19 in many ways,particularly in the control of autonomous medic robots.Health officials aim to curb the spread of COVID-19 among medical,nursing staff and patients by using intelligent robots.We propose an advanced controller for a service robot to be used in hospitals.This type of robot is deployed to deliver food and dispense medications to individual patients.An autonomous line-follower robot that can sense and follow a line drawn on the floor and drive through the rooms of patients with control of its direction.These criteria were met by using two controllers simultaneously:a deep neural network controller to predict the trajectory of movement and a proportional-integral-derivative(PID)controller for automatic steering and speed control.
基金Supported by the National High Technology Research and Development Programme of China （No. （2008AA11 A146 ）, China Postdoctoral Science Foundation （20090450298）.
文摘Safety-critical applications such as the independently driving systems of electric vehicle （EV） require a high degree of reliability. The controller area network （CAN） is used extensively in the control sectors. A new real-time and reliable scheduling algorithm based on time-triggered scheduler with a focus on the CAN-based distributed control systems for independently driving EV is exploited. A distributed control network model for a dual-wheel independendy driving EV is established. The timing and reliabili- ty analysis in the worst case with the algorithm is used to evaluate the predictability and dependability and the simulation based on the algorithm with CANoe software is designed. The results indicate the algorithm is more predicable and dependable.
基金supported by the National Basic Research Program of China("973"Project)(Grant No.2007CB714101)the National Key Technology R&D Program in the11th Five-year Plan of China(Grant No.2008BAB29B0501)the National Natural Science Foundation of China(Grant No.90815019)
文摘A complete scheme for solving the key scientific problems associated with high-standard,high-intensity continuous construction of high arch dams was presented. First,based on a coupling analysis of construction system decomposition and coordination for a high arc dam,a mathematical model for real-time control of construction quality and progress that considers complex constraints was developed. Second,a method of progress control was proposed based on a dynamic simulation. Third,a dynamic quality control mechanism was established based on construction information collected using a PDA. Fourth,a system for integrating collected information,progress simulation and quality control analyses under a network environment was developed. Finally,these methods were applied to a practical project to show that each aspect of a construction process can be managed effectively and that real-time monitoring and feedback control can be realized. Our methods provide new theoretical principles and technical measures for quality and progress control in the high arc dam construction process.
基金supported by the National Natural Science Foundation of China(No.52077146)Sichuan Science and Technology Program(No.2023NSFSC1945)。
文摘The increasing integration of intermittent renewable energy sources(RESs)poses great challenges to active distribution networks(ADNs),such as frequent voltage fluctuations.This paper proposes a novel ADN strategy based on multiagent deep reinforcement learning(MADRL),which harnesses the regulating function of switch state transitions for the realtime voltage regulation and loss minimization.After deploying the calculated optimal switch topologies,the distribution network operator will dynamically adjust the distributed energy resources(DERs)to enhance the operation performance of ADNs based on the policies trained by the MADRL algorithm.Owing to the model-free characteristics and the generalization of deep reinforcement learning,the proposed strategy can still achieve optimization objectives even when applied to similar but unseen environments.Additionally,integrating parameter sharing(PS)and prioritized experience replay(PER)mechanisms substantially improves the strategic performance and scalability.This framework has been tested on modified IEEE 33-bus,IEEE 118-bus,and three-phase unbalanced 123-bus systems.The results demonstrate the significant real-time regulation capabilities of the proposed strategy.
基金This work is supported by the National Natural Science Foundation of China(Grants Nos.11672146 and 11432001).
文摘In this study,a real-time optimal control approach is proposed using an interactive deep reinforcement learning algorithm for the Moon fuel-optimal landing problem.Considering the remote communication restrictions and environmental uncertainties,advanced landing control techniques are demanded to meet the high requirements of real-time performance and autonomy in the Moon landing missions.Deep reinforcement learning(DRL)algorithms have been recently developed for real-time optimal control but suffer the obstacles of slow convergence and difficult reward function design.To address these problems,a DRL algorithm is developed using an actor-indirect method architecture to achieve the optimal control of the Moon landing mission.In this DRL algorithm,an indirect method is employed to generate the optimal control actions for the deep neural network(DNN)learning,while the trained DNNs provide good initial guesses for the indirect method to promote the efficiency of training data generation.Through sufficient learning of the state-action relationship,the trained DNNs can approximate the optimal actions and steer the spacecraft to the target in real time.Additionally,a nonlinear feedback controller is developed to improve the terminal landing accuracy.Numerical simulations are given to verify the effectiveness of the proposed DRL algorithm and demonstrate the performance of the developed optimal landing controller.
