The multi-robot systems(MRS)exploration and fire searching problem is an important application of mobile robots which require massive computation capability that exceeds the ability of traditional MRS′s.This paper pr...The multi-robot systems(MRS)exploration and fire searching problem is an important application of mobile robots which require massive computation capability that exceeds the ability of traditional MRS′s.This paper propose a cloud-based hybrid decentralized partially observable semi-Markov decision process(HDec-POSMDPs)model.The proposed model is implemented for MRS exploration and fire searching application based on the Internet of things(IoT)cloud robotics framework.In this implementation the heavy and expensive computational tasks are offloaded to the cloud servers.The proposed model achieves a significant improvement in the computation burden of the whole task relative to a traditional MRS.The proposed model is applied to explore and search for fire objects in an unknown environment;using different sets of robots sizes.The preliminary evaluation of this implementation demonstrates that as the parallelism of computational instances increase the delay of new actuation commands which will be decreased,the mean time of task completion is decreased,the number of turns in the path from the start pose cells to the target cells is minimized and the energy consumption for each robot is reduced.展开更多
The wireless cloud robotic system(WCRS),which fully integrates sensing,communication,computing,and control capabilities as an intelligent agent,is a promising way to achieve intelligent manufacturing due to easy deplo...The wireless cloud robotic system(WCRS),which fully integrates sensing,communication,computing,and control capabilities as an intelligent agent,is a promising way to achieve intelligent manufacturing due to easy deployment and flexible expansion.However,the high-precision control of WCRS requires deterministic wireless communication,which is always challenging in the complex and dynamic radio space.This paper employs the reconfigurable intelligent surface(RIS)to establish a novel RIS-assisted WCRS architecture,where the radio channel is controlled to achieve ultra-reliable,low-delay,and low-jitter communication for high-precision closed-loop motion control.However,control and communication are strongly coupled and should be co-optimized.Fully considering the constraints of control input threshold,control delay deadline,beam phase,antenna power,and information distortion,we establish a stability maximization problem to jointly optimize control input compensation,RIS phase shift,and beamforming.Herein,a new jitter-oriented system stability objective with respect to control error and communication jitter is defined and the closed-form expression of control delay deadline is derived based on the Jensen Inequality and Lyapunov-Krasovskii functional.Due to the time-varying and partial observability of the channel and robot states,we model the problem as a partially observable Markov decision process(POMDP).To solve this complex problem,we propose a multi-agent transfer reinforcement learning algorithm named LSTM-PPO-MATRL,where the LSTM-enhanced proximal policy optimization(PPO)is designed to approximate an optimal solution and the option-guided policy transfer learning is proposed to facilitate the learning process.By centralized training and decentralized execution,LSTM-PPO-MATRL is validated by extensive experiments on MuJoCo tasks for both low-mobility and high-mobility robotic control scenarios.The results demonstrate that LSTM-PPO-MATRL not only realizes high learning efficiency,but also supports low-delay,low-jitter communication for low error control,where 71.9%control accuracy improvement and 68.7%delay jitter reduction are achieved compared to the PPO-MADRL baseline.展开更多
The rise in the cases of motor impairing therapy. Due to the current situation that the service illnesses demands the research for improvements in rehabilitation of the professional therapists cannot meet the need of ...The rise in the cases of motor impairing therapy. Due to the current situation that the service illnesses demands the research for improvements in rehabilitation of the professional therapists cannot meet the need of the motorimpaired subjects, a cloud robotic system is proposed to provide an Internet-based process for upper-limb rehabilitation with multimodal interaction. In this system, therapists and subjects are connected through the Internet using client/server architecture. At the client site, gradual virtual games are introduced so that the subjects can control and interact with virtual objects through the interaction devices such as robot arms. Computer graphics show the geometric results and interaction haptic/force is fed back during exercising. Both video/audio information and kinematical/physiological data axe transferred to the therapist for monitoring and analysis. In this way, patients can be diagnosed and directed and therapists can manage therapy sessions remotely. The rehabilitation process can be monitored through the Internet. Expert libraries on the central server can serve as a supervisor and give advice based on the training data and the physiological data. The proposed solution is a convenient application that has several features taking advantage of the extensive technological utilization in the area of physical rehabilitation and multimodal interaction.展开更多
Intelligent Space(IS)is widely regarded as a promising paradigm for improving quality of life through using service task processing.As the field matures,various state-of-the-art IS architectures have been proposed.Mos...Intelligent Space(IS)is widely regarded as a promising paradigm for improving quality of life through using service task processing.As the field matures,various state-of-the-art IS architectures have been proposed.Most of the IS architectures designed for service robots face the problems of fixedfunction modules and low scalability when performing service tasks.To this end,we propose a hybrid cloud service robot architecture based on a Service-Oriented Architecture(SOA).Specifically,we first use the distributed deployment of functional modules to solve the problem of high computing resource occupancy.Then,the Socket communication interface layer is designed to improve the calling efficiency of the function module.Next,the private cloud service knowledge base and the dataset for the home environment are used to improve the robustness and success rate of the robot when performing tasks.Finally,we design and deploy an interactive system based on Browser/Server(B/S)architecture,which aims to display the status of the robot in real-time as well as to expand and call the robot service.This system is integrated into the private cloud framework,which provides a feasible solution for improving the quality of life.Besides,it also fully reveals how to actively discover and provide the robot service mechanism of service tasks in the right way.The results of extensive experiments show that our cloud system provides sufficient prior knowledge that can assist the robot in completing service tasks.It is an efficient way to transmit data and reduce the computational burden on the robot.By using our cloud detection module,the robot system can save approximately 25% of the averageCPUusage and reduce the average detection time by 0.1 s compared to the locally deployed system,demonstrating the reliability and practicality of our proposed architecture.展开更多
A subject who wears a suitable robotic device will be able to walk in complex environments with the aid of environmental recognition schemes that provide reliable prior information of the human motion intent.Researche...A subject who wears a suitable robotic device will be able to walk in complex environments with the aid of environmental recognition schemes that provide reliable prior information of the human motion intent.Researchers have utilized 1 D laser signals and 2 D depth images to classify environments,but those approaches can face the problems of self-occlusion.In comparison,3 D point cloud is more appropriate for depicting the environments.This paper proposes a directional PointNet to directly classify the 3 D point cloud.First,an inertial measurement unit(IMU)is used to offset the orientation of point cloud.Then the directional PointNet can accurately classify the daily commuted terrains,including level ground,climbing up stairways,and walking down stairs.A classification accuracy of 98%has been achieved in tests.Moreover,the directional PointNet is more efficient than the previously used PointNet because the T-net,which is utilized to estimate the transformation of the point cloud,is not used in the present approach,and the length of the global feature is optimized.The experimental results demonstrate that the directional PointNet can classify the environments in robust and efficient manner.展开更多
基金Corresponding au-thor:Ayman El Shenawy received the Ph.D.degree in systems and computer engineer-ing from Al-Azhar University,Egypt in 2013.He is currently working as a lecturer at Systems and Computers Engineering Department,Faculty of Engineering Al-Azhar University,Egypt.He already de-veloped some breakthrough research in the mentioned areas.He made significant con-tributions to the stated research fields.His research interests include artificial intelligent methods,robotics and machine learning.E-mail:eaymanelshenawy@azhar.edu.eg ORCID iD:0000-0002-1309-644。
文摘The multi-robot systems(MRS)exploration and fire searching problem is an important application of mobile robots which require massive computation capability that exceeds the ability of traditional MRS′s.This paper propose a cloud-based hybrid decentralized partially observable semi-Markov decision process(HDec-POSMDPs)model.The proposed model is implemented for MRS exploration and fire searching application based on the Internet of things(IoT)cloud robotics framework.In this implementation the heavy and expensive computational tasks are offloaded to the cloud servers.The proposed model achieves a significant improvement in the computation burden of the whole task relative to a traditional MRS.The proposed model is applied to explore and search for fire objects in an unknown environment;using different sets of robots sizes.The preliminary evaluation of this implementation demonstrates that as the parallelism of computational instances increase the delay of new actuation commands which will be decreased,the mean time of task completion is decreased,the number of turns in the path from the start pose cells to the target cells is minimized and the energy consumption for each robot is reduced.
基金supported in part by the National Natural Science Foundation of China(62522320,92267108,62173322)Liaoning Revitalization Talents Program(XLYC2403062)the Science and Technology Program of Liaoning Province(2023JH3/10200004,2022JH25/10100005)。
文摘The wireless cloud robotic system(WCRS),which fully integrates sensing,communication,computing,and control capabilities as an intelligent agent,is a promising way to achieve intelligent manufacturing due to easy deployment and flexible expansion.However,the high-precision control of WCRS requires deterministic wireless communication,which is always challenging in the complex and dynamic radio space.This paper employs the reconfigurable intelligent surface(RIS)to establish a novel RIS-assisted WCRS architecture,where the radio channel is controlled to achieve ultra-reliable,low-delay,and low-jitter communication for high-precision closed-loop motion control.However,control and communication are strongly coupled and should be co-optimized.Fully considering the constraints of control input threshold,control delay deadline,beam phase,antenna power,and information distortion,we establish a stability maximization problem to jointly optimize control input compensation,RIS phase shift,and beamforming.Herein,a new jitter-oriented system stability objective with respect to control error and communication jitter is defined and the closed-form expression of control delay deadline is derived based on the Jensen Inequality and Lyapunov-Krasovskii functional.Due to the time-varying and partial observability of the channel and robot states,we model the problem as a partially observable Markov decision process(POMDP).To solve this complex problem,we propose a multi-agent transfer reinforcement learning algorithm named LSTM-PPO-MATRL,where the LSTM-enhanced proximal policy optimization(PPO)is designed to approximate an optimal solution and the option-guided policy transfer learning is proposed to facilitate the learning process.By centralized training and decentralized execution,LSTM-PPO-MATRL is validated by extensive experiments on MuJoCo tasks for both low-mobility and high-mobility robotic control scenarios.The results demonstrate that LSTM-PPO-MATRL not only realizes high learning efficiency,but also supports low-delay,low-jitter communication for low error control,where 71.9%control accuracy improvement and 68.7%delay jitter reduction are achieved compared to the PPO-MADRL baseline.
基金This work was supported by the National Key Research and Development Program of China under Grant No. 2016YFB1001300, the National Natural Science Foundation of China under Grant No. 61403080, and the Natural Science Foundation of Jiangsu Province Technology Support Plan under Grant No. BK20140641.
文摘The rise in the cases of motor impairing therapy. Due to the current situation that the service illnesses demands the research for improvements in rehabilitation of the professional therapists cannot meet the need of the motorimpaired subjects, a cloud robotic system is proposed to provide an Internet-based process for upper-limb rehabilitation with multimodal interaction. In this system, therapists and subjects are connected through the Internet using client/server architecture. At the client site, gradual virtual games are introduced so that the subjects can control and interact with virtual objects through the interaction devices such as robot arms. Computer graphics show the geometric results and interaction haptic/force is fed back during exercising. Both video/audio information and kinematical/physiological data axe transferred to the therapist for monitoring and analysis. In this way, patients can be diagnosed and directed and therapists can manage therapy sessions remotely. The rehabilitation process can be monitored through the Internet. Expert libraries on the central server can serve as a supervisor and give advice based on the training data and the physiological data. The proposed solution is a convenient application that has several features taking advantage of the extensive technological utilization in the area of physical rehabilitation and multimodal interaction.
基金supported in part by the National Natural Science Foundation of China under Grant 62273203,Grant U1813215in part by the Special Fund for the Taishan Scholars Program of Shandong Province(ts201511005).
文摘Intelligent Space(IS)is widely regarded as a promising paradigm for improving quality of life through using service task processing.As the field matures,various state-of-the-art IS architectures have been proposed.Most of the IS architectures designed for service robots face the problems of fixedfunction modules and low scalability when performing service tasks.To this end,we propose a hybrid cloud service robot architecture based on a Service-Oriented Architecture(SOA).Specifically,we first use the distributed deployment of functional modules to solve the problem of high computing resource occupancy.Then,the Socket communication interface layer is designed to improve the calling efficiency of the function module.Next,the private cloud service knowledge base and the dataset for the home environment are used to improve the robustness and success rate of the robot when performing tasks.Finally,we design and deploy an interactive system based on Browser/Server(B/S)architecture,which aims to display the status of the robot in real-time as well as to expand and call the robot service.This system is integrated into the private cloud framework,which provides a feasible solution for improving the quality of life.Besides,it also fully reveals how to actively discover and provide the robot service mechanism of service tasks in the right way.The results of extensive experiments show that our cloud system provides sufficient prior knowledge that can assist the robot in completing service tasks.It is an efficient way to transmit data and reduce the computational burden on the robot.By using our cloud detection module,the robot system can save approximately 25% of the averageCPUusage and reduce the average detection time by 0.1 s compared to the locally deployed system,demonstrating the reliability and practicality of our proposed architecture.
文摘A subject who wears a suitable robotic device will be able to walk in complex environments with the aid of environmental recognition schemes that provide reliable prior information of the human motion intent.Researchers have utilized 1 D laser signals and 2 D depth images to classify environments,but those approaches can face the problems of self-occlusion.In comparison,3 D point cloud is more appropriate for depicting the environments.This paper proposes a directional PointNet to directly classify the 3 D point cloud.First,an inertial measurement unit(IMU)is used to offset the orientation of point cloud.Then the directional PointNet can accurately classify the daily commuted terrains,including level ground,climbing up stairways,and walking down stairs.A classification accuracy of 98%has been achieved in tests.Moreover,the directional PointNet is more efficient than the previously used PointNet because the T-net,which is utilized to estimate the transformation of the point cloud,is not used in the present approach,and the length of the global feature is optimized.The experimental results demonstrate that the directional PointNet can classify the environments in robust and efficient manner.
