A complete characterization of the behavior in human-robot interactions(HRI) includes both: the behavioral dynamics and the control laws that characterize how the behavior is regulated with the perception data. In thi...A complete characterization of the behavior in human-robot interactions(HRI) includes both: the behavioral dynamics and the control laws that characterize how the behavior is regulated with the perception data. In this way, this work proposes a leader-follower coordinate control based on an impedance control that allows to establish a dynamic relation between social forces and motion error. For this, a scheme is presented to identify the impedance based on fictitious social forces, which are described by distance-based potential fields.As part of the validation procedure, we present an experimental comparison to select the better of two different fictitious force structures. The criteria are determined by two qualities: least impedance errors during the validation procedure and least parameter variance during the recursive estimation procedure.Finally, with the best fictitious force and its identified impedance,an impedance control is designed for a mobile robot Pioneer 3AT,which is programmed to follow a human in a structured scenario.According to results, and under the hypothesis that moving like humans will be acceptable by humans, it is believed that the proposed control improves the social acceptance of the robot for this kind of interaction.展开更多
This article describes a pilot study aiming at generating social interactions between a humanoid robot and adolescents with autism spectrum disorder (ASD), through the practice of a gesture imitation game. The partici...This article describes a pilot study aiming at generating social interactions between a humanoid robot and adolescents with autism spectrum disorder (ASD), through the practice of a gesture imitation game. The participants were a 17-year-old young lady with ASD and intellectual deficit, and a control participant: a preadolescent with ASD but no intellectual deficit (Asperger syndrome). The game is comprised of four phases: greetings, pairing, imitation, and closing. Field educators were involved, playing specific roles: visual or physical inciter. The use of a robot allows for catching the participants’ attention, playing the imitation game for a longer period of time than with a human partner, and preventing the game partner’s negative facial expressions resulting from tiredness, impatience, or boredom. The participants’ behavior was observed in terms of initial approach towards the robot, positioning relative to the robot in terms of distance and orientation, reactions to the robot’s voice or moves, signs of happiness, and imitation attempts. Results suggest a more and more natural approach towards the robot during the sessions, as well as a higher level of social interaction, based on the variations of the parameters listed above. We use these preliminary results to draw the next steps of our research work as well as identify further perspectives, with this aim in mind: improving social interactions with adolescents with ASD and intellectual deficit, allowing for better integration of these people into our societies.展开更多
Background This paper introduces a versatile edutainment platform based on a swarm robotics system that can support multiple interaction methods.We aim to create a re-usable open-ended tangible tool for a variety of e...Background This paper introduces a versatile edutainment platform based on a swarm robotics system that can support multiple interaction methods.We aim to create a re-usable open-ended tangible tool for a variety of educational and entertainment scenarios by utilizing the unique advantages of swarm robots such as flexible mobility,mutual perception,and free control of robot number.Methods Compared with the tangible user interface,the swarm user interface(SUI)possesses more flexible locomotion and more controllable widgets.However,research on SUI is still limited to system construction,and the upper interaction modes along with vivid applications have not been sufficiently studied.Results This study illustrates possible interaction modes for swarm robotics and feasible application scenarios based on these fundamental interaction modes.We also discuss the implementation of swarm robotics(including software and hardware),then design several simple experiments to verify the location accuracy of the swarm robotics system.展开更多
A more natural way for non-expert users to express their tasks in an open-ended set is to use natural language. In this case,a human-centered intelligent agent/robot is required to be able to understand and generate p...A more natural way for non-expert users to express their tasks in an open-ended set is to use natural language. In this case,a human-centered intelligent agent/robot is required to be able to understand and generate plans for these naturally expressed tasks. For this purpose, it is a good way to enhance intelligent robot's abilities by utilizing open knowledge extracted from the web, instead of hand-coded knowledge. A key challenge of utilizing open knowledge lies in the semantic interpretation of the open knowledge organized in multiple modes, which can be unstructured or semi-structured, before one can use it.Previous approaches used a limited lexicon to employ combinatory categorial grammar(CCG) as the underlying formalism for semantic parsing over sentences. Here, we propose a more effective learning method to interpret semi-structured user instructions. Moreover, we present a new heuristic method to recover missing semantic information from the context of an instruction. Experiments showed that the proposed approach renders significant performance improvement compared to the baseline methods and the recovering method is promising.展开更多
With the increasing of the elderly population and the growing hearth care cost, the role of service robots in aiding the disabled and the elderly is becoming important. Many researchers in the world have paid much att...With the increasing of the elderly population and the growing hearth care cost, the role of service robots in aiding the disabled and the elderly is becoming important. Many researchers in the world have paid much attention to heaRthcare robots and rehabilitation robots. To get natural and harmonious communication between the user and a service robot, the information perception/feedback ability, and interaction ability for service robots become more important in many key issues.展开更多
Adaptive locomotion in different types of surfaces is of critical importance for legged robots.The knowledge of various ground substrates,especially some geological properties,plays an essential role in ensuring the l...Adaptive locomotion in different types of surfaces is of critical importance for legged robots.The knowledge of various ground substrates,especially some geological properties,plays an essential role in ensuring the legged robots'safety.In this paper,the interaction between the robots and the environments is investigated through interaction dynamics with the closed-loop system model,the compliant contact model,and the friction model,which unveil the influence of environment's geological characteristics for legged robots'locomotion.The proposed method to classify substrates is based on the interaction dynamics and the sensory-motor coordination.The foot contact forces,joint position errors,and joint motor currents,which reflect body dynamics,are measured as the sensing variables.We train and classify the features extracted from the raw data with a multilevel weighted k-Nearest Neighbor(kNN) algorithm.According to the interaction dynamics,the strategy of adaptive walking is developed by adjusting the touchdown angles and foot trajectories while lifting up and dropping down the foot.Experiments are conducted on five different substrates with quadruped robot FROG-I.The comparison with other classification methods and adaptive walking between different substrates demonstrate the effectiveness of our approach.展开更多
Quadruped robots which have flexibility and load-bearing capacity,are regarded as the best mobile platform for remote operation in unstructured and restricted environments.In the process of remote operation of quadrup...Quadruped robots which have flexibility and load-bearing capacity,are regarded as the best mobile platform for remote operation in unstructured and restricted environments.In the process of remote operation of quadruped robots,their status is inevitably influenced by complex environments.To monitor the robot's real-time operation status and make necessary adjustments,this paper focuses on the single-leg of a quadruped robot,proposes a single-leg virtual-real interaction system based on Digital Twin,and studies its virtual-real interaction characteristics.The virtual-reality interaction system contains single-leg physical entity,single-leg virtual model,control system,data service system and communication system,enabling interactive applications for single-leg visual state monitoring and real-time control optimization.This paper creates a high-fidelity model based on the physical entity;provides a system performance analysis method based on the system framework;analyzes virtual-real interaction delay based on communication scheme;conducts stand and jump test based on the single-leg mathematical model and analyzes the interaction characteristics under position/force control.This system provides new insights for real-time monitoring and control optimization of quadruped robots.展开更多
Study results in the last decades show that amount and quality of physical exercises,then the active participation,and now the cognitive involvement of patient in rehabilitation training are crucial to enhance recover...Study results in the last decades show that amount and quality of physical exercises,then the active participation,and now the cognitive involvement of patient in rehabilitation training are crucial to enhance recovery outcome of motor dysfunction patients after stroke.Rehabilitation robots mainly have been developed along this direction to satisfy requirements of recovery therapy,or focused on one or more of the above three points.Therefore,rehabilitation robot based on neuro-machine interaction has been proposed for the paralyzed limb training of post-stroke patient,which utilizes motor related EEG,UCSDI(Ultrasound Current Source Density Imaging),EMG for the robot control and feeds back the multi-sensory interaction information such as visual,auditory,force,haptic sensation to the patient simultaneously.This neuro-controlled and perceptual rehabilitation robot will bring great benefits to post-stroke patients.In order to develop such a kind of rehabilitation robot,some key technologies,such as non-invasive precise measurement and decoding of neural signals,realistic sensation feedback,coordinated control for both the rehabilitation robot and the patient,need to be solved.In this paper,some fundamental problems in developing and optimizing such a kind of rehabilitation robot based on neuro-machine interaction are proposed and discussed.展开更多
A facial expression emotion recognition based human-robot interaction(FEER-HRI) system is proposed, for which a four-layer system framework is designed. The FEERHRI system enables the robots not only to recognize huma...A facial expression emotion recognition based human-robot interaction(FEER-HRI) system is proposed, for which a four-layer system framework is designed. The FEERHRI system enables the robots not only to recognize human emotions, but also to generate facial expression for adapting to human emotions. A facial emotion recognition method based on2D-Gabor, uniform local binary pattern(LBP) operator, and multiclass extreme learning machine(ELM) classifier is presented,which is applied to real-time facial expression recognition for robots. Facial expressions of robots are represented by simple cartoon symbols and displayed by a LED screen equipped in the robots, which can be easily understood by human. Four scenarios,i.e., guiding, entertainment, home service and scene simulation are performed in the human-robot interaction experiment, in which smooth communication is realized by facial expression recognition of humans and facial expression generation of robots within 2 seconds. As a few prospective applications, the FEERHRI system can be applied in home service, smart home, safe driving, and so on.展开更多
Dear Editor,This letter proposes a novel Nash bargaining solution-based multiobjective model predictive control(MPC)scheme to deal with the interaction force control and the path-following problem of the constrained i...Dear Editor,This letter proposes a novel Nash bargaining solution-based multiobjective model predictive control(MPC)scheme to deal with the interaction force control and the path-following problem of the constrained interactive robot.Considering the elastic interaction force model,a mechanical trade-off always exists between the interaction force and position,which means that neither force nor path following can satisfy their desired demands completely.Based on this consideration,two irreconcilable control specifications,the force object function and the position track object function,are proposed,and a new multi-objective MPC scheme is then designed.展开更多
This paper presents a novel enhanced human-robot interaction system based on model reference adaptive control. The presented method delivers guaranteed stability and task performance and has two control loops. A robot...This paper presents a novel enhanced human-robot interaction system based on model reference adaptive control. The presented method delivers guaranteed stability and task performance and has two control loops. A robot-specific inner loop, which is a neuroadaptive controller, learns the robot dynamics online and makes the robot respond like a prescribed impedance model. This loop uses no task information, including no prescribed trajectory. A task-specific outer loop takes into account the human operator dynamics and adapts the prescribed robot impedance model so that the combined human-robot system has desirable characteristics for task performance. This design is based on model reference adaptive control, but of a nonstandard form. The net result is a controller with both adaptive impedance characteristics and assistive inputs that augment the human operator to provide improved task performance of the human-robot team. Simulations verify the performance of the proposed controller in a repetitive point-to-point motion task. Actual experimental implementations on a PR2 robot further corroborate the effectiveness of the approach.展开更多
This paper proposes a novel approach for physical human-robot interactions(pHRI), where a robot provides guidance forces to a user based on the user performance. This framework tunes the forces in regards to behavior ...This paper proposes a novel approach for physical human-robot interactions(pHRI), where a robot provides guidance forces to a user based on the user performance. This framework tunes the forces in regards to behavior of each user in coping with different tasks, where lower performance results in higher intervention from the robot. This personalized physical human-robot interaction(p2HRI) method incorporates adaptive modeling of the interaction between the human and the robot as well as learning from demonstration(LfD) techniques to adapt to the users' performance. This approach is based on model predictive control where the system optimizes the rendered forces by predicting the performance of the user. Moreover, continuous learning of the user behavior is added so that the models and personalized considerations are updated based on the change of user performance over time. Applying this framework to a field such as haptic guidance for skill improvement, allows a more personalized learning experience where the interaction between the robot as the intelligent tutor and the student as the user,is better adjusted based on the skill level of the individual and their gradual improvement. The results suggest that the precision of the model of the interaction is improved using this proposed method,and the addition of the considered personalized factors to a more adaptive strategy for rendering of guidance forces.展开更多
Human-robot interaction(HRI) is fundamental for human-centered robotics, and has been attracting intensive research for more than a decade. The series elastic actuator(SEA) provides inherent compliance, safety and fur...Human-robot interaction(HRI) is fundamental for human-centered robotics, and has been attracting intensive research for more than a decade. The series elastic actuator(SEA) provides inherent compliance, safety and further benefits for HRI, but the introduced elastic element also brings control difficulties. In this paper, we address the stiffness rendering problem for a cable-driven SEA system, to achieve either low stiffness for good transparency or high stiffness bigger than the physical spring constant, and to assess the rendering accuracy with quantified metrics. By taking a velocity-sourced model of the motor, a cascaded velocity-torque-impedance control structure is established. To achieve high fidelity torque control, the 2-DOF(degree of freedom) stabilizing control method together with a compensator has been used to handle the competing requirements on tracking performance, noise and disturbance rejection,and energy optimization in the cable-driven SEA system. The conventional passivity requirement for HRI usually leads to a conservative design of the impedance controller, and the rendered stiffness cannot go higher than the physical spring constant. By adding a phase-lead compensator into the impedance controller,the stiffness rendering capability was augmented with guaranteed relaxed passivity. Extensive simulations and experiments have been performed, and the virtual stiffness has been rendered in the extended range of 0.1 to 2.0 times of the physical spring constant with guaranteed relaxed passivity for physical humanrobot interaction below 5 Hz. Quantified metrics also verified good rendering accuracy.展开更多
Nonverbal and noncontact behaviors play a significant role in allowing service robots to structure their interactions withhumans.In this paper, a novel human-mimic mechanism of robot’s navigational skills was propose...Nonverbal and noncontact behaviors play a significant role in allowing service robots to structure their interactions withhumans.In this paper, a novel human-mimic mechanism of robot’s navigational skills was proposed for developing sociallyacceptable robotic etiquette.Based on the sociological and physiological concerns of interpersonal interactions in movement,several criteria in navigation were represented by constraints and incorporated into a unified probabilistic cost grid for safemotion planning and control, followed by an emphasis on the prediction of the human’s movement for adjusting the robot’spre-collision navigational strategy.The human motion prediction utilizes a clustering-based algorithm for modeling humans’indoor motion patterns as well as the combination of the long-term and short-term tendency prediction that takes into accountthe uncertainties of both velocity and heading direction.Both simulation and real-world experiments verified the effectivenessand reliability of the method to ensure human’s safety and comfort in navigation.A statistical user trials study was also given tovalidate the users’favorable views of the human-friendly navigational behavior.展开更多
Supernumerary robotic limbs(SRLs) are a new type of wearable human auxiliary equipment, which is currently a hot research topic in the world. SRLs have broad applications in many fields, and will provide a reference a...Supernumerary robotic limbs(SRLs) are a new type of wearable human auxiliary equipment, which is currently a hot research topic in the world. SRLs have broad applications in many fields, and will provide a reference and technical support for the realization of human-robot collaboration and integration,while playing an important role in improving social security and public services. In this paper, representative SRLs are summarized from the aspects of related literature analysis,research status, ontology structure design, control and driving,sensing and perception, and application fields. This paper also analyzes and summarizes the current technical challenges faced by SRLs, and reviews development progress and key technologies,thus giving a prospect of future technical development trends.展开更多
Lower extremity robotic exoskeletons(LEEX)can not only improve the ability of the human body but also provide healing treatment for people with lower extremity dysfunction.There are a wide range of application needs a...Lower extremity robotic exoskeletons(LEEX)can not only improve the ability of the human body but also provide healing treatment for people with lower extremity dysfunction.There are a wide range of application needs and development prospects in the military,industry,medical treatment,consumption and other felds,which has aroused widespread concern in society.This paper attempts to review LEEX technical development.First,the history of LEEX is briefy traced.Second,based on existing research,LEEX is classifed according to auxiliary body parts,structural forms,functions and felds,and typical LEEX prototypes and products are introduced.Then,the latest key technologies are analyzed and summarized,and the research contents,such as bionic structure and driving characteristics,human–robot interaction(HRI)and intentawareness,intelligent control strategy,and evaluation method of power-assisted walking efciency,are described in detail.Finally,existing LEEX problems and challenges are analyzed,a future development trend is proposed,and a multidisciplinary development direction of the key technology is provided.展开更多
With the rapid development of the robotic industry, domestic robots have become increasingly popular. As domestic robots are expected to be personal assistants, it is important to develop a natural language-based huma...With the rapid development of the robotic industry, domestic robots have become increasingly popular. As domestic robots are expected to be personal assistants, it is important to develop a natural language-based human-robot interactive system for end-users who do not necessarily have much programming knowledge. To build such a system, we developed an interactive tutoring framework, named " Holert”, which can translate task descriptions in natural language to machine-interpretable logical forms automatically. Compared to previous works, Holert allows users to teach the robot by further explaining their intentions in an interactive tutor mode. Furthermore, Holert introduces a semantic dependency model to enable the robot to " understand” similar task descriptions. We have deployed Holert on an open-source robot platform, Turtlebot 2. Experimental results show that the system accuracy could be significantly improved by 163.9% with the support of the tutor mode. This system is also efficient. Even the longest task session with 10 sentences can be handled within 0.7 s.展开更多
文摘A complete characterization of the behavior in human-robot interactions(HRI) includes both: the behavioral dynamics and the control laws that characterize how the behavior is regulated with the perception data. In this way, this work proposes a leader-follower coordinate control based on an impedance control that allows to establish a dynamic relation between social forces and motion error. For this, a scheme is presented to identify the impedance based on fictitious social forces, which are described by distance-based potential fields.As part of the validation procedure, we present an experimental comparison to select the better of two different fictitious force structures. The criteria are determined by two qualities: least impedance errors during the validation procedure and least parameter variance during the recursive estimation procedure.Finally, with the best fictitious force and its identified impedance,an impedance control is designed for a mobile robot Pioneer 3AT,which is programmed to follow a human in a structured scenario.According to results, and under the hypothesis that moving like humans will be acceptable by humans, it is believed that the proposed control improves the social acceptance of the robot for this kind of interaction.
文摘This article describes a pilot study aiming at generating social interactions between a humanoid robot and adolescents with autism spectrum disorder (ASD), through the practice of a gesture imitation game. The participants were a 17-year-old young lady with ASD and intellectual deficit, and a control participant: a preadolescent with ASD but no intellectual deficit (Asperger syndrome). The game is comprised of four phases: greetings, pairing, imitation, and closing. Field educators were involved, playing specific roles: visual or physical inciter. The use of a robot allows for catching the participants’ attention, playing the imitation game for a longer period of time than with a human partner, and preventing the game partner’s negative facial expressions resulting from tiredness, impatience, or boredom. The participants’ behavior was observed in terms of initial approach towards the robot, positioning relative to the robot in terms of distance and orientation, reactions to the robot’s voice or moves, signs of happiness, and imitation attempts. Results suggest a more and more natural approach towards the robot during the sessions, as well as a higher level of social interaction, based on the variations of the parameters listed above. We use these preliminary results to draw the next steps of our research work as well as identify further perspectives, with this aim in mind: improving social interactions with adolescents with ASD and intellectual deficit, allowing for better integration of these people into our societies.
文摘Background This paper introduces a versatile edutainment platform based on a swarm robotics system that can support multiple interaction methods.We aim to create a re-usable open-ended tangible tool for a variety of educational and entertainment scenarios by utilizing the unique advantages of swarm robots such as flexible mobility,mutual perception,and free control of robot number.Methods Compared with the tangible user interface,the swarm user interface(SUI)possesses more flexible locomotion and more controllable widgets.However,research on SUI is still limited to system construction,and the upper interaction modes along with vivid applications have not been sufficiently studied.Results This study illustrates possible interaction modes for swarm robotics and feasible application scenarios based on these fundamental interaction modes.We also discuss the implementation of swarm robotics(including software and hardware),then design several simple experiments to verify the location accuracy of the swarm robotics system.
基金supported by the National Natural Science Foundation of China(61175057)the USTC Key-Direction Research Fund(WK0110000028)
文摘A more natural way for non-expert users to express their tasks in an open-ended set is to use natural language. In this case,a human-centered intelligent agent/robot is required to be able to understand and generate plans for these naturally expressed tasks. For this purpose, it is a good way to enhance intelligent robot's abilities by utilizing open knowledge extracted from the web, instead of hand-coded knowledge. A key challenge of utilizing open knowledge lies in the semantic interpretation of the open knowledge organized in multiple modes, which can be unstructured or semi-structured, before one can use it.Previous approaches used a limited lexicon to employ combinatory categorial grammar(CCG) as the underlying formalism for semantic parsing over sentences. Here, we propose a more effective learning method to interpret semi-structured user instructions. Moreover, we present a new heuristic method to recover missing semantic information from the context of an instruction. Experiments showed that the proposed approach renders significant performance improvement compared to the baseline methods and the recovering method is promising.
文摘With the increasing of the elderly population and the growing hearth care cost, the role of service robots in aiding the disabled and the elderly is becoming important. Many researchers in the world have paid much attention to heaRthcare robots and rehabilitation robots. To get natural and harmonious communication between the user and a service robot, the information perception/feedback ability, and interaction ability for service robots become more important in many key issues.
文摘Adaptive locomotion in different types of surfaces is of critical importance for legged robots.The knowledge of various ground substrates,especially some geological properties,plays an essential role in ensuring the legged robots'safety.In this paper,the interaction between the robots and the environments is investigated through interaction dynamics with the closed-loop system model,the compliant contact model,and the friction model,which unveil the influence of environment's geological characteristics for legged robots'locomotion.The proposed method to classify substrates is based on the interaction dynamics and the sensory-motor coordination.The foot contact forces,joint position errors,and joint motor currents,which reflect body dynamics,are measured as the sensing variables.We train and classify the features extracted from the raw data with a multilevel weighted k-Nearest Neighbor(kNN) algorithm.According to the interaction dynamics,the strategy of adaptive walking is developed by adjusting the touchdown angles and foot trajectories while lifting up and dropping down the foot.Experiments are conducted on five different substrates with quadruped robot FROG-I.The comparison with other classification methods and adaptive walking between different substrates demonstrate the effectiveness of our approach.
文摘Quadruped robots which have flexibility and load-bearing capacity,are regarded as the best mobile platform for remote operation in unstructured and restricted environments.In the process of remote operation of quadruped robots,their status is inevitably influenced by complex environments.To monitor the robot's real-time operation status and make necessary adjustments,this paper focuses on the single-leg of a quadruped robot,proposes a single-leg virtual-real interaction system based on Digital Twin,and studies its virtual-real interaction characteristics.The virtual-reality interaction system contains single-leg physical entity,single-leg virtual model,control system,data service system and communication system,enabling interactive applications for single-leg visual state monitoring and real-time control optimization.This paper creates a high-fidelity model based on the physical entity;provides a system performance analysis method based on the system framework;analyzes virtual-real interaction delay based on communication scheme;conducts stand and jump test based on the single-leg mathematical model and analyzes the interaction characteristics under position/force control.This system provides new insights for real-time monitoring and control optimization of quadruped robots.
基金supported by the National Natural Science Foundation of China ( Grant no. 61272379, 61325018)the Technique Support Project of Jiangsu Province ( Grantno. BE2014132)
文摘Study results in the last decades show that amount and quality of physical exercises,then the active participation,and now the cognitive involvement of patient in rehabilitation training are crucial to enhance recovery outcome of motor dysfunction patients after stroke.Rehabilitation robots mainly have been developed along this direction to satisfy requirements of recovery therapy,or focused on one or more of the above three points.Therefore,rehabilitation robot based on neuro-machine interaction has been proposed for the paralyzed limb training of post-stroke patient,which utilizes motor related EEG,UCSDI(Ultrasound Current Source Density Imaging),EMG for the robot control and feeds back the multi-sensory interaction information such as visual,auditory,force,haptic sensation to the patient simultaneously.This neuro-controlled and perceptual rehabilitation robot will bring great benefits to post-stroke patients.In order to develop such a kind of rehabilitation robot,some key technologies,such as non-invasive precise measurement and decoding of neural signals,realistic sensation feedback,coordinated control for both the rehabilitation robot and the patient,need to be solved.In this paper,some fundamental problems in developing and optimizing such a kind of rehabilitation robot based on neuro-machine interaction are proposed and discussed.
基金supported by the National Natural Science Foundation of China(61403422,61273102)the Hubei Provincial Natural Science Foundation of China(2015CFA010)+1 种基金the Ⅲ Project(B17040)the Fundamental Research Funds for National University,China University of Geosciences(Wuhan)
文摘A facial expression emotion recognition based human-robot interaction(FEER-HRI) system is proposed, for which a four-layer system framework is designed. The FEERHRI system enables the robots not only to recognize human emotions, but also to generate facial expression for adapting to human emotions. A facial emotion recognition method based on2D-Gabor, uniform local binary pattern(LBP) operator, and multiclass extreme learning machine(ELM) classifier is presented,which is applied to real-time facial expression recognition for robots. Facial expressions of robots are represented by simple cartoon symbols and displayed by a LED screen equipped in the robots, which can be easily understood by human. Four scenarios,i.e., guiding, entertainment, home service and scene simulation are performed in the human-robot interaction experiment, in which smooth communication is realized by facial expression recognition of humans and facial expression generation of robots within 2 seconds. As a few prospective applications, the FEERHRI system can be applied in home service, smart home, safe driving, and so on.
基金supported by the National Natural Science Foundation of China(62303095)the Natural Science Foundation of Sichuan Province(2023NSFSC0872).
文摘Dear Editor,This letter proposes a novel Nash bargaining solution-based multiobjective model predictive control(MPC)scheme to deal with the interaction force control and the path-following problem of the constrained interactive robot.Considering the elastic interaction force model,a mechanical trade-off always exists between the interaction force and position,which means that neither force nor path following can satisfy their desired demands completely.Based on this consideration,two irreconcilable control specifications,the force object function and the position track object function,are proposed,and a new multi-objective MPC scheme is then designed.
基金The work was supported by the National Science Foundation，the Office of Naval Research grant，the AFOSR (Air Force Office of Scientific Research) EOARD (European Office of Aerospace Research and Development) grant，the U.S. Army Research Office grant
文摘This paper presents a novel enhanced human-robot interaction system based on model reference adaptive control. The presented method delivers guaranteed stability and task performance and has two control loops. A robot-specific inner loop, which is a neuroadaptive controller, learns the robot dynamics online and makes the robot respond like a prescribed impedance model. This loop uses no task information, including no prescribed trajectory. A task-specific outer loop takes into account the human operator dynamics and adapts the prescribed robot impedance model so that the combined human-robot system has desirable characteristics for task performance. This design is based on model reference adaptive control, but of a nonstandard form. The net result is a controller with both adaptive impedance characteristics and assistive inputs that augment the human operator to provide improved task performance of the human-robot team. Simulations verify the performance of the proposed controller in a repetitive point-to-point motion task. Actual experimental implementations on a PR2 robot further corroborate the effectiveness of the approach.
文摘This paper proposes a novel approach for physical human-robot interactions(pHRI), where a robot provides guidance forces to a user based on the user performance. This framework tunes the forces in regards to behavior of each user in coping with different tasks, where lower performance results in higher intervention from the robot. This personalized physical human-robot interaction(p2HRI) method incorporates adaptive modeling of the interaction between the human and the robot as well as learning from demonstration(LfD) techniques to adapt to the users' performance. This approach is based on model predictive control where the system optimizes the rendered forces by predicting the performance of the user. Moreover, continuous learning of the user behavior is added so that the models and personalized considerations are updated based on the change of user performance over time. Applying this framework to a field such as haptic guidance for skill improvement, allows a more personalized learning experience where the interaction between the robot as the intelligent tutor and the student as the user,is better adjusted based on the skill level of the individual and their gradual improvement. The results suggest that the precision of the model of the interaction is improved using this proposed method,and the addition of the considered personalized factors to a more adaptive strategy for rendering of guidance forces.
基金supported by the National Natural Science Foundation of China(61403215)the National Natural Science Foundation of Tianjin(13JCYBJC36600)the Fundamental Research Funds for the Central Universities
文摘Human-robot interaction(HRI) is fundamental for human-centered robotics, and has been attracting intensive research for more than a decade. The series elastic actuator(SEA) provides inherent compliance, safety and further benefits for HRI, but the introduced elastic element also brings control difficulties. In this paper, we address the stiffness rendering problem for a cable-driven SEA system, to achieve either low stiffness for good transparency or high stiffness bigger than the physical spring constant, and to assess the rendering accuracy with quantified metrics. By taking a velocity-sourced model of the motor, a cascaded velocity-torque-impedance control structure is established. To achieve high fidelity torque control, the 2-DOF(degree of freedom) stabilizing control method together with a compensator has been used to handle the competing requirements on tracking performance, noise and disturbance rejection,and energy optimization in the cable-driven SEA system. The conventional passivity requirement for HRI usually leads to a conservative design of the impedance controller, and the rendered stiffness cannot go higher than the physical spring constant. By adding a phase-lead compensator into the impedance controller,the stiffness rendering capability was augmented with guaranteed relaxed passivity. Extensive simulations and experiments have been performed, and the virtual stiffness has been rendered in the extended range of 0.1 to 2.0 times of the physical spring constant with guaranteed relaxed passivity for physical humanrobot interaction below 5 Hz. Quantified metrics also verified good rendering accuracy.
基金supported by the National High Technology Research and Development Program(863 Program)of China(Grant No.2006AA040202 and No.2007AA041703)the National Natural Science Foundation of China(Grant No.60805032)
文摘Nonverbal and noncontact behaviors play a significant role in allowing service robots to structure their interactions withhumans.In this paper, a novel human-mimic mechanism of robot’s navigational skills was proposed for developing sociallyacceptable robotic etiquette.Based on the sociological and physiological concerns of interpersonal interactions in movement,several criteria in navigation were represented by constraints and incorporated into a unified probabilistic cost grid for safemotion planning and control, followed by an emphasis on the prediction of the human’s movement for adjusting the robot’spre-collision navigational strategy.The human motion prediction utilizes a clustering-based algorithm for modeling humans’indoor motion patterns as well as the combination of the long-term and short-term tendency prediction that takes into accountthe uncertainties of both velocity and heading direction.Both simulation and real-world experiments verified the effectivenessand reliability of the method to ensure human’s safety and comfort in navigation.A statistical user trials study was also given tovalidate the users’favorable views of the human-friendly navigational behavior.
基金supported in part by theNational Key R&D Program of China (2018YFB1304600)the Natural Science Foundation of China (51775541)CAS Interdisciplinary Innovation Team (JCTD-2018-11)。
文摘Supernumerary robotic limbs(SRLs) are a new type of wearable human auxiliary equipment, which is currently a hot research topic in the world. SRLs have broad applications in many fields, and will provide a reference and technical support for the realization of human-robot collaboration and integration,while playing an important role in improving social security and public services. In this paper, representative SRLs are summarized from the aspects of related literature analysis,research status, ontology structure design, control and driving,sensing and perception, and application fields. This paper also analyzes and summarizes the current technical challenges faced by SRLs, and reviews development progress and key technologies,thus giving a prospect of future technical development trends.
基金the National Basic Research Program of China(Grant No.2016YFC0802700)the National Natural Science Foundation of China(Grant No.50975010,Grant No.51075017).
文摘Lower extremity robotic exoskeletons(LEEX)can not only improve the ability of the human body but also provide healing treatment for people with lower extremity dysfunction.There are a wide range of application needs and development prospects in the military,industry,medical treatment,consumption and other felds,which has aroused widespread concern in society.This paper attempts to review LEEX technical development.First,the history of LEEX is briefy traced.Second,based on existing research,LEEX is classifed according to auxiliary body parts,structural forms,functions and felds,and typical LEEX prototypes and products are introduced.Then,the latest key technologies are analyzed and summarized,and the research contents,such as bionic structure and driving characteristics,human–robot interaction(HRI)and intentawareness,intelligent control strategy,and evaluation method of power-assisted walking efciency,are described in detail.Finally,existing LEEX problems and challenges are analyzed,a future development trend is proposed,and a multidisciplinary development direction of the key technology is provided.
基金supported by Tsinghua University Initiative Scientific Research Program(No.20141081140)
文摘With the rapid development of the robotic industry, domestic robots have become increasingly popular. As domestic robots are expected to be personal assistants, it is important to develop a natural language-based human-robot interactive system for end-users who do not necessarily have much programming knowledge. To build such a system, we developed an interactive tutoring framework, named " Holert”, which can translate task descriptions in natural language to machine-interpretable logical forms automatically. Compared to previous works, Holert allows users to teach the robot by further explaining their intentions in an interactive tutor mode. Furthermore, Holert introduces a semantic dependency model to enable the robot to " understand” similar task descriptions. We have deployed Holert on an open-source robot platform, Turtlebot 2. Experimental results show that the system accuracy could be significantly improved by 163.9% with the support of the tutor mode. This system is also efficient. Even the longest task session with 10 sentences can be handled within 0.7 s.
