Walking is the basic locomotion pattern for bipedal robots.The walking pattern is widely generated using the linear inverted pendulum model.The linear inverted pendulum motion of each support period can be designed as...Walking is the basic locomotion pattern for bipedal robots.The walking pattern is widely generated using the linear inverted pendulum model.The linear inverted pendulum motion of each support period can be designed as a walk primitive to be connected to form a walking trajectory.A novel method of integrating double support phase into the walk primitive was proposed in this article.The method describes the generation of walking patterns using walk primitives with double support,specifically for lateral plane including walking in place,walking for lateral,and walking initiation,and for sagittal plane including fixed step length walking,variable step length walking,and walking initiation.Compared to walk primitives without double support phase,those with double support phase reduce the maximum speed required by the robot and eliminate the need to adjust foothold for achieving continuous speed.The performance of the proposed method is validated by simulations and experiments on Neubot,a position-controlled biped robot.展开更多
1Introduction To date,in model-based gait-planning methods,the dynamics of the center of mass(COM)of bipedal robots have been analyzed by establishing their linear inverted pendulum model(LIPM)or extended forms(Owaki ...1Introduction To date,in model-based gait-planning methods,the dynamics of the center of mass(COM)of bipedal robots have been analyzed by establishing their linear inverted pendulum model(LIPM)or extended forms(Owaki et al.,2010;Englsberger et al.,2015;Xie et al.,2020).With regard to model-based gait-generation methods for uphill and downhill terrain,Kuo(2007)simulated human gait using an inverted pendulum,which provided a circular trajectory for the COM rather than a horizontal trajectory.He found that a horizontal COM trajectory consumed more muscle energy.Massah et al.(2012)utilized a 3D LIPM and the concept of zero moment point(ZMP).They developed a trajectory planner using the semi-elliptical motion equations of an NAO humanoid robot and simulated walking on various sloped terrains using the Webots platform.展开更多
The wheel-legged biped robot is a typical ground-based mobile robot that can combine the high velocity and high efficiency pertaining to wheeled motion and the strong,obstacle-crossing performance associated with legg...The wheel-legged biped robot is a typical ground-based mobile robot that can combine the high velocity and high efficiency pertaining to wheeled motion and the strong,obstacle-crossing performance associated with legged motion.These robots have gradually exhibited satisfactory application potential in various harsh scenarios such as rubble rescue,military operations,and wilderness exploration.Wheel-legged biped robots are divided into four categories according to the open–close chain structure forms and operation task modes,and the latest technology research status is summarized in this paper.The hardware control system,control method,and application are analyzed,and the dynamic balance control for the two-wheel,biomimetic jumping control for the legs and whole-body control for integrating the wheels and legs are analyzed.In summary,it is observed that the current research exhibits problems,such as the insufficient application of novel materials and a rigid–flexible coupling design;the limited application of the advanced,intelligent control methods;the inadequate understanding of the bionic jumping mechanisms in robot legs;and the insufficient coordination ability of the multi-modal motion,which do not exhibit practical application for the wheel-legged biped robots.Finally,this study discusses the key research directions and development trends for the wheel-legged biped robots.展开更多
In spite of its intrinsic complexities,the passive gait of bipedal robots on a sloping ramp is a subject of interest for numerous researchers.What distinguishes the present research from similar works is the considera...In spite of its intrinsic complexities,the passive gait of bipedal robots on a sloping ramp is a subject of interest for numerous researchers.What distinguishes the present research from similar works is the consideration of flexibility in the constituent links of this type of robotic systems.This is not a far-fetched assumption because in the transient(impact)phase,due to the impulsive forces which are applied to the system,the likelihood of exciting the vibration modes increases considerably.Moreover,the human leg bones that are involved in walking are supported by viscoelastic muscles and ligaments.Therefore,for achieving more exact results,it is essential to model the robot links with viscoelastic properties.To this end,the Gibbs-Appell formulation and Newton's kinematic impact law are used to derive the most general form of the system's dynamic equations in the swing and transient phases of motion.The most important issue in the passive walking motion of bipedal robots is the determination of the initial robot configuration with which the system could accomplish a periodic and stable gait solely under the effect of gravitational force.The extremely unstable nature of the system studied in this paper and the vibrations caused by the impulsive forces induced by the impact of robot feet with the inclined surface are some of the very serious challenges encountered for achieving the above-mentioned goal.To overcome such challenges,an innovative method that uses a combination of the linearized equations of motion in the swing phase and the algebraic motion equations in the transition phase is presented in this paper to obtain an eigenvalue problem.By solving this problem,the suitable initial conditions that are necessary for the passive gait of this bipedal robot on a sloping surface are determined.The effects of the characteristic parameters of elastic links including the modulus of elasticity and the Kelvin-Voigt coefficient on the walking stability of this type of robotic systems are also studied.The findings of this parametric study reveal that the increase in the Kelvin-Voigt coefficient enhances the stability of the robotic system,while the increase in the modulus of elasticity has an opposite effect.展开更多
Compliance motion and footstep adjustment are active balance control strategies from learning human subconscious behaviors.The force estimation without direct end-actuator force measurement and the optimal footsteps b...Compliance motion and footstep adjustment are active balance control strategies from learning human subconscious behaviors.The force estimation without direct end-actuator force measurement and the optimal footsteps based on complex analytical calculation are still challenging tasks for elementary and kid-size position-controlled robots.In this paper,an online compliant controller with Gravity Projection Observer(GPO),which can express the external force condition of perturbations by the estimated Projection of Gravity(PoG)with estimation covariance,is proposed for the realization of disturbance absorption,with which the robustness of the humanoid contact with environments can be maintained.The fuzzy footstep planner based on capturability analysis is proposed,and the Model Predictive Control(MPC)is applied to generate the desired steps.The fuzzification rules are well-designed and give the corresponding control output responding to complex and changeable external disturbances.To validate the presented methods,a series of experiments on a real humanoid robot are conducted.The results verify the effectiveness of the proposed balance control framework.展开更多
In the past few decades,people have been trying to address the issue of walking instability in bipedal robots in uncertain environments.However,most control methods currently have still failed to achieve robust walkin...In the past few decades,people have been trying to address the issue of walking instability in bipedal robots in uncertain environments.However,most control methods currently have still failed to achieve robust walking of bipedal robots under uncertain disturbances.Existing research mostly focuses on motion control methods for robots on uneven terrain and under sudden impact forces,with little consideration for the problem of continuous and intense external force disturbances in uncertain environments.In response to this issue,a disturbance-robust control method based on adaptive feedback compensation is proposed.First,based on the Lagrangian method,the dynamic model of a bipedal robot under different types of external force disturbances was established.Subsequently,through dynamic analysis,it was observed that classical control methods based on hybrid zero dynamics failed to consider the continuous and significant external force disturbances in uncertain environments.Therefore,an adaptive feedback compensation controller was designed,and an adaptive parameter adjustment optimization algorithm was proposed based on walking constraints to achieve stable walking of bipedal robots under different external force disturbances.Finally,in numerical simulation experiments,comparative analysis revealed that using only a controller based on hybrid zero dynamics was insufficient to converge the motion of a planar five-link bipedal robot subjected to periodic forces or bounded noise disturbances to a stable state.In contrast,in the adaptive feedback compensation control method,the use of an adaptive parameter adjustment optimization algorithm to generate time-varying control parameters successfully achieved stable walking of the robot under these disturbances.This indicates the effectiveness of the adaptive parameter adjustment algorithm and the robustness of the adaptive feedback compensation control method.展开更多
Reinforcement learning(RL)provides much potential for locomotion of legged robot.Due to the gap between simulation and the real world,achieving sim-to-real for legged robots is challenging.However,the support polygon ...Reinforcement learning(RL)provides much potential for locomotion of legged robot.Due to the gap between simulation and the real world,achieving sim-to-real for legged robots is challenging.However,the support polygon of legged robots can help to overcome some of these challenges.Quadruped robot has a considerable support polygon,followed by bipedal robot with actuated feet,and point-footed bipedal robot has the smallest support polygon.Therefore,despite the existing sim-to-real gap,most of the recent RL approaches are deployed to the real quadruped robots that are inherently more stable,while the RL-based locomotion of bipedal robot is challenged by zero-shot sim-to-real task.Especially for the point-footed one that gets better dynamic performance,the inevitable tumble brings extra barriers to sim-to-real task.Actually,the crux of this type of problem is the difference of mechanics properties between the physical robot and the simulated one,making it difficult to play the learned skills well on the physical bipedal robot.In this paper,we introduce the embedded mechanics properties(EMP)based on the optimization with Gaussian processes to RL training,making it possible to perform sim-to-real transfer on the BRS1-P robot used in this work,hence the trained policy can be deployed on the BRS1-P without any struggle.We validate the performance of the learning-based BRS1-P on the condition of disturbances and terrains not ever learned,demonstrating the bipedal locomotion and resistant performance.展开更多
In developing and exploring extreme and harsh underwater environments,underwater robots can effectively replace humans to complete tasks.To meet the requirements of underwater flexible motion and comprehensive subsea ...In developing and exploring extreme and harsh underwater environments,underwater robots can effectively replace humans to complete tasks.To meet the requirements of underwater flexible motion and comprehensive subsea operation,a novel octopus-inspired robot with eight soft limbs was designed and developed.This robot possesses the capabilities of underwater bipedal walking,multi-arm swimming,and grasping objects.To closely interact with the underwater seabed environment and minimize disturbance,the robot employs a cable-driven flexible arm for its walking in underwater floor through a bipedal walking mode.The multi-arm swimming offers a means of three-dimensional spatial movement,allowing the robot to swiftly explore and navigate over large areas,thereby enhancing its flexibility.Furthermore,the robot’s walking arm enables it to grasp and transport objects underwater,thereby enhancing its practicality in underwater environments.A simplified motion models and gait generation strategies were proposed for two modes of robot locomotion:swimming and walking,inspired by the movement characteristics of octopus-inspired multi-arm swimming and bipedal walking.Through experimental verification,the robot’s average speed of underwater bipedal walking reaches 7.26 cm/s,while the horizontal movement speed for multi-arm swimming is 8.6 cm/s.展开更多
In this work,we combined the model based reinforcement learning(MBRL)and model free reinforcement learning(MFRL)to stabilize a biped robot(NAO robot)on a rotating platform,where the angular velocity of the platform is...In this work,we combined the model based reinforcement learning(MBRL)and model free reinforcement learning(MFRL)to stabilize a biped robot(NAO robot)on a rotating platform,where the angular velocity of the platform is unknown for the proposed learning algorithm and treated as the external disturbance.Nonparametric Gaussian processes normally require a large number of training data points to deal with the discontinuity of the estimated model.Although some improved method such as probabilistic inference for learning control(PILCO)does not require an explicit global model as the actions are obtained by directly searching the policy space,the overfitting and lack of model complexity may still result in a large deviation between the prediction and the real system.Besides,none of these approaches consider the data error and measurement noise during the training process and test process,respectively.We propose a hierarchical Gaussian processes(GP)models,containing two layers of independent GPs,where the physically continuous probability transition model of the robot is obtained.Due to the physically continuous estimation,the algorithm overcomes the overfitting problem with a guaranteed model complexity,and the number of training data is also reduced.The policy for any given initial state is generated automatically by minimizing the expected cost according to the predefined cost function and the obtained probability distribution of the state.Furthermore,a novel Q(λ)based MFRL method scheme is employed to improve the policy.Simulation results show that the proposed RL algorithm is able to balance NAO robot on a rotating platform,and it is capable of adapting to the platform with varying angular velocity.展开更多
Existing biped robots mainly fall into two categories： robots with left and right feet and robots with upper and lower feet. The load carrying capability of a biped robot is quite limited since the two feet of a walk...Existing biped robots mainly fall into two categories： robots with left and right feet and robots with upper and lower feet. The load carrying capability of a biped robot is quite limited since the two feet of a walking robot supports the robot alternatively during walking. To improve the load carrying capability, a novel biped walking robot is proposed based on a 2-UPU＋2-UU parallel mechanism. The biped walking robot is composed of two identical platforms（feet） and four limbs, including two UPU（universal-prismatic-universal serial chain） limbs and two UU limbs. To enhance its terrain adaptability like articulated vehicles, the two feet of the biped walking robot are designed as two vehicles in detail. The conditions that the geometric parameters of the feet must satisfy are discussed. The degrees-of-freedom of the mechanism is analyzed by using screw theory. Gait analysis, kinematic analysis and stability analysis of the mechanism are carried out to verify the structural design parameters. The simulation results validate the feasibility of walking on rugged terrain. Experiments with a physical prototype show that the novel biped walking robot can walk stably on smooth terrain. Due to its unique feet design and high stiffness, the biped walking robot may adapt to rugged terrain and is suitable for load-carrying.展开更多
A new biped robot with a triangle configuration is presented and it is a planar closed chain mechanism. The scalability of three sides of the triangle is realized by three actuated prismatic joints. The three vertexes...A new biped robot with a triangle configuration is presented and it is a planar closed chain mechanism. The scalability of three sides of the triangle is realized by three actuated prismatic joints. The three vertexes of the triangle are centers of three passive revolute joints coincidently. The biped mechanism for straight walking is proposed and its walking principle and mobility are explained. The static stability and the height and span of one step are analyzed. Kinematic analysis is performed to plan the gaits of walking on an even floor and going upstairs. A prototype is developed and experiments are carried out to validate the straight walking gait. Two additional revolute joints are added to form a modified biped robot which can follow the instruction of turning around. The turning ability is verified by experiments. As a new member of biped robots, its triangle configuration is used to impart geometry knowledge. Because of its high stiffness, some potential applications are on the way.展开更多
Efficient walking is one of the main goals of researches on biped robots. A feasible way is to translate the understanding from human walking into robot walking, for example, an artificial control approach on a human ...Efficient walking is one of the main goals of researches on biped robots. A feasible way is to translate the understanding from human walking into robot walking, for example, an artificial control approach on a human like walking structure. In this paper, a walking pattern based on Center of Pressure （COP） switched and modeled after human walking is introduced firstly. Then, a parameterization method for the proposed walking gait is presented. In view of the complication, a multi-space planning method which divides the whole planning task into three sub-spaces, including simplified model space, work space and joint space, is proposed. Furthermore, a finite-state-based control method is also developed to implement the proposed walking pattern. The state switches of this method are driven by sensor events. For convincing verification, a 2D simulation system with a 9-1ink planar biped robot is developed. The simulation results exhibit an efficient walking gait.展开更多
During bipedal walking,it is critical to detect and adjust the robot postures by feedback control to maintain its normal state amidst multi-source random disturbances arising from some unavoidable uncertain factors.Th...During bipedal walking,it is critical to detect and adjust the robot postures by feedback control to maintain its normal state amidst multi-source random disturbances arising from some unavoidable uncertain factors.The radical basis function（RBF）neural network model of a five-link biped robot is established,and two certain disturbances and a randomly uncertain disturbance are then mixed with the optimal torques in the network model to study the performance of the biped robot by several evaluation indices and a specific Poincar′e map.In contrast with the simulations,the response varies as desired under optimal inputting while the output is fluctuating in the situation of disturbance driving.Simulation results from noise inputting also show that the dynamics of the robot is less sensitive to the disturbance of knee joint input of the swing leg than those of the other three joints,the response errors of the biped will be increasing with higher disturbance levels,and especially there are larger output fluctuations in the knee and hip joints of the swing leg.展开更多
During dynamic walking of biped robots, the underactuated rotating degree of freedom （DOF） emerges between the support foot and the ground, which makes the biped model hybrid and dimension-variant. This paper addres...During dynamic walking of biped robots, the underactuated rotating degree of freedom （DOF） emerges between the support foot and the ground, which makes the biped model hybrid and dimension-variant. This paper addresses the asymptotic orbit stability for dimension-variant hybrid systems （DVHS）. Based on the generalized Poincare map, the stability criterion for DVHS is also presented, and the result is then used to study dynamic walking for a five-link planar biped robot with feet. Time-invariant gait planning and nonlinear control strategy for dynamic walking with fiat feet is also introduced. Simulation results indicate that an asymptotically stable limit cycle of dynamic walking is achieved by the proposed method.展开更多
Walking without impacts has been considered in dynamics as a motion/force control problem. In order to avoid impacts, an approach for both the specified motion of the biped and its ground reaction forces was presented...Walking without impacts has been considered in dynamics as a motion/force control problem. In order to avoid impacts, an approach for both the specified motion of the biped and its ground reaction forces was presented yielding a combined motion and force control problem. As an application, a walker on a horizontal plane has been considered. In this paper, it is shown how the control of the ground reaction forces and the energy consumption depend on the gradient of a slope. The biped dynamics and the constraints within the biped system and on the ground are discussed. A motion control synthesis is developed using the inverse dynamics principle proven to be most efficient for human walking research, too. The impactless walking with controlled legs is illustrated by a seven-link biped. The ＂flying＂ biped has nine degrees of freedom, with six control inputs. During locomotion, the standing leg has three scleronomic constraints, and the trunk has three rheonomic constraints. However, there are three rheonomic constraints for the prescribed leg motion or three scleronomic constraints for reaction forces of the trailing leg, respectively. The nominal control action for impactless walking can be precomputed and stored. The model proposed allows the investigation of several problems： uphill and downhill walking, optimization of step length,stiction of the feet on the slope and many more. All these findings are also of interest in biomechanics. C 2013 The Chinese Society of Theoretical and Applied Mechanics. [doi：10.1063/2.1301302]展开更多
This paper presents a novel design of minimalist bipedal walking robot with flexible ankle and split-mass balancing systems.The proposed approach implements a novel strategy to achieve stable bipedal walk by decouplin...This paper presents a novel design of minimalist bipedal walking robot with flexible ankle and split-mass balancing systems.The proposed approach implements a novel strategy to achieve stable bipedal walk by decoupling the walking motion control from the sideway balancing control.This strategy allows the walking controller to execute the walking task independently while the sideway balancing controller continuously maintains the balance of the robot.The hip-mass carry approach and selected stages of walk implemented in the control strategy can minimize the efect of major hip mass of the robot on the stability of its walk.In addition,the developed smooth joint trajectory planning eliminates the impacts of feet during the landing.In this paper,the new design of mechanism for locomotion systems and balancing systems are introduced.An additional degree of freedom introduced at the ankle joint increases the sensitivity of the system and response time to the sideway disturbances.The efectiveness of the proposed strategy is experimentally tested on a bipedal robot prototype.The experimental results provide evidence that the proposed strategy is feasible and advantageous.展开更多
基金supported in part by the National Key R&D Program under Grant 2018YFB1304504.
文摘Walking is the basic locomotion pattern for bipedal robots.The walking pattern is widely generated using the linear inverted pendulum model.The linear inverted pendulum motion of each support period can be designed as a walk primitive to be connected to form a walking trajectory.A novel method of integrating double support phase into the walk primitive was proposed in this article.The method describes the generation of walking patterns using walk primitives with double support,specifically for lateral plane including walking in place,walking for lateral,and walking initiation,and for sagittal plane including fixed step length walking,variable step length walking,and walking initiation.Compared to walk primitives without double support phase,those with double support phase reduce the maximum speed required by the robot and eliminate the need to adjust foothold for achieving continuous speed.The performance of the proposed method is validated by simulations and experiments on Neubot,a position-controlled biped robot.
基金supported by the National Natural Science Foundation of China(No.12332023)the Zhejiang Provincial Natural Science Foundation of China(No.LY23E050010).
文摘1Introduction To date,in model-based gait-planning methods,the dynamics of the center of mass(COM)of bipedal robots have been analyzed by establishing their linear inverted pendulum model(LIPM)or extended forms(Owaki et al.,2010;Englsberger et al.,2015;Xie et al.,2020).With regard to model-based gait-generation methods for uphill and downhill terrain,Kuo(2007)simulated human gait using an inverted pendulum,which provided a circular trajectory for the COM rather than a horizontal trajectory.He found that a horizontal COM trajectory consumed more muscle energy.Massah et al.(2012)utilized a 3D LIPM and the concept of zero moment point(ZMP).They developed a trajectory planner using the semi-elliptical motion equations of an NAO humanoid robot and simulated walking on various sloped terrains using the Webots platform.
基金supported by the Research Fund of State Key Laboratory of Mechanics and Control for Aerospace Structures(1005-IZD23002-25).
文摘The wheel-legged biped robot is a typical ground-based mobile robot that can combine the high velocity and high efficiency pertaining to wheeled motion and the strong,obstacle-crossing performance associated with legged motion.These robots have gradually exhibited satisfactory application potential in various harsh scenarios such as rubble rescue,military operations,and wilderness exploration.Wheel-legged biped robots are divided into four categories according to the open–close chain structure forms and operation task modes,and the latest technology research status is summarized in this paper.The hardware control system,control method,and application are analyzed,and the dynamic balance control for the two-wheel,biomimetic jumping control for the legs and whole-body control for integrating the wheels and legs are analyzed.In summary,it is observed that the current research exhibits problems,such as the insufficient application of novel materials and a rigid–flexible coupling design;the limited application of the advanced,intelligent control methods;the inadequate understanding of the bionic jumping mechanisms in robot legs;and the insufficient coordination ability of the multi-modal motion,which do not exhibit practical application for the wheel-legged biped robots.Finally,this study discusses the key research directions and development trends for the wheel-legged biped robots.
文摘In spite of its intrinsic complexities,the passive gait of bipedal robots on a sloping ramp is a subject of interest for numerous researchers.What distinguishes the present research from similar works is the consideration of flexibility in the constituent links of this type of robotic systems.This is not a far-fetched assumption because in the transient(impact)phase,due to the impulsive forces which are applied to the system,the likelihood of exciting the vibration modes increases considerably.Moreover,the human leg bones that are involved in walking are supported by viscoelastic muscles and ligaments.Therefore,for achieving more exact results,it is essential to model the robot links with viscoelastic properties.To this end,the Gibbs-Appell formulation and Newton's kinematic impact law are used to derive the most general form of the system's dynamic equations in the swing and transient phases of motion.The most important issue in the passive walking motion of bipedal robots is the determination of the initial robot configuration with which the system could accomplish a periodic and stable gait solely under the effect of gravitational force.The extremely unstable nature of the system studied in this paper and the vibrations caused by the impulsive forces induced by the impact of robot feet with the inclined surface are some of the very serious challenges encountered for achieving the above-mentioned goal.To overcome such challenges,an innovative method that uses a combination of the linearized equations of motion in the swing phase and the algebraic motion equations in the transition phase is presented in this paper to obtain an eigenvalue problem.By solving this problem,the suitable initial conditions that are necessary for the passive gait of this bipedal robot on a sloping surface are determined.The effects of the characteristic parameters of elastic links including the modulus of elasticity and the Kelvin-Voigt coefficient on the walking stability of this type of robotic systems are also studied.The findings of this parametric study reveal that the increase in the Kelvin-Voigt coefficient enhances the stability of the robotic system,while the increase in the modulus of elasticity has an opposite effect.
基金supported by the National Natural Science Foundation of China under Grants 62173248,62073245.
文摘Compliance motion and footstep adjustment are active balance control strategies from learning human subconscious behaviors.The force estimation without direct end-actuator force measurement and the optimal footsteps based on complex analytical calculation are still challenging tasks for elementary and kid-size position-controlled robots.In this paper,an online compliant controller with Gravity Projection Observer(GPO),which can express the external force condition of perturbations by the estimated Projection of Gravity(PoG)with estimation covariance,is proposed for the realization of disturbance absorption,with which the robustness of the humanoid contact with environments can be maintained.The fuzzy footstep planner based on capturability analysis is proposed,and the Model Predictive Control(MPC)is applied to generate the desired steps.The fuzzification rules are well-designed and give the corresponding control output responding to complex and changeable external disturbances.To validate the presented methods,a series of experiments on a real humanoid robot are conducted.The results verify the effectiveness of the proposed balance control framework.
基金supported by the National Natural Science Foundation of China(Grant No.12332003)CIE-Tencent Robotics X Rhino-Bird Focused Research Program,and Zhejiang Provincial Natural Science Foundation of China(Grant No.LY23E050010).
文摘In the past few decades,people have been trying to address the issue of walking instability in bipedal robots in uncertain environments.However,most control methods currently have still failed to achieve robust walking of bipedal robots under uncertain disturbances.Existing research mostly focuses on motion control methods for robots on uneven terrain and under sudden impact forces,with little consideration for the problem of continuous and intense external force disturbances in uncertain environments.In response to this issue,a disturbance-robust control method based on adaptive feedback compensation is proposed.First,based on the Lagrangian method,the dynamic model of a bipedal robot under different types of external force disturbances was established.Subsequently,through dynamic analysis,it was observed that classical control methods based on hybrid zero dynamics failed to consider the continuous and significant external force disturbances in uncertain environments.Therefore,an adaptive feedback compensation controller was designed,and an adaptive parameter adjustment optimization algorithm was proposed based on walking constraints to achieve stable walking of bipedal robots under different external force disturbances.Finally,in numerical simulation experiments,comparative analysis revealed that using only a controller based on hybrid zero dynamics was insufficient to converge the motion of a planar five-link bipedal robot subjected to periodic forces or bounded noise disturbances to a stable state.In contrast,in the adaptive feedback compensation control method,the use of an adaptive parameter adjustment optimization algorithm to generate time-varying control parameters successfully achieved stable walking of the robot under these disturbances.This indicates the effectiveness of the adaptive parameter adjustment algorithm and the robustness of the adaptive feedback compensation control method.
基金supported in part by the National Natural Science Foundation of China under Grant No.62073041,and in part by the“111”Project under Grant B08043.
文摘Reinforcement learning(RL)provides much potential for locomotion of legged robot.Due to the gap between simulation and the real world,achieving sim-to-real for legged robots is challenging.However,the support polygon of legged robots can help to overcome some of these challenges.Quadruped robot has a considerable support polygon,followed by bipedal robot with actuated feet,and point-footed bipedal robot has the smallest support polygon.Therefore,despite the existing sim-to-real gap,most of the recent RL approaches are deployed to the real quadruped robots that are inherently more stable,while the RL-based locomotion of bipedal robot is challenged by zero-shot sim-to-real task.Especially for the point-footed one that gets better dynamic performance,the inevitable tumble brings extra barriers to sim-to-real task.Actually,the crux of this type of problem is the difference of mechanics properties between the physical robot and the simulated one,making it difficult to play the learned skills well on the physical bipedal robot.In this paper,we introduce the embedded mechanics properties(EMP)based on the optimization with Gaussian processes to RL training,making it possible to perform sim-to-real transfer on the BRS1-P robot used in this work,hence the trained policy can be deployed on the BRS1-P without any struggle.We validate the performance of the learning-based BRS1-P on the condition of disturbances and terrains not ever learned,demonstrating the bipedal locomotion and resistant performance.
基金provided by Hy Action Plan Project(Grant no.7172755A)the Key Projects of Science and Technology Plan of Zhejiang Province(Grant no.2019C04018)partially by the Ministry of Science and Higher Education of the Russian Federation as part of the World-class Research Center program:Advanced Digital Technologies(contract No.075-15-2022-312 dated 20.04.2022).
文摘In developing and exploring extreme and harsh underwater environments,underwater robots can effectively replace humans to complete tasks.To meet the requirements of underwater flexible motion and comprehensive subsea operation,a novel octopus-inspired robot with eight soft limbs was designed and developed.This robot possesses the capabilities of underwater bipedal walking,multi-arm swimming,and grasping objects.To closely interact with the underwater seabed environment and minimize disturbance,the robot employs a cable-driven flexible arm for its walking in underwater floor through a bipedal walking mode.The multi-arm swimming offers a means of three-dimensional spatial movement,allowing the robot to swiftly explore and navigate over large areas,thereby enhancing its flexibility.Furthermore,the robot’s walking arm enables it to grasp and transport objects underwater,thereby enhancing its practicality in underwater environments.A simplified motion models and gait generation strategies were proposed for two modes of robot locomotion:swimming and walking,inspired by the movement characteristics of octopus-inspired multi-arm swimming and bipedal walking.Through experimental verification,the robot’s average speed of underwater bipedal walking reaches 7.26 cm/s,while the horizontal movement speed for multi-arm swimming is 8.6 cm/s.
文摘In this work,we combined the model based reinforcement learning(MBRL)and model free reinforcement learning(MFRL)to stabilize a biped robot(NAO robot)on a rotating platform,where the angular velocity of the platform is unknown for the proposed learning algorithm and treated as the external disturbance.Nonparametric Gaussian processes normally require a large number of training data points to deal with the discontinuity of the estimated model.Although some improved method such as probabilistic inference for learning control(PILCO)does not require an explicit global model as the actions are obtained by directly searching the policy space,the overfitting and lack of model complexity may still result in a large deviation between the prediction and the real system.Besides,none of these approaches consider the data error and measurement noise during the training process and test process,respectively.We propose a hierarchical Gaussian processes(GP)models,containing two layers of independent GPs,where the physically continuous probability transition model of the robot is obtained.Due to the physically continuous estimation,the algorithm overcomes the overfitting problem with a guaranteed model complexity,and the number of training data is also reduced.The policy for any given initial state is generated automatically by minimizing the expected cost according to the predefined cost function and the obtained probability distribution of the state.Furthermore,a novel Q(λ)based MFRL method scheme is employed to improve the policy.Simulation results show that the proposed RL algorithm is able to balance NAO robot on a rotating platform,and it is capable of adapting to the platform with varying angular velocity.
基金supported by National Natural Science Foundation of China(Grant No.51175030)Fundamental Research Funds for the Central Universities of China(Grant No.2012JBZ002)
文摘Existing biped robots mainly fall into two categories： robots with left and right feet and robots with upper and lower feet. The load carrying capability of a biped robot is quite limited since the two feet of a walking robot supports the robot alternatively during walking. To improve the load carrying capability, a novel biped walking robot is proposed based on a 2-UPU＋2-UU parallel mechanism. The biped walking robot is composed of two identical platforms（feet） and four limbs, including two UPU（universal-prismatic-universal serial chain） limbs and two UU limbs. To enhance its terrain adaptability like articulated vehicles, the two feet of the biped walking robot are designed as two vehicles in detail. The conditions that the geometric parameters of the feet must satisfy are discussed. The degrees-of-freedom of the mechanism is analyzed by using screw theory. Gait analysis, kinematic analysis and stability analysis of the mechanism are carried out to verify the structural design parameters. The simulation results validate the feasibility of walking on rugged terrain. Experiments with a physical prototype show that the novel biped walking robot can walk stably on smooth terrain. Due to its unique feet design and high stiffness, the biped walking robot may adapt to rugged terrain and is suitable for load-carrying.
基金supported by Geometry Robots for Science and Technology Education Exhibits (Beijing Municipal Commission of Education)Program for New Century Excellent Talents in University (Grant No.NCET-07-0063)+2 种基金National Natural Science Foundation of China (Grant No. 50875018)Beijing Municipal Natural Science Foundation of China (Grant No. 3093025)Science Foundation of Beijing Jiaotong University (Grant No. 2009JBZ001-1)
文摘A new biped robot with a triangle configuration is presented and it is a planar closed chain mechanism. The scalability of three sides of the triangle is realized by three actuated prismatic joints. The three vertexes of the triangle are centers of three passive revolute joints coincidently. The biped mechanism for straight walking is proposed and its walking principle and mobility are explained. The static stability and the height and span of one step are analyzed. Kinematic analysis is performed to plan the gaits of walking on an even floor and going upstairs. A prototype is developed and experiments are carried out to validate the straight walking gait. Two additional revolute joints are added to form a modified biped robot which can follow the instruction of turning around. The turning ability is verified by experiments. As a new member of biped robots, its triangle configuration is used to impart geometry knowledge. Because of its high stiffness, some potential applications are on the way.
基金Acknowledgements The work was supported by National Natural Science Foundation of China under grant 50775037 and 51075071.
文摘Efficient walking is one of the main goals of researches on biped robots. A feasible way is to translate the understanding from human walking into robot walking, for example, an artificial control approach on a human like walking structure. In this paper, a walking pattern based on Center of Pressure （COP） switched and modeled after human walking is introduced firstly. Then, a parameterization method for the proposed walking gait is presented. In view of the complication, a multi-space planning method which divides the whole planning task into three sub-spaces, including simplified model space, work space and joint space, is proposed. Furthermore, a finite-state-based control method is also developed to implement the proposed walking pattern. The state switches of this method are driven by sensor events. For convincing verification, a 2D simulation system with a 9-1ink planar biped robot is developed. The simulation results exhibit an efficient walking gait.
基金supported by the Science Fund for Creative Research Groups of National Natural Science Foundation of China(51221004)the National Natural Science Foundation of China(11172260,11372270,and 51375434)+2 种基金the Higher School Specialized Research Fund for the Doctoral Program(20110101110016)the Science and technology project of Zhejiang Province(2013C31086)the Fundamental Research Funds forthe Central Universities of China(2013XZZX005)
文摘During bipedal walking,it is critical to detect and adjust the robot postures by feedback control to maintain its normal state amidst multi-source random disturbances arising from some unavoidable uncertain factors.The radical basis function（RBF）neural network model of a five-link biped robot is established,and two certain disturbances and a randomly uncertain disturbance are then mixed with the optimal torques in the network model to study the performance of the biped robot by several evaluation indices and a specific Poincar′e map.In contrast with the simulations,the response varies as desired under optimal inputting while the output is fluctuating in the situation of disturbance driving.Simulation results from noise inputting also show that the dynamics of the robot is less sensitive to the disturbance of knee joint input of the swing leg than those of the other three joints,the response errors of the biped will be increasing with higher disturbance levels,and especially there are larger output fluctuations in the knee and hip joints of the swing leg.
基金the National Natural Science Foundation of China (No. 50575119)the 863 Program(No. 2006AA04Z253)the Ph.D.Programs Foundation of Ministry of Education of China(No. 20060003026)
文摘During dynamic walking of biped robots, the underactuated rotating degree of freedom （DOF） emerges between the support foot and the ground, which makes the biped model hybrid and dimension-variant. This paper addresses the asymptotic orbit stability for dimension-variant hybrid systems （DVHS）. Based on the generalized Poincare map, the stability criterion for DVHS is also presented, and the result is then used to study dynamic walking for a five-link planar biped robot with feet. Time-invariant gait planning and nonlinear control strategy for dynamic walking with fiat feet is also introduced. Simulation results indicate that an asymptotically stable limit cycle of dynamic walking is achieved by the proposed method.
基金supported by Overseas Training Program for Young Backbone Teachers from Tongji University, China(2010)
文摘Walking without impacts has been considered in dynamics as a motion/force control problem. In order to avoid impacts, an approach for both the specified motion of the biped and its ground reaction forces was presented yielding a combined motion and force control problem. As an application, a walker on a horizontal plane has been considered. In this paper, it is shown how the control of the ground reaction forces and the energy consumption depend on the gradient of a slope. The biped dynamics and the constraints within the biped system and on the ground are discussed. A motion control synthesis is developed using the inverse dynamics principle proven to be most efficient for human walking research, too. The impactless walking with controlled legs is illustrated by a seven-link biped. The ＂flying＂ biped has nine degrees of freedom, with six control inputs. During locomotion, the standing leg has three scleronomic constraints, and the trunk has three rheonomic constraints. However, there are three rheonomic constraints for the prescribed leg motion or three scleronomic constraints for reaction forces of the trailing leg, respectively. The nominal control action for impactless walking can be precomputed and stored. The model proposed allows the investigation of several problems： uphill and downhill walking, optimization of step length,stiction of the feet on the slope and many more. All these findings are also of interest in biomechanics. C 2013 The Chinese Society of Theoretical and Applied Mechanics. [doi：10.1063/2.1301302]
文摘This paper presents a novel design of minimalist bipedal walking robot with flexible ankle and split-mass balancing systems.The proposed approach implements a novel strategy to achieve stable bipedal walk by decoupling the walking motion control from the sideway balancing control.This strategy allows the walking controller to execute the walking task independently while the sideway balancing controller continuously maintains the balance of the robot.The hip-mass carry approach and selected stages of walk implemented in the control strategy can minimize the efect of major hip mass of the robot on the stability of its walk.In addition,the developed smooth joint trajectory planning eliminates the impacts of feet during the landing.In this paper,the new design of mechanism for locomotion systems and balancing systems are introduced.An additional degree of freedom introduced at the ankle joint increases the sensitivity of the system and response time to the sideway disturbances.The efectiveness of the proposed strategy is experimentally tested on a bipedal robot prototype.The experimental results provide evidence that the proposed strategy is feasible and advantageous.
