Robust teleoperation in image-guided interventions faces critical challenges from latency,deformation,and the quasi-periodic nature of physiological motion.This paper presents a fully integrated,latency-aware visual s...Robust teleoperation in image-guided interventions faces critical challenges from latency,deformation,and the quasi-periodic nature of physiological motion.This paper presents a fully integrated,latency-aware visual servoing system leveraging stereo vision,hand–eye calibration,and learning-based prediction for motion-compensated teleoperation.The system combines a calibrated binocular camera setup,dual robotic arms,and a predictive control loop incorporating Long Short-Term Memory(LSTM)and Temporal Convolutional Network(TCN)models.Through experiments using both in vivo and phantom datasets,we quantitatively assess the prediction accuracy and motion-compensation performance of both models.Results show that TCNs deliver more stable and precise tracking,especially on regular trajectories,while LSTMs exhibit robustness under quasi-periodic dynamics.By matching prediction horizons to system latency,the approach significantly reduces peak and steady-state tracking errors,demonstrating practical feasibility for deploying prediction-augmented servoing in teleoperated surgical.展开更多
This paper presents a new solution to haptic based teleoperation to control a large-sized slave robot for space exploration, which includes two specially designed haptic joysticks, a hybrid master-slave motion mapping...This paper presents a new solution to haptic based teleoperation to control a large-sized slave robot for space exploration, which includes two specially designed haptic joysticks, a hybrid master-slave motion mapping method, and a haptic feedback model rendering the operating resistance and the interactive feedback on the slave side. Two devices using the 3 R and DELTA mechanisms respectively are developed to be manipulated to control the position and orientation of a large-sized slave robot by using both of a user's two hands respectively. The hybrid motion mapping method combines rate control and variable scaled position mapping to realize accurate and efficient master-slave control. Haptic feedback for these two mapping modes is designed with emphasis on ergonomics to improve the immersion of haptic based teleoperation. A stiffness estimation method is used to calculate the contact stiffness on the slave side and play the contact force rendered by using a traditional spring-damping model to a user on the master side stably. Experiments by using virtual environments to simulate the slave side are conducted to validate the effectiveness and efficiency of the proposed solution.展开更多
Haptic teleoperation in nuclear and aerospace applications faces challenges such as a limited workspace,high payload demands,and the need for both coarse positioning and fine manipulation.Existing commercial systems o...Haptic teleoperation in nuclear and aerospace applications faces challenges such as a limited workspace,high payload demands,and the need for both coarse positioning and fine manipulation.Existing commercial systems often lack structural consistency between master and slave devices,which leads to complex motion mapping and limited adaptability.This paper presents a modular isomorphic haptic master device and dual-mode control strategy tailored for these environments.Two reconfigurable versions(5-DOF and 6-DOF)were developed to match the task-specific slave arms.The system supports autonomous-to-manual switching,joint and end-effector mapping,and real-time haptic rendering.Simulations and experiments verified their performance in representative scenarios.The proposed solution addresses structural mismatches and control inflexibility through a scalable task-driven design for high-risk remote operations.展开更多
Force feedback bilateral teleoperation represents a pivotal advancement in control technology,finding widespread application in hazardous material transportation,perilous environments,space and deep-sea exploration,an...Force feedback bilateral teleoperation represents a pivotal advancement in control technology,finding widespread application in hazardous material transportation,perilous environments,space and deep-sea exploration,and healthcare domains.This paper traces the evolutionary trajectory of force feedback bilateral teleoperation from its conceptual inception to its current complexity.It elucidates the fundamental principles underpinning interaction forces and tactile exchanges,with a specific emphasis on the crucial role of tactile devices.In this review,a quantitative analysis of force feedback bilateral teleoperation development trends from 2011 to 2024 has been conducted,utilizing published journal article data as the primary source of information.The review accentuates classical control frameworks and algorithms,while also delving into existing research advancements and prospec-tive breakthrough directions.Moreover,it explores specific practical scenarios ranging from intricate surgeries to hazardous environment exploration,underscoring the technology’s potential to revolutionize industries by augmenting human manipulation of remote systems.This underscores the pivotal role of force feedback bilateral teleoperation as a transformative human-machine interface,capable of shaping flexible control strategies and addressing technological bottlenecks.Future research endeavors in force feedback bilateral teleoperation are expected to prioritize the creation of more immersive experiences,overcoming technical hurdles,fortifying human-machine collaboration,and broadening application domains,particularly within the realms of medical intervention and hazardous environments.With the continuous progression of technology,the integration of human intelligence and robotic capabilities is expected to produce more innovations and breakthroughs in the field of automatic control.展开更多
In this paper,a self-developed master-slave follow-up disc cutter is used to conduct rock-breaking tests on hard sandstone samples.Different working parameters were employed in the tests(e.g.cutting depth,cutting spee...In this paper,a self-developed master-slave follow-up disc cutter is used to conduct rock-breaking tests on hard sandstone samples.Different working parameters were employed in the tests(e.g.cutting depth,cutting speed,cutting angle,and rotational speed)in order to explore their influences on cutting performance.The results indicate that the thrust,torque,vibration velocity,and roughness all increased continuously with increase of the propulsion speed and cutting depth.At the same time,the specific energy consumption was found to decrease continuously.As the rotational speed was increased,the thrust increased at first and then decreased.In contrast,the torque and roughness continuously decreased,and the specific energy consumption and vibration speed continuously increased.When the cutting angle was increased,the thrust remained unchanged.However,the torque,specific energy consumption,and vibration speed all decreased continuously,and the roughness increased continuously.The temperature of the surface of the cutting tool was found to be relatively uniformly distributed during the rock-breaking process;the highest temperatures generated were in the range of 200-300℃.As the propulsion speed,cutting depth,and cutting angle were increased,the proportion of tensile fractures produced appeared to increase and the proportion of shear fractures decreased.As the rotational speed was increased,the proportion of tensile fractures decreased and the proportion of shear fractures increased.The results could provide useful information on the rock-breaking behavior involved and can be used to offer technical support for engineers using master-slave follow-up disc cutters in the field.展开更多
This paper investigates the problem of cluster synchronization of master-slave complex net-works with time-varying delay via linear and adaptive feedback pinning controls.We need not non-delayed and delayed coupling m...This paper investigates the problem of cluster synchronization of master-slave complex net-works with time-varying delay via linear and adaptive feedback pinning controls.We need not non-delayed and delayed coupling matrices to be symmetric or irreducible.We have the advantages of using adaptive control method to reduce control gain and pinning control technology to reduce cost.By con-structing Lyapunov function,some sufficient synchronization criteria are established.Finally,numerical examples are employed to illustrate the effectiveness of the proposed approach.展开更多
This article investigates virtual reality (VR)-based teleoperation with robustness against modeling errors. VR technology is an effective way to overcome the large time delay during space robot teleoperation. However,...This article investigates virtual reality (VR)-based teleoperation with robustness against modeling errors. VR technology is an effective way to overcome the large time delay during space robot teleoperation. However, it depends highly on the accuracy of model. Model errors between the virtual and real environment exist inevitably. The existing way to deal with the problem is by means of either model matching or robot compliance control. As distinct from the existing methods, this article tries to combine m...展开更多
Welding seam tracking precision was decreased due to human hand tremor during the master-slave welding teleoperation. To solve this problem, a master-slave robot remote welding system was built, the system consisted o...Welding seam tracking precision was decreased due to human hand tremor during the master-slave welding teleoperation. To solve this problem, a master-slave robot remote welding system was built, the system consisted of a master manipulator with six degree of freedom （ DOF ） , an industrial computer control system and a slave Motoman HP3 J robot, and human hand tremor and digital filtering were discussed. An optimal digital filter was designed to clean human tremor signal for improving the welding seam tracking precision. The experimental results show that the digital filter suppresses the operator＇ s tremor signal.展开更多
A particular emphasis is put on a novel wearable exoskeleton arm, ZJUESA, with 6 degrees of freedom, which is used for the robot teleoperation with the force-feedback in the unknown environment. In this external struc...A particular emphasis is put on a novel wearable exoskeleton arm, ZJUESA, with 6 degrees of freedom, which is used for the robot teleoperation with the force-feedback in the unknown environment. In this external structure mechanism, the 3-revolution-prismatic-spherical （3RPS） parallel mechanism is devised from the concept of the human upper-limb anatomy and applied for the shoulder 3-DOF joint. Meanwhile, the orthogonal experiment design method is introduced for its optimal design. Aiming at enhancing the performance of teleoperation, the force feedback is employed by the pneumatic system on ZJUESA to produce the vivid feeling in addition to the soft control interface. Due to the compressibility and nonlinearity of the pneumatic force feedback system, a novel hybrid fuzzy controller for the precise force control is proposed and realized based on the Mega8 microcontroller units as the units of the distributed control system on ZJUESA. With the results of several experiments for master-slave control with force feedback, the feasibility of ZJUESA system and the effect of its hybrid fuzzy controller are verified.展开更多
This paper presents a new composite nonlinear bilateral control method based on the nonlinear disturbance observer(NDOB) for teleoperation systems with external disturbances. By introducing the estimations of NDOB and...This paper presents a new composite nonlinear bilateral control method based on the nonlinear disturbance observer(NDOB) for teleoperation systems with external disturbances. By introducing the estimations of NDOB and systems' nominal nonlinear dynamics into controller design, a NDOB based composite nonlinear bilateral controller is constructed to attenuate the influence of disturbance and uncertain nonlinearities. As compared with the existing bilateral control methods which usually achieve force haptic(i.e., contact force tracking)through a passive way, the newly proposed method has two major merits: 1) asymptotical convergence of both position and force tracking errors is guaranteed;2) disturbance influence on force tracking error dynamics is rejected through the direct feedforward compensation of disturbance estimation. Simulations on a nonlinear teleoperation system are carried out and the results validate the effectiveness of the proposed controller.展开更多
State convergence is a novel control algorithm for bilateral teleoperation of robotic systems. First, it models the teleoperation system on state space and considers all the possible interactions between the master an...State convergence is a novel control algorithm for bilateral teleoperation of robotic systems. First, it models the teleoperation system on state space and considers all the possible interactions between the master and slave systems. Second, it presents an elegant design procedure which requires a set of equations to be solved in order to compute the control gains of the bilateral loop. These design conditions are obtained by turning the master-slave error into an autonomous system and imposing the desired dynamic behavior of the teleoperation system. Resultantly, the convergence of master and slave states is achieved in a well-defined manner. The present study aims at achieving a similar convergence behavior offered by state convergence controller while reducing the number of variables sent across the communication channel. The proposal suggests transmitting composite master and slave variables instead of full master and slave states while keeping the operator's force channel intact. We show that,with these composite and force variables;it is indeed possible to achieve the convergence of states in a desired way by strictly following the method of state convergence. The proposal leads to a reduced complexity state convergence algorithm which is termed as composite state convergence controller. In order to validate the proposed scheme in the absence and presence of communication time delays, MATLAB simulations and semi-real time experiments are performed on a single degree-of-freedom teleoperation system.展开更多
In this paper,the problem of time varying telecommunication delays in passive teleoperation systems is addressed.The design comprises delayed position,velocity and position-velocity signals with the local position and...In this paper,the problem of time varying telecommunication delays in passive teleoperation systems is addressed.The design comprises delayed position,velocity and position-velocity signals with the local position and velocity signals of the master and slave manipulators.Nonlinear adaptive control terms are employed locally to cope with uncertain parameters associated with the gravity loading vector of the master and slave manipulators.Lyapunov-Krasovskii function is employed for three methods to establish asymptotic tracking property of the closed loop teleoperation systems.The stability analysis is derived for both symmetrical and unsymmetrical time varying delays in the forward and backward communication channel that connects the local and remote sites.Finally,evaluation results are presented to illustrate the efectiveness of the proposed design for real-time applications.展开更多
Teleoperation rendezvous and docking can be used as a backup for autonomous rendezvous and docking（RVD） for an unmanned spacecraft when the autonomous system is failure or for guiding the chaser docking with an unco...Teleoperation rendezvous and docking can be used as a backup for autonomous rendezvous and docking（RVD） for an unmanned spacecraft when the autonomous system is failure or for guiding the chaser docking with an uncooperative target.The theoretical model for analyzing the handling qualities in teleoperation RVD process is established based on the previous studies conducted by National Aeronautics and Space Administration（NASA）.The predictive factor is introduced to describe the pilot＇s predictive ability in the teleoperation tasks with time delay,which interrelates with the skills of a pilot and the predictive assist approach used in the tasks such as the predictive display method.Based on the semi-physical simulation system in our laboratory,900 experiments at two levels of time delay are carried out by 18 volunteers for validating the established model.The experimental results demonstrate the correctness of the theoretical model and indicate that a skilled pilot has a predictive ability of approximately 0.9 in teleoperation RVD tasks.The theoretical analysis shows that the handling qualities are greatly affected by the time delay and the predictive factor,and it is impossible to achieve a teleoperation RVD task for the skilled pilot when the time delay is larger than 9.0 s.展开更多
Upon flaws of current blockchain platforms of heavyweight, large capacity of ledger, and time-consuming of synchronization of data, in this paper, we proposed a new paradigm of master-slave blockchain scheme(MSB) for ...Upon flaws of current blockchain platforms of heavyweight, large capacity of ledger, and time-consuming of synchronization of data, in this paper, we proposed a new paradigm of master-slave blockchain scheme(MSB) for pervasive computing that suitable for general PC, mobile device such as smart phones or PADs to participants in the working of mining and verification, in which we separated traditional blockchain model in 2 layer defined as master node layer and a series of slavery agents layer, then we proposed 2 approaches for partially computing model(PCM) and non-computing of model(NCM) in the MSB blockchain, Finally large amounts of simulations manifest the proposed master-slave blockchain scheme is feasible, extendible and suitable for pervasive computing especially in the 5 G generation environment, and can apply in the DRM-related applications.展开更多
Teleoperation can assist people to complete various complex tasks in inaccessible or high-risk environments,in which a wearable hand exoskeleton is one of the key devices.Adequate adaptability would be available to en...Teleoperation can assist people to complete various complex tasks in inaccessible or high-risk environments,in which a wearable hand exoskeleton is one of the key devices.Adequate adaptability would be available to enable the master hand exoskeleton to capture the motion of human fingers and reproduce the contact force between the slave hand and its object.This paper presents a novel finger exoskeleton based on the cascading four-link closed-loop kinematic chain.Each finger has an independent closed-loop kinematic chain,and the angle sensors are used to obtain the finger motion including the flexion/extension and the adduction/abduction.The cable tension is changed by the servo motor to transmit the contact force to the fingers in real time.Based on the finger exoskeleton,an adaptive hand exoskeleton is consequently developed.In addition,the hand exoskeleton is tested in a master-slave system.The experiment results show that the adaptive hand exoskeleton can be worn without any mechanical constraints,and the slave hand can follow the motions of each human finger.The accuracy and the real-time capability of the force reproduction are validated.The proposed adaptive hand exoskeleton can be employed as the master hand to remotely control the humanoid five-fingered dexterous slave hand,thus,enabling the teleoperation system to complete complex dexterous manipulation tasks.展开更多
Bilateral teleoperation system is referred to as a promising technology to extend human actions and intelligence to manipulating objects remotely.For the tracking control of teleoperation systems,velocity measurements...Bilateral teleoperation system is referred to as a promising technology to extend human actions and intelligence to manipulating objects remotely.For the tracking control of teleoperation systems,velocity measurements are necessary to provide feedback information.However,due to hardware technology and cost constraints,the velocity measurements are not always available.In addition,the time-varying communication delay makes it challenging to achieve tracking task.This paper provides a solution to the issue of real-time tracking for teleoperation systems,subjected to unavailable velocity signals and time-varying communication delays.In order to estimate the velocity information,immersion and invariance(I&I)technique is employed to develop an exponential stability velocity observer.For the proposed velocity observer,a linear relationship between position and observation state is constructed,through which the need of solving partial differential and certain integral equations can be avoided.Meanwhile,the mean value theorem is exploited to separate the observation error terms,and hence,all functions in our observer can be analytically expressed.With the estimated velocity information,a slave-torque feedback control law is presented.A novel Lyapunov-Krasovskii functional is constructed to establish asymptotic tracking conditions.In particular,the relationship between the controller design parameters and the allowable maximum delay values is provided.Finally,simulation and experimental results reveal that the proposed velocity observer and controller can guarantee that the observation errors and tracking error converge to zero.展开更多
The teleoperation of a 6 degrees-of-freedom(DOF)manipulator is one of the basic methods to extend people’s capabilities in the wide variety of applications.The master interface based on the force/torque(FT)sensor cou...The teleoperation of a 6 degrees-of-freedom(DOF)manipulator is one of the basic methods to extend people’s capabilities in the wide variety of applications.The master interface based on the force/torque(FT)sensor could provide the full-dimension intuitive teleoperation of a 6-DOF robot since it has the ability to trigger 6-DOF command input.However,due to the force coupling,noise disturbance and unlimited input signals of the FT sensor,this force-sensed interface could not be widely used in practice.In this paper,we present an intuitive teleoperation method based on the FT sensor to overcome these challenges.In this method,the input signals from the force-sensed joystick were filtered and then processed to the force commands by force limit algorithm,with the merits of anti-interference,output limitation,and online velocity adjustment.Furthermore,based on the admittance control and position controller,the manipulator could be teleoperated by the force commands.Three experiments were conducted on our self-designed robotic system.The result of the first experiment shows that the interfered force from the force coupling could be effectively suppressed with the limitation of the input force through force limit algorithm.Then,a parameter was introduced in the other two experiments to adjust the velocity online practically with force limit algorithm.The proposed method could give a practical solution to the intuitive teleoperation based on the FT sensor.展开更多
Currently,most teleoperation work is focusing on scenarios where slave robots interact with unknown environments.However,in some fields such as medical robots or rescue robots,the other typical teleoperation applicati...Currently,most teleoperation work is focusing on scenarios where slave robots interact with unknown environments.However,in some fields such as medical robots or rescue robots,the other typical teleoperation application is precise object transportation.Generally,the object’s weight is unknown yet essential for both accurate control of the slave robot and intuitive perception of the human operator.However,due to high cost and limited installation space,it is unreliable to employ a force sensor to directly measure the weight.Therefore,in this paper,a control scheme free of force sensor is proposed for teleoperation robots to transfer a weight-unknown object accurately.In this scheme,the workspace mapping between master and slave robot is firstly established,based on which,the operator can generate command trajectory on-line by operating the master robot.Then,a slave controller is designed to follow the master command closely and estimate the object’s weight rapidly,accurately and robust to unmodeled uncertainties.Finally,for the sake of telepresence,a master controller is designed to generate force feedback to reproduce the estimated weight of the object.In the end,comparative experiments show that the proposed scheme can achieve better control accuracy and telepresence,with accurate force feedback generated in only 500 ms.展开更多
基金Support by Sichuan Science and Technology Program[2023YFSY0026,2023YFH0004]Guangzhou Huashang University[2024HSZD01,HS2023JYSZH01].
文摘Robust teleoperation in image-guided interventions faces critical challenges from latency,deformation,and the quasi-periodic nature of physiological motion.This paper presents a fully integrated,latency-aware visual servoing system leveraging stereo vision,hand–eye calibration,and learning-based prediction for motion-compensated teleoperation.The system combines a calibrated binocular camera setup,dual robotic arms,and a predictive control loop incorporating Long Short-Term Memory(LSTM)and Temporal Convolutional Network(TCN)models.Through experiments using both in vivo and phantom datasets,we quantitatively assess the prediction accuracy and motion-compensation performance of both models.Results show that TCNs deliver more stable and precise tracking,especially on regular trajectories,while LSTMs exhibit robustness under quasi-periodic dynamics.By matching prediction horizons to system latency,the approach significantly reduces peak and steady-state tracking errors,demonstrating practical feasibility for deploying prediction-augmented servoing in teleoperated surgical.
基金supported by the Open Research Fund of Key Laboratory of Space Utilization,Chinese Academy of Sciences(No.LSU-YKZX-2017-02)
文摘This paper presents a new solution to haptic based teleoperation to control a large-sized slave robot for space exploration, which includes two specially designed haptic joysticks, a hybrid master-slave motion mapping method, and a haptic feedback model rendering the operating resistance and the interactive feedback on the slave side. Two devices using the 3 R and DELTA mechanisms respectively are developed to be manipulated to control the position and orientation of a large-sized slave robot by using both of a user's two hands respectively. The hybrid motion mapping method combines rate control and variable scaled position mapping to realize accurate and efficient master-slave control. Haptic feedback for these two mapping modes is designed with emphasis on ergonomics to improve the immersion of haptic based teleoperation. A stiffness estimation method is used to calculate the contact stiffness on the slave side and play the contact force rendered by using a traditional spring-damping model to a user on the master side stably. Experiments by using virtual environments to simulate the slave side are conducted to validate the effectiveness and efficiency of the proposed solution.
基金Supported by National Key Research and Development Program of China(Grant No.2022YFE0112500).
文摘Haptic teleoperation in nuclear and aerospace applications faces challenges such as a limited workspace,high payload demands,and the need for both coarse positioning and fine manipulation.Existing commercial systems often lack structural consistency between master and slave devices,which leads to complex motion mapping and limited adaptability.This paper presents a modular isomorphic haptic master device and dual-mode control strategy tailored for these environments.Two reconfigurable versions(5-DOF and 6-DOF)were developed to match the task-specific slave arms.The system supports autonomous-to-manual switching,joint and end-effector mapping,and real-time haptic rendering.Simulations and experiments verified their performance in representative scenarios.The proposed solution addresses structural mismatches and control inflexibility through a scalable task-driven design for high-risk remote operations.
基金supported by the MSIT(Ministry of Science and ICT),Republic of Korea,under the Convergence Security Core Talent Training Business Support Program(IITP-2024-RS-2024-00423071)supervised by the IITP(Institute of Information&Communications Technology Planning&Evaluation)supported by Sichuan Science and Technology Program(2023YFSY0026,2023YFH0004).
文摘Force feedback bilateral teleoperation represents a pivotal advancement in control technology,finding widespread application in hazardous material transportation,perilous environments,space and deep-sea exploration,and healthcare domains.This paper traces the evolutionary trajectory of force feedback bilateral teleoperation from its conceptual inception to its current complexity.It elucidates the fundamental principles underpinning interaction forces and tactile exchanges,with a specific emphasis on the crucial role of tactile devices.In this review,a quantitative analysis of force feedback bilateral teleoperation development trends from 2011 to 2024 has been conducted,utilizing published journal article data as the primary source of information.The review accentuates classical control frameworks and algorithms,while also delving into existing research advancements and prospec-tive breakthrough directions.Moreover,it explores specific practical scenarios ranging from intricate surgeries to hazardous environment exploration,underscoring the technology’s potential to revolutionize industries by augmenting human manipulation of remote systems.This underscores the pivotal role of force feedback bilateral teleoperation as a transformative human-machine interface,capable of shaping flexible control strategies and addressing technological bottlenecks.Future research endeavors in force feedback bilateral teleoperation are expected to prioritize the creation of more immersive experiences,overcoming technical hurdles,fortifying human-machine collaboration,and broadening application domains,particularly within the realms of medical intervention and hazardous environments.With the continuous progression of technology,the integration of human intelligence and robotic capabilities is expected to produce more innovations and breakthroughs in the field of automatic control.
基金study was supported by the National Key Research and Development Program of China(Grant No.2023YFC2907202)the National Natural Science Foundation of China(Grant No.52404116)the Postdoctoral Fellowship Program of CPSF(Grant No.GZB20240129).
文摘In this paper,a self-developed master-slave follow-up disc cutter is used to conduct rock-breaking tests on hard sandstone samples.Different working parameters were employed in the tests(e.g.cutting depth,cutting speed,cutting angle,and rotational speed)in order to explore their influences on cutting performance.The results indicate that the thrust,torque,vibration velocity,and roughness all increased continuously with increase of the propulsion speed and cutting depth.At the same time,the specific energy consumption was found to decrease continuously.As the rotational speed was increased,the thrust increased at first and then decreased.In contrast,the torque and roughness continuously decreased,and the specific energy consumption and vibration speed continuously increased.When the cutting angle was increased,the thrust remained unchanged.However,the torque,specific energy consumption,and vibration speed all decreased continuously,and the roughness increased continuously.The temperature of the surface of the cutting tool was found to be relatively uniformly distributed during the rock-breaking process;the highest temperatures generated were in the range of 200-300℃.As the propulsion speed,cutting depth,and cutting angle were increased,the proportion of tensile fractures produced appeared to increase and the proportion of shear fractures decreased.As the rotational speed was increased,the proportion of tensile fractures decreased and the proportion of shear fractures increased.The results could provide useful information on the rock-breaking behavior involved and can be used to offer technical support for engineers using master-slave follow-up disc cutters in the field.
文摘This paper investigates the problem of cluster synchronization of master-slave complex net-works with time-varying delay via linear and adaptive feedback pinning controls.We need not non-delayed and delayed coupling matrices to be symmetric or irreducible.We have the advantages of using adaptive control method to reduce control gain and pinning control technology to reduce cost.By con-structing Lyapunov function,some sufficient synchronization criteria are established.Finally,numerical examples are employed to illustrate the effectiveness of the proposed approach.
基金National Natural Science Foundation of China (60675054)National High-Tech Research and Development Program (2006AA04Z228)"111" Project (B07018)
文摘This article investigates virtual reality (VR)-based teleoperation with robustness against modeling errors. VR technology is an effective way to overcome the large time delay during space robot teleoperation. However, it depends highly on the accuracy of model. Model errors between the virtual and real environment exist inevitably. The existing way to deal with the problem is by means of either model matching or robot compliance control. As distinct from the existing methods, this article tries to combine m...
基金This research is supported by National Natural Science Foundation of China （No. 50905043）.
文摘Welding seam tracking precision was decreased due to human hand tremor during the master-slave welding teleoperation. To solve this problem, a master-slave robot remote welding system was built, the system consisted of a master manipulator with six degree of freedom （ DOF ） , an industrial computer control system and a slave Motoman HP3 J robot, and human hand tremor and digital filtering were discussed. An optimal digital filter was designed to clean human tremor signal for improving the welding seam tracking precision. The experimental results show that the digital filter suppresses the operator＇ s tremor signal.
基金National Natural Science Foundation of China(No.50305035)
文摘A particular emphasis is put on a novel wearable exoskeleton arm, ZJUESA, with 6 degrees of freedom, which is used for the robot teleoperation with the force-feedback in the unknown environment. In this external structure mechanism, the 3-revolution-prismatic-spherical （3RPS） parallel mechanism is devised from the concept of the human upper-limb anatomy and applied for the shoulder 3-DOF joint. Meanwhile, the orthogonal experiment design method is introduced for its optimal design. Aiming at enhancing the performance of teleoperation, the force feedback is employed by the pneumatic system on ZJUESA to produce the vivid feeling in addition to the soft control interface. Due to the compressibility and nonlinearity of the pneumatic force feedback system, a novel hybrid fuzzy controller for the precise force control is proposed and realized based on the Mega8 microcontroller units as the units of the distributed control system on ZJUESA. With the results of several experiments for master-slave control with force feedback, the feasibility of ZJUESA system and the effect of its hybrid fuzzy controller are verified.
基金supported in part by the National Natural Science Foundation of China(61573099,61633003,61750110525,61903192)Fundamental Research Funds for the Central Universities(2242016R30011)+5 种基金Graduate Innovation Program of Jiangsu Province(KYLX15-0114)Scientific Research Foundation of Graduate School of Southeast University(YBJJ1561)Open Project Program of Ministry of EducationKey Laboratory of Measurement and Control of School of Computer Science and Engineering(CSE) MCCSE2017A01,MCCSE2019A01)Chinese Scholarship CouncilNewton Fund by the British Council
文摘This paper presents a new composite nonlinear bilateral control method based on the nonlinear disturbance observer(NDOB) for teleoperation systems with external disturbances. By introducing the estimations of NDOB and systems' nominal nonlinear dynamics into controller design, a NDOB based composite nonlinear bilateral controller is constructed to attenuate the influence of disturbance and uncertain nonlinearities. As compared with the existing bilateral control methods which usually achieve force haptic(i.e., contact force tracking)through a passive way, the newly proposed method has two major merits: 1) asymptotical convergence of both position and force tracking errors is guaranteed;2) disturbance influence on force tracking error dynamics is rejected through the direct feedforward compensation of disturbance estimation. Simulations on a nonlinear teleoperation system are carried out and the results validate the effectiveness of the proposed controller.
基金supported by the Natural Sciences and Engineering Research Council of Canada(NSERC)
文摘State convergence is a novel control algorithm for bilateral teleoperation of robotic systems. First, it models the teleoperation system on state space and considers all the possible interactions between the master and slave systems. Second, it presents an elegant design procedure which requires a set of equations to be solved in order to compute the control gains of the bilateral loop. These design conditions are obtained by turning the master-slave error into an autonomous system and imposing the desired dynamic behavior of the teleoperation system. Resultantly, the convergence of master and slave states is achieved in a well-defined manner. The present study aims at achieving a similar convergence behavior offered by state convergence controller while reducing the number of variables sent across the communication channel. The proposal suggests transmitting composite master and slave variables instead of full master and slave states while keeping the operator's force channel intact. We show that,with these composite and force variables;it is indeed possible to achieve the convergence of states in a desired way by strictly following the method of state convergence. The proposal leads to a reduced complexity state convergence algorithm which is termed as composite state convergence controller. In order to validate the proposed scheme in the absence and presence of communication time delays, MATLAB simulations and semi-real time experiments are performed on a single degree-of-freedom teleoperation system.
基金supported by Natural Sciences and Engineering Research Council of Canada (NSERC) Research Fellowship,Canada Research Chairs Program and University of Ottawa Research Chair Program
文摘In this paper,the problem of time varying telecommunication delays in passive teleoperation systems is addressed.The design comprises delayed position,velocity and position-velocity signals with the local position and velocity signals of the master and slave manipulators.Nonlinear adaptive control terms are employed locally to cope with uncertain parameters associated with the gravity loading vector of the master and slave manipulators.Lyapunov-Krasovskii function is employed for three methods to establish asymptotic tracking property of the closed loop teleoperation systems.The stability analysis is derived for both symmetrical and unsymmetrical time varying delays in the forward and backward communication channel that connects the local and remote sites.Finally,evaluation results are presented to illustrate the efectiveness of the proposed design for real-time applications.
文摘Teleoperation rendezvous and docking can be used as a backup for autonomous rendezvous and docking（RVD） for an unmanned spacecraft when the autonomous system is failure or for guiding the chaser docking with an uncooperative target.The theoretical model for analyzing the handling qualities in teleoperation RVD process is established based on the previous studies conducted by National Aeronautics and Space Administration（NASA）.The predictive factor is introduced to describe the pilot＇s predictive ability in the teleoperation tasks with time delay,which interrelates with the skills of a pilot and the predictive assist approach used in the tasks such as the predictive display method.Based on the semi-physical simulation system in our laboratory,900 experiments at two levels of time delay are carried out by 18 volunteers for validating the established model.The experimental results demonstrate the correctness of the theoretical model and indicate that a skilled pilot has a predictive ability of approximately 0.9 in teleoperation RVD tasks.The theoretical analysis shows that the handling qualities are greatly affected by the time delay and the predictive factor,and it is impossible to achieve a teleoperation RVD task for the skilled pilot when the time delay is larger than 9.0 s.
基金supported by the National Natural Science Foundation of China under Grant 61272519the Research Funds of Blockchain Joint Lab between BUPT and BCTthe joint Blockchain and Security Lab between BUPT and CAPSTONE
文摘Upon flaws of current blockchain platforms of heavyweight, large capacity of ledger, and time-consuming of synchronization of data, in this paper, we proposed a new paradigm of master-slave blockchain scheme(MSB) for pervasive computing that suitable for general PC, mobile device such as smart phones or PADs to participants in the working of mining and verification, in which we separated traditional blockchain model in 2 layer defined as master node layer and a series of slavery agents layer, then we proposed 2 approaches for partially computing model(PCM) and non-computing of model(NCM) in the MSB blockchain, Finally large amounts of simulations manifest the proposed master-slave blockchain scheme is feasible, extendible and suitable for pervasive computing especially in the 5 G generation environment, and can apply in the DRM-related applications.
基金Supported by National Key Research and Development Program of China(Grant No.2018YFE0125600)Zhejiang Provincial Key Research,Develop-ment Program(Grant No.2021C04015)Natural Science Foundation of Zhejiang(Grant No.LZ23E050005).
文摘Teleoperation can assist people to complete various complex tasks in inaccessible or high-risk environments,in which a wearable hand exoskeleton is one of the key devices.Adequate adaptability would be available to enable the master hand exoskeleton to capture the motion of human fingers and reproduce the contact force between the slave hand and its object.This paper presents a novel finger exoskeleton based on the cascading four-link closed-loop kinematic chain.Each finger has an independent closed-loop kinematic chain,and the angle sensors are used to obtain the finger motion including the flexion/extension and the adduction/abduction.The cable tension is changed by the servo motor to transmit the contact force to the fingers in real time.Based on the finger exoskeleton,an adaptive hand exoskeleton is consequently developed.In addition,the hand exoskeleton is tested in a master-slave system.The experiment results show that the adaptive hand exoskeleton can be worn without any mechanical constraints,and the slave hand can follow the motions of each human finger.The accuracy and the real-time capability of the force reproduction are validated.The proposed adaptive hand exoskeleton can be employed as the master hand to remotely control the humanoid five-fingered dexterous slave hand,thus,enabling the teleoperation system to complete complex dexterous manipulation tasks.
基金supported in part by the National Science Foundation(NSF)of China(61973263)the National Natural Science Foundation of China Outstanding Youth Fund(62222314)+5 种基金Youth Talent Program of Hebei(BJ2020031,BJ2019047)the Excellent Youth Project for NSF of Hebei Province(F2021203056)the Distinguished Young Foundation of Hebei Province(F2022203001)the Central Guidance Local Foundation of Hebei Province(226Z3201G)the Three-Three-Three Foundation of Hebei Province(C20221019)the Innovation Capability Improvement Plan Project of Hebei Province(22567626H)。
文摘Bilateral teleoperation system is referred to as a promising technology to extend human actions and intelligence to manipulating objects remotely.For the tracking control of teleoperation systems,velocity measurements are necessary to provide feedback information.However,due to hardware technology and cost constraints,the velocity measurements are not always available.In addition,the time-varying communication delay makes it challenging to achieve tracking task.This paper provides a solution to the issue of real-time tracking for teleoperation systems,subjected to unavailable velocity signals and time-varying communication delays.In order to estimate the velocity information,immersion and invariance(I&I)technique is employed to develop an exponential stability velocity observer.For the proposed velocity observer,a linear relationship between position and observation state is constructed,through which the need of solving partial differential and certain integral equations can be avoided.Meanwhile,the mean value theorem is exploited to separate the observation error terms,and hence,all functions in our observer can be analytically expressed.With the estimated velocity information,a slave-torque feedback control law is presented.A novel Lyapunov-Krasovskii functional is constructed to establish asymptotic tracking conditions.In particular,the relationship between the controller design parameters and the allowable maximum delay values is provided.Finally,simulation and experimental results reveal that the proposed velocity observer and controller can guarantee that the observation errors and tracking error converge to zero.
基金National Key Research and Development Program of China(Grant No.2019YFB1309900)Shandong Provincial Key Research and Development Program of China(Grant No.2019JZZY010432)Institute for Guo Qiang,Tsinghua University,China(Grant No.2019GQG0007).
文摘The teleoperation of a 6 degrees-of-freedom(DOF)manipulator is one of the basic methods to extend people’s capabilities in the wide variety of applications.The master interface based on the force/torque(FT)sensor could provide the full-dimension intuitive teleoperation of a 6-DOF robot since it has the ability to trigger 6-DOF command input.However,due to the force coupling,noise disturbance and unlimited input signals of the FT sensor,this force-sensed interface could not be widely used in practice.In this paper,we present an intuitive teleoperation method based on the FT sensor to overcome these challenges.In this method,the input signals from the force-sensed joystick were filtered and then processed to the force commands by force limit algorithm,with the merits of anti-interference,output limitation,and online velocity adjustment.Furthermore,based on the admittance control and position controller,the manipulator could be teleoperated by the force commands.Three experiments were conducted on our self-designed robotic system.The result of the first experiment shows that the interfered force from the force coupling could be effectively suppressed with the limitation of the input force through force limit algorithm.Then,a parameter was introduced in the other two experiments to adjust the velocity online practically with force limit algorithm.The proposed method could give a practical solution to the intuitive teleoperation based on the FT sensor.
基金supported in part by the National Natural Science Foundation of China(52075476,92048302)Key R&D Program of Zhejiang Province(2021C03013)。
文摘Currently,most teleoperation work is focusing on scenarios where slave robots interact with unknown environments.However,in some fields such as medical robots or rescue robots,the other typical teleoperation application is precise object transportation.Generally,the object’s weight is unknown yet essential for both accurate control of the slave robot and intuitive perception of the human operator.However,due to high cost and limited installation space,it is unreliable to employ a force sensor to directly measure the weight.Therefore,in this paper,a control scheme free of force sensor is proposed for teleoperation robots to transfer a weight-unknown object accurately.In this scheme,the workspace mapping between master and slave robot is firstly established,based on which,the operator can generate command trajectory on-line by operating the master robot.Then,a slave controller is designed to follow the master command closely and estimate the object’s weight rapidly,accurately and robust to unmodeled uncertainties.Finally,for the sake of telepresence,a master controller is designed to generate force feedback to reproduce the estimated weight of the object.In the end,comparative experiments show that the proposed scheme can achieve better control accuracy and telepresence,with accurate force feedback generated in only 500 ms.
