There are two main trends in the development of unmanned aerial vehicle(UAV)technologies:miniaturization and intellectualization,in which realizing object tracking capabilities for a nano-scale UAV is one of the most ...There are two main trends in the development of unmanned aerial vehicle(UAV)technologies:miniaturization and intellectualization,in which realizing object tracking capabilities for a nano-scale UAV is one of the most challenging problems.In this paper,we present a visual object tracking and servoing control system utilizing a tailor-made 38 g nano-scale quadrotor.A lightweight visual module is integrated to enable object tracking capabilities,and a micro positioning deck is mounted to provide accurate pose estimation.In order to be robust against object appearance variations,a novel object tracking algorithm,denoted by RMCTer,is proposed,which integrates a powerful short-term tracking module and an efficient long-term processing module.In particular,the long-term processing module can provide additional object information and modify the short-term tracking model in a timely manner.Furthermore,a positionbased visual servoing control method is proposed for the quadrotor,where an adaptive tracking controller is designed by leveraging backstepping and adaptive techniques.Stable and accurate object tracking is achieved even under disturbances.Experimental results are presented to demonstrate the high accuracy and stability of the whole tracking system.展开更多
A visual servoing tracking controller is proposed based on the sliding mode control theory in order to achieve strong robustness against parameter variations and external disturbances. A sliding plane with time delay ...A visual servoing tracking controller is proposed based on the sliding mode control theory in order to achieve strong robustness against parameter variations and external disturbances. A sliding plane with time delay compensation is presented by the pre-estimate of states. To reduce the chattering of the sliding mode controller, a modified exponential reaching law and hyperbolic tangent function are applied to the design of visual controller and robot joint controller. Simulation results show that the visual servoing control scheme is robust and has good tracking performance.展开更多
This paper describes a system for grasping known objects with unmanned aerial vehicles (UAVs) provided with dual manipulators using an RGB-D camera. Aerial manipulation remains a very challenging task. This paper cove...This paper describes a system for grasping known objects with unmanned aerial vehicles (UAVs) provided with dual manipulators using an RGB-D camera. Aerial manipulation remains a very challenging task. This paper covers three principal aspects for this task: object detection and pose estimation, grasp planning, and in-flight grasp execution. First, an artificial neural network (ANN) is used to obtain clues regarding the object’s position. Next, an alignment algorithm is used to obtain the object’s sixdimensional (6D) pose, which is filtered with an extended Kalman filter. A three-dimensional (3D) model of the object is then used to estimate an arranged list of good grasps for the aerial manipulator. The results from the detection algorithm—that is, the object’s pose—are used to update the trajectories of the arms toward the object. If the target poses are not reachable due to the UAV’s oscillations, the algorithm switches to the next feasible grasp. This paper introduces the overall methodology, and provides the experimental results of both simulation and real experiments for each module, in addition to a video showing the results.展开更多
This paper presents an improved support vector machine （SVM） algorithm, which employs invariant moments-based edge extraction to obtain feature attribute. A heuristic attribute reduction algorithm based on rough set...This paper presents an improved support vector machine （SVM） algorithm, which employs invariant moments-based edge extraction to obtain feature attribute. A heuristic attribute reduction algorithm based on rough set＇s discernible matrix is proposed to identify and classify micro-targets. To avoid the complicated calibration for intrinsic parameters of camera, an improved Broyden＇s method is proposed to estimate the image Jacobian matrix which employs Chebyshev polynomial to construct a cost function to approximate the optimization value. Finally, a visual controller is designed for a robotic micromanipulation system. The experiment results of micro-parts assembly show that the proposed methods and algorithms are effective and feasible.展开更多
In this paper, we propose a method to select the observation position in visual servoing with an eye-in-vehicle configuration for the manipulator. In traditional visual servoing, the images taken by the camera may hav...In this paper, we propose a method to select the observation position in visual servoing with an eye-in-vehicle configuration for the manipulator. In traditional visual servoing, the images taken by the camera may have various problems, including being out of view, large perspective aberrance, improper projection area of object in images and so on. In this paper, we propose a method to determine the observation position to solve these problems. A mobile robot system with pan-tilt camera is designed, which calculates the observation position based on an observation and then moves there. Both simulation and experimental results are provided to validate the effectiveness of the proposed method.展开更多
A learning-based control approach is presented for force servoing of a robot with vision in an unknown environment. Firstly, mapping relationships between image features of the servoing object and the joint angles of ...A learning-based control approach is presented for force servoing of a robot with vision in an unknown environment. Firstly, mapping relationships between image features of the servoing object and the joint angles of the robot are derived and learned by a neural network. Secondly, a learning controller based on the neural network is designed for the robot to trace the object. Thirdly, a discrete time impedance control law is obtained for the force servoing of the robot, the on-line learning algorithms for three neural networks are developed to adjust the impedance parameters of the robot in the unknown environment. Lastly, wiping experiments are carried out by using a 6 DOF industrial robot with a CCD camera and a force/torque sensor in its end effector, and the experimental results confirm the effecti veness of the approach.展开更多
A robust visual servoing system is investigated on a humanoid robot which grasps a brush in Chinese calligraphy task.The system is implemented based on uncalibrated visual servoing controller utilizing Kalman-Bucy fil...A robust visual servoing system is investigated on a humanoid robot which grasps a brush in Chinese calligraphy task.The system is implemented based on uncalibrated visual servoing controller utilizing Kalman-Bucy filter,with the help of an object detector by continuously adaptive MeanShift(CAMShift) algorithm.Under this control scheme,a humanoid robot can satisfactorily grasp a brush without system modeling.The proposed method is shown to be robust and effective through a Chinese calligraphy task on a NAO robot.展开更多
In IBVS (image based visual servoing), the error signal in image space should be transformed into the control signal in the input space quickly. To avoid the iterative adjustment and complicated inverse solution of im...In IBVS (image based visual servoing), the error signal in image space should be transformed into the control signal in the input space quickly. To avoid the iterative adjustment and complicated inverse solution of image Jacobian, CMAC (cerebellar model articulation controller) neural network is inserted into visual servo control loop to implement the nonlinear mapping. Two control schemes are used. Simulation results on two schemes are provided, which show a better tracking precision and stability can be achieved using scheme 2.展开更多
In this paper,a visual servoing approach is developed to capture the docking rings of tumbling non-cooperative satellites with a space manipulator.The primary challenge addressed is the potential for the docking ring ...In this paper,a visual servoing approach is developed to capture the docking rings of tumbling non-cooperative satellites with a space manipulator.The primary challenge addressed is the potential for the docking ring to leave the monocular camera’s field-of-view as the manipulator approaches the target,due to the ring’s large size.To solve this issue,a two-phase visual servoing scheme combining a monocular camera and a three-line structured light vision system is proposed.In an effort to augment the success rate and safety of capture operations,several constraints are formulated,encompassing manipulator’s kinematics,monocular camera’s field-of-view,obstacle avoidance,structured light’s breakpoints and smooth capture.Subsequently,a nonlinear model predictive controller is proposed to manage these constraints in real-time and regulate the system.System models are established based on image moments and pose for each phase,selecting these features as visual feedback to simplify the formulation of servo constraints and avoid the complex circle-based pose measurement.Furthermore,to ensure unbiased predictions,the model disturbances arising from the imprecise estimation of target motion parameter are observed using an extended Kalman filter,which are then incorporated into the predictive control framework.The simulation results demonstrate the effectiveness of this scheme.展开更多
Welding path planning can substitute for the manual teaching process of the robot and can promote the autonomous level of the robotic welding. A path planning method by visual servoing was presented, in which the opti...Welding path planning can substitute for the manual teaching process of the robot and can promote the autonomous level of the robotic welding. A path planning method by visual servoing was presented, in which the optimal angle of charge-coupled device (CCD) camera was also planned. Aiming at planning two forms of kinked line seams, obtuse angle seam and right angle seam, a practicable solution was put forward. In this solution, the intersection of two adjacent straight segments is detected in each local seam image, and if intersection is found, the seam errors are calculated using the next straight segment. The experimental results show that kinked line seam can be well planned using this solution.展开更多
Currently, most visual servoing system must be calibrated, while it is impossible to calibrate cameras and robot models precisely in industrial practice, so a novel dynamic uncalibrated eye-in-hand visual servoing sys...Currently, most visual servoing system must be calibrated, while it is impossible to calibrate cameras and robot models precisely in industrial practice, so a novel dynamic uncalibrated eye-in-hand visual servoing system of tracking a moving target is proposed. The method does not require calibration of camera and robot kinematic models. Vision guided algorithm for tracking dynamic image is developed through minimizing nonlinear objective function. For the large residual has not been approximated in dynamic environment and the change of composite image Jacobian with time increment has not been computed in visual servoing system now,large residuals are dynamic approximated and the change of composite image Jacobian at each iterative step is computed. Simulation results demonstrate the validity of these approaches.展开更多
In this paper,a method with an eye-in-hand configuration is developed to hit targets during visual tracking for the TLS(Tele-Light Saber) game.It is not necessary to calibrate camera parameters and predict the traject...In this paper,a method with an eye-in-hand configuration is developed to hit targets during visual tracking for the TLS(Tele-Light Saber) game.It is not necessary to calibrate camera parameters and predict the trajectory of the moving object.Firstly,the expression of the image Jacobian matrix for the eye-in-hand configuration is proposed,and then an update law is designed to estimate the image Jacobian online.Furthermore,a control scheme is presented and the Lyapunov method is employed to prove asymptotic convergence of image errors.No assumption for the moving objects is needed.Finally,both simulation and experimental results are shown to support the approach in this paper.展开更多
Stable switch control between multiple cameras for uncalibrated visual servoing was studied. Switch images based on fusion were presented to get the continuous dynamic image Jacobian matrix among robots and distribute...Stable switch control between multiple cameras for uncalibrated visual servoing was studied. Switch images based on fusion were presented to get the continuous dynamic image Jacobian matrix among robots and distributed visual sensors. The designed fusion algorithm is suitable to have dynamically adjustable fusion weights, and the fusion structure was analyzed. Simulations and experiments without any knowledge of mobile robots and uncalibrated visual sensors show that the method has higher adaptability than the traditional instant switch control method. The method can enhance the system stability at the switching process.展开更多
A dual operational modes mobile robot system based on visual guiding and visual servo control is presented. This system consists of a mobile robot with a two-axis manipulator and a tele-operation station. In the visua...A dual operational modes mobile robot system based on visual guiding and visual servo control is presented. This system consists of a mobile robot with a two-axis manipulator and a tele-operation station. In the visual guiding mode, for the robot works in an open loop visual servo control mode, the manipulating burden of the operator is reduced largely. In the visual servo mode the robot can locate the position of the target assigned by the operator and pick it up by its manipulator. With the help of the operator, the diffieuh problems of finding and handling a target in a complicated environment by the robot can be solved easily.展开更多
Target tracking is one typical application of visual servoing technology. It is still a difficult task to track high speed target with current visual servo system. The improvement of visual servoing scheme is strongly...Target tracking is one typical application of visual servoing technology. It is still a difficult task to track high speed target with current visual servo system. The improvement of visual servoing scheme is strongly required. A position-based visual servo parallel system is presented for tracking target with high speed. A local Frenet frame is assigned to the sampling point of spatial trajectory. Position estimation is formed by the differential features of intrinsic geometry, and orientation estimation is formed by homogenous transformation. The time spent for searching and processing can be greatly reduced by shifting the window according to features location prediction. The simulation results have demonstrated the ability of the system to track spatial moving object.展开更多
To enhance the robustness and real-time performance of robotic arm visual servoing in complex environments such as space,this study proposes Di FA-DETR,a modified object detection framework based on the DETR architect...To enhance the robustness and real-time performance of robotic arm visual servoing in complex environments such as space,this study proposes Di FA-DETR,a modified object detection framework based on the DETR architecture.The proposed model incorporates an improved Res Net50 Bottleneck structure with spatial dimensionality reduction and sparse interaction mechanisms,alongside a redesigned self-attention module featuring downsampling optimization and adaptive feature enhancement.A custom-annotated satellite component dataset was constructed to train and evaluate the system.Experimental results demonstrate that Di FA-DETR achieves an AP50 of 79.9%,outperforming existing DETR variants while reducing computational complexity by 31.9%and nearly doubling the inference speed.The method was further validated in a ground-based visual servoing system using an industrial robotic arm and camera setup.The system successfully tracked satellite targets under dynamic motion scenarios,maintaining millimeter-level positioning accuracy.These results confirm the feasibility and effectiveness of the proposed method in supporting future space robotic applications requiring precision tracking and fast response.展开更多
Precision motion actuation is a key technology for miniature medical robotics in a variety of applications,such as optical fibre-based diagnosis and intervention tools.Conventional inductive actuation mechanisms are c...Precision motion actuation is a key technology for miniature medical robotics in a variety of applications,such as optical fibre-based diagnosis and intervention tools.Conventional inductive actuation mechanisms are challenging to scale down.Piezoelectric materials offer a scalable,precise,fast and high-force method but at a limited displacement range.In previous work,the combination of piezoelectric beams(benders)with compliant motion translation structures has been shown to be promising for robotic micro-actuation.In this paper,this approach is employed to implement a three degrees of freedom delta robot,suitable for catheter,diagnostic optical fibre and microsurgery tool manipulation.The fabrication process combines additive manufacturing,origami structuring and piezoelectric beam assembly.Closed-loop control is implemented using a new,on-board visual feedback concept.In contrast to typical optical motion systems,the fully internal visual feedback offers system compactness with precise and reliable camera-to-marker geometry definition.By employment of this method,a delta robot with motion accuracy of 7.5μm,resolution of 10μm and 8.1μm precision is demonstrated.The robot is shown to follow a range of programmable trajectories under these specifications,and to compensate for externally applied forces typically expected during microsurgery manipulations.This is the first,to our knowledge,demonstration of micromotion control using internal visual feedback,and it opens up the way for high-resolution compact microrobots.展开更多
Hair transplantation surgery is an effective solution for hair loss problems,among which follicle unit extraction(FUE)surgery is more widely used and favored.At present,most hair transplantation surgeries still rely h...Hair transplantation surgery is an effective solution for hair loss problems,among which follicle unit extraction(FUE)surgery is more widely used and favored.At present,most hair transplantation surgeries still rely heavily on manual operation by doctors and very few hair transplantation robots with complex structures have been introduced.This paper proposes a pneumatic hair transplantation mechanism for FUE surgery,equipped with a camera,capable of automatically performing both hair implantation and extraction with airflow.This pneumatic method eliminates the complex needle structure,has the function of temporarily storing the follicles inside the needle,thus facilitating the automation of transferring follicles from extraction to implantation.Then a visual feedback system is proposed to accurately position the follicles during the transplantation.The experimental results show that average distance deviation between the actual and target positions is 0.6128 mm and the average deviation of hair implantation depth is 1.7176 mm,which verify the feasibility of the proposed system.展开更多
A system for a type of nonholonomic wheeled mobile robots equipped with an uncalibrated camera fixed to the ceiling is investigated.Based on the visual feedback and the state-input transformation,models of uncertain c...A system for a type of nonholonomic wheeled mobile robots equipped with an uncalibrated camera fixed to the ceiling is investigated.Based on the visual feedback and the state-input transformation,models of uncertain chained form systems are presented for the robot-camera systems.Then,new smooth time-varying feedback controllers are proposed to exponentially stabilize the uncertain chained system by using state-scaling and control theories for two cases.The exponential stabilities of the closed-loop uncertain systems are rigorously proved.Simulation results demonstrate the effectiveness of the proposed strategies.展开更多
基金supported in part by the Institute for Guo Qiang of Tsinghua University(2019GQG1023)in part by Graduate Education and Teaching Reform Project of Tsinghua University(202007J007)+1 种基金in part by National Natural Science Foundation of China(U19B2029,62073028,61803222)in part by the Independent Research Program of Tsinghua University(2018Z05JDX002)。
文摘There are two main trends in the development of unmanned aerial vehicle(UAV)technologies:miniaturization and intellectualization,in which realizing object tracking capabilities for a nano-scale UAV is one of the most challenging problems.In this paper,we present a visual object tracking and servoing control system utilizing a tailor-made 38 g nano-scale quadrotor.A lightweight visual module is integrated to enable object tracking capabilities,and a micro positioning deck is mounted to provide accurate pose estimation.In order to be robust against object appearance variations,a novel object tracking algorithm,denoted by RMCTer,is proposed,which integrates a powerful short-term tracking module and an efficient long-term processing module.In particular,the long-term processing module can provide additional object information and modify the short-term tracking model in a timely manner.Furthermore,a positionbased visual servoing control method is proposed for the quadrotor,where an adaptive tracking controller is designed by leveraging backstepping and adaptive techniques.Stable and accurate object tracking is achieved even under disturbances.Experimental results are presented to demonstrate the high accuracy and stability of the whole tracking system.
基金supported by China Postdoctoral Science Founda-tion (No. 20080441093)Key Laboratory Foundation of Liaoning Province (No. 2008S088).
文摘A visual servoing tracking controller is proposed based on the sliding mode control theory in order to achieve strong robustness against parameter variations and external disturbances. A sliding plane with time delay compensation is presented by the pre-estimate of states. To reduce the chattering of the sliding mode controller, a modified exponential reaching law and hyperbolic tangent function are applied to the design of visual controller and robot joint controller. Simulation results show that the visual servoing control scheme is robust and has good tracking performance.
文摘This paper describes a system for grasping known objects with unmanned aerial vehicles (UAVs) provided with dual manipulators using an RGB-D camera. Aerial manipulation remains a very challenging task. This paper covers three principal aspects for this task: object detection and pose estimation, grasp planning, and in-flight grasp execution. First, an artificial neural network (ANN) is used to obtain clues regarding the object’s position. Next, an alignment algorithm is used to obtain the object’s sixdimensional (6D) pose, which is filtered with an extended Kalman filter. A three-dimensional (3D) model of the object is then used to estimate an arranged list of good grasps for the aerial manipulator. The results from the detection algorithm—that is, the object’s pose—are used to update the trajectories of the arms toward the object. If the target poses are not reachable due to the UAV’s oscillations, the algorithm switches to the next feasible grasp. This paper introduces the overall methodology, and provides the experimental results of both simulation and real experiments for each module, in addition to a video showing the results.
基金supported by National Natural Science Foundation of China (No.60873032)National High Technology Research and Development Program of China (863 Program) (No.2008AA8041302)
文摘This paper presents an improved support vector machine （SVM） algorithm, which employs invariant moments-based edge extraction to obtain feature attribute. A heuristic attribute reduction algorithm based on rough set＇s discernible matrix is proposed to identify and classify micro-targets. To avoid the complicated calibration for intrinsic parameters of camera, an improved Broyden＇s method is proposed to estimate the image Jacobian matrix which employs Chebyshev polynomial to construct a cost function to approximate the optimization value. Finally, a visual controller is designed for a robotic micromanipulation system. The experiment results of micro-parts assembly show that the proposed methods and algorithms are effective and feasible.
基金supported by Natural Science Foundation of China (No. 61773374)Key Research and Development Program of China (No. 2017YFB1300104)
文摘In this paper, we propose a method to select the observation position in visual servoing with an eye-in-vehicle configuration for the manipulator. In traditional visual servoing, the images taken by the camera may have various problems, including being out of view, large perspective aberrance, improper projection area of object in images and so on. In this paper, we propose a method to determine the observation position to solve these problems. A mobile robot system with pan-tilt camera is designed, which calculates the observation position based on an observation and then moves there. Both simulation and experimental results are provided to validate the effectiveness of the proposed method.
基金This project was supported by the research foundation of China Education Ministry for the scholars from abroad (2002247).
文摘A learning-based control approach is presented for force servoing of a robot with vision in an unknown environment. Firstly, mapping relationships between image features of the servoing object and the joint angles of the robot are derived and learned by a neural network. Secondly, a learning controller based on the neural network is designed for the robot to trace the object. Thirdly, a discrete time impedance control law is obtained for the force servoing of the robot, the on-line learning algorithms for three neural networks are developed to adjust the impedance parameters of the robot in the unknown environment. Lastly, wiping experiments are carried out by using a 6 DOF industrial robot with a CCD camera and a force/torque sensor in its end effector, and the experimental results confirm the effecti veness of the approach.
基金Supported by the National Natural Science Foundation of China(No.61221003)
文摘A robust visual servoing system is investigated on a humanoid robot which grasps a brush in Chinese calligraphy task.The system is implemented based on uncalibrated visual servoing controller utilizing Kalman-Bucy filter,with the help of an object detector by continuously adaptive MeanShift(CAMShift) algorithm.Under this control scheme,a humanoid robot can satisfactorily grasp a brush without system modeling.The proposed method is shown to be robust and effective through a Chinese calligraphy task on a NAO robot.
基金This project is supported by National Natural Science Foundation of China (No.59990470).
文摘In IBVS (image based visual servoing), the error signal in image space should be transformed into the control signal in the input space quickly. To avoid the iterative adjustment and complicated inverse solution of image Jacobian, CMAC (cerebellar model articulation controller) neural network is inserted into visual servo control loop to implement the nonlinear mapping. Two control schemes are used. Simulation results on two schemes are provided, which show a better tracking precision and stability can be achieved using scheme 2.
基金supported by the China Postdoctoral Science Foundation(No.2022M710956).
文摘In this paper,a visual servoing approach is developed to capture the docking rings of tumbling non-cooperative satellites with a space manipulator.The primary challenge addressed is the potential for the docking ring to leave the monocular camera’s field-of-view as the manipulator approaches the target,due to the ring’s large size.To solve this issue,a two-phase visual servoing scheme combining a monocular camera and a three-line structured light vision system is proposed.In an effort to augment the success rate and safety of capture operations,several constraints are formulated,encompassing manipulator’s kinematics,monocular camera’s field-of-view,obstacle avoidance,structured light’s breakpoints and smooth capture.Subsequently,a nonlinear model predictive controller is proposed to manage these constraints in real-time and regulate the system.System models are established based on image moments and pose for each phase,selecting these features as visual feedback to simplify the formulation of servo constraints and avoid the complex circle-based pose measurement.Furthermore,to ensure unbiased predictions,the model disturbances arising from the imprecise estimation of target motion parameter are observed using an extended Kalman filter,which are then incorporated into the predictive control framework.The simulation results demonstrate the effectiveness of this scheme.
文摘Welding path planning can substitute for the manual teaching process of the robot and can promote the autonomous level of the robotic welding. A path planning method by visual servoing was presented, in which the optimal angle of charge-coupled device (CCD) camera was also planned. Aiming at planning two forms of kinked line seams, obtuse angle seam and right angle seam, a practicable solution was put forward. In this solution, the intersection of two adjacent straight segments is detected in each local seam image, and if intersection is found, the seam errors are calculated using the next straight segment. The experimental results show that kinked line seam can be well planned using this solution.
文摘Currently, most visual servoing system must be calibrated, while it is impossible to calibrate cameras and robot models precisely in industrial practice, so a novel dynamic uncalibrated eye-in-hand visual servoing system of tracking a moving target is proposed. The method does not require calibration of camera and robot kinematic models. Vision guided algorithm for tracking dynamic image is developed through minimizing nonlinear objective function. For the large residual has not been approximated in dynamic environment and the change of composite image Jacobian with time increment has not been computed in visual servoing system now,large residuals are dynamic approximated and the change of composite image Jacobian at each iterative step is computed. Simulation results demonstrate the validity of these approaches.
基金Supported by the National Natural Science Foundation of China(No.60905061)the National Natural Science Foundation of Tianjin(No.08JCYBJC12700)
文摘In this paper,a method with an eye-in-hand configuration is developed to hit targets during visual tracking for the TLS(Tele-Light Saber) game.It is not necessary to calibrate camera parameters and predict the trajectory of the moving object.Firstly,the expression of the image Jacobian matrix for the eye-in-hand configuration is proposed,and then an update law is designed to estimate the image Jacobian online.Furthermore,a control scheme is presented and the Lyapunov method is employed to prove asymptotic convergence of image errors.No assumption for the moving objects is needed.Finally,both simulation and experimental results are shown to support the approach in this paper.
基金The National Natural Science Foundation of China (No 60428303)
文摘Stable switch control between multiple cameras for uncalibrated visual servoing was studied. Switch images based on fusion were presented to get the continuous dynamic image Jacobian matrix among robots and distributed visual sensors. The designed fusion algorithm is suitable to have dynamically adjustable fusion weights, and the fusion structure was analyzed. Simulations and experiments without any knowledge of mobile robots and uncalibrated visual sensors show that the method has higher adaptability than the traditional instant switch control method. The method can enhance the system stability at the switching process.
基金Supported by the National High Technology Research and Development Program of China （No. 2003AA421030） and the National Science Foundation of China （No. 60375026）.
文摘A dual operational modes mobile robot system based on visual guiding and visual servo control is presented. This system consists of a mobile robot with a two-axis manipulator and a tele-operation station. In the visual guiding mode, for the robot works in an open loop visual servo control mode, the manipulating burden of the operator is reduced largely. In the visual servo mode the robot can locate the position of the target assigned by the operator and pick it up by its manipulator. With the help of the operator, the diffieuh problems of finding and handling a target in a complicated environment by the robot can be solved easily.
基金This project is supported by National Electric Power Corporation Foundation of China(No.SPKJ010-27).
文摘Target tracking is one typical application of visual servoing technology. It is still a difficult task to track high speed target with current visual servo system. The improvement of visual servoing scheme is strongly required. A position-based visual servo parallel system is presented for tracking target with high speed. A local Frenet frame is assigned to the sampling point of spatial trajectory. Position estimation is formed by the differential features of intrinsic geometry, and orientation estimation is formed by homogenous transformation. The time spent for searching and processing can be greatly reduced by shifting the window according to features location prediction. The simulation results have demonstrated the ability of the system to track spatial moving object.
基金supported by the Foundation of National Key Laboratory of Human Factors Engineering,China(No.HFNKL2023 WWO5)。
文摘To enhance the robustness and real-time performance of robotic arm visual servoing in complex environments such as space,this study proposes Di FA-DETR,a modified object detection framework based on the DETR architecture.The proposed model incorporates an improved Res Net50 Bottleneck structure with spatial dimensionality reduction and sparse interaction mechanisms,alongside a redesigned self-attention module featuring downsampling optimization and adaptive feature enhancement.A custom-annotated satellite component dataset was constructed to train and evaluate the system.Experimental results demonstrate that Di FA-DETR achieves an AP50 of 79.9%,outperforming existing DETR variants while reducing computational complexity by 31.9%and nearly doubling the inference speed.The method was further validated in a ground-based visual servoing system using an industrial robotic arm and camera setup.The system successfully tracked satellite targets under dynamic motion scenarios,maintaining millimeter-level positioning accuracy.These results confirm the feasibility and effectiveness of the proposed method in supporting future space robotic applications requiring precision tracking and fast response.
基金financially supported in part by the Engineering and Physical Sciences Research Council(EPSRC),United Kingdom(EP/P012779,Micro-Robotics for Surgery).
文摘Precision motion actuation is a key technology for miniature medical robotics in a variety of applications,such as optical fibre-based diagnosis and intervention tools.Conventional inductive actuation mechanisms are challenging to scale down.Piezoelectric materials offer a scalable,precise,fast and high-force method but at a limited displacement range.In previous work,the combination of piezoelectric beams(benders)with compliant motion translation structures has been shown to be promising for robotic micro-actuation.In this paper,this approach is employed to implement a three degrees of freedom delta robot,suitable for catheter,diagnostic optical fibre and microsurgery tool manipulation.The fabrication process combines additive manufacturing,origami structuring and piezoelectric beam assembly.Closed-loop control is implemented using a new,on-board visual feedback concept.In contrast to typical optical motion systems,the fully internal visual feedback offers system compactness with precise and reliable camera-to-marker geometry definition.By employment of this method,a delta robot with motion accuracy of 7.5μm,resolution of 10μm and 8.1μm precision is demonstrated.The robot is shown to follow a range of programmable trajectories under these specifications,and to compensate for externally applied forces typically expected during microsurgery manipulations.This is the first,to our knowledge,demonstration of micromotion control using internal visual feedback,and it opens up the way for high-resolution compact microrobots.
基金supported by Special Funds for the Cultivation of Guangdong College Students’Scientific and Technological Innovation(Pdjh2022b0568).
文摘Hair transplantation surgery is an effective solution for hair loss problems,among which follicle unit extraction(FUE)surgery is more widely used and favored.At present,most hair transplantation surgeries still rely heavily on manual operation by doctors and very few hair transplantation robots with complex structures have been introduced.This paper proposes a pneumatic hair transplantation mechanism for FUE surgery,equipped with a camera,capable of automatically performing both hair implantation and extraction with airflow.This pneumatic method eliminates the complex needle structure,has the function of temporarily storing the follicles inside the needle,thus facilitating the automation of transferring follicles from extraction to implantation.Then a visual feedback system is proposed to accurately position the follicles during the transplantation.The experimental results show that average distance deviation between the actual and target positions is 0.6128 mm and the average deviation of hair implantation depth is 1.7176 mm,which verify the feasibility of the proposed system.
基金supported by the National Natural Science Foundation of China under Grant Nos.61374040,61304004 and 61473179the Natural Science Foundation of Shandong Province under Grant Nos.ZR2013FM012 and ZR2014FM007
文摘A system for a type of nonholonomic wheeled mobile robots equipped with an uncalibrated camera fixed to the ceiling is investigated.Based on the visual feedback and the state-input transformation,models of uncertain chained form systems are presented for the robot-camera systems.Then,new smooth time-varying feedback controllers are proposed to exponentially stabilize the uncertain chained system by using state-scaling and control theories for two cases.The exponential stabilities of the closed-loop uncertain systems are rigorously proved.Simulation results demonstrate the effectiveness of the proposed strategies.
