This paper discusses the coordination process for a robot gripper to approach a movingobject with feedback from an uncalibrated visual system. The dynamic of the whole system, includingtarget's random motion and t...This paper discusses the coordination process for a robot gripper to approach a movingobject with feedback from an uncalibrated visual system. The dynamic of the whole system, includingtarget's random motion and the gripper's tracking motion, is bounded to a 2-D working plane. Acamera, whose relations with the robot system and the 2-D working plane are unknown to the robotcontroller, is fixed aside to observe the object and gripper positions continually. Thus the movementsof the robot gripper can be decided on the positions of the object observed in each visual samplingmoment. The coordination of the vision and robot system is to be shown independently from therelations between the robot and the vision system, which should always be calibrated a prior forthe control of traditional robot/vision coordination system. Simulations are provided to show theproperty of the proposed method.展开更多
This paper investigates the visual servoing robust stabilization of nonholonomic mobile robots. The calibration of visual parameters is not only complicated, but also needs great consumption of calculated time so that...This paper investigates the visual servoing robust stabilization of nonholonomic mobile robots. The calibration of visual parameters is not only complicated, but also needs great consumption of calculated time so that the accurate calibration is impossible in some situations for high requirement of real timing. Hence, it is interesting and important to consider the design of stabilizing controllers for nonholonomic kinematic systems with uncalibrated visual parameters. A novel uncertain model of these nonholonomic kinematic systems is proposed. Based on this model, a stabilizing controller is discussed by using dynamic feedback and two-step techniques. The proposed robust controller makes the mobile robot image pose and the orientation converge to the desired configuration despite the lack of depth information and the lack of precise visual parameters. The stability of the closed loop system is rigorously proved. The simulation is given to show the effectiveness of the presented controllers.展开更多
This paper proposes an uncalibrated workpiece positioning method for peg-in-hole assembly of a device using an industrial robot.Depth images are used to identify and locate the workpieces when a peg-in-hole assembly t...This paper proposes an uncalibrated workpiece positioning method for peg-in-hole assembly of a device using an industrial robot.Depth images are used to identify and locate the workpieces when a peg-in-hole assembly task is carried out by an industrial robot in a flexible production system.First,the depth image is thresholded according to the depth data of the workpiece surface so as to filter out the background interference.Second,a series of image processing and the feature recognition algorithms are executed to extract the outer contour features and locate the center point position.This image information,fed by the vision system,will drive the robot to achieve the positioning,approximately.Finally,the Hough circle detection algorithm is used to extract the features and the relevant parameters of the circular hole where the assembly would be done,on the color image,for accurate positioning.The experimental result shows that the positioning accuracy of this method is between 0.6-1.2 mm,in the used experimental system.The entire positioning process need not require complicated calibration,and the method is highly flexible.It is suitable for the automatic assembly tasks with multi-specification or in small batches,in a flexible production system.展开更多
Currently, most visual servoing system must be calibrated, while it is impossible to calibrate cameras and robot models precisely in industrial practice, so a novel dynamic uncalibrated eye-in-hand visual servoing sys...Currently, most visual servoing system must be calibrated, while it is impossible to calibrate cameras and robot models precisely in industrial practice, so a novel dynamic uncalibrated eye-in-hand visual servoing system of tracking a moving target is proposed. The method does not require calibration of camera and robot kinematic models. Vision guided algorithm for tracking dynamic image is developed through minimizing nonlinear objective function. For the large residual has not been approximated in dynamic environment and the change of composite image Jacobian with time increment has not been computed in visual servoing system now,large residuals are dynamic approximated and the change of composite image Jacobian at each iterative step is computed. Simulation results demonstrate the validity of these approaches.展开更多
In this paper,a method with an eye-in-hand configuration is developed to hit targets during visual tracking for the TLS(Tele-Light Saber) game.It is not necessary to calibrate camera parameters and predict the traject...In this paper,a method with an eye-in-hand configuration is developed to hit targets during visual tracking for the TLS(Tele-Light Saber) game.It is not necessary to calibrate camera parameters and predict the trajectory of the moving object.Firstly,the expression of the image Jacobian matrix for the eye-in-hand configuration is proposed,and then an update law is designed to estimate the image Jacobian online.Furthermore,a control scheme is presented and the Lyapunov method is employed to prove asymptotic convergence of image errors.No assumption for the moving objects is needed.Finally,both simulation and experimental results are shown to support the approach in this paper.展开更多
Stable switch control between multiple cameras for uncalibrated visual servoing was studied. Switch images based on fusion were presented to get the continuous dynamic image Jacobian matrix among robots and distribute...Stable switch control between multiple cameras for uncalibrated visual servoing was studied. Switch images based on fusion were presented to get the continuous dynamic image Jacobian matrix among robots and distributed visual sensors. The designed fusion algorithm is suitable to have dynamically adjustable fusion weights, and the fusion structure was analyzed. Simulations and experiments without any knowledge of mobile robots and uncalibrated visual sensors show that the method has higher adaptability than the traditional instant switch control method. The method can enhance the system stability at the switching process.展开更多
文摘This paper discusses the coordination process for a robot gripper to approach a movingobject with feedback from an uncalibrated visual system. The dynamic of the whole system, includingtarget's random motion and the gripper's tracking motion, is bounded to a 2-D working plane. Acamera, whose relations with the robot system and the 2-D working plane are unknown to the robotcontroller, is fixed aside to observe the object and gripper positions continually. Thus the movementsof the robot gripper can be decided on the positions of the object observed in each visual samplingmoment. The coordination of the vision and robot system is to be shown independently from therelations between the robot and the vision system, which should always be calibrated a prior forthe control of traditional robot/vision coordination system. Simulations are provided to show theproperty of the proposed method.
基金supported by the National Natural Science Foundation of China (No.60874002)the Key Program of Scientific Innovation of Shanghai Education Committee (No.09zz158)the Shanghai Key Discipline (No.S30501)
文摘This paper investigates the visual servoing robust stabilization of nonholonomic mobile robots. The calibration of visual parameters is not only complicated, but also needs great consumption of calculated time so that the accurate calibration is impossible in some situations for high requirement of real timing. Hence, it is interesting and important to consider the design of stabilizing controllers for nonholonomic kinematic systems with uncalibrated visual parameters. A novel uncertain model of these nonholonomic kinematic systems is proposed. Based on this model, a stabilizing controller is discussed by using dynamic feedback and two-step techniques. The proposed robust controller makes the mobile robot image pose and the orientation converge to the desired configuration despite the lack of depth information and the lack of precise visual parameters. The stability of the closed loop system is rigorously proved. The simulation is given to show the effectiveness of the presented controllers.
文摘This paper proposes an uncalibrated workpiece positioning method for peg-in-hole assembly of a device using an industrial robot.Depth images are used to identify and locate the workpieces when a peg-in-hole assembly task is carried out by an industrial robot in a flexible production system.First,the depth image is thresholded according to the depth data of the workpiece surface so as to filter out the background interference.Second,a series of image processing and the feature recognition algorithms are executed to extract the outer contour features and locate the center point position.This image information,fed by the vision system,will drive the robot to achieve the positioning,approximately.Finally,the Hough circle detection algorithm is used to extract the features and the relevant parameters of the circular hole where the assembly would be done,on the color image,for accurate positioning.The experimental result shows that the positioning accuracy of this method is between 0.6-1.2 mm,in the used experimental system.The entire positioning process need not require complicated calibration,and the method is highly flexible.It is suitable for the automatic assembly tasks with multi-specification or in small batches,in a flexible production system.
文摘Currently, most visual servoing system must be calibrated, while it is impossible to calibrate cameras and robot models precisely in industrial practice, so a novel dynamic uncalibrated eye-in-hand visual servoing system of tracking a moving target is proposed. The method does not require calibration of camera and robot kinematic models. Vision guided algorithm for tracking dynamic image is developed through minimizing nonlinear objective function. For the large residual has not been approximated in dynamic environment and the change of composite image Jacobian with time increment has not been computed in visual servoing system now,large residuals are dynamic approximated and the change of composite image Jacobian at each iterative step is computed. Simulation results demonstrate the validity of these approaches.
基金Supported by the National Natural Science Foundation of China(No.60905061)the National Natural Science Foundation of Tianjin(No.08JCYBJC12700)
文摘In this paper,a method with an eye-in-hand configuration is developed to hit targets during visual tracking for the TLS(Tele-Light Saber) game.It is not necessary to calibrate camera parameters and predict the trajectory of the moving object.Firstly,the expression of the image Jacobian matrix for the eye-in-hand configuration is proposed,and then an update law is designed to estimate the image Jacobian online.Furthermore,a control scheme is presented and the Lyapunov method is employed to prove asymptotic convergence of image errors.No assumption for the moving objects is needed.Finally,both simulation and experimental results are shown to support the approach in this paper.
基金The National Natural Science Foundation of China (No 60428303)
文摘Stable switch control between multiple cameras for uncalibrated visual servoing was studied. Switch images based on fusion were presented to get the continuous dynamic image Jacobian matrix among robots and distributed visual sensors. The designed fusion algorithm is suitable to have dynamically adjustable fusion weights, and the fusion structure was analyzed. Simulations and experiments without any knowledge of mobile robots and uncalibrated visual sensors show that the method has higher adaptability than the traditional instant switch control method. The method can enhance the system stability at the switching process.
