To enhance the robustness and real-time performance of robotic arm visual servoing in complex environments such as space,this study proposes Di FA-DETR,a modified object detection framework based on the DETR architect...To enhance the robustness and real-time performance of robotic arm visual servoing in complex environments such as space,this study proposes Di FA-DETR,a modified object detection framework based on the DETR architecture.The proposed model incorporates an improved Res Net50 Bottleneck structure with spatial dimensionality reduction and sparse interaction mechanisms,alongside a redesigned self-attention module featuring downsampling optimization and adaptive feature enhancement.A custom-annotated satellite component dataset was constructed to train and evaluate the system.Experimental results demonstrate that Di FA-DETR achieves an AP50 of 79.9%,outperforming existing DETR variants while reducing computational complexity by 31.9%and nearly doubling the inference speed.The method was further validated in a ground-based visual servoing system using an industrial robotic arm and camera setup.The system successfully tracked satellite targets under dynamic motion scenarios,maintaining millimeter-level positioning accuracy.These results confirm the feasibility and effectiveness of the proposed method in supporting future space robotic applications requiring precision tracking and fast response.展开更多
There are two main trends in the development of unmanned aerial vehicle(UAV)technologies:miniaturization and intellectualization,in which realizing object tracking capabilities for a nano-scale UAV is one of the most ...There are two main trends in the development of unmanned aerial vehicle(UAV)technologies:miniaturization and intellectualization,in which realizing object tracking capabilities for a nano-scale UAV is one of the most challenging problems.In this paper,we present a visual object tracking and servoing control system utilizing a tailor-made 38 g nano-scale quadrotor.A lightweight visual module is integrated to enable object tracking capabilities,and a micro positioning deck is mounted to provide accurate pose estimation.In order to be robust against object appearance variations,a novel object tracking algorithm,denoted by RMCTer,is proposed,which integrates a powerful short-term tracking module and an efficient long-term processing module.In particular,the long-term processing module can provide additional object information and modify the short-term tracking model in a timely manner.Furthermore,a positionbased visual servoing control method is proposed for the quadrotor,where an adaptive tracking controller is designed by leveraging backstepping and adaptive techniques.Stable and accurate object tracking is achieved even under disturbances.Experimental results are presented to demonstrate the high accuracy and stability of the whole tracking system.展开更多
This paper describes a system for grasping known objects with unmanned aerial vehicles (UAVs) provided with dual manipulators using an RGB-D camera. Aerial manipulation remains a very challenging task. This paper cove...This paper describes a system for grasping known objects with unmanned aerial vehicles (UAVs) provided with dual manipulators using an RGB-D camera. Aerial manipulation remains a very challenging task. This paper covers three principal aspects for this task: object detection and pose estimation, grasp planning, and in-flight grasp execution. First, an artificial neural network (ANN) is used to obtain clues regarding the object’s position. Next, an alignment algorithm is used to obtain the object’s sixdimensional (6D) pose, which is filtered with an extended Kalman filter. A three-dimensional (3D) model of the object is then used to estimate an arranged list of good grasps for the aerial manipulator. The results from the detection algorithm—that is, the object’s pose—are used to update the trajectories of the arms toward the object. If the target poses are not reachable due to the UAV’s oscillations, the algorithm switches to the next feasible grasp. This paper introduces the overall methodology, and provides the experimental results of both simulation and real experiments for each module, in addition to a video showing the results.展开更多
A visual servoing tracking controller is proposed based on the sliding mode control theory in order to achieve strong robustness against parameter variations and external disturbances. A sliding plane with time delay ...A visual servoing tracking controller is proposed based on the sliding mode control theory in order to achieve strong robustness against parameter variations and external disturbances. A sliding plane with time delay compensation is presented by the pre-estimate of states. To reduce the chattering of the sliding mode controller, a modified exponential reaching law and hyperbolic tangent function are applied to the design of visual controller and robot joint controller. Simulation results show that the visual servoing control scheme is robust and has good tracking performance.展开更多
This paper presents an improved support vector machine （SVM） algorithm, which employs invariant moments-based edge extraction to obtain feature attribute. A heuristic attribute reduction algorithm based on rough set...This paper presents an improved support vector machine （SVM） algorithm, which employs invariant moments-based edge extraction to obtain feature attribute. A heuristic attribute reduction algorithm based on rough set＇s discernible matrix is proposed to identify and classify micro-targets. To avoid the complicated calibration for intrinsic parameters of camera, an improved Broyden＇s method is proposed to estimate the image Jacobian matrix which employs Chebyshev polynomial to construct a cost function to approximate the optimization value. Finally, a visual controller is designed for a robotic micromanipulation system. The experiment results of micro-parts assembly show that the proposed methods and algorithms are effective and feasible.展开更多
In this paper, we propose a method to select the observation position in visual servoing with an eye-in-vehicle configuration for the manipulator. In traditional visual servoing, the images taken by the camera may hav...In this paper, we propose a method to select the observation position in visual servoing with an eye-in-vehicle configuration for the manipulator. In traditional visual servoing, the images taken by the camera may have various problems, including being out of view, large perspective aberrance, improper projection area of object in images and so on. In this paper, we propose a method to determine the observation position to solve these problems. A mobile robot system with pan-tilt camera is designed, which calculates the observation position based on an observation and then moves there. Both simulation and experimental results are provided to validate the effectiveness of the proposed method.展开更多
A learning-based control approach is presented for force servoing of a robot with vision in an unknown environment. Firstly, mapping relationships between image features of the servoing object and the joint angles of ...A learning-based control approach is presented for force servoing of a robot with vision in an unknown environment. Firstly, mapping relationships between image features of the servoing object and the joint angles of the robot are derived and learned by a neural network. Secondly, a learning controller based on the neural network is designed for the robot to trace the object. Thirdly, a discrete time impedance control law is obtained for the force servoing of the robot, the on-line learning algorithms for three neural networks are developed to adjust the impedance parameters of the robot in the unknown environment. Lastly, wiping experiments are carried out by using a 6 DOF industrial robot with a CCD camera and a force/torque sensor in its end effector, and the experimental results confirm the effecti veness of the approach.展开更多
A robust visual servoing system is investigated on a humanoid robot which grasps a brush in Chinese calligraphy task.The system is implemented based on uncalibrated visual servoing controller utilizing Kalman-Bucy fil...A robust visual servoing system is investigated on a humanoid robot which grasps a brush in Chinese calligraphy task.The system is implemented based on uncalibrated visual servoing controller utilizing Kalman-Bucy filter,with the help of an object detector by continuously adaptive MeanShift(CAMShift) algorithm.Under this control scheme,a humanoid robot can satisfactorily grasp a brush without system modeling.The proposed method is shown to be robust and effective through a Chinese calligraphy task on a NAO robot.展开更多
A dual operational modes mobile robot system based on visual guiding and visual servo control is presented. This system consists of a mobile robot with a two-axis manipulator and a tele-operation station. In the visua...A dual operational modes mobile robot system based on visual guiding and visual servo control is presented. This system consists of a mobile robot with a two-axis manipulator and a tele-operation station. In the visual guiding mode, for the robot works in an open loop visual servo control mode, the manipulating burden of the operator is reduced largely. In the visual servo mode the robot can locate the position of the target assigned by the operator and pick it up by its manipulator. With the help of the operator, the diffieuh problems of finding and handling a target in a complicated environment by the robot can be solved easily.展开更多
In IBVS (image based visual servoing), the error signal in image space should be transformed into the control signal in the input space quickly. To avoid the iterative adjustment and complicated inverse solution of im...In IBVS (image based visual servoing), the error signal in image space should be transformed into the control signal in the input space quickly. To avoid the iterative adjustment and complicated inverse solution of image Jacobian, CMAC (cerebellar model articulation controller) neural network is inserted into visual servo control loop to implement the nonlinear mapping. Two control schemes are used. Simulation results on two schemes are provided, which show a better tracking precision and stability can be achieved using scheme 2.展开更多
In this paper,a visual servoing approach is developed to capture the docking rings of tumbling non-cooperative satellites with a space manipulator.The primary challenge addressed is the potential for the docking ring ...In this paper,a visual servoing approach is developed to capture the docking rings of tumbling non-cooperative satellites with a space manipulator.The primary challenge addressed is the potential for the docking ring to leave the monocular camera’s field-of-view as the manipulator approaches the target,due to the ring’s large size.To solve this issue,a two-phase visual servoing scheme combining a monocular camera and a three-line structured light vision system is proposed.In an effort to augment the success rate and safety of capture operations,several constraints are formulated,encompassing manipulator’s kinematics,monocular camera’s field-of-view,obstacle avoidance,structured light’s breakpoints and smooth capture.Subsequently,a nonlinear model predictive controller is proposed to manage these constraints in real-time and regulate the system.System models are established based on image moments and pose for each phase,selecting these features as visual feedback to simplify the formulation of servo constraints and avoid the complex circle-based pose measurement.Furthermore,to ensure unbiased predictions,the model disturbances arising from the imprecise estimation of target motion parameter are observed using an extended Kalman filter,which are then incorporated into the predictive control framework.The simulation results demonstrate the effectiveness of this scheme.展开更多
Welding path planning can substitute for the manual teaching process of the robot and can promote the autonomous level of the robotic welding. A path planning method by visual servoing was presented, in which the opti...Welding path planning can substitute for the manual teaching process of the robot and can promote the autonomous level of the robotic welding. A path planning method by visual servoing was presented, in which the optimal angle of charge-coupled device (CCD) camera was also planned. Aiming at planning two forms of kinked line seams, obtuse angle seam and right angle seam, a practicable solution was put forward. In this solution, the intersection of two adjacent straight segments is detected in each local seam image, and if intersection is found, the seam errors are calculated using the next straight segment. The experimental results show that kinked line seam can be well planned using this solution.展开更多
Currently, most visual servoing system must be calibrated, while it is impossible to calibrate cameras and robot models precisely in industrial practice, so a novel dynamic uncalibrated eye-in-hand visual servoing sys...Currently, most visual servoing system must be calibrated, while it is impossible to calibrate cameras and robot models precisely in industrial practice, so a novel dynamic uncalibrated eye-in-hand visual servoing system of tracking a moving target is proposed. The method does not require calibration of camera and robot kinematic models. Vision guided algorithm for tracking dynamic image is developed through minimizing nonlinear objective function. For the large residual has not been approximated in dynamic environment and the change of composite image Jacobian with time increment has not been computed in visual servoing system now,large residuals are dynamic approximated and the change of composite image Jacobian at each iterative step is computed. Simulation results demonstrate the validity of these approaches.展开更多
In this paper,a method with an eye-in-hand configuration is developed to hit targets during visual tracking for the TLS(Tele-Light Saber) game.It is not necessary to calibrate camera parameters and predict the traject...In this paper,a method with an eye-in-hand configuration is developed to hit targets during visual tracking for the TLS(Tele-Light Saber) game.It is not necessary to calibrate camera parameters and predict the trajectory of the moving object.Firstly,the expression of the image Jacobian matrix for the eye-in-hand configuration is proposed,and then an update law is designed to estimate the image Jacobian online.Furthermore,a control scheme is presented and the Lyapunov method is employed to prove asymptotic convergence of image errors.No assumption for the moving objects is needed.Finally,both simulation and experimental results are shown to support the approach in this paper.展开更多
Stable switch control between multiple cameras for uncalibrated visual servoing was studied. Switch images based on fusion were presented to get the continuous dynamic image Jacobian matrix among robots and distribute...Stable switch control between multiple cameras for uncalibrated visual servoing was studied. Switch images based on fusion were presented to get the continuous dynamic image Jacobian matrix among robots and distributed visual sensors. The designed fusion algorithm is suitable to have dynamically adjustable fusion weights, and the fusion structure was analyzed. Simulations and experiments without any knowledge of mobile robots and uncalibrated visual sensors show that the method has higher adaptability than the traditional instant switch control method. The method can enhance the system stability at the switching process.展开更多
Target tracking is one typical application of visual servoing technology. It is still a difficult task to track high speed target with current visual servo system. The improvement of visual servoing scheme is strongly...Target tracking is one typical application of visual servoing technology. It is still a difficult task to track high speed target with current visual servo system. The improvement of visual servoing scheme is strongly required. A position-based visual servo parallel system is presented for tracking target with high speed. A local Frenet frame is assigned to the sampling point of spatial trajectory. Position estimation is formed by the differential features of intrinsic geometry, and orientation estimation is formed by homogenous transformation. The time spent for searching and processing can be greatly reduced by shifting the window according to features location prediction. The simulation results have demonstrated the ability of the system to track spatial moving object.展开更多
Permanent magnet synchronous motor based electro-mechanical actuation servo drives have widespread applications in the aviation field,such as unmanned aerial vehicle electric servos,electric cabin doors,and mechanical...Permanent magnet synchronous motor based electro-mechanical actuation servo drives have widespread applications in the aviation field,such as unmanned aerial vehicle electric servos,electric cabin doors,and mechanical arms.The performance of the servo drive,which encompasses the response to the torque,efficiency,control bandwidth and the steady-state positioning accuracy,significantly influences the performance of the aviation actuation.Consequently,enhancing the control bandwidth and refining the positioning accuracy of aviation electro-mechanical actuation servo drives have emerged as a focal point of research.This paper investigates the multi-source disturbances present in aviation electro-mechanical actuation servo systems and summarizes recent research on high-performance servo control methods based on active disturbance rejection control(ADRC).We present a comprehensive overview of the research status pertaining to servo control architecture,strategies for suppressing disturbances in the current loop,and ADRC-based strategies for the position loop.We delineate the research challenges and difficulties encountered by aviation electro-mechanical actuation servo drive control technology.展开更多
During indoor operations,Unmanned Aerial Vehicles(UAVs)are required to embody attributes such as heightened sensitivity,compact design,and robust maneuverability.A high operational advantage is evident when tasks are ...During indoor operations,Unmanned Aerial Vehicles(UAVs)are required to embody attributes such as heightened sensitivity,compact design,and robust maneuverability.A high operational advantage is evident when tasks are executed using multiple UAVs in unison.Despite the prevalent focus in current UAV research on enhancing discrete components or modules,a holistic,integrated approach that encompasses the UAV architecture,platform design,algorithms,simulation,and swarm intelligence,is lacking.This study introduces a micro-UAV swarm system designed for efficient perception within partially known indoor environments.We devised the comprehensive architectural blueprint of a micro-UAV swarm system.A communication routing evaluation metric is proposed to improve the quality of intercommunication among UAVs in the micro-UAV swarm.In addressing the localization and perception challenges,this study features the development of a multisensor-based autonomous positioning methodology,complemented by an object detection and tracking framework based on YOLOv5 and DeepSORT technologies.In the realm of decision making,we used the DuelingDQN algorithm to facilitate mission allocation and scheduling within the micro-UAV swarm system.For flight control,we introduced a control strategy that integrated pipeline control and visual servoing mechanisms.We developed a dedicated simulation platform and designed a realistic scenario to rigorously validate the efficacy of the entire micro-UAV swarm system in simulated exercises and actual flight tests.展开更多
Bio-inspired magnetic helical microrobots have great potential for biomedical and micromanipulation applications. Precise interaction with objects in liquid environments is an important prerequisite and challenge for ...Bio-inspired magnetic helical microrobots have great potential for biomedical and micromanipulation applications. Precise interaction with objects in liquid environments is an important prerequisite and challenge for helical microrobots to perform various tasks. In this study, an automatic control method is proposed to realize the axial docking of helical microrobots with arbitrarily placed cylindrical objects in liquid environments. The docking process is divided into ascent, approach, alignment, and insertion stages. First, a 3D docking path is planned according to the positions and orientations of the microrobot and the target object. Second, a steering-based 3D path-following controller guides the helical microrobot to rise away from the container bottom and approach the target along the path. Third, based on path design with gravity compensation and steering output limits, alignment of position and orientation can be accomplished simultaneously. Finally, the helical microrobot completes the docking under the rotating magnetic field along the target orientation. Experiments verified the automatic docking of the helical microrobot with static targets, including connecting with micro-shafts and inserting into micro-tubes. The object grasping of a reconfigurable helical microrobot aided by 3D automatic docking was also demonstrated. This method enables precise docking of helical microrobots with objects, which might be used for capture and sampling, in vivo navigation control, and functional assembly of microrobots.展开更多
基金supported by the Foundation of National Key Laboratory of Human Factors Engineering,China(No.HFNKL2023 WWO5)。
文摘To enhance the robustness and real-time performance of robotic arm visual servoing in complex environments such as space,this study proposes Di FA-DETR,a modified object detection framework based on the DETR architecture.The proposed model incorporates an improved Res Net50 Bottleneck structure with spatial dimensionality reduction and sparse interaction mechanisms,alongside a redesigned self-attention module featuring downsampling optimization and adaptive feature enhancement.A custom-annotated satellite component dataset was constructed to train and evaluate the system.Experimental results demonstrate that Di FA-DETR achieves an AP50 of 79.9%,outperforming existing DETR variants while reducing computational complexity by 31.9%and nearly doubling the inference speed.The method was further validated in a ground-based visual servoing system using an industrial robotic arm and camera setup.The system successfully tracked satellite targets under dynamic motion scenarios,maintaining millimeter-level positioning accuracy.These results confirm the feasibility and effectiveness of the proposed method in supporting future space robotic applications requiring precision tracking and fast response.
基金supported in part by the Institute for Guo Qiang of Tsinghua University(2019GQG1023)in part by Graduate Education and Teaching Reform Project of Tsinghua University(202007J007)+1 种基金in part by National Natural Science Foundation of China(U19B2029,62073028,61803222)in part by the Independent Research Program of Tsinghua University(2018Z05JDX002)。
文摘There are two main trends in the development of unmanned aerial vehicle(UAV)technologies:miniaturization and intellectualization,in which realizing object tracking capabilities for a nano-scale UAV is one of the most challenging problems.In this paper,we present a visual object tracking and servoing control system utilizing a tailor-made 38 g nano-scale quadrotor.A lightweight visual module is integrated to enable object tracking capabilities,and a micro positioning deck is mounted to provide accurate pose estimation.In order to be robust against object appearance variations,a novel object tracking algorithm,denoted by RMCTer,is proposed,which integrates a powerful short-term tracking module and an efficient long-term processing module.In particular,the long-term processing module can provide additional object information and modify the short-term tracking model in a timely manner.Furthermore,a positionbased visual servoing control method is proposed for the quadrotor,where an adaptive tracking controller is designed by leveraging backstepping and adaptive techniques.Stable and accurate object tracking is achieved even under disturbances.Experimental results are presented to demonstrate the high accuracy and stability of the whole tracking system.
文摘This paper describes a system for grasping known objects with unmanned aerial vehicles (UAVs) provided with dual manipulators using an RGB-D camera. Aerial manipulation remains a very challenging task. This paper covers three principal aspects for this task: object detection and pose estimation, grasp planning, and in-flight grasp execution. First, an artificial neural network (ANN) is used to obtain clues regarding the object’s position. Next, an alignment algorithm is used to obtain the object’s sixdimensional (6D) pose, which is filtered with an extended Kalman filter. A three-dimensional (3D) model of the object is then used to estimate an arranged list of good grasps for the aerial manipulator. The results from the detection algorithm—that is, the object’s pose—are used to update the trajectories of the arms toward the object. If the target poses are not reachable due to the UAV’s oscillations, the algorithm switches to the next feasible grasp. This paper introduces the overall methodology, and provides the experimental results of both simulation and real experiments for each module, in addition to a video showing the results.
基金supported by China Postdoctoral Science Founda-tion (No. 20080441093)Key Laboratory Foundation of Liaoning Province (No. 2008S088).
文摘A visual servoing tracking controller is proposed based on the sliding mode control theory in order to achieve strong robustness against parameter variations and external disturbances. A sliding plane with time delay compensation is presented by the pre-estimate of states. To reduce the chattering of the sliding mode controller, a modified exponential reaching law and hyperbolic tangent function are applied to the design of visual controller and robot joint controller. Simulation results show that the visual servoing control scheme is robust and has good tracking performance.
基金supported by National Natural Science Foundation of China (No.60873032)National High Technology Research and Development Program of China (863 Program) (No.2008AA8041302)
文摘This paper presents an improved support vector machine （SVM） algorithm, which employs invariant moments-based edge extraction to obtain feature attribute. A heuristic attribute reduction algorithm based on rough set＇s discernible matrix is proposed to identify and classify micro-targets. To avoid the complicated calibration for intrinsic parameters of camera, an improved Broyden＇s method is proposed to estimate the image Jacobian matrix which employs Chebyshev polynomial to construct a cost function to approximate the optimization value. Finally, a visual controller is designed for a robotic micromanipulation system. The experiment results of micro-parts assembly show that the proposed methods and algorithms are effective and feasible.
基金supported by Natural Science Foundation of China (No. 61773374)Key Research and Development Program of China (No. 2017YFB1300104)
文摘In this paper, we propose a method to select the observation position in visual servoing with an eye-in-vehicle configuration for the manipulator. In traditional visual servoing, the images taken by the camera may have various problems, including being out of view, large perspective aberrance, improper projection area of object in images and so on. In this paper, we propose a method to determine the observation position to solve these problems. A mobile robot system with pan-tilt camera is designed, which calculates the observation position based on an observation and then moves there. Both simulation and experimental results are provided to validate the effectiveness of the proposed method.
基金This project was supported by the research foundation of China Education Ministry for the scholars from abroad (2002247).
文摘A learning-based control approach is presented for force servoing of a robot with vision in an unknown environment. Firstly, mapping relationships between image features of the servoing object and the joint angles of the robot are derived and learned by a neural network. Secondly, a learning controller based on the neural network is designed for the robot to trace the object. Thirdly, a discrete time impedance control law is obtained for the force servoing of the robot, the on-line learning algorithms for three neural networks are developed to adjust the impedance parameters of the robot in the unknown environment. Lastly, wiping experiments are carried out by using a 6 DOF industrial robot with a CCD camera and a force/torque sensor in its end effector, and the experimental results confirm the effecti veness of the approach.
基金Supported by the National Natural Science Foundation of China(No.61221003)
文摘A robust visual servoing system is investigated on a humanoid robot which grasps a brush in Chinese calligraphy task.The system is implemented based on uncalibrated visual servoing controller utilizing Kalman-Bucy filter,with the help of an object detector by continuously adaptive MeanShift(CAMShift) algorithm.Under this control scheme,a humanoid robot can satisfactorily grasp a brush without system modeling.The proposed method is shown to be robust and effective through a Chinese calligraphy task on a NAO robot.
基金Supported by the National High Technology Research and Development Program of China （No. 2003AA421030） and the National Science Foundation of China （No. 60375026）.
文摘A dual operational modes mobile robot system based on visual guiding and visual servo control is presented. This system consists of a mobile robot with a two-axis manipulator and a tele-operation station. In the visual guiding mode, for the robot works in an open loop visual servo control mode, the manipulating burden of the operator is reduced largely. In the visual servo mode the robot can locate the position of the target assigned by the operator and pick it up by its manipulator. With the help of the operator, the diffieuh problems of finding and handling a target in a complicated environment by the robot can be solved easily.
基金This project is supported by National Natural Science Foundation of China (No.59990470).
文摘In IBVS (image based visual servoing), the error signal in image space should be transformed into the control signal in the input space quickly. To avoid the iterative adjustment and complicated inverse solution of image Jacobian, CMAC (cerebellar model articulation controller) neural network is inserted into visual servo control loop to implement the nonlinear mapping. Two control schemes are used. Simulation results on two schemes are provided, which show a better tracking precision and stability can be achieved using scheme 2.
基金supported by the China Postdoctoral Science Foundation(No.2022M710956).
文摘In this paper,a visual servoing approach is developed to capture the docking rings of tumbling non-cooperative satellites with a space manipulator.The primary challenge addressed is the potential for the docking ring to leave the monocular camera’s field-of-view as the manipulator approaches the target,due to the ring’s large size.To solve this issue,a two-phase visual servoing scheme combining a monocular camera and a three-line structured light vision system is proposed.In an effort to augment the success rate and safety of capture operations,several constraints are formulated,encompassing manipulator’s kinematics,monocular camera’s field-of-view,obstacle avoidance,structured light’s breakpoints and smooth capture.Subsequently,a nonlinear model predictive controller is proposed to manage these constraints in real-time and regulate the system.System models are established based on image moments and pose for each phase,selecting these features as visual feedback to simplify the formulation of servo constraints and avoid the complex circle-based pose measurement.Furthermore,to ensure unbiased predictions,the model disturbances arising from the imprecise estimation of target motion parameter are observed using an extended Kalman filter,which are then incorporated into the predictive control framework.The simulation results demonstrate the effectiveness of this scheme.
文摘Welding path planning can substitute for the manual teaching process of the robot and can promote the autonomous level of the robotic welding. A path planning method by visual servoing was presented, in which the optimal angle of charge-coupled device (CCD) camera was also planned. Aiming at planning two forms of kinked line seams, obtuse angle seam and right angle seam, a practicable solution was put forward. In this solution, the intersection of two adjacent straight segments is detected in each local seam image, and if intersection is found, the seam errors are calculated using the next straight segment. The experimental results show that kinked line seam can be well planned using this solution.
文摘Currently, most visual servoing system must be calibrated, while it is impossible to calibrate cameras and robot models precisely in industrial practice, so a novel dynamic uncalibrated eye-in-hand visual servoing system of tracking a moving target is proposed. The method does not require calibration of camera and robot kinematic models. Vision guided algorithm for tracking dynamic image is developed through minimizing nonlinear objective function. For the large residual has not been approximated in dynamic environment and the change of composite image Jacobian with time increment has not been computed in visual servoing system now,large residuals are dynamic approximated and the change of composite image Jacobian at each iterative step is computed. Simulation results demonstrate the validity of these approaches.
基金Supported by the National Natural Science Foundation of China(No.60905061)the National Natural Science Foundation of Tianjin(No.08JCYBJC12700)
文摘In this paper,a method with an eye-in-hand configuration is developed to hit targets during visual tracking for the TLS(Tele-Light Saber) game.It is not necessary to calibrate camera parameters and predict the trajectory of the moving object.Firstly,the expression of the image Jacobian matrix for the eye-in-hand configuration is proposed,and then an update law is designed to estimate the image Jacobian online.Furthermore,a control scheme is presented and the Lyapunov method is employed to prove asymptotic convergence of image errors.No assumption for the moving objects is needed.Finally,both simulation and experimental results are shown to support the approach in this paper.
基金The National Natural Science Foundation of China (No 60428303)
文摘Stable switch control between multiple cameras for uncalibrated visual servoing was studied. Switch images based on fusion were presented to get the continuous dynamic image Jacobian matrix among robots and distributed visual sensors. The designed fusion algorithm is suitable to have dynamically adjustable fusion weights, and the fusion structure was analyzed. Simulations and experiments without any knowledge of mobile robots and uncalibrated visual sensors show that the method has higher adaptability than the traditional instant switch control method. The method can enhance the system stability at the switching process.
基金This project is supported by National Electric Power Corporation Foundation of China(No.SPKJ010-27).
文摘Target tracking is one typical application of visual servoing technology. It is still a difficult task to track high speed target with current visual servo system. The improvement of visual servoing scheme is strongly required. A position-based visual servo parallel system is presented for tracking target with high speed. A local Frenet frame is assigned to the sampling point of spatial trajectory. Position estimation is formed by the differential features of intrinsic geometry, and orientation estimation is formed by homogenous transformation. The time spent for searching and processing can be greatly reduced by shifting the window according to features location prediction. The simulation results have demonstrated the ability of the system to track spatial moving object.
基金supported by the National Natural Science Foundation of China(Nos.52177059 and 52407064).
文摘Permanent magnet synchronous motor based electro-mechanical actuation servo drives have widespread applications in the aviation field,such as unmanned aerial vehicle electric servos,electric cabin doors,and mechanical arms.The performance of the servo drive,which encompasses the response to the torque,efficiency,control bandwidth and the steady-state positioning accuracy,significantly influences the performance of the aviation actuation.Consequently,enhancing the control bandwidth and refining the positioning accuracy of aviation electro-mechanical actuation servo drives have emerged as a focal point of research.This paper investigates the multi-source disturbances present in aviation electro-mechanical actuation servo systems and summarizes recent research on high-performance servo control methods based on active disturbance rejection control(ADRC).We present a comprehensive overview of the research status pertaining to servo control architecture,strategies for suppressing disturbances in the current loop,and ADRC-based strategies for the position loop.We delineate the research challenges and difficulties encountered by aviation electro-mechanical actuation servo drive control technology.
基金supported by the National Key R&D Program of China(2024YFB4504500)the Shanghai Collaborative Innovation Project(24xtcx00500).
文摘During indoor operations,Unmanned Aerial Vehicles(UAVs)are required to embody attributes such as heightened sensitivity,compact design,and robust maneuverability.A high operational advantage is evident when tasks are executed using multiple UAVs in unison.Despite the prevalent focus in current UAV research on enhancing discrete components or modules,a holistic,integrated approach that encompasses the UAV architecture,platform design,algorithms,simulation,and swarm intelligence,is lacking.This study introduces a micro-UAV swarm system designed for efficient perception within partially known indoor environments.We devised the comprehensive architectural blueprint of a micro-UAV swarm system.A communication routing evaluation metric is proposed to improve the quality of intercommunication among UAVs in the micro-UAV swarm.In addressing the localization and perception challenges,this study features the development of a multisensor-based autonomous positioning methodology,complemented by an object detection and tracking framework based on YOLOv5 and DeepSORT technologies.In the realm of decision making,we used the DuelingDQN algorithm to facilitate mission allocation and scheduling within the micro-UAV swarm system.For flight control,we introduced a control strategy that integrated pipeline control and visual servoing mechanisms.We developed a dedicated simulation platform and designed a realistic scenario to rigorously validate the efficacy of the entire micro-UAV swarm system in simulated exercises and actual flight tests.
基金supported by the National Natural Science Foundation of China(No.62273117)Pre-research Task(No.SKLRS202418B)of State Key Laboratory of Robotics and Systems(HIT).
文摘Bio-inspired magnetic helical microrobots have great potential for biomedical and micromanipulation applications. Precise interaction with objects in liquid environments is an important prerequisite and challenge for helical microrobots to perform various tasks. In this study, an automatic control method is proposed to realize the axial docking of helical microrobots with arbitrarily placed cylindrical objects in liquid environments. The docking process is divided into ascent, approach, alignment, and insertion stages. First, a 3D docking path is planned according to the positions and orientations of the microrobot and the target object. Second, a steering-based 3D path-following controller guides the helical microrobot to rise away from the container bottom and approach the target along the path. Third, based on path design with gravity compensation and steering output limits, alignment of position and orientation can be accomplished simultaneously. Finally, the helical microrobot completes the docking under the rotating magnetic field along the target orientation. Experiments verified the automatic docking of the helical microrobot with static targets, including connecting with micro-shafts and inserting into micro-tubes. The object grasping of a reconfigurable helical microrobot aided by 3D automatic docking was also demonstrated. This method enables precise docking of helical microrobots with objects, which might be used for capture and sampling, in vivo navigation control, and functional assembly of microrobots.
