In IBVS (image based visual servoing), the error signal in image space should be transformed into the control signal in the input space quickly. To avoid the iterative adjustment and complicated inverse solution of im...In IBVS (image based visual servoing), the error signal in image space should be transformed into the control signal in the input space quickly. To avoid the iterative adjustment and complicated inverse solution of image Jacobian, CMAC (cerebellar model articulation controller) neural network is inserted into visual servo control loop to implement the nonlinear mapping. Two control schemes are used. Simulation results on two schemes are provided, which show a better tracking precision and stability can be achieved using scheme 2.展开更多
A dual operational modes mobile robot system based on visual guiding and visual servo control is presented. This system consists of a mobile robot with a two-axis manipulator and a tele-operation station. In the visua...A dual operational modes mobile robot system based on visual guiding and visual servo control is presented. This system consists of a mobile robot with a two-axis manipulator and a tele-operation station. In the visual guiding mode, for the robot works in an open loop visual servo control mode, the manipulating burden of the operator is reduced largely. In the visual servo mode the robot can locate the position of the target assigned by the operator and pick it up by its manipulator. With the help of the operator, the diffieuh problems of finding and handling a target in a complicated environment by the robot can be solved easily.展开更多
Robot-assisted surgery has become an indispensable component in modern neurosurgical procedures.However,existing registration methods for neurosurgical robots often rely on high-end hardware and involve prolonged or u...Robot-assisted surgery has become an indispensable component in modern neurosurgical procedures.However,existing registration methods for neurosurgical robots often rely on high-end hardware and involve prolonged or unstable registration times,limiting their applicability in dynamic and time-sensitive intraoperative settings.This paper proposes a novel fully automatic monocular-based registration and real-time tracking method.First,dedicated fiducials are designed,and an automatic preoperative and intraoperative detection method for these fiducials is introduced.Second,a geometric representation of the fiducials is constructed based on a 2D KD-Tree.Through a two-stage optimization process,the depth of 2D fiducials is estimated,and 2D-3D correspondences are established to achieve monocular registration.This approach enables fully automatic intraoperative registration using only a single optical camera.Finally,a six-degree-of-freedom visual servo control strategy inspired by the mass-spring-damper system is proposed.By integrating artificial potential field and admittance control,the strategy ensures real-time responsiveness and stable tracking.Experimental results demonstrate that the proposed method achieves a registration time of 0.23 s per instance with an average error of 0.58 mm.Additionally,the motion performance of the control strategy has been validated.Preliminary experiments verify the effectiveness of MonoTracker in dynamic tracking scenarios.This method holds promise for enhancing the adaptability of neurosurgical robots and offers significant clinical application potential.展开更多
An automated approach is proposed for a microassembly task, which is to insert a 10 μm diameter glass tube into a 12 μm diameter hole in a silicon substrate, and bond them together with ultraviolet （UV） curable ad...An automated approach is proposed for a microassembly task, which is to insert a 10 μm diameter glass tube into a 12 μm diameter hole in a silicon substrate, and bond them together with ultraviolet （UV） curable adhesive. Two three-degree-of-freedom micromanipulators axe used to move the glass tube and the dispensing needle, respectively. Visual feedback is provided by an optical microscope. The angle of the microscope axis is precisely calibrated using an autofocus strategy. Robust image segmentation method and feature extraction algorithm are developed to obtain the features of the hole, the glass tube and the dispensing needle. Visual servo control is employed to achieve accurate aligning for the tube and the hole. Automated adhesive dispensing is used to bond the glass tube and the silicon substrate together after the insertion. On-line monitoring ensures that the diameter of the adhesive spot is within a desired range. Experimental results demonstrate the effectiveness of the proposed strategy.展开更多
基金This project is supported by National Natural Science Foundation of China (No.59990470).
文摘In IBVS (image based visual servoing), the error signal in image space should be transformed into the control signal in the input space quickly. To avoid the iterative adjustment and complicated inverse solution of image Jacobian, CMAC (cerebellar model articulation controller) neural network is inserted into visual servo control loop to implement the nonlinear mapping. Two control schemes are used. Simulation results on two schemes are provided, which show a better tracking precision and stability can be achieved using scheme 2.
基金Supported by the National High Technology Research and Development Program of China （No. 2003AA421030） and the National Science Foundation of China （No. 60375026）.
文摘A dual operational modes mobile robot system based on visual guiding and visual servo control is presented. This system consists of a mobile robot with a two-axis manipulator and a tele-operation station. In the visual guiding mode, for the robot works in an open loop visual servo control mode, the manipulating burden of the operator is reduced largely. In the visual servo mode the robot can locate the position of the target assigned by the operator and pick it up by its manipulator. With the help of the operator, the diffieuh problems of finding and handling a target in a complicated environment by the robot can be solved easily.
基金Supported by National Natural Science Foundation of China(Grant No.92148206).
文摘Robot-assisted surgery has become an indispensable component in modern neurosurgical procedures.However,existing registration methods for neurosurgical robots often rely on high-end hardware and involve prolonged or unstable registration times,limiting their applicability in dynamic and time-sensitive intraoperative settings.This paper proposes a novel fully automatic monocular-based registration and real-time tracking method.First,dedicated fiducials are designed,and an automatic preoperative and intraoperative detection method for these fiducials is introduced.Second,a geometric representation of the fiducials is constructed based on a 2D KD-Tree.Through a two-stage optimization process,the depth of 2D fiducials is estimated,and 2D-3D correspondences are established to achieve monocular registration.This approach enables fully automatic intraoperative registration using only a single optical camera.Finally,a six-degree-of-freedom visual servo control strategy inspired by the mass-spring-damper system is proposed.By integrating artificial potential field and admittance control,the strategy ensures real-time responsiveness and stable tracking.Experimental results demonstrate that the proposed method achieves a registration time of 0.23 s per instance with an average error of 0.58 mm.Additionally,the motion performance of the control strategy has been validated.Preliminary experiments verify the effectiveness of MonoTracker in dynamic tracking scenarios.This method holds promise for enhancing the adaptability of neurosurgical robots and offers significant clinical application potential.
基金supported by National Natural Science Foundation of China under(Nos.61227804 and 61105036)
文摘An automated approach is proposed for a microassembly task, which is to insert a 10 μm diameter glass tube into a 12 μm diameter hole in a silicon substrate, and bond them together with ultraviolet （UV） curable adhesive. Two three-degree-of-freedom micromanipulators axe used to move the glass tube and the dispensing needle, respectively. Visual feedback is provided by an optical microscope. The angle of the microscope axis is precisely calibrated using an autofocus strategy. Robust image segmentation method and feature extraction algorithm are developed to obtain the features of the hole, the glass tube and the dispensing needle. Visual servo control is employed to achieve accurate aligning for the tube and the hole. Automated adhesive dispensing is used to bond the glass tube and the silicon substrate together after the insertion. On-line monitoring ensures that the diameter of the adhesive spot is within a desired range. Experimental results demonstrate the effectiveness of the proposed strategy.
