As humans and robots work closer together than ever,anthropomorphic robotic arms with intuitive human-robot interaction interfaces have drawn massive attention to improving the quality of robot-assisted manipulation.I...As humans and robots work closer together than ever,anthropomorphic robotic arms with intuitive human-robot interaction interfaces have drawn massive attention to improving the quality of robot-assisted manipulation.In pursuit of this,we designed a dedicated 7-degrees-of-freedom(DoF)anthropomorphic robotic arm having three compact differential joints and a head-mounted gaze tracker enabling head-pose-tracked 3D gaze estimation.Moreover,two key challenges were addressed to achieve accurate robot-assisted manipulation of the object indicated by the direction of human gaze.First,a novel predictive pupil feature was proposed for 3D gaze estimation.Differing from most existing features subjected to the common paraxial approximation assumption,the proposed novel predictive pupil feature considered the light refraction at two corneal surfaces with a more realistic eye model,significantly improving the 3D gaze estimation accuracy when the eyeball rotates at large angles.Second,a novel optimization-based approach was developed to efficiently compensate for the posture errors of the designed 7-DoF anthropomorphic robotic arm for accurate manipulation.Compared with the existing Jacobian-based or optimization-based approaches with nominal joint values as iteration initial,the proposed approach computed the optimal iteration initial and realized faster convergence for real-time posture error compensation.With the posture error compensation in real time and 3D gaze estimated accurately,the human can command accurate robot-assisted manipulation using his eyes intuitively.The proposed system was successfully tested on five healthy subjects.展开更多
基金supported by the National Natural Science Foundation of China(Grant Nos.52027806,52435005,92248304,52075191).
文摘As humans and robots work closer together than ever,anthropomorphic robotic arms with intuitive human-robot interaction interfaces have drawn massive attention to improving the quality of robot-assisted manipulation.In pursuit of this,we designed a dedicated 7-degrees-of-freedom(DoF)anthropomorphic robotic arm having three compact differential joints and a head-mounted gaze tracker enabling head-pose-tracked 3D gaze estimation.Moreover,two key challenges were addressed to achieve accurate robot-assisted manipulation of the object indicated by the direction of human gaze.First,a novel predictive pupil feature was proposed for 3D gaze estimation.Differing from most existing features subjected to the common paraxial approximation assumption,the proposed novel predictive pupil feature considered the light refraction at two corneal surfaces with a more realistic eye model,significantly improving the 3D gaze estimation accuracy when the eyeball rotates at large angles.Second,a novel optimization-based approach was developed to efficiently compensate for the posture errors of the designed 7-DoF anthropomorphic robotic arm for accurate manipulation.Compared with the existing Jacobian-based or optimization-based approaches with nominal joint values as iteration initial,the proposed approach computed the optimal iteration initial and realized faster convergence for real-time posture error compensation.With the posture error compensation in real time and 3D gaze estimated accurately,the human can command accurate robot-assisted manipulation using his eyes intuitively.The proposed system was successfully tested on five healthy subjects.
