期刊文献+

移动双臂机械手系统协调操作的视觉伺服技术 被引量:18

Visual servo technology for coordinated manipulation of a mobile dual-arm manipulator system
在线阅读 下载PDF
导出
摘要 本文利用双目泛倾斜变焦摄像机(pan-tilt-zoom,PTZ)像机,实现移动双臂机械手系统的视觉伺服协调操作,重点研究室内复杂环境和光照变化情况下目标物体的检测、识别和定位问题.首先,提出了色调、饱和度、亮度颜色模型(hue-saturation-value,HSV)空间下图像分割的改进算法,通过阈值更新和外接矩形改善分割结果,提高检测算法对环境光照变化的适应性;然后,基于Hu不变矩,利用物体形状特征,对检测得到的物体加以识别:在此基础上,利用摄像机投影矩阵,计算目标物体的空间坐标,实现其定位测量:最后,在实验室平台上,通过模拟双臂倒水操作,验证提出的图像处理和分析算法以及视觉伺服协调操作方案的有效性.实验结果表明移动双臂机械手系统能够成功完成倒水动作的协调操作. Two pan-tilt-zoom (PTZ) cameras are used in this study to realize visual servo for coordinated manipulation of a mobile dual-arm manipulator system. The focus of this study is mainly on the problems of target object detection, recognition and localization in the indoor environment of scattered background and varying illumination. First, a modi- fied algorithm is proposed to detect objects in the hue-saturation-value (HSV) color space based on updated segmentation thresholds and bounding rectangles, which improves the detection algorithm's adaptability to illumination variation. Sec- ond, the target is identified from the detected objects using the target contour features and the Hu's moment invariants. Then, the spatial coordinates of the target object are computed with the cameras' perspective matrices, and the target position is consequently determined. Finally, to verify effectiveness of the image processing and analysis algorithms presented and the visual servo technology, experiments are done on a mobile platform in our lab to mimic the manipulation of pouring water with two arms, and the results show that the mobile manipulator system can complete the task successfully.
出处 《控制理论与应用》 EI CAS CSCD 北大核心 2015年第1期69-74,共6页 Control Theory & Applications
基金 国家自然科学基金项目(61375109 61273356) 机器人学国家重点实验室开放基金项目(2013-012)资助~~
关键词 移动双臂机械手系统 视觉伺服 协调操作 HSV空间 不变矩 mobile dual-arm manipulator system visual servo coordinated manipulation HSV space invariant moment
  • 相关文献

参考文献12

  • 1WELCH R. LIMONADI D, MANNING R. System engineering the curiosity rover: A retrospective [C] //Proceedings of the 8th Interna- tional Conference on System of Systems Engineering. Maui. HI, 2013: 70 - 75.
  • 2MAKI J, THIESSEN D, POURANGI A. et al. The Mars science laboratory wngineering cameras [J]. Space Science Reviews, 2012, 170( 1/2/3/4): 77 - 93.
  • 3SONG K T. TSAI S C. Vision-based adaptive grasping of a humanoid robot arm[C ]//Proceedings of IEEE International Conference on Au- tomation and Logistics. Zhengzhou: IEEE, 2012:155 - 160.
  • 4CHITTA S, JONES E G. CIOCARLIE M, et al. Mobile manipula- tion in unstructured environments: Perception. planning, and execu- tion [J ]. IEEE Robotics and Automation Magazine. 2012, 19( 2 ): 58 - 71.
  • 5CHENG H. CHEN H, LIU Y. Object handling using autonomous in- dustrial mobile manipulator [C]//Proceedings of IEEE International Conference on Cyher Technology in Automation, Control and Intelli- gent Systems. Nanjing, China: IEEE. 2013:36 - 41.
  • 6JIANG Y. XI N, ZHANG Q. ct al. Target object identification and localization in mobile manipulators [C] //Proceedings of IEEE Inter- national Cnference on Robotics and Biomimetics. Phuket, Thailand, 2011:144- 149.
  • 7MAITIN-SHEPARD J. CUSUMANO-TOWNER M. LEI J. et al. Cloth grasp point detection based on multiple-view geometric cues with application to robotic towel folding [C]//Proceedings of IEEE International Conference on Robotics and Automation. Alaska USA: [s.n.]. 2010:2308 - 2315.
  • 8HIROSE M. OGAWA K. Honda humanoid robots development [J]. Philosophical Transactions of the Royal Society A - Mathematical Physical and Engineering Sciences. 2007, 365( 1850): 11 - 19.
  • 9DIETRICH A. WIMBOCK T, ALBU-SHAFFER A. et al. Reactive whole-body control: dynamic mobile manipulation using a large number of actuated degrees of freedom [J]. IEEE Robotics and Automation Magazine, 2012. 19(2): 20 - 33.
  • 10QI N. ZHAO L, LI R. et al. Dual-arm service robots for mobile operation in indoor environmenl [C] //Proceedings of IEEE Inter- national Conference on Mechatronics and Automation. Chengdu, China: IEEE. 2012:1898 - 1903.

同被引文献124

引证文献18

二级引证文献83

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部