期刊文献+

基于细胞神经网络的快速手语视频分割方法 被引量:4

Fast segmentation of sign language video based on cellular neural network
在线阅读 下载PDF
导出
摘要 为实现感兴趣区手语视频编码,提高通话效率,提出一种基于细胞神经网络(CNN)的快速手语视频分割方法。该方法首先利用肤色信息特征进行基于CNN的肤色检测,检测出手语视频中的肤色区域;然后对肤色检测结果,利用帧差法进行基于CNN的运动检测,获得初始的手势区域;最后采用形态学处理方法进行空洞填充和边界平滑,实现了手语视频图像序列中的面部和手部区域的分割。研究结果表明,该方法能够快速准确地进行手语视频分割。 To achieve sign language video coding of region of interest, and improve call efficiency, a fast segmentation methodology of sign language video based on Cellular Neural Network (CNN) was proposed. Firstly, the skin regions of sign language video were detected through corresponding CNN templates by using the skin color information characteristics. Secondly, CNN based motion detection was carried out on the skin detection results by using inter-frame difference algorithm, and then the initial gesture region could be obtained. Finally, morphological processing methods were employed to fill small holes and smooth the boundaries of regions, and eventually the segmentation of the face and hands regions of sign language video image sequence was realized. The results show that the method can rapidly and accurately segment sign language video.
出处 《计算机应用》 CSCD 北大核心 2013年第2期503-506,共4页 journal of Computer Applications
基金 国家自然科学基金资助项目(11072099) 甘肃省自然科学基金资助项目(112RJZA033)
关键词 细胞神经网络 手语 视频分割 肤色检测 运动检测 Cellular Neural Network (CNN) sign language video segmentation skin color detection motion detection
  • 相关文献

参考文献16

  • 1von AGRIS U,ZIEREN J,CANZLER U. Recent developments in visual sign language recognition[J].Universal Access in the Information Society,2008,(04):323-362.
  • 2LADNER R E. Communication technologies for people with sensory disabilities[J].Proceedings of the IEEE,2009,(04):957-973.
  • 3SAXE D M,FOULDS R A. Robust region of interest coding for improved sign language telecommunication[J].IEEE Transactions on Information Technology in Biomedicine,2002,(04):310-316.
  • 4HABILI N,LIM C C,MOINI A. Segmentation of the face and hands in sign language video sequences using color and motion cues[J].IEEE Transactions on Circuits and Systems for Video Technology,2004,(08):1086-1097.
  • 5曹昕燕,赵继印,李敏.基于肤色和运动检测技术的单目视觉手势分割[J].湖南大学学报(自然科学版),2011,38(1):78-83. 被引量:21
  • 6CHUA L O,YANG L. Cellular neural networks:theory[J].IEEE Transactions on Circuits and Systems,1988,(10):1257-1272.doi:10.1109/31.7600.
  • 7CHUA L O,YANG L. Cellular neural networks:applications[J].IEEE Transactions on Circuits and Systems,1988,(10):1273-1290.doi:10.1109/31.7601.
  • 8KIM H,ROSKA T,CHOU L O. Automatic detection and tracking of moving image target with CNN-UM via target probability fusion of multiple features[J].International Journal of Circuit theory and Applications,2003,(04):329-346.
  • 9COSTANTINIL G,CASALI D,PERFETTI R. Analogic CNN algorithm for estimating position and size of moving objects[J].International Journal of Circuit theory and Applications,2004,(06):509-522.
  • 10ANZALONE A,BIZZARRI F,STORACE M. A cellular non-linear network for image fusion based on data regularization[J].International Journal of Circuit theory and Applications,2006,(05):533-546.

二级参考文献27

  • 1林生佑,石教英.基于HVS的彩色图像边缘检测算子[J].中国图象图形学报(A辑),2005,10(1):43-47. 被引量:17
  • 2凌建国,刘小军,徐心和,杨杰.基于熵的变分辨率彩色图像分割[J].上海交通大学学报,2005,39(12):1975-1978. 被引量:2
  • 3陈锻生,刘政凯.肤色检测技术综述[J].计算机学报,2006,29(2):194-207. 被引量:119
  • 4路凯,李小坚,周金祥.基于肤色和边缘轮廓检测的手势识别[J].北方工业大学学报,2006,18(3):12-15. 被引量:10
  • 5WANG Qi, CHEN Xi-lin, ZHANG Liang-guo, et al. View- point invariant sign language recognition[J]. Computer Vision and Image Understanding, 2007,108(1/2) : 87- 97.
  • 6DENG J W, TSUI H T. A two-step approach based on PaHMM for the recognition of ASL[C]// The Fifth Asian Conference on Computer Vision. Melbourne, Victoria, Aus- tralia:. ACCV, 2002: 126-131.
  • 7STARNER T, WEAVER J, PENTLAND A. Real-time A- merican sign language recognition using desk and wearable computer based video[J]. IEEE Transations on Pattern Anal- ysis and Machine Intelligence, 1998,20(12):1371-1375.
  • 8HEAP T, HOGG D. Wormholes in shape space: tracking through discontinuous changes in shape[C]// Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Bombay, India: IEEE, 1998:344- 349.
  • 9CUI Yun-tao,JONE J W, View-based hand segmentation and hand-sequence recognition with complex backgrounds[C]// Proceedings of the IEEE International Conference on Pattern Recognition. Vienna, Austria: IEEE, 1996:617-621.
  • 10HABILI N,LIM C C. Hand and face segmentation using mo- tion and color cues in digital image sequences[C]// Proceed- ings of IEEE International Conference on Multimedia and Ex- po. Tokyo, Japan: IEEE Computer Society, 2001 :377-380.

共引文献51

同被引文献46

  • 1刘玉杰,赵国英,李宗民,李华.基于逻辑运算的二值图像检索[J].计算机应用,2004,24(10):72-74. 被引量:3
  • 2朱海华,李雅娟,宋志坚.基于图像力场转换的耳廓图像识别[J].自动化学报,2006,32(4):512-518. 被引量:5
  • 3Ciarmello F M, Hemami S S. A computational intelligibili- ty model for assessment and compression of American sign language video[J]. IEEE Transactions on Image Pro- cessing,2011,20 ( 11 ) : 3014 - 3028.
  • 4Habili N, Lim C C, Moini A. Segmentation of the face and hands in sign language video sequences using color and motion cues [ J]. IEEE Transactions on Circuits and Sys- tems for Video Technology,2004,14 ( 8 ) : 1086 - 1097.
  • 5Holden E,Lee G, Owens R. Australian sign language rec- ognition[J]. Machine Vision and Applications, 2005,16 (5) :312 -320.
  • 6Gonzalez M, ollet C, Dubot R. Head tracking and hand segmentation during hand over face occlusion in sign 1an-guage[J]. Lecture Notes in Computer Science, 2012 (655:~) :234 - 243.
  • 7Smith P, Lobo N, Shah M. Resolving hand over face oc- clusion [ J ]. Image and Vision Computing, 2007 (25) : 1432 - 1448.
  • 8Hussain A,Abbasi A R,Afzulpurkar N. Detecting and in- terpreting self-manipulating hand movements for student's affect prediction[J]. Human-centric Computing and Infor- mation Sciences ,2012,2 ( 1 ) : 14.
  • 9Hurley D J, Nixon M S, Carter J N. Force field feature extraction for ear biometrics[ J]. Computer Vision and Im- age Understanding,2005,98 (3) :491 - 512.
  • 10Nixon M S,Liu X U, Direkoglu C, et al. On using physi- cal analogies for feature and shape extraction in computer vision[ J]. The Computer Journal,2011,54( 1 ) : 11 - 25.

引证文献4

二级引证文献6

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部