摘要
针对复杂场景下深度相机环境要求高,可穿戴设备不自然,基于深度学习模型数据集样本少导致识别能力、鲁棒性欠佳的问题,提出了一种基于语义分割的深度学习模型进行手势分割结合迁移学习的神经网络识别的手势识别方法;通过对采集到的图像数据集进行不同角度旋转、翻转等操作进行数据集样本增强,训练分割模型进行手势区域的分割,通过迁移学习卷积神经网络更好地提取手势特征向量,通过Softmax函数进行手势分类识别;通过4个人在不同背景下做的10个手势,实验结果表明:针对复杂背景环境下能够正确地识别手势。
Due to the high requirements for the deep camera environment in complex scenes,wearable devices are not natural,and the lack of data set samples based on the deep learning model leads to poor recognition ability and robustness,A gesture recognition method based on deep learning model based on semantic segmentation and neural network based on transfer learning is proposed.By rotating and flipping the collected image data set at different angles,data set samples were enhanced,segmentation model was trained to segment gesture areas,and gesture feature vectors were extracted better through transfer learning convolutional neural network.Softmax function is used for gesture classification and recognition.Through 10 gestures made by 4 people in different backgrounds,the experimental results show that they can correctly recognize gestures in complex environments.
作者
邢予权
潘今一
王伟
刘建烽
Xing Yuquan;Pan Jinyi;Wang Wei;Liu Jianfeng(College of Information Engineering,Zhejiang University of Technology,Hangzhou 310023,China)
出处
《计算机测量与控制》
2020年第4期196-199,204,共5页
Computer Measurement &Control
关键词
语义分割
迁移学习
手势识别
卷积神经网络
semantic segmentation
transfer learning
gesture recognition
convolutional neural networks
