Shot boundary detection is the fundamental part in many real applications as video retrieval and so on. This paper tackles the problem of video segment obtaining in complex movie videos. Firstly, intermediate descript...Shot boundary detection is the fundamental part in many real applications as video retrieval and so on. This paper tackles the problem of video segment obtaining in complex movie videos. Firstly, intermediate descriptor is proposed to depict the variation of both abrupt and gradual change in shot boundaries, which is formed by distance vector on Local Binary Pattern(LBP), GIST(GIST) or their fusion. Instead of just using the adjacent frames distance, intermediate descriptor keeps the distances between current frame and consecutive frames. It comprehensively characterizes local temporal structure, which is especially important for gradual change. For the excellent ability for feature fusion in random forests, it is adopted here to verify the fusion effect of intermediate descriptor on LBP and GIST. The whole experiments are designed on the subset of TRECVid 2013 INS(INstance Search) task to verify the effectiveness of proposed intermediate descriptor and the fusion ability for random forest. Compared with static and adaptive thresholds approaches, the best performance can be achieved by post-fusion of intermediate descriptor on LBP and GIST.展开更多
提出了一种鲁棒的图像局部特征区域的描述方法,即IWCS-LTP(Improved weighted center symmetric local trinarypattern)描述子.该方法对图像局部特征区域采用类似SIFT描述子的分块处理,可以使描述子包含更多的结构信息;采用ICS-LTP算子...提出了一种鲁棒的图像局部特征区域的描述方法,即IWCS-LTP(Improved weighted center symmetric local trinarypattern)描述子.该方法对图像局部特征区域采用类似SIFT描述子的分块处理,可以使描述子包含更多的结构信息;采用ICS-LTP算子进行编码,可以在不大量增加描述子维数和计算量的同时对图像的梯度方向信息进行更具体的描述;采用加权纹理谱直方图计算方法可以使描述子包含图像的梯度幅值信息.大量的实验结果验证了该描述子的有效性.展开更多
为了提高尺度不变特征变换(scale invariant feature transform,SIFT)算法的不变性,并降低图像中存在多个相似区域时的误匹配率,提出了一种将基于局部二进制模式的中心对称的改进局部三进制模式(center-symmetric improved local ternar...为了提高尺度不变特征变换(scale invariant feature transform,SIFT)算法的不变性,并降低图像中存在多个相似区域时的误匹配率,提出了一种将基于局部二进制模式的中心对称的改进局部三进制模式(center-symmetric improved local ternary patterns,CS-ILTP)描述子和全局灰度值分布(global distribution of intensity,GDI)描述子相融合的局部不变特征描述算法。通过迭代变换,使得由SIFT算法得到的初始特征点收敛到仿射不变点并得到仿射不变区域;分别提取CS-ILTP和GDI描述符,从而得到图像的局部不变特征描述。实验结果表明,所提算法具有高鲁棒性和独特性,相似区域和人工路标匹配中的正确匹配特征个数分别比SIFT算法增加了100%和86%以上。展开更多
针对传统人脸识别方法在单样本条件下受姿态、表情、遮挡和光照影响识别效果不佳等问题,提出一种改进的纹理特征和边缘特征相结合的人脸描述算子ε-WLBD(ε-Weber Local Binary Descriptor)。先用改进的局部二值模式和改进的Kirsch算子...针对传统人脸识别方法在单样本条件下受姿态、表情、遮挡和光照影响识别效果不佳等问题,提出一种改进的纹理特征和边缘特征相结合的人脸描述算子ε-WLBD(ε-Weber Local Binary Descriptor)。先用改进的局部二值模式和改进的Kirsch算子进行纹理特征和边缘特征提取,然后分别进行直方图统计,并将其串接起来作为人脸识别的总体特征向量,最后利用最近邻算法进行分类识别。在YALE和AR人脸库上进行测试,实验结果表明所提方法简单有效,且对姿态、表情、遮挡和光照等变化具有较强鲁棒性,对单样本人脸描述具有较好的效果。展开更多
基金Supported by the Young Teacher Support Plan by Heilongjiang Province and Harbin Engineering University in China(No.1155G17)partially by the Fundamental Research Funds for the Central Universities Grant to X.Xiang
文摘Shot boundary detection is the fundamental part in many real applications as video retrieval and so on. This paper tackles the problem of video segment obtaining in complex movie videos. Firstly, intermediate descriptor is proposed to depict the variation of both abrupt and gradual change in shot boundaries, which is formed by distance vector on Local Binary Pattern(LBP), GIST(GIST) or their fusion. Instead of just using the adjacent frames distance, intermediate descriptor keeps the distances between current frame and consecutive frames. It comprehensively characterizes local temporal structure, which is especially important for gradual change. For the excellent ability for feature fusion in random forests, it is adopted here to verify the fusion effect of intermediate descriptor on LBP and GIST. The whole experiments are designed on the subset of TRECVid 2013 INS(INstance Search) task to verify the effectiveness of proposed intermediate descriptor and the fusion ability for random forest. Compared with static and adaptive thresholds approaches, the best performance can be achieved by post-fusion of intermediate descriptor on LBP and GIST.
文摘提出了一种鲁棒的图像局部特征区域的描述方法,即IWCS-LTP(Improved weighted center symmetric local trinarypattern)描述子.该方法对图像局部特征区域采用类似SIFT描述子的分块处理,可以使描述子包含更多的结构信息;采用ICS-LTP算子进行编码,可以在不大量增加描述子维数和计算量的同时对图像的梯度方向信息进行更具体的描述;采用加权纹理谱直方图计算方法可以使描述子包含图像的梯度幅值信息.大量的实验结果验证了该描述子的有效性.
文摘为了提高尺度不变特征变换(scale invariant feature transform,SIFT)算法的不变性,并降低图像中存在多个相似区域时的误匹配率,提出了一种将基于局部二进制模式的中心对称的改进局部三进制模式(center-symmetric improved local ternary patterns,CS-ILTP)描述子和全局灰度值分布(global distribution of intensity,GDI)描述子相融合的局部不变特征描述算法。通过迭代变换,使得由SIFT算法得到的初始特征点收敛到仿射不变点并得到仿射不变区域;分别提取CS-ILTP和GDI描述符,从而得到图像的局部不变特征描述。实验结果表明,所提算法具有高鲁棒性和独特性,相似区域和人工路标匹配中的正确匹配特征个数分别比SIFT算法增加了100%和86%以上。
文摘针对传统人脸识别方法在单样本条件下受姿态、表情、遮挡和光照影响识别效果不佳等问题,提出一种改进的纹理特征和边缘特征相结合的人脸描述算子ε-WLBD(ε-Weber Local Binary Descriptor)。先用改进的局部二值模式和改进的Kirsch算子进行纹理特征和边缘特征提取,然后分别进行直方图统计,并将其串接起来作为人脸识别的总体特征向量,最后利用最近邻算法进行分类识别。在YALE和AR人脸库上进行测试,实验结果表明所提方法简单有效,且对姿态、表情、遮挡和光照等变化具有较强鲁棒性,对单样本人脸描述具有较好的效果。