期刊文献+

自适应编辑传播的人脸图像光照迁移 被引量:1

Face relighting using adaptive edit propagation
在线阅读 下载PDF
导出
摘要 提出一种融合人脸特征分析的自适应编辑传播方法来提高人脸图像光照渲染的效能,并以此实现复杂背景下基于单张参考人脸的自动光照迁移。该方法把参考图像的人脸区域与目标图像的背景区域进行融合,利用边缘保持平滑滤波从融合的人脸中提取光照信息。然后,构建一个能随不同人脸区域而自适应变化的编辑传播模型,把提取的光照信息从人脸区域扩散到背景区域,生成光照模板。最后,通过融合光照模板与目标人脸实现光照迁移。在YaleB数据库的定量实验中,平均每张迁移光照人脸有超过85%的像素(归一化到[0,255])与标准光照人脸的像素值差异小于6。与其他方法对比,本文方法获得的光照渲染效果具有更好一致性。结果表明,本文方法扩展了光照迁移的适用范围,具有良好的稳定性,能在具有不同性别和背景等特点的参考人脸与目标人脸中生成自然的光照迁移效果。 An adaptive edit propagation method based on facial priors was proposed to achieve natural relighting effect of a portrait in a complex background using a single reference face.Firstly,the facial region of a reference image and the background region of a target were combined,and an edgepreserving smoothing filter was used to extract the illumination information from the combined image.Then a new edit propagation model adaptively changed with facial parameters was constructed to generate an illumination template by propagating the illumination from the facial region to the background.Finally,the illumination template and the target were multiplied in the luminance channel to achieve the relighting effect.The quantitative experiments in YaleB database show that there are averagely over 85% pixels(normalized to [0,255])in a relighting effect face,whose intensity differences are less than 6 comparing with the ground true.As compared with other methods,the relighting effects of proposed method are more consistency.The conclusion shows that the proposed method achieves reliable and natural face relighting effect on portraits with different genders and backgrounds.
机构地区 华南理工大学
出处 《光学精密工程》 EI CAS CSCD 北大核心 2015年第5期1450-1457,共8页 Optics and Precision Engineering
基金 国家自然科学基金资助项目(No.61472144 No.61273255) 国家科技支撑计划资助项目(No.2013BAH65F01-2013BAH65F04) 国家教育部博士点基金资助项目(No.20120172110023) 中央高校基本科研业务费专项资金资助项目(SCUT 2013ZG0011) 广东省教育厅科技创新项目(No.2013KJCX0010) 中国博士后科学基金资助项目
关键词 人脸图像 光照迁移 编辑传播 边缘保持平滑 光照模板 face image face relighting edit propagation edge-preserving smoothing illumination template
  • 相关文献

参考文献24

  • 1BLANZ V, VETTER T. A morphable model for the synthesis of 3D faces [C]. Proc. Conf. CGIT, 1999:187-194.
  • 2BASRI R, JACOBS D W. Lambertian reflectance and linear subspaces [J]. IEEE Trans. Patt. Anal. Mach. Intell., 2003, 25(2):218-233.
  • 3SHASHUA A, RIKLIN-RAVIV T. The quotient image: class-based re-rendering and recognition with varying illuminations [J]. IEEE Trans. Patt. Anal. Mach. Intell., 2001, 23(2): 129-139.
  • 4PEERS P, TAMURA N, MATUSIK W, et al. Post-production facial performance relighting using reflectance transfer [J]. ACM Trans. Graph., 2007, 26(3):10.
  • 5LI Q, YIN W, DENG Z. Image-based face illumination transferring using logarithmic total variation models [J]. The Visual Computer, 2010, 26(1): 41-49.
  • 6CHEN J, SU G, HE J, et al. Face image relighting using locally constrained global optimization [C]. Proc. ECCV, 2010: 44-57.
  • 7CHEN X, WU H, JIN X, et al. Face illumination manipulation using a single reference image by adaptive layer decomposition [J]. IEEE Transactions on Image Processing, 2013, 22(11): 4249-4259.
  • 8LIANG L, JIN L. A new face relighting method based on edge-preserving filter [J]. IEICE Transactions on Information and Systems, 2013, E96-D(12): 2904-2907.
  • 9CHEN X, JIN X, ZHAO Q, et al. Artistic illumination transfer for portraits [J]. Comput. Graphics Forum, 2012, 31(4): 1425-1434.
  • 10CHEN X, ZOU D, ZHAO Q, et al. Manifold preserving edit propagation [J]. ACM Trans. Graph., 2012, 31(6): 132.

二级参考文献50

  • 1贾云涛,胡事民.基于图切分的交互式图像染色算法[J].计算机学报,2006,29(3):508-512. 被引量:15
  • 2l,evin A, l,isehinski D. Weiss Y. Co]orization using optimization [ J]. ACM Transactions on Graphics, 2004, 23:689-693.
  • 3Gastal E S L, Oliveira M M. Domain transform for edge-aware image and video pncessing [ J]. ACM Transaclions on Graphics, 2011, 30(4) :69(1-12).
  • 4Bhat P, Zitnick C L, Cohen M, el al. GradientShop: a gra- dientdomain optimization framev,'ork for image and video filtering [J]. ACM Transactions on Graphics, 2010, 29(2):10(1-12).
  • 5Yatziv L, Sapiro G. Fas! image and video (.o]orizalion using ehro- minmwe blending [ J]. IEEE Transactions on Image Processing, 2006, 15(5) :1120-1129.
  • 6Criminisi A, Sharp T, Rother C, et al. Geodesic image and vi- deo editing [J]. ACM Transactions on Graphics, 2010, 29: 134(1-15).
  • 7Sheng B, Sun H Q, Chen S B. Colorization using the rotation-in- variant feature space [ J ]. IEEE Computer Graphics and Applica- tions, 2011, 31 (2) :24-35.
  • 8He K M, Sun J, Tang X O. Guided inmge filtering [ C] //Prn- eeedings of the llth European Conference nn Computer Vision. Crele, Greece : Springer, 2010 : 1-14.
  • 9Levin A, l,ischiaski D, Weiss Y. Closed-form solution to natural image matting [ J ]. IEEE Transactions on Pattern Analysis and Ma('hine Intelligeuce, 2008, 30(2):228-242.
  • 10He K M, Sun J, Tang X. Fast matting using large kernel matting Laplaeian malriees[ C ] // Proceedings of IEEE CompHler Vision and Pattern Recognition. San Franciseo, USA: IEEE, 2010: 2165-2172.

共引文献30

同被引文献5

引证文献1

二级引证文献2

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部