Depth image based rendering （DIBR） is an effective approach for virtual view synthesis in free viewpoint television and 3D video.One of the important steps in DIBR is filling the holes caused by disoeclusion regions...Depth image based rendering （DIBR） is an effective approach for virtual view synthesis in free viewpoint television and 3D video.One of the important steps in DIBR is filling the holes caused by disoeclusion regions and wrong depth values.Most of the existing hole-filling methods work well in areas of low spatial activity but fail to obtain satisfactory results in high spatial activity regions.In this paper,we combine the depth based hole-filling and the adaptive recursive interpolation algorithm which is capable of handling edges passing through the missing areas.Accoring to the experimental results,we confirm that the depth based adaptive recursive interpolation algorithm can provide better rendering quality objectively and subjectively.展开更多
The quality of virtual view based on multi-view video （MVD） plus depth format is often evaluated by PSNR or subjectively judged. However, due to synthesizing arbitrary view images, the virtual view images mostly hav...The quality of virtual view based on multi-view video （MVD） plus depth format is often evaluated by PSNR or subjectively judged. However, due to synthesizing arbitrary view images, the virtual view images mostly have no reference images and are only assessed using non-reference. Virtual view images synthesized by depth estimation reference software （DERS） and view synthesis reference software （VSRS） often accompanied with blockiness and other distortions on the edge. In addition, matching level for the depth map and the corresponding texture maps of left and right views also affects the quality of the virtual view. This paper compares the edge similarity of the depth and the corresponding texture maps which generate the intermediate virtual view and combined with the virtual view＇s blockiness which causing blur to evaluate the quality of the virtual view. Experiment results show that the proposed method can reflect the quality of the virtual view better.展开更多
基于深度图像的绘制(Depth Image Based Rendering,DIBR)技术生成的虚拟视点图像,存在鬼影、空洞等瑕疵,这会损坏合成图像的真实感。文章提出了一种结合视图分层与填补策略的虚拟视点合成方案,旨在解决上述问题。该方法先对输入的深度...基于深度图像的绘制(Depth Image Based Rendering,DIBR)技术生成的虚拟视点图像,存在鬼影、空洞等瑕疵,这会损坏合成图像的真实感。文章提出了一种结合视图分层与填补策略的虚拟视点合成方案,旨在解决上述问题。该方法先对输入的深度信息做高斯滤波预处理,以抑制噪声、修复平滑深度不连续之处。之后,对场景的不同层次进行差异化的三维映射,并结合视点融合策略来抑制因前景和背景像素错误混合而产生的鬼影。针对图像空洞问题,运用反向映射技术,再利用深度信息的图像修复算法来填补。采用公开数据集Breakdancers进行实测,验证了该方法的有效性。实验结果显示,文章所提方法在主观视觉质量和客观评价指标方面都有稳定提升。展开更多
基金The MSIP(Ministry of Science,ICT & Future Planning),Korea,under the ITRC(Information Technology Research Center)support program(NIPA-2013-H0301-13-2006)supervised by the NIPA(National IT Industry Promotion Agency)
文摘Depth image based rendering （DIBR） is an effective approach for virtual view synthesis in free viewpoint television and 3D video.One of the important steps in DIBR is filling the holes caused by disoeclusion regions and wrong depth values.Most of the existing hole-filling methods work well in areas of low spatial activity but fail to obtain satisfactory results in high spatial activity regions.In this paper,we combine the depth based hole-filling and the adaptive recursive interpolation algorithm which is capable of handling edges passing through the missing areas.Accoring to the experimental results,we confirm that the depth based adaptive recursive interpolation algorithm can provide better rendering quality objectively and subjectively.
基金supported by the National Natural Science Foundation of China(Grant No.60832003)the Key Laboratory of Advanced Display and System Application(Shanghai University),Ministry of Education,China(Grant No.p200902)+1 种基金the Science and Technology Commission of Shanghai Municipality(Grant No.10510500500)the Natural Science Foundation of Anhui Higher Education Institutions of China(Grant No.KJ2011Z008)
文摘The quality of virtual view based on multi-view video （MVD） plus depth format is often evaluated by PSNR or subjectively judged. However, due to synthesizing arbitrary view images, the virtual view images mostly have no reference images and are only assessed using non-reference. Virtual view images synthesized by depth estimation reference software （DERS） and view synthesis reference software （VSRS） often accompanied with blockiness and other distortions on the edge. In addition, matching level for the depth map and the corresponding texture maps of left and right views also affects the quality of the virtual view. This paper compares the edge similarity of the depth and the corresponding texture maps which generate the intermediate virtual view and combined with the virtual view＇s blockiness which causing blur to evaluate the quality of the virtual view. Experiment results show that the proposed method can reflect the quality of the virtual view better.
文摘基于深度图像的绘制(Depth Image Based Rendering,DIBR)技术生成的虚拟视点图像,存在鬼影、空洞等瑕疵,这会损坏合成图像的真实感。文章提出了一种结合视图分层与填补策略的虚拟视点合成方案,旨在解决上述问题。该方法先对输入的深度信息做高斯滤波预处理,以抑制噪声、修复平滑深度不连续之处。之后,对场景的不同层次进行差异化的三维映射,并结合视点融合策略来抑制因前景和背景像素错误混合而产生的鬼影。针对图像空洞问题,运用反向映射技术,再利用深度信息的图像修复算法来填补。采用公开数据集Breakdancers进行实测,验证了该方法的有效性。实验结果显示,文章所提方法在主观视觉质量和客观评价指标方面都有稳定提升。
