It is important to reduce data redundancy of stereo video in practical applications. In this paper,first,a data embedding method for stereo video（DEMSV） is investigated by embedding the encoding data into the refere...It is important to reduce data redundancy of stereo video in practical applications. In this paper,first,a data embedding method for stereo video（DEMSV） is investigated by embedding the encoding data into the reference frame to encode stereo video. It can use only one channel to transfer all the video data and the receiver can choose a monocular video decoder or stereo video decoder adaptively. Then,introducing the joint prediction scheme in the coding process of DEMSV,we propose a novel data embedding method for H.264 stereo video codec with joint prediction scheme（DEMSV-JPS） to achieve high coding efficiency. Experimental results show that the proposed method can obtain high peak signal-to-noise ratio（PSNR） and compression ratio（at least 33 dB for the test sequence） . Comparing the testing methods using JPS and without using JPS,we prove that JPS can further improve the objective and visual quality. DEMSV-JPS shows such advantages and will be suitable to applications in real-time environments of stereo-video transmission.展开更多
In the paper, an approach is proposed for the problem of consistency in depth maps estimation from binocular stereo video sequence. The consistent method includes temporal consistency and spatial consistency to elimin...In the paper, an approach is proposed for the problem of consistency in depth maps estimation from binocular stereo video sequence. The consistent method includes temporal consistency and spatial consistency to eliminate the flickering artifacts and smooth inaccuracy in depth recovery. So the improved global stereo matching based on graph cut and energy optimization is implemented. In temporal domain, the penalty function with coherence factor is introduced for temporal consistency, and the factor is determined by Lucas-Kanade optical flow weighted histogram similarity constraint(LKWHSC). In spatial domain, the joint bilateral truncated absolute difference(JBTAD) is proposed for segmentation smoothing. The method can smooth naturally and uniformly in low-gradient region and avoid over-smoothing as well as keep edge sharpness in high-gradient discontinuities to realize spatial consistency. The experimental results show that the algorithm can obtain better spatial and temporal consistent depth maps compared with the existing algorithms.展开更多
Stereo video is widely used because it can provide depth information. However, it is difficult to store and transmit stereo video due to the huge data amount. So, high efficient channel encoding algorithm and proper t...Stereo video is widely used because it can provide depth information. However, it is difficult to store and transmit stereo video due to the huge data amount. So, high efficient channel encoding algorithm and proper transmission strategy is needed to deal with the video transmission over limited bandwidth channel. In this paper, unequal error protection (UEP) based on low density parity check (LDPC) code was used to transmit stereo video over wireless channel with limited bandwidth. Different correction level LDPC code was used according to the importance of video stream to reconstruction at the receiver. Simulation result shows that the proposed transmission scheme increases the PSNR of reconstructed image, and improves the subjective effect.展开更多
This paper presents a new implementation of a high-definition image-processing engine,which mainly targets the 3-dimensional(3D)visualization and stereo video stream display of binocular display equipment.The engine i...This paper presents a new implementation of a high-definition image-processing engine,which mainly targets the 3-dimensional(3D)visualization and stereo video stream display of binocular display equipment.The engine is compatible with the mainstream analog and digital stereo videos in component format and is able to receive stereo composite video broadcast signals using an integrated analog stereo video decoder.The four modules include a spatiotemporal scaling transform engine,a 2D–3D converter,an image animating engine,and a 2D scalar operating in pipeline architecture to implement the video format conversion and the stereo effect enhancement.Furthermore,the data access,hardware structure,and system-level configurations are optimized.Finally,the proposed architecture is realized by 0.18 lm CMOS technology.The application-specific integrated circuit verification results show that the engine can generate a strong feeling of 3D immersion and highdefinition image quality with minimal flicker.The chip has wide compatibility and an uppermost 1080P-processing capacity,which has approximately 3.5 million gates with about 43 mm2 die size.展开更多
Following the success of the audio video standard （AVS） for 2D video coding, in 2008, the China AVS workgroup started developing 3D video （3DV） coding techniques. In this paper, we discuss the background, technica...Following the success of the audio video standard （AVS） for 2D video coding, in 2008, the China AVS workgroup started developing 3D video （3DV） coding techniques. In this paper, we discuss the background, technical features, and applications of AVS 3DV coding technology. We introduce two core techniques used in AVS 3DV coding： inter-view prediction and enhanced stereo packing coding. We elaborate on these techniques, which are used in the AVS real-time 3DV encoder. An application of the AVS 3DV coding system is presented to show the great practical value of this system. Simulation results show that the advanced techniques used in AVS 3DV coding provide remarkable coding gain compared with techniques used in a simulcast scheme.展开更多
基金Supported by the National Natural Science foundation of China (60832003)
文摘It is important to reduce data redundancy of stereo video in practical applications. In this paper,first,a data embedding method for stereo video（DEMSV） is investigated by embedding the encoding data into the reference frame to encode stereo video. It can use only one channel to transfer all the video data and the receiver can choose a monocular video decoder or stereo video decoder adaptively. Then,introducing the joint prediction scheme in the coding process of DEMSV,we propose a novel data embedding method for H.264 stereo video codec with joint prediction scheme（DEMSV-JPS） to achieve high coding efficiency. Experimental results show that the proposed method can obtain high peak signal-to-noise ratio（PSNR） and compression ratio（at least 33 dB for the test sequence） . Comparing the testing methods using JPS and without using JPS,we prove that JPS can further improve the objective and visual quality. DEMSV-JPS shows such advantages and will be suitable to applications in real-time environments of stereo-video transmission.
基金the Science and Technology Innovation Project of Ministry of Culture of China(No.2014KJCXXM08)the National Key Technology Research and Development Program of the Ministry of Science and Technology of China(No.2012BAH37F02)the National High Technology Research and Development Program(863)of China(No.2011AA01A107)
文摘In the paper, an approach is proposed for the problem of consistency in depth maps estimation from binocular stereo video sequence. The consistent method includes temporal consistency and spatial consistency to eliminate the flickering artifacts and smooth inaccuracy in depth recovery. So the improved global stereo matching based on graph cut and energy optimization is implemented. In temporal domain, the penalty function with coherence factor is introduced for temporal consistency, and the factor is determined by Lucas-Kanade optical flow weighted histogram similarity constraint(LKWHSC). In spatial domain, the joint bilateral truncated absolute difference(JBTAD) is proposed for segmentation smoothing. The method can smooth naturally and uniformly in low-gradient region and avoid over-smoothing as well as keep edge sharpness in high-gradient discontinuities to realize spatial consistency. The experimental results show that the algorithm can obtain better spatial and temporal consistent depth maps compared with the existing algorithms.
文摘Stereo video is widely used because it can provide depth information. However, it is difficult to store and transmit stereo video due to the huge data amount. So, high efficient channel encoding algorithm and proper transmission strategy is needed to deal with the video transmission over limited bandwidth channel. In this paper, unequal error protection (UEP) based on low density parity check (LDPC) code was used to transmit stereo video over wireless channel with limited bandwidth. Different correction level LDPC code was used according to the importance of video stream to reconstruction at the receiver. Simulation result shows that the proposed transmission scheme increases the PSNR of reconstructed image, and improves the subjective effect.
基金supported by the Important Specific Projects of National Science and Technology of China(2009ZX01033-001-010)
文摘This paper presents a new implementation of a high-definition image-processing engine,which mainly targets the 3-dimensional(3D)visualization and stereo video stream display of binocular display equipment.The engine is compatible with the mainstream analog and digital stereo videos in component format and is able to receive stereo composite video broadcast signals using an integrated analog stereo video decoder.The four modules include a spatiotemporal scaling transform engine,a 2D–3D converter,an image animating engine,and a 2D scalar operating in pipeline architecture to implement the video format conversion and the stereo effect enhancement.Furthermore,the data access,hardware structure,and system-level configurations are optimized.Finally,the proposed architecture is realized by 0.18 lm CMOS technology.The application-specific integrated circuit verification results show that the engine can generate a strong feeling of 3D immersion and highdefinition image quality with minimal flicker.The chip has wide compatibility and an uppermost 1080P-processing capacity,which has approximately 3.5 million gates with about 43 mm2 die size.
文摘Following the success of the audio video standard （AVS） for 2D video coding, in 2008, the China AVS workgroup started developing 3D video （3DV） coding techniques. In this paper, we discuss the background, technical features, and applications of AVS 3DV coding technology. We introduce two core techniques used in AVS 3DV coding： inter-view prediction and enhanced stereo packing coding. We elaborate on these techniques, which are used in the AVS real-time 3DV encoder. An application of the AVS 3DV coding system is presented to show the great practical value of this system. Simulation results show that the advanced techniques used in AVS 3DV coding provide remarkable coding gain compared with techniques used in a simulcast scheme.
