Distributed video coding （DVC） is a new video coding approach based on Wyner-Ziv theorem. The novel uplink-friendly DVC, which offers low-complexity, low-power consuming, and low-cost video encoding, has aroused mor...Distributed video coding （DVC） is a new video coding approach based on Wyner-Ziv theorem. The novel uplink-friendly DVC, which offers low-complexity, low-power consuming, and low-cost video encoding, has aroused more and more research interests. In this paper a new method based on multiple view geometry is presented for spatial side information generation of uncalibrated video sensor network. Trifocal tensor encapsulates all the geometric relations among three views that are independent of scene structure; it can be computed from image correspondences alone without requiring knowledge of the motion or calibration. Simulation results show that trifocal tensor-based spatial side information improves the rate-distortion performance over motion compensation based interpolation side information by a maximum gap of around 2dB. Then fusion merges the different side information （temporal and spatial） in order to improve the quality of the final one. Simulation results show that the rate-distortion gains about 0.4 dB.展开更多
Popular video coding standards like H.264 and MPEG working on the principle of motion-compensated pre-dictive coding demand much of the computational resources at the encoder increasing its complexity. Such bulky enco...Popular video coding standards like H.264 and MPEG working on the principle of motion-compensated pre-dictive coding demand much of the computational resources at the encoder increasing its complexity. Such bulky encoders are not suitable for applications like wireless low power surveillance, multimedia sensor networks, wireless PC cameras, mobile camera phones etc. New video coding scheme based on the principle of distributed source coding is looked upon in this paper. This scheme supports a low complexity encoder, at the same time trying to achieve the rate distortion performance of conventional video codecs. Current im-plementation uses LDPC codes for syndrome coding.展开更多
Side information （SI） is one of the key issues in distributed video coding （DVC） and affects the compression performance of DVC largely. This paper proposes an SI refinement algorithm, in which the Wyner-Ziv （WZ...Side information （SI） is one of the key issues in distributed video coding （DVC） and affects the compression performance of DVC largely. This paper proposes an SI refinement algorithm, in which the Wyner-Ziv （WZ） frame is split into two parts based on checkerboard pattern, and the two parts are encoded independently but decoded sequentially. In the decoding process, the part 1 is first decoded with the initial SI and partially decoded part （PDP） 1 is used to improve the motion vectors （MVs） and SI of both parts. At the next stage, the part 2 is decoded with the improved SI and PDP 2 is used to further refine MVs of the part 2. Then, SI of both parts are further refined. Simulation results show that the proposed algorithm can improve the peak signal to noise ratio （PSNR） by up to 1.43 dB when compared with traditional DVC codec.展开更多
This paper proposes a maximum a posteriori （MAP） based blocking artifact reduction algorithm for discrete cosine transform （DCT） domain distributed video coding, in which the SI and the initial reconstructed Wyner...This paper proposes a maximum a posteriori （MAP） based blocking artifact reduction algorithm for discrete cosine transform （DCT） domain distributed video coding, in which the SI and the initial reconstructed Wyner-Ziv （WZ） frame are utilized to further estimate the original WZ frame. Though the MAP estimate improves quality of the artifact region, it also leads to over-smoothness and decreases quality of the non-artifact region. To overcome this problem, a criterion is presented to discriminate the artifact and the non-artifact region in the initial reconstructed WZ frame, and only the artifact region is updated with the MAP estimate. Simulation results show that the proposed algorithm provides obvious improvement in terms of both objective and subjective evaluations.展开更多
In the frame of compressed sensing distributed video coding, the design of the quantization matrix directly affects the reconstruction quality of the receiving terminal of the video. In this article, we present a new ...In the frame of compressed sensing distributed video coding, the design of the quantization matrix directly affects the reconstruction quality of the receiving terminal of the video. In this article, we present a new design method of the Gaussian quantization matrix adapting to the compressed sensing coding, for that the distribution of the parameters of the image is featured of the characteristic of approximately normal distribution after measured by compressive sensing. By this way, the parameters of a certain quantity of the image frames depending on the video sequences generated by the Gaussian quantization matrix possess certain adaptive capacity. By comparison with the plan of the traditional quantization, the quantization matrix presented in this article would improve the reconstruction quality of the video.展开更多
The rate and distortion of Id-slice do not fit the globally linear relationship on a logarithmic scale. Lagrange multiplier selection methods based on the globally linear approximate relationship are neither efficient...The rate and distortion of Id-slice do not fit the globally linear relationship on a logarithmic scale. Lagrange multiplier selection methods based on the globally linear approximate relationship are neither efficient nor optimal for multi-view video coding (MVC). To improve the coding efficiency of MVC, a local curve fitting based Lagrange multiplier selection method is proposed in this paper, where Lagrange multipliers are selected according to the local slopes of the approximate curves. Experi-mental results showed that the proposed method improves the coding efficiency. Up to 2.5 dB gain was achieved at low bitrates.展开更多
A novel color compensation method for multi-view video coding (MVC) is proposed, which efficiently exploits the inter-view dependencies between views with the existence of color mismatch caused by the diversity of cam...A novel color compensation method for multi-view video coding (MVC) is proposed, which efficiently exploits the inter-view dependencies between views with the existence of color mismatch caused by the diversity of cameras. A color compensation model is developed in RGB channels and then extended to YCbCr channels for practical use. A modified inter-view reference picture is constructed based on the color compensation model, which is more similar to the coding picture than the original inter-view reference picture. Moreover, the color compensation factors can be derived in both encoder and decoder, therefore no additional data need to be transmitted to the decoder. The experimental results show that the proposed method improves the coding efficiency of MVC and maintains good subjective quality.展开更多
Current multi-view video coding （MVC） reference model in joint video team （JVT） does not provide efficient rate control schemes. This paper presents a rate control algorithm for MVC by improving the quadratic rate...Current multi-view video coding （MVC） reference model in joint video team （JVT） does not provide efficient rate control schemes. This paper presents a rate control algorithm for MVC by improving the quadratic rate-distortion （R-D） model. We reasonably allocate bit-rate among views based on the correlation analysisl The proposed algorithm consists of three levels to control the rate bits more accurately, of which the frame layer allocates bits according to the frame complexity and the temporal activity. Extensive experiments show that the proposed algorithm can control the bit rate efficiently.展开更多
The variable block-size motion estimation(ME) and disparity estimation(DE) are adopted in multi-view video coding(MVC) to achieve high coding efficiency. However, much higher computational complexity is also introduce...The variable block-size motion estimation(ME) and disparity estimation(DE) are adopted in multi-view video coding(MVC) to achieve high coding efficiency. However, much higher computational complexity is also introduced in coding system, which hinders practical application of MVC. An efficient fast mode decision method using mode complexity is proposed to reduce the computational complexity. In the proposed method, mode complexity is firstly computed by using the spatial, temporal and inter-view correlation between the current macroblock(MB) and its neighboring MBs. Based on the observation that direct mode is highly possible to be the optimal mode, mode complexity is always checked in advance whether it is below a predefined threshold for providing an efficient early termination opportunity. If this early termination condition is not met, three mode types for the MBs are classified according to the value of mode complexity, i.e., simple mode, medium mode and complex mode, to speed up the encoding process by reducing the number of the variable block modes required to be checked. Furthermore, for simple and medium mode region, the rate distortion(RD) cost of mode 16×16 in the temporal prediction direction is compared with that of the disparity prediction direction, to determine in advance whether the optimal prediction direction is in the temporal prediction direction or not, for skipping unnecessary disparity estimation. Experimental results show that the proposed method is able to significantly reduce the computational load by 78.79% and the total bit rate by 0.07% on average, while only incurring a negligible loss of PSNR(about 0.04 d B on average), compared with the full mode decision(FMD) in the reference software of MVC.展开更多
Color inconsistency between views is an important problem to be solved in multi-view video applications, such as free viewpoint television and other three-dimensional video systems. In this paper, by combining with mu...Color inconsistency between views is an important problem to be solved in multi-view video applications, such as free viewpoint television and other three-dimensional video systems. In this paper, by combining with multi-view video coding, a coding-oriented multi-view video color correction method is proposed. We first separate foreground and background in first Group Of Pictures （GOP） by using SKIP coding mode. Then by transferring means and standard deviations in backgrounds, color correction is performed for each frame in GOP, and multi-view video coding is performed and used to renew the backgrounds. Experimental results ances in color correction and multi-view video show the proposed method can obtain better performcoding.展开更多
A novel Compressed-Sensing-based(CS-based)Distributed Video Coding(DVC)system,called Distributed Adaptive Compressed Video Sensing(DISACOS),is proposed in this paper.In this system,the input frames are divided into ke...A novel Compressed-Sensing-based(CS-based)Distributed Video Coding(DVC)system,called Distributed Adaptive Compressed Video Sensing(DISACOS),is proposed in this paper.In this system,the input frames are divided into key frames and non-key frames,which are encoded by block CS sampling.The key frames are encoded as CS measurements at substantially higher rates than the non-key frames and decoded by the Smoothed Projected Landweber(SPL)algorithm using multi-hypothesis predictions.For the non-key frames,a small number of CS measurements are first transmitted to detect blocks having low-quality Side Information(SI)generated by the conventional interpolation or extrapolation at the decoder;then,another group of CS measurements are sampled again upon the decoder’s request.To fully utilise the CS measurements,we adaptively allocate these measurements to each block in terms of different edge features.Finally,the residual frame is reconstructed using the SPL algorithm and the decoded non-key frame is simply determined as the sum of the residual frame and the SI.Experimental results have revealed that our CS-based DVC system yields better rate-distortion performance when compared with other schemes.展开更多
In Wyner-Ziv (WZ) Distributed Video Coding (DVC), correlation noise model is often used to describe the error distribution between WZ frame and the side information. The accuracy of the model can influence the perform...In Wyner-Ziv (WZ) Distributed Video Coding (DVC), correlation noise model is often used to describe the error distribution between WZ frame and the side information. The accuracy of the model can influence the performance of the video coder directly. A mixture correlation noise model in Discrete Cosine Transform (DCT) domain for WZ video coding is established in this paper. Different correlation noise estimation method is used for direct current and alternating current coefficients. Parameter estimation method based on expectation maximization algorithm is used to estimate the Laplace distribution center of direct current frequency band and Mixture Laplace-Uniform Distribution Model (MLUDM) is established for alternating current coefficients. Experimental results suggest that the proposed mixture correlation noise model can describe the heavy tail and sudden change of the noise accurately at high rate and make significant improvement on the coding efficiency compared with the noise model presented by DIStributed COding for Video sERvices (DISCOVER).展开更多
The Wyner-Ziv distributed video coding scheme is characterized for its intraframe encoder and interframe decoder which can also approach the efficiency of an interframe encoder-decoder system. In Wyner-Ziv residual co...The Wyner-Ziv distributed video coding scheme is characterized for its intraframe encoder and interframe decoder which can also approach the efficiency of an interframe encoder-decoder system. In Wyner-Ziv residual coding of video, the residual of a frame with respect to a reference frame is Wyner-Ziv encoded, which can reduces the input entropy and leads to a higher coding efficiency than directly encoding the original frame. In this paper, we propose a new approach of residual coding combined with Region Of Interest (ROI) extraction. Experimental results show that, the proposed scheme achieves better rate-distortion performance compared to conventional Wyner-Ziv coding scheme.展开更多
Accumulated low density parity check （LDPCA） codec is proposed for DISCOVER project in distributed video coding （DVC）, which offers flexible coding rate. Although it can use feedback channel to adapt the rate to t...Accumulated low density parity check （LDPCA） codec is proposed for DISCOVER project in distributed video coding （DVC）, which offers flexible coding rate. Although it can use feedback channel to adapt the rate to the correlation of the video, but in real applications, using feedback channel can not always be possible. To solve this problem, some researchers proposed estimating the code rate at the encoder but the performance was not very good. Based on their researches, this paper considers the impact of convergence rate for iteration on rate estimate, which can be calculated using its check matrix. As a pilot study, this paper pays attention to the regular LDPCA codec. At the same time, it considers the impact of deviation in the estimated crossover probability, which gives some constraints to rate estimate. In the experiment, the proposed algorithm can improve the rate-distortion performance by up to 1 dB-1.2 dB.展开更多
Distributed video coding(DVC)is a new video coding architecture.Compared with traditional video coding schemes,DVC has a simple encoder and complex decoder,which makes it suitable for circumstances where the encoder e...Distributed video coding(DVC)is a new video coding architecture.Compared with traditional video coding schemes,DVC has a simple encoder and complex decoder,which makes it suitable for circumstances where the encoder equipments are simple but the decoder equipments are complex.Most of the existing DVC architectures use decoder rate allocation method with the help of feedback channel.According to the results of the current decoding round,the decoder informs the encoder by feedback channel whether more parity bits are needed.The use of feedback channel not only increases the system delay,but also limits the use of DVC to instances where there is no feedback channel.In this paper,we propose a novel encoder rate allocation method.First,the simple three-step motion estimation is introduced into the encoder to estimate the side information of the decoder,and then the number of parity bits the decoder needs for each bitplane is allocated at the encoder according to the difference of the estimated side information and the current Wyner-Ziv(WZ)frame.Experiment results indicate that the accuracy of the proposed method is 5.18%-52.93% higher than that of the method proposed by Morbee.展开更多
Distributed video coding （DVC） arouses high interests due to its property of low-complexity encoding. This paper proposes a robust multiple description DVC （MDDVC） under the constraint of low-complexity encoding. ...Distributed video coding （DVC） arouses high interests due to its property of low-complexity encoding. This paper proposes a robust multiple description DVC （MDDVC） under the constraint of low-complexity encoding. In MDDVC, zeros are padded to each frame and the resulting big-size video is divided into multiple descriptions. Then, each description is compressed by s hybrid DVC （HDVC） codec and trans- mitted over different channel. When one channel does not work, the lost HDVC description is estimated by the received from other channel, which guarantees the robustness of the system; MDDVC moves the complex motion estimation totally to the decoder so it features low-complexity encoding. In the pre-processing, an optimized zero-padding is also proposed to improve the performance. Experimental results exhibit that the proposed MDDVC scheme achieves better rate-distortion performance and robustness than the referenced especially when packet-loss rate is high.展开更多
Error Estimating Code (EEC) is a new channel coding method to estimate the Bit Error Rate (BER) information of the transmitted sequence. However, the estimated BER is not precise enough if the practical value of BER i...Error Estimating Code (EEC) is a new channel coding method to estimate the Bit Error Rate (BER) information of the transmitted sequence. However, the estimated BER is not precise enough if the practical value of BER is high. A weighted EEC estimation method is proposed to improve the accuracy performance of BER estimation by classifying the raw estimation results into intervals and multiplying them by different coefficients separately. The applications of weighted EEC in modulation selection scheme and distributed video coding are discussed. Simulation results show that the EEC-based modulation selection method can achieve better performance at a cost of little redundancy and computation, and the EEC-based rate estimation method in distributed video coding can save the decoding time.展开更多
We address the compression efficiency of feedback-free and hash-check distributed video coding,which generates and transmits a hash code of a source information sequence.The hash code helps the decoder perform a motio...We address the compression efficiency of feedback-free and hash-check distributed video coding,which generates and transmits a hash code of a source information sequence.The hash code helps the decoder perform a motion search.A hash collision is a special case in which the hash codes of wrongly reconstructed information sequences occasionally match the hash code of the source information sequence.This deteriorates the quality of the decoded image greatly.In this paper,the statistics of hash collision are analyzed to help the codec select the optimal trade-off between the probability of hash collision and the length of the hash code,according to the principle of rate-distortion optimization.Furthermore,two novel algorithms are proposed:(1) the nonzero prefix of coefficients (NPC),which indicates the count of nonzero coefficients of each block for the second algorithm,and also saves 8.4% bitrate independently;(2) the adaptive selection of hash functions (AHF),which is based on the NPC and saves a further 2%-6% bitrate on average.The detailed optimization of the parameters of AHF is also presented.展开更多
The trend in video viewing has been evolving beyond simply providing a multi-view option.Recently,a function that allows selection and viewing of a clip from a multi-view service that captures a specific range or obje...The trend in video viewing has been evolving beyond simply providing a multi-view option.Recently,a function that allows selection and viewing of a clip from a multi-view service that captures a specific range or object has been added.In particular,the free-view service is an extended concept of multi-view and provides a freer viewpoint.However,since numerous videos and additional data are required for its construction,all of the clips constituting the content cannot be simultaneously provided.Only certain clips are selected and provided to the user.If the video is not the preferred video,change request is made,and a delay occurs during retransmission from the server.Delays due to frequent re-requests degrade the overall quality of service.For free-view services,selectively transmitting the video according to the user’s desired viewpoint and region of interest within the limited network of available videos is important.In this study,we propose a method of screening and providing the correct video based on objects in the contents.Based on the method of recognizing the object in each clip,we designed a method of setting its priority based on information about the object’s location for each viewpoint.During the transmission and receiving process using this information,the selected video can be rapidly recognized and changed.Herein,we present a service system configuration method and propose video selection examples for free-view services.展开更多
文摘Distributed video coding （DVC） is a new video coding approach based on Wyner-Ziv theorem. The novel uplink-friendly DVC, which offers low-complexity, low-power consuming, and low-cost video encoding, has aroused more and more research interests. In this paper a new method based on multiple view geometry is presented for spatial side information generation of uncalibrated video sensor network. Trifocal tensor encapsulates all the geometric relations among three views that are independent of scene structure; it can be computed from image correspondences alone without requiring knowledge of the motion or calibration. Simulation results show that trifocal tensor-based spatial side information improves the rate-distortion performance over motion compensation based interpolation side information by a maximum gap of around 2dB. Then fusion merges the different side information （temporal and spatial） in order to improve the quality of the final one. Simulation results show that the rate-distortion gains about 0.4 dB.
文摘Popular video coding standards like H.264 and MPEG working on the principle of motion-compensated pre-dictive coding demand much of the computational resources at the encoder increasing its complexity. Such bulky encoders are not suitable for applications like wireless low power surveillance, multimedia sensor networks, wireless PC cameras, mobile camera phones etc. New video coding scheme based on the principle of distributed source coding is looked upon in this paper. This scheme supports a low complexity encoder, at the same time trying to achieve the rate distortion performance of conventional video codecs. Current im-plementation uses LDPC codes for syndrome coding.
基金Supported by the National Natural Science Foundation of China （ No. 60736043, 60672088） and the National Basic Research Program of China （No. 2009CB32005）.
文摘Side information （SI） is one of the key issues in distributed video coding （DVC） and affects the compression performance of DVC largely. This paper proposes an SI refinement algorithm, in which the Wyner-Ziv （WZ） frame is split into two parts based on checkerboard pattern, and the two parts are encoded independently but decoded sequentially. In the decoding process, the part 1 is first decoded with the initial SI and partially decoded part （PDP） 1 is used to improve the motion vectors （MVs） and SI of both parts. At the next stage, the part 2 is decoded with the improved SI and PDP 2 is used to further refine MVs of the part 2. Then, SI of both parts are further refined. Simulation results show that the proposed algorithm can improve the peak signal to noise ratio （PSNR） by up to 1.43 dB when compared with traditional DVC codec.
基金Supported by the National Natural Science Foundation of China （No.60672088, No.60736043） the National Basic Research Development Program of China （2009CB320905）
文摘This paper proposes a maximum a posteriori （MAP） based blocking artifact reduction algorithm for discrete cosine transform （DCT） domain distributed video coding, in which the SI and the initial reconstructed Wyner-Ziv （WZ） frame are utilized to further estimate the original WZ frame. Though the MAP estimate improves quality of the artifact region, it also leads to over-smoothness and decreases quality of the non-artifact region. To overcome this problem, a criterion is presented to discriminate the artifact and the non-artifact region in the initial reconstructed WZ frame, and only the artifact region is updated with the MAP estimate. Simulation results show that the proposed algorithm provides obvious improvement in terms of both objective and subjective evaluations.
文摘In the frame of compressed sensing distributed video coding, the design of the quantization matrix directly affects the reconstruction quality of the receiving terminal of the video. In this article, we present a new design method of the Gaussian quantization matrix adapting to the compressed sensing coding, for that the distribution of the parameters of the image is featured of the characteristic of approximately normal distribution after measured by compressive sensing. By this way, the parameters of a certain quantity of the image frames depending on the video sequences generated by the Gaussian quantization matrix possess certain adaptive capacity. By comparison with the plan of the traditional quantization, the quantization matrix presented in this article would improve the reconstruction quality of the video.
基金Project (Nos. 60505017 and 60534070) supported by the National Natural Science Foundation of China
文摘The rate and distortion of Id-slice do not fit the globally linear relationship on a logarithmic scale. Lagrange multiplier selection methods based on the globally linear approximate relationship are neither efficient nor optimal for multi-view video coding (MVC). To improve the coding efficiency of MVC, a local curve fitting based Lagrange multiplier selection method is proposed in this paper, where Lagrange multipliers are selected according to the local slopes of the approximate curves. Experi-mental results showed that the proposed method improves the coding efficiency. Up to 2.5 dB gain was achieved at low bitrates.
基金Supported by National Natural Science Foundation of China（61170147） Major Cooperation Project of Production and College in Fujian Province（2012H61010016） Natural Science Foundation of Fujian Province（2013J01234）
基金Project supported by the National Natural Science Foundation of China (No. 60772134)the Innovation Foundation of Xidian University,China (No. Chuang 05018)
文摘A novel color compensation method for multi-view video coding (MVC) is proposed, which efficiently exploits the inter-view dependencies between views with the existence of color mismatch caused by the diversity of cameras. A color compensation model is developed in RGB channels and then extended to YCbCr channels for practical use. A modified inter-view reference picture is constructed based on the color compensation model, which is more similar to the coding picture than the original inter-view reference picture. Moreover, the color compensation factors can be derived in both encoder and decoder, therefore no additional data need to be transmitted to the decoder. The experimental results show that the proposed method improves the coding efficiency of MVC and maintains good subjective quality.
基金supported by the National Natural Science Foundation of China (Grant Nos.60832003,60672052,60902085,60972137)the Key Project of Shanghai Municipal Education Commission (Grant No.09ZZ90)+2 种基金the Natural Science Foundation of Shanghai(Grant No.09ZR1412500)the Innovation Foundation of Shanghai University (Grants Nos.10YZ09,SHUCX091061)the Shuguang Plan of Shanghai Education Development Foundation (Grant No.06SG43)
文摘Current multi-view video coding （MVC） reference model in joint video team （JVT） does not provide efficient rate control schemes. This paper presents a rate control algorithm for MVC by improving the quadratic rate-distortion （R-D） model. We reasonably allocate bit-rate among views based on the correlation analysisl The proposed algorithm consists of three levels to control the rate bits more accurately, of which the frame layer allocates bits according to the frame complexity and the temporal activity. Extensive experiments show that the proposed algorithm can control the bit rate efficiently.
基金Project(08Y29-7)supported by the Transportation Science and Research Program of Jiangsu Province,ChinaProject(201103051)supported by the Major Infrastructure Program of the Health Monitoring System Hardware Platform Based on Sensor Network Node,China+1 种基金Project(61100111)supported by the National Natural Science Foundation of ChinaProject(BE2011169)supported by the Scientific and Technical Supporting Program of Jiangsu Province,China
文摘The variable block-size motion estimation(ME) and disparity estimation(DE) are adopted in multi-view video coding(MVC) to achieve high coding efficiency. However, much higher computational complexity is also introduced in coding system, which hinders practical application of MVC. An efficient fast mode decision method using mode complexity is proposed to reduce the computational complexity. In the proposed method, mode complexity is firstly computed by using the spatial, temporal and inter-view correlation between the current macroblock(MB) and its neighboring MBs. Based on the observation that direct mode is highly possible to be the optimal mode, mode complexity is always checked in advance whether it is below a predefined threshold for providing an efficient early termination opportunity. If this early termination condition is not met, three mode types for the MBs are classified according to the value of mode complexity, i.e., simple mode, medium mode and complex mode, to speed up the encoding process by reducing the number of the variable block modes required to be checked. Furthermore, for simple and medium mode region, the rate distortion(RD) cost of mode 16×16 in the temporal prediction direction is compared with that of the disparity prediction direction, to determine in advance whether the optimal prediction direction is in the temporal prediction direction or not, for skipping unnecessary disparity estimation. Experimental results show that the proposed method is able to significantly reduce the computational load by 78.79% and the total bit rate by 0.07% on average, while only incurring a negligible loss of PSNR(about 0.04 d B on average), compared with the full mode decision(FMD) in the reference software of MVC.
基金the National Natural Science Foundation of China (No.60672073, No.60872094)the Program for New Century Excellent Talents in University (NCET-06-0537)+2 种基金the Key Project of Chinese Ministry of Education (No. 206059)Scientific Research Fund of Zhejiang Provincial Education Department (No.20070962)the Natural Science Foundation of Ningbo (No.2008A610016).
文摘Color inconsistency between views is an important problem to be solved in multi-view video applications, such as free viewpoint television and other three-dimensional video systems. In this paper, by combining with multi-view video coding, a coding-oriented multi-view video color correction method is proposed. We first separate foreground and background in first Group Of Pictures （GOP） by using SKIP coding mode. Then by transferring means and standard deviations in backgrounds, color correction is performed for each frame in GOP, and multi-view video coding is performed and used to renew the backgrounds. Experimental results ances in color correction and multi-view video show the proposed method can obtain better performcoding.
基金supported by the Graduate Student Research Innovation Project of Jiangsu Province China under Grants No. CXZZ12_0466, No. CXZZ11_0390the National Natural Science Foundation of China under Grants No. 61071091, No. 61271240+2 种基金the Natural Science Foundation of the Higher Education Institutions of Jiangsu Province China under Grant No. 12KJB510019the Nanjing University of Posts and Telecommunications Natural Science Foundation under Grant No. NY212015the Technology Research Program of Hubei Provincial Department of Education under Grant No. D20121408
文摘A novel Compressed-Sensing-based(CS-based)Distributed Video Coding(DVC)system,called Distributed Adaptive Compressed Video Sensing(DISACOS),is proposed in this paper.In this system,the input frames are divided into key frames and non-key frames,which are encoded by block CS sampling.The key frames are encoded as CS measurements at substantially higher rates than the non-key frames and decoded by the Smoothed Projected Landweber(SPL)algorithm using multi-hypothesis predictions.For the non-key frames,a small number of CS measurements are first transmitted to detect blocks having low-quality Side Information(SI)generated by the conventional interpolation or extrapolation at the decoder;then,another group of CS measurements are sampled again upon the decoder’s request.To fully utilise the CS measurements,we adaptively allocate these measurements to each block in terms of different edge features.Finally,the residual frame is reconstructed using the SPL algorithm and the decoded non-key frame is simply determined as the sum of the residual frame and the SI.Experimental results have revealed that our CS-based DVC system yields better rate-distortion performance when compared with other schemes.
基金Supported by the National Natural Science Foundation of China (No. 61071091)Jiangsu Province Graduate Innovative Research Plan (CX07B_107Z)
文摘In Wyner-Ziv (WZ) Distributed Video Coding (DVC), correlation noise model is often used to describe the error distribution between WZ frame and the side information. The accuracy of the model can influence the performance of the video coder directly. A mixture correlation noise model in Discrete Cosine Transform (DCT) domain for WZ video coding is established in this paper. Different correlation noise estimation method is used for direct current and alternating current coefficients. Parameter estimation method based on expectation maximization algorithm is used to estimate the Laplace distribution center of direct current frequency band and Mixture Laplace-Uniform Distribution Model (MLUDM) is established for alternating current coefficients. Experimental results suggest that the proposed mixture correlation noise model can describe the heavy tail and sudden change of the noise accurately at high rate and make significant improvement on the coding efficiency compared with the noise model presented by DIStributed COding for Video sERvices (DISCOVER).
基金Supported by the National Natural Science Foundation of China (No.61003236, 61171053, 61170065)the Doctoral Fund of Ministry of Education of China (No.20113223110002)the Natural Science Major Program for Colleges and Universities in Jiangsu Province(No.11KJA520001)
文摘The Wyner-Ziv distributed video coding scheme is characterized for its intraframe encoder and interframe decoder which can also approach the efficiency of an interframe encoder-decoder system. In Wyner-Ziv residual coding of video, the residual of a frame with respect to a reference frame is Wyner-Ziv encoded, which can reduces the input entropy and leads to a higher coding efficiency than directly encoding the original frame. In this paper, we propose a new approach of residual coding combined with Region Of Interest (ROI) extraction. Experimental results show that, the proposed scheme achieves better rate-distortion performance compared to conventional Wyner-Ziv coding scheme.
文摘Accumulated low density parity check （LDPCA） codec is proposed for DISCOVER project in distributed video coding （DVC）, which offers flexible coding rate. Although it can use feedback channel to adapt the rate to the correlation of the video, but in real applications, using feedback channel can not always be possible. To solve this problem, some researchers proposed estimating the code rate at the encoder but the performance was not very good. Based on their researches, this paper considers the impact of convergence rate for iteration on rate estimate, which can be calculated using its check matrix. As a pilot study, this paper pays attention to the regular LDPCA codec. At the same time, it considers the impact of deviation in the estimated crossover probability, which gives some constraints to rate estimate. In the experiment, the proposed algorithm can improve the rate-distortion performance by up to 1 dB-1.2 dB.
基金supported by the Fundamental Research Funds for the Central Universities.
文摘Distributed video coding(DVC)is a new video coding architecture.Compared with traditional video coding schemes,DVC has a simple encoder and complex decoder,which makes it suitable for circumstances where the encoder equipments are simple but the decoder equipments are complex.Most of the existing DVC architectures use decoder rate allocation method with the help of feedback channel.According to the results of the current decoding round,the decoder informs the encoder by feedback channel whether more parity bits are needed.The use of feedback channel not only increases the system delay,but also limits the use of DVC to instances where there is no feedback channel.In this paper,we propose a novel encoder rate allocation method.First,the simple three-step motion estimation is introduced into the encoder to estimate the side information of the decoder,and then the number of parity bits the decoder needs for each bitplane is allocated at the encoder according to the difference of the estimated side information and the current Wyner-Ziv(WZ)frame.Experiment results indicate that the accuracy of the proposed method is 5.18%-52.93% higher than that of the method proposed by Morbee.
基金Supported in part by the National Natural Science Foundation of China (Grant Nos.60776794 and 90604032)the National Basic Research Program of China (973 program) (Grant No.2006CB303104)+2 种基金the National High-tech Research & Development Program of China (863 program)(Grant No.2007AA01Z175)Program for Changjiang Scholars and Innovative Research Team in University (Grant No.IRT0707)Specialized Research Foundation of BJTU,Youth Science Technology Research Foundation of Shanxi Province (Grant No.2008021020)
文摘Distributed video coding （DVC） arouses high interests due to its property of low-complexity encoding. This paper proposes a robust multiple description DVC （MDDVC） under the constraint of low-complexity encoding. In MDDVC, zeros are padded to each frame and the resulting big-size video is divided into multiple descriptions. Then, each description is compressed by s hybrid DVC （HDVC） codec and trans- mitted over different channel. When one channel does not work, the lost HDVC description is estimated by the received from other channel, which guarantees the robustness of the system; MDDVC moves the complex motion estimation totally to the decoder so it features low-complexity encoding. In the pre-processing, an optimized zero-padding is also proposed to improve the performance. Experimental results exhibit that the proposed MDDVC scheme achieves better rate-distortion performance and robustness than the referenced especially when packet-loss rate is high.
基金supported bythe 111 Project under Grant No. B08004the major project of Ministry of Industry and Information Technology of the People's Republic of China under Grant No. 2010ZX03002-006China Fundamental Research Funds for the Central Universities
文摘Error Estimating Code (EEC) is a new channel coding method to estimate the Bit Error Rate (BER) information of the transmitted sequence. However, the estimated BER is not precise enough if the practical value of BER is high. A weighted EEC estimation method is proposed to improve the accuracy performance of BER estimation by classifying the raw estimation results into intervals and multiplying them by different coefficients separately. The applications of weighted EEC in modulation selection scheme and distributed video coding are discussed. Simulation results show that the EEC-based modulation selection method can achieve better performance at a cost of little redundancy and computation, and the EEC-based rate estimation method in distributed video coding can save the decoding time.
基金supported by the National Basic Research Program (973) of China (No.2009CB320903)the Program for New Century Ex-cellent Talents in University,China
文摘We address the compression efficiency of feedback-free and hash-check distributed video coding,which generates and transmits a hash code of a source information sequence.The hash code helps the decoder perform a motion search.A hash collision is a special case in which the hash codes of wrongly reconstructed information sequences occasionally match the hash code of the source information sequence.This deteriorates the quality of the decoded image greatly.In this paper,the statistics of hash collision are analyzed to help the codec select the optimal trade-off between the probability of hash collision and the length of the hash code,according to the principle of rate-distortion optimization.Furthermore,two novel algorithms are proposed:(1) the nonzero prefix of coefficients (NPC),which indicates the count of nonzero coefficients of each block for the second algorithm,and also saves 8.4% bitrate independently;(2) the adaptive selection of hash functions (AHF),which is based on the NPC and saves a further 2%-6% bitrate on average.The detailed optimization of the parameters of AHF is also presented.
基金supported by the Basic Science Research Program through the National Research Foundation of Korea(NRF)funded by the Ministry of Education(NRF-2019R1F1A1061635)by a research grant from Seoul Women’s University(2020-0213).
文摘The trend in video viewing has been evolving beyond simply providing a multi-view option.Recently,a function that allows selection and viewing of a clip from a multi-view service that captures a specific range or object has been added.In particular,the free-view service is an extended concept of multi-view and provides a freer viewpoint.However,since numerous videos and additional data are required for its construction,all of the clips constituting the content cannot be simultaneously provided.Only certain clips are selected and provided to the user.If the video is not the preferred video,change request is made,and a delay occurs during retransmission from the server.Delays due to frequent re-requests degrade the overall quality of service.For free-view services,selectively transmitting the video according to the user’s desired viewpoint and region of interest within the limited network of available videos is important.In this study,we propose a method of screening and providing the correct video based on objects in the contents.Based on the method of recognizing the object in each clip,we designed a method of setting its priority based on information about the object’s location for each viewpoint.During the transmission and receiving process using this information,the selected video can be rapidly recognized and changed.Herein,we present a service system configuration method and propose video selection examples for free-view services.
