基于3D-SPIHT的立体视频图像压缩编码

该文提出一种新的立体视频编码方案:在辅助序列中进行视差补偿预测和三维等级数集合分区(3D-SPIHT)编码,3D-SPIHT算法建立在真三维小波分解基础上,通过定义一种新的时空方向树结构,实现了静止图像SPIHT算法的三维扩展,实验结果表明该方案的编码性能略高于传统方案,具有较低的计算复杂度,所产生的嵌入式辅助序列码流,可根据通道带宽自适应调整输出码率,最大限度地提高辅助序列的质量。     

Low complexity shape-adaptive DCT for coding of arbitrarily shaped image segments

A low complexity shape-adaptive DCT transform algorithm for coding pels in arbitrarily shaped image segments is presented. The proposed algorithm is compared to the well established generalized shape-adaptive transform method introduced by Gilge et al. in terms of transform efficiency and computational complexity. Results obtained under both theoretical and experimental conditions show that the new algorithm achieves a transform efficiency close to that of the Gilge method with considerably reduced computational complexity. The proposed shape-adaptive DCT algorithm was implemented into a standard MPEG-1 coder to provide object or segment based coding of images and video with additional content-based functionality. The extended MPEG-1 object based coding scheme can handle generic input sequences and can readily provide MPEG-1 backward compatibility if no contour data is transmitted for a given video sequence. Results for INTRA coding of images indicate that the algorithm allows efficient coding over a wide range of coding parameters — thus providing means for generic coding of segmented video between very high and very low bit rates. It is further shown that some of the content-based based functionalities currently discussed in MPEG-4 can be provided efficiently using the proposed object based coding scheme.     

基于联合预测的立体视频压缩编解码系统

提出了一种新颖的立体视频压缩编解码系统,通过采用结合3种预测方式的联合预测方法来获得较高的编解码效率以及较低的计算复杂度,改善了视频的质量.     

Object-based stereo video compression using fractals and shape-adaptive DCT

Based on the classical fractal video compression method, an improved object-based stereo video compression scheme with Shape-Adaptive DCT is proposed in this paper. Firstly, we use more effective macroblock partition scheme instead of classical quadtree partition scheme; thus reducing the block searching strategy. The stereo fractal video coding is proposed which matches the macroblock with two reference frames in left and right view results in increasing compression ratio and reducing bit rate when transmitting compressed stereo data. The stereo codec combines the Motion Compensation Prediction (MCP) and Disparity Compensation Prediction (DCP). Fractal coding is adopted and each object is encoded independently by a prior video segmentation alpha plane, which is defined exactly as in MPEG-4. The testing results with the nature monocular and stereo video sequences provide promising performances at low bit rate coding. We believe it will be a powerful and efficient technique for the object-based monocular and stereo video sequences coding.     

A reduced-complexity image coding scheme using decision-directed wavelet-based contourlet transform

Recently the wavelet-based contourlet transform (WBCT) is adopted for image coding because it matches better image textures of different orientations. However, its computational complexity is very high. In this paper, we propose three tools to enhance the WBCT coding scheme, in particular, on reducing its computational complexity. First, we propose short-length 2-D filters for directional transform. Second, the directional transform is applied to only a few selected subbands and the selection is done by a mean-shift-based decision procedure. Third, we fine-tune the context tables used by the arithmetic coder in WBCT coding to improve coding efficiency and to reduce computation. Simulations show that, at comparable coded image quality, the proposed scheme saves over 92% computing time of the original WBCT scheme. Comparing to the conventional 2-D wavelet coding schemes, it produces clearly better subjective image quality.     

自适应选择联合补偿预测模式的立体视频编码算法

运动补偿预测．视差补偿预测以及两者相结合的联合补偿预测是研究立体视频编码的关键技术。不同预测模式不仅考虑了左右视频通道各自的时间相关性、而且考虑到了左右视频通道之间的空间相关性。本文提出了一种自适应选择预测模式的立体视频编码算法,并在预测模式确定后通过选取不同的加权值来达到联合补偿预测的目的。实验结果表明,本文提出的算法在改善编码性能的同时,提高了编码速度。     

Variable block-based deblocking filter for H.264/AVC on low-end and low-bit rates terminals

H.264/AVC supports variable block motion compensation, multiple reference frames, 1/4-pixel motion vector accuracy, and in-loop deblocking filter, compared with previous video coding standards. While these coding techniques are major functions for video compression improvement, they lead to high computational complexity at the same time. For the H.264 video coding techniques to be actually applied on low-end/low-bit rates terminals more extensively, it is essential to improve the coding efficiency. Currently the H.264 deblocking filter, which can improve the subjective quality of video, is hardly used on low-end terminals due to computational complexity.In this paper, we propose an enhanced method of deblocking filter that efficiently reduces the blocking artifacts occurring during the low-bit rates video coding. In the ‘variable block-based deblocking filter (VBDF)’ proposed in this paper, the temporal and spatial characteristics of moving pictures are extracted using the variable block-size information of motion compensation, the filter mode is classified into four different modes according to the moving-picture characteristics, and the adaptive filtering is executed in the separate modes. The proposed VBDF can reduce the blocking artifacts, prevent excessive blurring effects, and achieve about 30–40% computational speedup at about the same PSNR compared with the existing methods.     

一种基于MPEG-2的立体视频编码中的视差匹配快速算法

高效，快速的视差匹配是立体视频处理中的一项关键技术。本文在分析立体图像序列的视差矢量与运动矢量之间的相关性的基础上，提出一种基于MPEG-2的立体视频编码中的视差匹配快速算法。实验结果表明，与全搜索法相比，在保证重建图像质量的前提下，快速算法能显著降低视差估计的计算复杂度。     

A unified rate-distortion analysis framework for transform coding: a summary

In our previous work, we have developed a rate-distortion (R-D) modeling framework H.263 video coding by introducing the new concepts of characteristic rate curves and rate curve decomposition. In this paper, we further show it is a unified R-D analysis framework for all typical image/video transform coding systems, such as EZW, SPIHT and JPEG image coding; MPEG-2, H.263, and MPEG-4 video coding. Based on this framework, a unified R-D estimation and control algorithm is proposed for all typical transform coding systems. We have also provided a theoretical justification for the unique properties of the characteristic rate curves. A linear rate regulation scheme is designed to further improve the estimation accuracy and robustness, as well as to reduce the computational complexity of the R-D estimation algorithm. Our extensive experimental results show that with the proposed algorithm, we can accurately estimate the R-D functions and robustly control the output bit rate or picture quality of the image/video encoder.     

A hybrid scheme for low bit-rate coding of stereo images

We propose a hybrid scheme to implement an object driven, block based algorithm to achieve low bit-rate compression of stereo image pairs. The algorithm effectively combines the simplicity and adaptability of the existing block based stereo image compression techniques with an edge/contour based object extraction technique to determine appropriate compression strategy for various areas of the right image. Unlike the existing object-based coding such as MPEG-4 developed in the video compression community, the proposed scheme does not require any additional shape coding. Instead, the arbitrary shape is reconstructed by the matching object inside the left frame, which has been encoded by standard JPEG algorithm and hence made available at the decoding end for those shapes in right frames. Yet the shape reconstruction for right objects incurs no distortion due to the unique correlation between left and right frames inside stereo image pairs and the nature of the proposed hybrid scheme. Extensive experiments carried out support that significant improvements of up to 20% in compression ratios are achieved by the proposed algorithm in comparison with the existing block-based technique, while the reconstructed image quality is maintained at a competitive level in terms of both PSNR values and visual inspections.     

Scalable Interframe Wavelet Coding with Low Complex Spatial Wavelet Transform

In the decoding process associated with interframe wavelet coding, the inverse wavelet transform requires high computational complexity. However, as video technology starts to pervade all aspects of our lives, decoders are becoming required in various devices such as PDAs, notebooks, PCs, and set‐top boxes. Therefore, a decoder's complexity needs to be adapted to the processor's computational power, and consequently a low‐complexity codec is also required for scalable video coding. In this paper, we propose a method of controlling and lowering the complexity of the spatial wavelet transform while sustaining the same coding efficiency as that currently afforded. In addition, the proposed method may alleviate the ringing effect for slowly changing image sequences.     

波形内插语音编码器中快渐变波形幅度的量化

在低速率参数语音编码算法中,如何用有限的比特数有效地量化幅度谱是一个关键问题。本文对波形内插语音编码模型中快渐变波形幅度的量化问题进行了深入研究和分析,提出了一种基于矢量变维和DCT的REW幅度感觉加权量化方案,该方法降低了编码比特数,减少了存储和计算复杂度,增强了编码语音的感性质量。主观听力测试结果表明该量化方案在每帧4比特时的WI语音编解码质量要优于用基于DCT的REW幅度矩阵量化方案在每帧10比特时的重建语音质量。     

Fast transcoding architectures for insertion of non-regular shaped objects in the compressed DCT-domain

This paper addresses the problem concerned with the insertion of non-regular shaped objects, such as logos or subtitles, in compressed video signals. To achieve this objective, a different approach from the usual pixel-domain compositing operation is adopted, in order to avoid the presence of undesired semi-transparent rectangular regions around the inserted objects. The transposition of this technique to the compressed DCT-domain is presented, as well as the integration of the logo insertion module in several architectures of compressed domain video transcoders. A detailed study of the main characteristics of the proposed DCT-domain transcoders, with a special emphasis on the required computational load and on the obtained coding quality (PSNR) of the processed video sequences shows that DCT-domain insertion architectures can offer significant advantages, both in terms of subjective quality and computational cost. Moreover, the distinctive features presented by the proposed architectures provide the means to adapt the insertion scheme to the particular requirements of the target application.     

A Video Coding Algorithm Based on Intraframe and Interframe Joint Prediction of Wavelet Coefficients

ＡＶｉｄｅｏＣｏｄｉｎｇＡｌｇｏｒｉｔｈｍＢａｓｅｄｏｎＩｎｔｒａｆｒａｍｅａｎｄＩｎｔｅｒｆｒａｍｅＪｏｉｎｔＰｒｅｄｉｃｔｉｏｎｏｆＷａｖｅｌｅｔＣｏｅｆｉｃｉｅｎｔｓＺｈａｎｇＸｕｄｏｎｇＷａｎｇＤｅｓｈｅｎｇＰｅｎｇＹｉｎｇｎｉｎｇ（Ｔｓｉｎ...     

View-spatial–temporal post-refinement for view synthesis in 3D video systems

Depth image based rendering is one of key techniques to realize view synthesis for three-dimensional television and free-viewpoint television, which provide high quality and immersive experiences to end viewers. However, artifacts of rendered images, including holes caused by occlusion/disclosure and boundary artifacts, may degrade the subjective and objective image quality. To handle these problems and improve the quality of rendered images, we present a novel view-spatial–temporal post-refinement method for view synthesis, in which new hole-filling and boundary artifact removal techniques are proposed. In addition, we propose an optimal reference frame selection algorithm for a better trade-off between the computational complexity and rendered image quality. Experimental results show that the proposed method can achieve a peak signal-to-noise ratio gain of 0.94 dB on average for multiview video test sequences when compared with the benchmark view synthesis reference software. In addition, the subjective quality of the rendered image is also improved.     

A Video Coding Algorithm Based on Intraframe and Interframe Joint Prediction of Wavelet Coeffictients

A novel video coding algorithm based on intraframe and interframe prediction of wavelet coefficients is described in this paper.A BZT(Block Zero Tree)coding scheme represents the position of zero coefficients block efficiently,For nonzero coefficients block,temporal redundancy is removed using MultiResolution Motion Estimation(MRME).The proposed algorithm improves the coding performance significantly over the baseline MRME technique.In addition,the computational complexity is further reduced.     

立体视频图像编码的研究进展

从编码方案、关键技术和评价准则3个方面综述了立体视频图像编码研究的发展.阐明了各种编码方案的特点及适用范围.详细分析了立体视频图像编码中视差估计、运动估计、遮挡检测、残差图像编码和码率控制5大关键技术,总结了各项技术的发展现状.最后指出了立体视频图像编码研究中存在的问题,并对未来的研究方向进行了展望.     

应用分层MRF/GRF模型的立体图像视差估计及分割

视差估计与分割是立体图像编码及立体视觉匹配的核心问题,本文提出一种基于分层MRF/GRF模型和交叠块匹配(HMOM)视差估计算法以及结合主动轮廓模型的视差分割提取算法.该混合视差估计方法,可得到光滑准确,且具有清晰边缘的视差场;并便于用主动轮廓模型提取感兴趣对象(OOI)的视差轮廓.与通常的变尺寸块匹配(VSBM)相比,本算法得到的视差补偿图像的峰值信噪比可提高2.5dB左右.本文得到的视差场及对应的轮廓可进一步用于立体图像编码以及视频对象分割.     

Just noticeable distortion model and its applications in video coding

We explore a new perceptually-adaptive video coding (PVC) scheme for hybrid video compression, in order to achieve better perceptual coding quality and operational efficiency. A new just noticeable distortion (JND) estimator for color video is first devised in the image domain. How to efficiently integrate masking effects together is a key issue of JND modelling. We integrate spatial masking factors with the nonlinear additivity model for masking (NAMM). The JND estimator applies to all color components and accounts for the compound impact of luminance masking, texture masking and temporal masking. Extensive subjective viewing confirms that it is capable of determining a more accurate visibility threshold that is close to the actual JND bound in human eyes. Secondly, the image-domain JND profile is incorporated into hybrid video encoding via the JND-adaptive motion estimation and residue filtering process. The scheme works with any prevalent video coding standards and various motion estimation strategies. To demonstrate the effectiveness of the proposed scheme, it has been implemented in the MPEG-2 TM5 coder and demonstrated to achieve average improvement of over 18% in motion estimation efficiency, 0.6 dB in average peak signal-to perceptual-noise ratio (PSPNR) and most remarkably, 0.17 dB in the objective coding quality measure (PSNR) on average. Theoretical explanation is presented for the improvement on the objective coding quality measure. With the JND-based motion estimation and residue filtering process, hybrid video encoding can be more efficient and the use of bits is optimized for visual quality.