三维小波变换结合运动补偿的视频编码器

对三雏小波变换结合运动补偿的视频压缩算法提出了改进方案。针对运动补偿提升（MCLIFT）框架的弱点,结合MPEG的特点,采用新的帧结构对视频序列进行帧间滤波去除时间冗余,再对每个帧在空间上进行小波分解并用SPIHT算法对小波系数进行编码。实验表明,此方法继承了MCLIFT框架的优点,同时又减少了时延和所需的帧缓存,而且这种与MPEG相似的帧结构能进一步降低码率,提高压缩比。     

运动图象压缩编码中的三层小波分解

在序列图象编码中采用对帧间位移矢量进行估值的一类算法－－匹配算法，给出了一种利用三层小波分解序列图象运动补偿编码的方案。     

一种基于信源划分定理的小波帧内编码方法

本文在SPIHT算法的基础上，基于信源划分定理提出了一种新的小波系数量化编码算法。这种算法更好的利用了小波系数的统计特性，可以获得比SPIHT算法更高的压缩效率，并且能够产生完全嵌入码流。实验表明，这种算法非常适合于极低码率视编码的帧内编码，在相同压缩比下，能够取得比H.263 帧内编码器更好的重建图像质量。     

用于DT网格模型基视频编码的三角形分割准则

在分析DT(Delaunay tdangulation)网格已有的2种分割准则--灰度误差最小化准则和灰度分布均匀化准则在网格基编码不足的基础上,提出了一种新的DT网格分割准则--灰度误差平方和最小化准则,使三角形分割更加合理有效,编码性能比以前的方法有明显提高.在此基础上提出了帧内变换编码/帧间网格基运动估计的混合编码方案,该方案可应用于复杂运动和背景的视频序列中,突破了以往模型基编码只能应用于视频会议的限制.实验结果表明,该编码方案在复杂运动和背景的应用场合高出了H.263的编码性能.     

H.263中全零系数块预测的新方法

用H.263标准对甚低码率图像编码时,经过帧间预测后得到的运动补偿数据通常很小,对这些数据再进行DCT和量化后往往成为全零块,Alice Yu算法和周算法是预先判别全零系数块的较为有效的方法,但在对较为复杂的序列图像进行预测时分别出现了较大程度的误判和漏判。针对这些缺点,该文提出了一种新的全零系数块的判别方法,它具有能随量化级的变化自适应地调整全零块的判断阈值、无需任何附加运算和对图像序列内容复杂程度不敏感的优点,将该方法应用于H.263编码器中,对Miss America和News图像序列进行仿真实验。实验表明,大约有40％-80％的块可以在做DCT和量化前被判别为全零系数块,大大减少了编码的时间,同时图像质量的下降控制在0.0005 dB以内。     

基于H.264比特流运动矢量的水印算法研究

针对水印质量和比特率增加的问题,该文设计两种直接在H.264比特流运动矢量中进行水印嵌入的脆弱性视频水印算法。算法I通过引入运动矢量误差补偿模块和优化水印嵌入位置选择方法提高重建视频质量;算法Ⅱ在其基础上,引入帧内-帧间误差补偿模块来消除由于帧内-帧间误差累积现象带来的重建视频失真,进一步提高了重建视频质量。实验结果表明,算法I可以取得较好的重建视频质量,且重建视频流的比特率增加比较小;算法Ⅱ保证重建视频质量的同时带来一定比特率增加。两种算法为H.264压缩视频的内容完整性认证提供了有效的解决方案。     

甚低速视频编码中PB帧技术的研究

本文首先对甚低速视频编码H.263的PB帧技术和H.263+所采用IPB帧技术进行性能分析,在此基础上,提出一种简单有效的B帧选取方法(称之为B帧熵最大选取法),其基本思路是根据信息论熵值理论定义B帧的熵,并根据熵值来选择信息量最大、对暴露区补偿最有意义的B帧,实验结果表明该方法在保留了H.263+的IPB帧的优点的同时,可获得更优的补偿效果。     

基于H.264误差漂移补偿的鲁棒性视频水印算法

针对现有基于H.264的视频水印算法存在误差漂移的问题,在分析了误差漂移产生原因的基础上,提出了一种抑制误差漂移的鲁棒性视频水印新算法.通过调制H.264编码中Ⅰ帧量化后的4 ×4 DCT系数来实现水印的嵌入,并对帧内预测量化后满足特定条件的DCT子块的最后一行、列进行补偿和对帧间预测进行补偿,有效地抑制了帧内、帧间误差漂移.另外,该算法结合CAVLC编码来调制量化后的DCT残差系数,使整体码流变动较小,并且算法能够根据不同视频序列自适应地调节嵌入容量及嵌入位置,具有较好的灵活性和鲁棒性.在水印提取过程中,不需要原始视频的参与,即可实现盲提取.仿真实验结果表明,该算法在具有良好不可见性的前提下,对压缩码率影响较小,能够较好地抵抗噪声、帧剪切、重编码等攻击.     

甚低比特率水下视频图像压缩编码方法

为满足水声信道有限带宽的要求,提出了一种高效的水下视频图像压缩编码方案。编码系统主要由图像预处理、帧内编码和帧间预测编码3个模块组成。基于小波变换的预处理模块用于去除水下图像中的视觉冗余。根据水下图像的特点,采用基于小波树的WDR(wavelet difference reduction)算法对帧内图像进行高效编码。帧间运动估计和补偿是针对预处理后的图像子带进行,运动补偿后的残差图像采用基于重要子块和重要系数的双重WDR编码策略。实验结果表明:在保证图像重建质量的前提下,本文算法的平均压缩比可以达到250∶1～500∶1,基本满足水声信道传输速率为16 Kbps时的要求。     

H.264中的基于全零块检测的运动搜索方法

运动搜索和变换域编码是视频编码标准H.264中运算量很大的部分,为了减少视频编码的运算量,本文根据H.264运动搜索和整数变换的特征,提出了一种H.264下的全零块检测方法。在帧间编码中,该方法在运动搜索中和变换前,对运动补偿的差值数据进行全零检测,检测的门限根据绝对误差和(SAD)和量化参数而定。在运动搜索非常准确时,就可以找到全零块,就停止搜索,可以省却后面的搜索运算和全零块的整数变换以及相应的量化运算,在基本保持H.264原有编码算法的图像质量的同时,减少了运算量,缩短了码流,提高了编码器的编码效率。     

Multiframe video coding for improved performance over wirelesschannels

We propose and evaluate a multi-frame extension to block motion compensation (BMC) coding of videoconferencing-type video signals for wireless channels. The multi-frame BMC (MF-BMC) coder makes use of the redundancy that exists across multiple frames in typical videoconferencing sequences to achieve additional compression over that obtained by using the single frame BMC (SF-BMC) approach, such as in the base-level H.263 codec. The MF-BMC approach also has an inherent ability of overcoming some transmission errors and is thus more robust when compared to the SF-BMC approach. We model the error propagation process in MF-BMC coding as a multiple Markov chain and use Markov chain analysis to infer that the use of multiple frames in motion compensation increases robustness. The Markov chain analysis is also used to devise a simple scheme which randomizes the selection of the frame (amongst the multiple previous frames) used in BMC to achieve additional robustness. The MF-BMC coders proposed are a multi-frame extension of the base level H.263 coder and are found to be more robust than the base level H.263 coder when subjected to simulated errors commonly encountered on wireless channels.     

H.263甚低速率图像编码的全局判决实现方法

本文对Ｈ．２６３编码算法的现有实现方法作了深入的分析,首先发现变换部分存在大量无效运算,提出了在变换前加判决的前变换判决的编码方案,以压缩无效的变换运算;其次发现运动估计部分由于忽略了图像场景的分级运动而存在一定的无效搜索运算,提出了基于分级运动的可变搜索域法来压缩无效的搜索运算;最后将前变换判决方案与运动估计的可变搜索域法有机地结合在一起,提出了全局判决编码方案,从而比较全面地改进了现有实现方法,因而能大幅度地提高编码器的编码速度．     

Motion compensated lossy-to-lossless compression of 4-D medical images using integer wavelet transforms.

This paper proposes a method for progressive lossy-to-lossless compression of four-dimensional (4-D) medical images (sequences of volumetric images over time) by using a combination of three-dimensional (3-D) integer wavelet transform (IWT) and 3-D motion compensation. A 3-D extension of the set-partitioning in hierarchical trees (SPIHT) algorithm is employed for coding the wavelet coefficients. To effectively exploit the redundancy between consecutive 3-D images, the concepts of key and residual frames from video coding is used. A fast 3-D cube matching algorithm is employed to do motion estimation. The key and the residual volumes are then coded using 3-D IWT and the modified 3-D SPIHT. The experimental results presented in this paper show that our proposed compression scheme achieves better lossy and lossless compression performance on 4-D medical images when compared with JPEG-2000 and volumetric compression based on 3-D SPIHT.     

Scalable wavelet video coding using aliasing-reduced hierarchicalmotion compensation

We describe a spatially scalable video coding framework in which motion correspondences between successive video frames are exploited in the wavelet transform domain. The basic motivation for our coder is that motion fields are typically smooth and, therefore, can be efficiently captured through a multiresolutional framework. A wavelet decomposition is applied to each video frame and the coefficients at each level are predicted from the coarser level through backward motion compensation. To remove the aliasing effects caused by downsampling in the transform, a special interpolation filter is designed with the weighted aliasing energy as part of the optimization goal, and motion estimation is carried out with low pass filtering and interpolation in the estimation loop. Further, to achieve robust motion estimation against quantization noise, we propose a novel backward/forward hybrid motion compensation scheme, and a tree structured dynamic programming algorithm to optimize the backward/forward mode choices. A novel adaptive quantization scheme is applied to code the motion predicted residue wavelet coefficients, Experimental results reveal 0.3-2-dB increase in coded PSNR at low bit rates over the state-of-the-art H.263 standard with all enhancement modes enabled, and similar improvements over MPEG-2 at high bit rates, with a considerable improvement in subjective reconstruction quality, while simultaneously supporting a scalable representation.     

Error-resilient video transmission using long-term memorymotion-compensated prediction

Long-term memory prediction extends the spatial displacement vector utilized in hybrid video coding by a variable time delay, permitting the use of more than one reference frame for motion compensation. This extension leads to improved rate-distortion performance. However, motion compensation in combination with transmission errors leads to temporal error propagation that occurs when the reference frames at the coder and decoder differ. In this paper, we present a framework that incorporates an estimated error into rate-constrained motion estimation and mode decision. Experimental results with a Rayleigh fading channel show that long-term memory prediction significantly outperforms the single-frame prediction H.263-based anchor. When a feedback channel is available, the decoder can inform the encoder about successful or unsuccessful transmission events by sending positive (ACK) or negative (NACK) acknowledgments. This information is utilized for updating the error estimates at the encoder. Similar concepts, such as the ACK and NACK mode known from the H.263 standard, are unified into a general framework providing superior transmission performance     

Wavelet-based very low bit-rate video coding using image warpingand overlapped block motion compensation

The authors present an algorithm for very low bit-rate video coding that combines new ideas in motion estimation, wavelet filter design, and wavelet-based coding techniques. A new motion compensation technique using image warping and overlapped block motion compensation is proposed to reduce temporal redundancies in a given image sequence. This combined motion model has the advantage of representing more complex motion than simple block matching schemes. To further improve the quality of the temporal prediction, an adaptive grid with variable density according to the varying motion activity of a given scene is generated. An adaptively switched high-quality texture interpolation is employed to cope with the problem of fractional displacements in such a way that both objective and subjective reconstruction quality is improved. Spatial decorrelation of the motion compensated residual images is performed using an one-parametric family of biorthogonal infinite impulse response (IIR) wavelet filters coupled with the highly efficient pre-coding scheme of `partitioning, aggregation and conditional coding' (PACC). Experimental results demonstrate significant improvements in objective quality of 1.0-2.3 dB PSNR in comparison to the H.263+ test model TMN10 using advanced coding options. In addition, the authors' intracoding method provides a performance gain of 0.5 dB PSNR on the average for a test suite of various still images when compared to the emerging still image coding standard JPEG-2000     

An efficient retinex-like brightness normalization method for coding camera flashes and strong brightness variation in videos

Conventional hybrid video coding systems rely on the assumption that the brightness is constant. This does not take inter-frame brightness variations into consideration during motion estimation and compensation processes. Under the influence of inter-frame lighting variations like camera flashes, video motion activities are not accurately estimated and the pixel prediction is poor which directly increases the bits for prediction error coding. In this paper, we propose an efficient algorithm based on the retinex-like system which allows inter-frame brightness being normalized before applying the conventional motion estimation and compensation. Experimental results show that our approach is superior to all similar approaches in the literature and demonstrate that our proposed system is very robust against the inter-frame brightness variations. Further experimental works have been done using the verification models of the MPEG-4 and the H.264 on sequences with brightness variations, results of which show that our proposed system outperforms these coding systems, including the weighted prediction feature in H.264, which were specifically designed for this purpose.     

Invertible temporal subband/wavelet filter banks with half-pixel-accurate motion compensation

Three-dimensional (3-D) subband/wavelet coding with motion compensation has been demonstrated to be an efficient technique for video coding applications in some recent research works. When motion compensation is performed with half-pixel accuracy, images need to be interpolated in both temporal subband analysis and synthesis stages. The resulting subband filter banks developed in these former algorithms were not invertible due to image interpolation. In this paper, an invertible temporal analysis/synthesis system with half-pixel-accurate motion compensation is presented. We look at temporal decomposition of image sequences as a kind of down-conversion of the sampling lattices. The earlier motion-compensated (MC) interlaced/progressive scan conversion scheme is extended for temporal subband analysis/synthesis. The proposed subband/wavelet filter banks allow perfect reconstruction of the decomposed video signal while retaining high energy compaction of subband transforms. The invertible filter banks are then utilized in our 3-D subband video coder. This video coding system does not contain the temporal DPCM loop employed in the conventional hybrid coder and the earlier MC 3-D subband coders. The experimental results show a significant PSNR improvement by the proposed method. The generalization of our algorithm for MC temporal filtering at arbitrary subpixel accuracy is also discussed.     

Hybrid picture coding with wavelet transform and overlappedmotion-compensated interframe prediction coding

A novel video coding scheme using an orthonormal wavelet transform is proposed. The wavelet transform is used in a motion compensated interframe coder in which a blockless motion compensation technique is employed to increase efficiency of wavelet transform coding. A new scanning method for wavelet coefficients is also proposed which is rather different from subband coding. Simulation work is carried out to evaluate the proposed coding method. Significant improvement in subjective quality is obtained over that obtained with conventional hybrid coding methods that use blockwise motion compensation and DCT. Some improvement has also been realized in the signal to noise ratio. Although wavelet coding is still in its early stages of development, it appears to hold great promise for motion picture coding     

An optimum power management scheme for wireless video service in CDMA systems

An optimum power management scheme is proposed for intra-frame refreshed image sequences of the wireless video service in code-division multiple-access (CDMA) systems. The end-to-end distortion of H.263 video data is first modeled when the error concealment schemes are employed. This distortion model takes into account the error propagation effects caused by the motion compensation. Then, based on the model, the target bit-error rates (BERs) of the image frames are optimized in such a way that the consumed power could be minimized under the constraint of maximum distortion. To satisfy the specified target BER requirement, an optimum power management scheme is proposed. Simulation results show that the proposed scheme considerably outperforms the conventional scheme in the sense of the decoded image quality. Additionally, the effects of the imperfect power control on the performance are also investigated.