视频流传输中的网络编码综述

网络视频应用增长迅猛,利用网络编码（NC）来提高网络吞吐量和传输可靠性进而改善视频流传输质量成为研究热点。针对如何优化网络编码进行视频流传输这一问题,必须要结合视频流自身特性作出改进并综合考虑所处的网络环境,才能充分发挥网络编码的优势。首先回顾了网络编码的基本概念和方法;然后对网络编码应用于视频流传输时需要考虑的视频业务特性,包括进行不等差错保护以优先保障重要等级视频数据包、降低数据包传输延迟以满足视频流实时性需求、增强网络差错恢复策略以提升传输可靠性等作了分析和归纳;接着阐述了基于网络编码的视频流传输策略在包括P2P、多源协作及内容中心网络等典型场景中的应用;最后对网络编码应用于视频流传输的研究趋势进行展望。     

FJND-based fuzzy rate control of scalable video for streaming applications

Multimedia Tools and Applications - A fuzzy rate controller with buffer constraint in combination with a perceptual quality controller is proposed for streaming applications of the AVC/H.264...     

Region-based rate control and bit allocation for wireless video transmission

In this paper, we propose a joint source-channel region-based rate control algorithm for real-time video transmissions over wireless systems. During the video transmission, the channel throughput available to the video encoder in the wireless systems is inherently variable, due to the retransmission of the error packets using the automatic repeat request (ARQ) error control. The variable data rate of the wireless system is characterized by the packet-level Gilbert two-state Markov Model, the parameters of which are extracted from the statistical properties of the channel information obtained from the wireless channel simulator. The proposed algorithm adopts a fast but effective block-based segmentation method to extract the regions of interest. Unlike traditional bit allocation methods used in the region/content-based rate control, the algorithm exploits the most effective criteria "coding qualities" as quantitative factors to directly control bit allocation among different regions so as to achieve better visual quality in the regions of interest. The computational complexity of the algorithm is low making it suitable for real-time applications. Compared with the MPEG-4 rate control algorithm, our algorithm can effectively enhance the perceptual quality for the regions of interest and significantly reduce the number of frame skipping; thereby, improve the smoothness of the video.     

面向高效率视频编码标准的快速码率控制算法

在详细分析高效率视频编码标准HEVC现有码率控制算法JCTVC-H0213的基础上,提出了一种快速有效的改进算法。该算法根据前一帧的目标比特和实际比特的比值来确定当前帧量化参数。在恒定比特率情况下将该算法与JCTVC-H0213进行比较,实验结果表明该算法对于大部分内容特性序列峰值信噪比变化值提高2.4dB以上,达到了很好的码率控制效果;并且该算法非常简单,适用于实时的码率控制应用。     

New bufferless rate control for high efficiency video coding

Multimedia Tools and Applications - As a crucial component of video compression, rate control regulates the encoding bitrates of compressed bitstreams to meet channel bandwidths while obtaining...     

Visual sensitivity guided bit allocation for video coding

A video bit allocation technique adopting a visual distortion sensitivity model for better rate-visual distortion coding control is proposed in this paper. Instead of applying complicated semantic understanding, the proposed automatic distortion sensitivity analysis process analyzes both the motion and the texture structures in the video sequences in order to achieve better bit allocation for rate-constrained video coding. The proposed technique evaluates the perceptual distortion sensitivity on a macroblock basis, and allocates fewer bits to regions permitting large perceptual distortions for rate reduction. The proposed algorithm can be incorporated into existing video coding rate control schemes to achieve same visual quality at reduced bitrate. Experiments based on H.264 JM7.6 show that this technique achieves bit-rate saving of up to 40.61%. However, the conducted subjective viewing experiments show that there is no perceptual quality degradation. EDICS-1-CPRS, 3-QUAL.     

WuKong: a practical video streaming service based on native BitTorrent and scalable video coding

Many researches on peer-to-peer video streaming have focused on dealing with highly dynamic, high-churn P2P environment. Most of P2P streaming protocols were modified from a P2P file sharing protocol. Inspired by the high performance on peer-to-peer file sharing of BitTorrent, we propose an overlaying streaming mechanism on the native BitTorrent protocol and realize a practical P2P video streaming service, called WuKong. WuKong not only takes advantages of BitTorrent but also combines the video scalability of layered video coding. In this paper, we depict an overlaid streaming mechanism in WuKong and an adaptive layer-downloading process to balance between the video quality and bandwidth utilization on heterogeneous peers. WuKong is carried out by using an open-sourced library of the BitTorrent protocol, coding schemes of the Windows Media Video (WMV), and the Scalable Video Coding (SVC). We measured and compared the service quality of end-users served by WuKong on heterogeneous peers. In addition, we evaluated the effectiveness of WuKong with peers that are randomly joining and leaving the P2P network. The results show that WuKong not only provides high quality P2P video streaming services but also supports different scaling abilities over heterogeneous devices.     

基于模糊逻辑的Internet视频流拥塞控制

为了提高视频传输质量,在Internet上对视频流进行拥塞控制,即利用包发送和接收间隔时间（IPGs）代替丢包率作为拥塞指示,采用模糊逻辑拥塞控制策略（FLC）调整视频发送速率并用遗传算法优化模糊控制规则,提高了拥塞控制性能。仿真结果表明,与TFRC和RAP拥塞控制相比,由于FLC发送速率更平滑、带宽利用率更高,从而减少了丢包,提高了视频传输质量;另外,FLC能够与竞争的TCP流公平地分享带宽并对路由器缓冲区大小保持了很好的鲁棒性。     

H.264可伸缩视频编码层间码率控制算法

为H.264/AVC标准的可伸缩编码(SVC)扩展提出了一种自适应的层间码率控制算法。该算法提出了一个选择模型,通过当前层的前一帧或者前一层的当前帧来预测Inter帧所需比特数。首先,将码率—复杂度—量化因子(R-C-Q)模型引入可伸缩的视频编码;接着,使用一个已有的比例—积分—微分(PID)缓冲区控制器来根据缓冲区状态提供当前Inter帧的比特数估计;然后,为了在视频画面发生急剧变化时获得更为精确的估计,利用前一层中的当前帧所用实际比特数来进一步进行当前Inter帧比特数估计;最后,使用选择模型决定最终的预测比特数,并通过R-C-Q模型计算出量化因子(QP)。实验结果表明,相对于推荐的JVT-043码率控制算法,所提出的算法可以在SVC的每层获得更加精确的实际输出比特率,保持缓冲区充盈度的稳定,同时减少跳帧和质量波动,提高整体编码质量。     

Low-delay rate control for real-time H.264/AVC video coding

This paper presents an efficient rate control scheme for the H.264/AVC video coding in low-delay environments. In our scheme, we propose an enhancement to the buffer-status based H.264/AVC bit allocation method. The enhancement is by using a PSNR-based frame complexity estimation to improve the existing mean absolute difference based (MAD-based) complexity measure. Bit allocation to each frame is not just computed by encoder buffer status but also adjusted by a combined frame complexity measure. To prevent the buffer from undesirable overflow or underflow under small buffer size constraint in low delay environment,the computed quantization parameter (QP) for the current MB is adjusted based on actual encoding results at that point. We also propose to compare the bits produced by each mode with the average target bits per MB to dynamically modify Lagrange multiplier (/spl lambda//sub MODE/) for mode decision. The objective of QP and /spl lambda//sub MODE/ adjustment is to produce bits as close to the frame target as possible, which is especially important for low delay applications. Simulation results show that the H.264 coder, using our proposed scheme, obtains significant improvement for the mismatch ratio of target bits and actual bits in all testing cases, achieves a visual quality improvement of about 0.6 dB on the average, performs better for buffer overflow and underflow,and achieves a similar or smaller PSNR deviation.     

A frame-level encoder rate control scheme for transform domain Wyner-Ziv video coding

Available distributed video coding codecs are mostly based on decoder rate control scheme where the parity bits for decoding can be achieved over a feedback channel. Meanwhile, the frequent requests over feedback channel increase the transmission delay. The feedback-free distributed video coding, relying on encoder rate control in literatures, has overcome the aforementioned shortcoming. However, when performing parity bitrate estimation and other operations, the feedback-free distributed video coding systems based on bit-plane usually require high precision of bitrate estimation and high quality of side information at the encoder. In this paper, we propose a frame-level distributed video coding system based on encoder rate control. The innovations include three parts: 1) an adaptive coding mode selection algorithm is proposed, which utilizes both temporal and spatial correlation and reduces the complexity of encoder; 2) a bit-plane rearrangement method is adopted, which makes the coding rate on each bit-plane homogeneous and effectively reduces the accuracy requirement of the parity bitrate prediction and improves the efficiency of rate estimation; 3) a frame-level parity bitrate estimation scheme is presented to enhance the efficiency of rate estimation on the basis of a look-up table. Numerical results verify that the proposed scheme remarkably improves the rate distortion performance of distributed video coding at low bitrate.     

Battery-aware rate adaptation for extending video streaming playback time

Multimedia streaming applications are computation and network intensive that put a high demand on battery usage of mobile devices. Battery usage forms an important metric in user satisfaction, as increased battery consumption results in faster battery depletion and eventually leads to battery outage. In this paper, we propose an adaptation technique, referred as Battery-Aware Rate Adaptation (BARA) scheme, which adapts to the appropriate bit rate to prolong the battery lifetime. BARA considers both the wireless channel conditions, as well as the device’s battery level, to determine the best transmission rate for optimizing the mobile battery consumption. Actual experiment and simulation results corroborate that compared to the conventional techniques, BARA can save more than 40% of battery power, while extending the video playback time by 20%.

     

基于模糊控制的流媒体自适应传输算法

基于HTTP的动态自适应流媒体DASH传输协议可以使用户根据自身的终端显示能力和信道条件选择合适的视频质量,是网络视频服务技术的发展方向。如何根据网络吞吐量的变化自适应地选择视频码率,以获得最佳的用户体验质量QOE,在已有的DASH系统中还没有得到很好的解决。 提出了一种基于模糊控制的自适应传输算法,将缓存的视频余量以及用户申请的视频码率和网络吞吐量的码率失配度作为输入,将预期的缓存变化量作为输出,通过模糊逻辑实现以下控制目的：(1）将缓存稳定在一个安全的区间;(2）使传输视频的平均质量最大化;(3）避免因带宽波动所造成的视频播放中断。最后,分别在两种虚拟网络环境和两种实际网络环境下进行性能测试,实验结果表明,与已有的算法相比较,本文提出的算法可以给用户带来更好的QOE。     

一种低码率彩色人脸图像编码方法

提出了一种适合低码率信道传输的嵌入式彩色人脸图像编码方法,不仅把握了人脸图像的特点,而且充分利用了彩色图像小波变换后的多种相关性。该方法将联合色彩分量矢量量化和零块、零树编码方法巧妙结合,把彩色图像的三个色彩分量单独扫描,单独编码的过程简化为联合扫描和联合编码的过程。实验结果表明该算法在低码率下,相比JPEG,获得了在视觉效果和峰值信噪比方面更好的恢复图像质量。     

A low-complexity and efficient encoder rate control solution for distributed residual video coding

Multimedia Tools and Applications - Existing encoder rate control (ERC) solutions have two technical limitations that prevent them from being widely used in real-world applications. One is that...