一种低复杂度立体视频错误隐藏新方法

针对立体视频流传输中右视 点整帧丢失,提出 了一种低复杂度的错误隐藏算法。首先,为了高效地感知立体视频的时域质量和视点间质量 ,定义了时域相似尺度(TSM)、 视间相似尺度(ISM)的概念;将前一时刻右视点图像进行时域和视点间匹配,分别求取 其以像素为单位的TSM和 ISM映射图;然后,计算前一时刻右视点图像当前宏块的TSM和ISM值,通过比较得 到当前宏块的预测模式;最后,根据视频序列的时域一致性,将前一时刻右视点图像宏块 的预测模式作为丢失图像宏 块的预测模式,从而使用运动补偿预测(MCP)或者视差补偿预测(DCP )的方法恢复丢失信息。研究结果表明,与已有错误隐藏 算法相比,本文算法获得更好主客观视觉效果;同时与基于图像结构相似度(SSIM)的错误隐藏算法相比,在保持主观视觉质量情况下,错误隐藏时间节省20%左右。     

基于深度的虚拟视失真估计方法

提出一种基于深度的虚拟视失真估计方法,将深度图宏块划分为平坦宏块和非平坦宏块,结合各自特点分别用频域块级方法和时域像素级方法估计由深度失真引起的虚拟视失真。实验证明,该方法估计准确度较高,且复杂度比像素级模型有所降低。它对于提高深度视频编码效率和优化多视+深度(MVD)码率分配具有重要指导意义。     

立体视频右视点图像宏块丢失错误隐藏算法

根据宏块的运动特性,提出了一种立体视频右视 点图像宏块丢失的错误隐藏算法。根 据视点内时域相邻帧及 视点间相邻帧的相关性估计丢失宏块的运动静止特性,将丢失宏块分为运动块和静止块。对 于静止块,直接使用时 域帧拷贝的方法恢复;对于运动块,使用外边界匹配准则选择候选块并赋予相应的权重得到 加权候选块,根据最优 候选块和加权候选块的边界匹配值自适应地选择最优块或空域插值方法恢复丢失信息。实验 表明,本文算法提高了 隐藏图像的主客观质量。在不同量化参数(QP)和不同宏块丢包率(PLR) 的情况下,经本文算 法恢复后图像的峰值信噪比(PSNR)与普通JM算法相比,平均提高0. 77～3.22dB。     

一种用于多视视频加深度联合编码的错误隐藏算法

ATM(AVC-based test model)测试模型实现了多视视频加深度(MVD)格式的联合编码,使得数据的压缩效率更高。然而,较高的压缩效率使得码流对传输错误非常敏感,极易产生错误扩散现象。针对ATM测试模型的编码顺序,提出一种用于MVD联合编码的错误隐藏算法。算法充分利用视点内、视点间及纹理视频与深度视频间的相关性,针对每个视点的不同特征提出了适应其视频特性的不同隐藏算法。实验表明,本文提出的算法可以在不增加算法复杂度的情况下,有效提高视频的主客观质量。     

基于单深度帧内模式的3D-HEVC深度视频信息隐藏算法

针对三维(3D)视频系统中深度视频的安全问题,利 用一种全新的信息嵌入载体,提出 一种基于单深度帧内模式(single depth intra mode)的3D高效视频编码(3D-HEVC)深度视 频信息隐藏算法。首先,对采用单深度帧内模式编码的编码单元(CU)根据 相邻块重建像素构建像素候选列表,并比较候选列表中的两个像素值;然后,为增加算法的 安全性、保证 视频的质量,在像素值相等和不相等的情况下分别根据密钥和后续块的预测模式范围选择嵌 入块;最后, 根据隐秘信息对嵌入块候选列表所选像素的索引值进行LSB调制。实验结果表明,本文算 法平均每帧嵌入容 量为244bit,编码重建深度视频绘制视点质量的峰值 信噪比(PSNR)值和结构相似度(SSIM)值仅分别平均下降1.41×10－3 dB和6×10－6,码率平均增长0.12%,可见本文算法对3D视频的主观感知质量及码率影响很小。     

基于转移概率的多视点视频快速模式选择算法

针对多视点视频编码(MVC)中部分大宏块模式(SKI P/DIRECT模式,帧间16×16模式)相对于其它模式的计算复杂 度低,并且在编码所确定的最优模式中占有相当高比重的特点,本文提出一种基于转移概率 的多视点视频 快速模式选择算法。首先根据多视点视频当前编码宏块对应时间和视点间宏块及周围宏块的 位置几何关系, 建立宏块模式参考模型;其次比较参考模型中模式的时间相似度和视点间相似度;最后计算 模式之间的转 移概率,确定提前结束大宏块模式选择过程的阈值。实验结果表明,本文所提出的快速算法 平均节约MVC时间80.93%,编码质量平均下降0.04dB,码率平均增加0.27%。     

结合深度信息的多视点视频编码快速模式选择算法

多视点视频加深度(MVD,multi-view video plus depth)的编码格式包含多个纹理视频序列及其对应的深度图,深度图与对应的纹理视频具有相似的边缘信息。传统的编码模式不考虑两者的联系,单独编码导致复杂度高、编码时间过长。因此,合理利用深度图与纹理图的相似性进行编码,可以有效降低编码复杂度,同时应该确保编码质量不受影响。本文利用深度图的这一特点辅助纹理视频的编码,提出一种帧间快速模式选择算法,充分利用深度图与纹理图之间的相似性,建立一种联合复杂度模型,根据模型得到每个宏块的复杂度。对于复杂度低的宏块,在计算率失真代价之前跳过编码中一些不必要的模式,从而降低编码复杂度。实验表明,本文提出的快速模式选择算法,在保证率失真性能基本不变的情况下,能减少60.57%的编码复杂度,并最高能减少80.64%的编码时间。     

一种基于FPGA的通用实时差错隐藏算法

整帧图像丢失和部分宏块数据丢失是视频通信中的两种常见现象.由于差错隐藏原理不同,现有算法只能分别处理这两种差错,不利于硬件统一实现.文中通过改进基于光流理论的差错隐藏算法,在处理整帧图像丢失的算法框架中融合处理部分宏块丢失的算法,提出了一种能处理这两种情况的通用差错隐藏算法,并针对FPGA实时处理要求进行了算法优化.仿真结果表明在差错隐藏性能方面,该算法优于H.264参考算法.     

联合彩色信息的多视点深度视频视差矢量预测

多视点加深度(MVD)格式可以利用虚拟视点绘制技术生成任意视点的视频,能高效地向观看者提供立体感知。由于MVD中的深度视频与对应的彩色视频采集于同一场景,具有高度的相关性。因此,深度视频可以利用已编码的彩色信息辅助编码。提出一种联合彩色信息的多视点深度视频视差矢量预测方法。该方法首先获得当前编码深度块对应位置的彩色块,提取彩色块预测得到的视差矢量作为深度块的一个候选视差矢量。然后,利用深度块信息计算得到另一个候选视差矢量。最后,对两个候选视差矢量通过计算下采样均方差,选择更精确的一个作为当前深度块的视差矢量预测值。实验结果表明,所提出的方法性能优于3D-HEVC编码平台HTM。     

基于动态多阈值的多视点视频编码宏块模式快速选择算法

本文分析了多视点视频编码中宏块模式选择情况的统计特性,把宏块模式分为四类.提出了基于宏块模式类率失真均值的多阈值快速宏块模式选择算法及阈值的近似计算方法和动态更新算法,理论分析了该快速算法的编码率失真性能.实验结果表明,所提出快速算法在几乎不影响编码率失真性能的情况下,编码速度比多视点视频编码校验模型提高1.92倍到7.07倍.     

Multiframe error concealment for MPEG-coded video delivery over error-prone networks

Compressed video sequences are very vulnerable to channel disturbances when they are transmitted through an unreliable medium such as a wireless channel. Transmission errors not only corrupt the current decoded frame, but they may also propagate to succeeding frames. A number of post-processing error concealment (ECN) methods that exploit the spatial and/or temporal redundancy in the video signal have been proposed to combat channel disturbances. Although these approaches can effectively conceal lost or erroneous macroblocks (MBs), all of them only consider spatial and/or temporal correlation in a single frame (the corrupted one), which limits their ability to obtain an optimal recovery. Since the error propagates to the next few motion-compensated frames in the presence of lost MBs in an I or P frame, error concealment should simultaneously minimize the errors not only in the current decoded frame but also in the succeeding B and P frames that depend on the corrupted frame. We propose a novel multiframe recovery principle which analyzes the propagation of a lost MB into succeeding frames. Then, MPEG-compatible spatial and temporal error concealment approaches using this multiframe recovery principle are proposed, where the lost MBs are recovered in such a way that the error propagation is minimized.     

面向三维高效视频编码的深度图错误隐藏

基于多视点视频序列视点内、视点间存在的相关性,并结合视点间运动矢量共享技术,该文提出一种面向3维高效视频编码中深度序列传输丢包的错误隐藏算法。首先,根据3D高效视频编码(3D-HEVC)的分层B帧预测(HBP)结构和深度图纹理特征,将深度图丢失块分成运动块和静止块;然后,对于受损运动块,使用结合纹理结构的外边界匹配准则来选择相对最优的运动/视差矢量进行基于位移矢量补偿的错误掩盖,而对受损静止块采用参考帧直接拷贝进行快速错误隐藏;最后,使用参考帧拆分重组来获取新的运动/视差补偿块对修复质量较差的重建块进行质量提升。实验结果表明:相较于近年提出的对比算法,该文算法隐藏后的深度帧平均峰值信噪比(PSNR)能提升0.25～2.03 dB,结构相似度测量值(SSIM)能提升0.001～0.006,且修复区域的主观视觉质量与原始深度图更接近。     

Edge adaptive upsampling of depth map videos for enhanced free-viewpoint video quality

Quality enhancement of free-viewpoint videos is addressed for 3D video systems that use the colour texture video plus depth map representation format. More specifically, a novel and efficient shape adaptive filter is presented for upsampling depth map videos that are of lower resolution than their colour texture counterparts. Either measurement or estimation of depth map videos can take place at lower resolution. At the same time, depth map reconstruction takes place at low resolution if reduced resolution compression techniques are utilised. The proposed design is based on the observation that significant transitions in depth intensity across depth map frames influence the overall quality of generated free-viewpoint videos. Hence, sharpness and accuracy in the free-viewpoint videos rendered using 3D geometry via depth maps, especially across object borders, are targeted. Accordingly, significant enhancement of rendered free-viewpoint video quality is obtained when the proposed method is applied on top of MPEG spatial scalability filters.     

采用灰度共生矩阵进行深度预判的3D-HEVC深度图帧内快速编码算法

针对3D视频的3D-HEVC编码标准以多视点纹理视频和深度视频格式进行编码,其深度图编码仍延续纹理视频编码的模式和编码尺寸遍历选择,使得3D-HEVC的编码复杂度居高不下。本文针对深度图帧内预测编码,采用灰度共生矩阵对深度图中的CTU进行计算,统计并分析其矩阵中非零值个数与CTU分割深度的关系,根据非零值个数分布规律,设定阈值,使得帧内编码时可以预判编码模块的分割深度,从而选择性跳过部分不同深度CU的帧内预测过程。经过HTM16.0测试平台的检验,本算法在全帧内编码模式下,测试序列合成视点比特率仅增加0.08%的同时,平均节省了16.8%的编码时间,与其他同类较新算法在HTM16.0平台上的性能比较也有一定的优势。      

An effective GM/LM-based video error concealment

Error concealment (EC) techniques are often utilized at decoder side to improve reconstructed videos, in case of some information is lost during transmission on a wireless or band-width limited communication channel. In this paper, a global motion/local motion (GM/LM)-based error concealment method is proposed. First, the correct-macro-blocks (CMBs) are classified into global motion compensated MBs and local motion compensated MBs adaptively. Then, an erroneous MB (EMB) is classified into one of the three types: global motion MB (GMB), local motion MB (LMB), and global/local overlapping MB (GLMB) according to the MB type information in its neighbors. For the EMB with its type, GMB is recovered using the global motion vector (GMV). The EMB with its type LMB is recovered using the average motion vector information. And for the MB with its type GLMB, a recursive boundary matching strategy is utilized to search an optimal recovering motion vector. Experimental results show the effectiveness of the proposed GM/LM-based error concealment method.     

3D-HEVC深度图帧内编码快速算法

编码3D视频的3D-HEVC编码标准采用多视点加深度图的编码格式,新增的深度信息使编码复杂度剧增。本文针对编码块(Coding Unit,CU)的四叉树分割模型和帧内预测模式,提出了深度图帧内编码的快速算法。用Otsu’s算子计算当前CU的最大类间方差值,判断当前CU是否平坦,对平坦CU终止四叉树分割和减少帧内模式的遍历数目。根据子CU与上一层CU的相似性,利用已编码的上一层CU对提前终止CU分割算法做优化。本算法与原始3D-HEVC算法相比减少40.1%的编码时间,而合成视点的质量几乎无变化。      

Proposed dynamic error control techniques for QoS improvement of wireless 3D video transmission

Error control techniques like error resilience (ER) and error concealment (EC) are efficient techniques to ameliorate the lost macroblocks (MBs) in the 3D video (3DV) communication system. In this paper, we propose efficient and adaptive hybrid ER‐EC algorithms for 3DV transmission over error‐prone wireless channels. At the encoder, adaptive preprocessing ER mechanisms are proposed through using the context adaptive variable length coding entropy, slice structured coding modes, and explicit flexible macroblock ordering mapping. They are used to assist the suggested EC techniques at the decoder to accurately reconstruct the erroneous MBs and frames. At the decoder, an efficient postprocessing EC technique with multiproposition methods is proposed to dynamically select the convenient EC hypothesis method based on the size of the lost MBs, the faulty view, and the frame type. It conceals the received erroneous MBs of intra‐encoded and inter‐encoded frames of the transmitted 3DV by exploiting the temporal, spatial, and inter‐view correlations among frames and views. To further improve the decoded 3DV quality, a weighted overlapping block motion and disparity compensation technique is used to reinforce the performance of the suggested ER‐EC techniques. Experimental results on various 3DV streams prove that the suggested techniques have considerably acceptable subjective and objective 3DV performance. They achieve an improved average peak signal‐to‐noise ratio gain by almost 2.85 dB compared to the conventional error control algorithms at a packet loss rate = 40%.     

Fast intra mode decision for depth coding in 3D-HEVC

The emergent 3D High Efficiency Video Coding (3D-HEVC) is an extension of the High Efficiency Video Coding (HEVC) standard for the compression of the multi-view texture videos plus depth maps format. Since depth maps have different statistical properties compared to texture video, various new intra tools have been added to 3D-HEVC depth coding. In current 3D-HEVC, new intra tools are utilized together with the conventional HEVC intra prediction modes for depth coding. This technique achieves the highest possible coding efficiency, but leads to an extremely high computational complexity which limits 3D-HEVC from practical applications. In this paper, we propose a fast intra mode decision algorithm for depth coding in 3D-HEVC. The basic idea of the proposed algorithm is to utilize the depth map characteristics to predict the current depth prediction mode and skip some specific depth intra modes rarely used in 3D-HEVC depth coding. Based on this analysis, two fast intra mode decision strategies are proposed including reduction of the number of conventional intra prediction modes, and simplification of depth modeling modes (DMMs). Experimental results demonstrate that the proposed algorithm can save 30 % coding runtime on average while maintaining almost the same rate-distortion (RD) performance as the original 3D-HEVC encoder.