2D视频转换3D视频技术概览

传统的数字高清2D电视已经不能满足人们对视频逼真感的追求,人们需要在观看视频时有一种真切的身临其境的感觉,于是代表下一代数字电视发展趋势的自然三维电视(three-dimensional TV:3DTV)便应运而生了.3DTV的显示离不开合适内容的制作.而由于目前大量传统2D视频的存在,对2D转3D技术的研究有着更为现...     

制作三星D508专用视频

三星D508支持3GP格式的影片播放,当然也要充分利用了,如果要欣赏画质和速度都还不错的视频,就需要一些小技巧了。我们可以利用一个视频转换软件Xenon来转换,下载地址是:http://www.sdjtu.edu. cn/jeikecn/Xenon.rar。压缩包里有补丁文件,安装好后复制exe文件到安装目录。很多读者都反映转换后的视频在D508 上无法播放,或者是播放出来效果不好,不流畅,其实转换的关键在于视频与音频的设置。正确的设置后转换出的视频才能在D508上流畅播放。     

巴可推出3D LED视频屏幕墙

巴可借助其控制室可视化解决方案和3D立体显示领先地位,开发全新系列LED投影显示单元。OLS系列融合屡获大奖的OL系列的优势和逼真3D立体显示技术,新系列适用于控制室和模拟仿真市场,为需要显示立体图像的视频屏幕墙提供灵活、高性价比且可扩展的解决方案。OLS系列于2011年10月9～13日在迪拜GITEX科技周上首次亮相。     

改进的3D DCT视频编码方案

文中详细研究了离散余弦变换（DCT）的原理及统计特性,提出一种改进的3D DCT的视频编码方案。该算法在不影响信噪比的情况下,运算量减少了1/7,且编码与解码的运算量相当。     

基于Android的3D视频播放器

随着科学技术的不断进步,传统的2D显示已经不能完全满足人们对视频透视感和环绕感的需求,3D应用越来越广泛。现今Android作为主流的平板和手机的操作系统为人们所使用,在Android系统上提供3D应用将是不错的选择。本文首先详细介绍2D图像转化为3D图像的基本原理,然后介绍基于Android的3D视频播放器模块的实现。经验证,本文提供的基于Android的3D视频播放器可以较高效的进行2D视频转化为3D视频并播放。     

3D视频的错误隐藏快速算法

具有独特编码结构的3D视频在不可靠信道上传输时遭遇丢包后极易造成错误传播,因此研究基于3D视频的错误隐藏技术十分必要。而且,压缩后传输的3D视频数据量仍然较大,这对解码器的解码速度提出了很高的要求。如何在解码端加速进行错误隐藏是研究重点,通过快速定位静止宏块的方法加速错误隐藏速度。实验结果表明该算法在保证不降低视频的主、客观质量的同时,能有效地降低错误隐藏算法的复杂度。     

高速视频A／D转换器的研究进展

介绍了当前视频Ａ／Ｄ转换器的研究进展，详细分析了各种主流结构的原理和工作方式，并指出了它们各自的优势和不足之处。最后，总结了视频Ａ／Ｄ转换器的未来发展趋势。     

Key-frame-based depth propagation for semi-automatic stereoscopic video conversion

In this paper, we propose a key-frame-based bi-directional depth propagation algorithm for semi-automatic 2D-to-3D stereoscopic video conversion. First, key-frames are identified from each video shot based on color motion-compensation errors to prevent high-motion content between any pair of consecutive key frames. Depths for key-frames are manually assigned or rendered by popular computer tools, and then bi-directionally propagated to non-key-frames there between. Our depth propagation algorithm is featured of a multi-pass error correcting procedure for each frame to prevent depth artifacts from being further propagated to adjacent frames. Our proposed algorithm is advantageous in solving the background occlusion/dis-occlusion problem that degrades the performances of traditional depth propagation algorithms. Experimental results show that our scheme is capable of achieving better results against three prior algorithms in view of the qualities of the estimated depth map (e.g., dis-occluded background and object boundaries) and the synthesized stereo views.     

对象引导的单幅散焦图像深度提取方法

2D图像转3D图像是解决3D影视内容缺乏的主要手段之一,而深度提取是其中的关键步骤.考虑到影视作品中存在大量散焦图像,提出单幅散焦图像深度估计的方法:首先通过高斯卷积将散焦图像转换成两幅模糊程度不同的图像;其次计算这两幅图像在边缘处的梯度幅值比例,进而根据阶跃信号与镜头的卷积模型得到边缘处的模糊度;再次将边缘处的模糊度转换成图像的稀疏深度并利用拉普拉斯矩阵插值得到稠密深度图;最后通过图像的视觉显著度提取前景对象,建立对象引导的深度图优化能量模型,使前景的深度趋于一致并平滑梯度较小区域的深度.该方法利用对象引导的深度优化,剔除了拉普拉斯矩阵插值引入深度图的纹理信息.模拟图像的峰值信噪比和真实图像的视觉对比均表明该算法比现有方法有较大改善.     

具有容错能力的L1最优化半自动2D转3D

半自动2D转3D的关键是将用户分配的稀疏深度转换为稠密深度.现有方法没有充分考虑纹理图像和深度图之间的结构差异,以及2D转3D对用户误标注的容错性.针对上述问题,借助L₁范数对异常数据的抵制,在一个统一框架下实现结构相关具有容错能力的稀疏深度稠密插值.首先,利用L₁范数表示估计深度和用户分配深度在标注位置的差异,建立数据项;其次,根据特征的相似性用L₁范数计算局部相邻像素点之间的深度差异,建立局部正则项;再次,对图像进行超像素分割,根据不同超像素内代表性像素点之间深度差异的L₁测度,建立全局正则项;最后,用上述数据项和正则项构建能量函数,并通过分裂Bregman算法予以求解.无误差和有误差情况下的实验结果表明,与边缘保持的最优化插值、随机游走、混合图割与随机游走、软分割约束的最优化插值和非局部化随机游走相比,本文估计深度图绘制的虚拟视点图像空洞和伪影损伤更小.在误操作情况下,本文比上述方法PSNR改善了0.9dB以上,且在视觉上屏蔽了用户误操作的影响.     

Physics-based ball tracking and 3D trajectory reconstruction with applications to shooting location estimation in basketball video

The demand for computer-assisted game study in sports is growing dramatically. This paper presents a practical video analysis system to facilitate semantic content understanding. A physics-based algorithm is designed for ball tracking and 3D trajectory reconstruction in basketball videos and shooting location statistics can be obtained. The 2D-to-3D inference is intrinsically a challenging problem due to the loss of 3D information in projection to 2D frames. One significant contribution of the proposed system lies in the integrated scheme incorporating domain knowledge and physical characteristics of ball motion into object tracking to overcome the problem of 2D-to-3D inference. With the 2D trajectory extracted and the camera parameters calibrated, physical characteristics of ball motion are involved to reconstruct the 3D trajectories and estimate the shooting locations. Our experiments on broadcast basketball videos show promising results. We believe the proposed system will greatly assist intelligence collection and statistics analysis in basketball games.     

Cross-layer optimized authentication and error control for wireless 3D medical video streaming over LTE

3D video for tele-medicine applications is gradually gaining momentum since the 3D technology can provide precise location information. However, the weak link for 3D video streaming is the necessary wireless link of the communication system. Neglecting the wireless impairments can severely degrade the performance of 3D video streaming that communicates complex critical medical data. In this paper, we propose systematic methodology for ensuring high performance of the 3D medical video streaming system. First, we present a recursive end-to-end distortion estimation approach for MVC (multiview video coding)-based 3D video streaming over error-prone networks by considering the 3D inter-view prediction. Then, based on the previous model, we develop a cross-layer optimization scheme that considers the LTE wireless physical layer (PHY). In this optimization, the authentication requirements of 3D medical video are also taken into account. The proposed cross-layer optimization approach jointly controls and manages the authentication, video coding quantization of 3D video, and the modulation and channel coding scheme (MCS) of the LTE wireless PHY to minimize the end-to-end video distortion. Experimental results show that the proposed approach can provide superior 3D medical video streaming performance in terms of peak signal-to-noise ratio (PSNR) when compared to state-of-the-art approaches that include joint source-channel optimized streaming with multi-path hash-chaining based-authentication, and also conventional video streaming with single path hash-chaining-based authentication.     

Semi-automatic 2D-to-3D video conversion based on background sprite generation

This paper presents a technique for semi-automatic 2D-to-3D stereo video conversion, which is known to provide user intervention in assigning foreground/background depths for key frames and then get depth maps for non-key frames via automatic depth propagation. Our algorithm treats foreground and background separately. For foregrounds, kernel pixels are identified and then used as the seeds for graph-cut segmentation for each non-key frame independently, resulting in results not limited by objects’ motion activity. For backgrounds, all video frames, after foregrounds being removed, are integrated into a common background sprite model (BSM) based on a relay-frame-based image registration algorithm. Users can then draw background depths for BSM in an integrated manner, thus reducing human efforts significantly. Experimental results show that our method is capable of retaining more faithful foreground depth boundaries (by 1.6–2.7 dB) and smoother background depths than prior works. This advantage is helpful for 3D display and 3D perception.     

软分割约束边缘保持插值的半自动2D转3D

半自动2D转3D将用户标注的稀疏深度转换成稠密深度,是解决3D片源不足的主要手段之一.针对现有方法利用硬分割增强深度边缘引入误差的问题,提出像素点与超像素深度一致性约束的边缘保持插值方法.首先,建立像素点深度和超像素深度传播的能量模型,通过像素点与所属超像素间深度差异的约束项将二者关联起来;其次,利用矩阵表示形式将两个能量模型的最优化转换成一个稀疏线性方程组的求解问题.通过超像素提供的约束项,可避免深度传播穿过低对比度边缘区域,从而能保持对象边缘.实验结果表明,本文方法对象边缘处深度恢复的准确性优于融合图割的随机游走方法,PSNR改善了1.5dB以上.     

Shape transformer nets: Generating viewpoint-invariant 3D shapes from a single image

Single-view 3D shapes generation has achieved great success in recent years. However, current methods always blind the learning of shapes and viewpoints. The generated shape only fit the observed viewpoints and would not be optimal from unknown viewpoints. In this paper, we propose a novel encoder–decoder based network which contains a disentangled transformer to generate the viewpoint-invariant 3D shapes. The differentiable and parametric Non-uniform B-spline (NURBS) surface generation and 3D-to-3D viewpoint transformation are incorporated to learn the viewpoint-invariant shape and the camera viewpoint, respectively. Our new framework allows us to learn the latent geometric parameters of shapes and viewpoints without knowing the ground truth viewpoint. That can simultaneously generate camera-viewpoint and viewpoint-invariant 3D shapes of the object. We analyze the effects of disentanglement and show both quantitative and qualitative results of shapes generated at various unknown viewpoints.     

AVS 3D Video Coding Technology and System

Following the success of the audio video standard(AVS) for 2D video coding,in 2008,the China AVS workgroup started developing 3D video(3DV) coding techniques.In this paper,we discuss the background,technical features,and applications of AVS 3DV coding technology.We introduce two core techniques used in AVS 3DV coding:inter-view prediction and enhanced stereo packing coding.We elaborate on these techniques,which are used in the AVS real-time 3DV encoder.An application of the AVS 3DV coding system is presented to show the great practical value of this system.Simulation results show that the advanced techniques used in AVS 3DV coding provide remarkable coding gain compared with techniques used in a simulcast scheme.     

Synchronous 2D/3D Switching System for Service‐Compatible 3DTV Broadcasting

This paper proposes a new broadcasting system for the service‐compatible 3DTV in which the 3D service can coexist with the conventional digital TV broadcast. In the proposed system, the commercial 3DTV service can be implemented via the existing DTV channel without utilizing the dedicated 3DTV system. This 2D/3D system interworks with the conventional system and can switch to 2D or 3D service according to the broadcast programming and schedule. The system also provides a mechanism that can prevent the synchronization mismatch between left and right video streams and between the stream and the associated signaling in the 2D/3D transition periods. The picture quality measurements are carried out based on the ITU‐R recommended test to check the level of quality of service provided by the proposed scheme. The conformity tests are also performed with the conventional channel and the receiver for the DTV system to confirm the feasibility of the proposed one for the commercial service.