超多视点的大视角光场三维显示方法

针对传统自由立体显示技术视点数目少和视角窄的问题,提出一种超多视点的大视角光场三维(3D)显示方法.基于集成成像全视差光场构建原理,该方法利用大节距的非连续柱透镜阵列(DLLA)以特定的水平方向角将基元图像(EI)中所有平面像素发出的光线进行水平调制,在大视角范围内构建出水平方向密集排列的超多视点.此外,对DLLA进行光学成像优化设计以抑制像差,保证高质量3D成像.在实验部分,利用分辨率为1280 pixel×720 pixel的54 inch(1 inch=2.54 cm)发光二极管(LED)显示器实现了视角为42.8°、视点数目为100的水平光场3D显示效果,且3D成像的畸变率为2.23％,呈现的3D影像具有连续的运动视差和自然的深度信息表达,这些结果验证了本文方法的优越性和可行性.     

3D自由视点视频技术及其在中国馆中的应用

阐述了3D自由视点视频应用系统相关的关键技术,包括显示、内容获取与生成、编解码重构等,并对大屏幕3D自由视点视频技术在2010年上海世博会中国国家馆中的成功应用作了简要介绍。     

基于光栅的手机多视点立体显示技术研究

研究了基于多视点立体视频处理系统的手机客户终端显示技术。针对现有的8视点光栅立体手机显示技术的缺陷,在原有8视点立体图像合成算法的基础上,研究视差原理及校正方法和视点配对原理,采用调整视点间视差和减少视点数两种解决方案,并提出将两种方案进行结合的方法。经实验验证,本文提出的两种方法在保证原有立体显示效果的基础上,大幅度提高了立体显示的舒适度。     

交互式立体显示中基于图像拼合的视点合成

在立体显示中,视点合成是实现交互性的关键技术,即在三维(3D)场景中通过自由选择视点而获得环视能力.本文将视点插值和基于图像拼合的视点变形技术相结合,提出一种中间视合成算法.首先均匀化原始立体图像对;然后只对前景对象区域进行视差估计以提高视差匹配的速度和精度;接着确定左右视点中的可靠区域,根据可靠区域生成过渡中间视点;最后,采用视点插值结合变形的方法,由过渡视合成中间视点.实验结果表明合成的中间视点图像质量良好,而且合成速度也明显提高.本文算法可用于实时 3D 视频应用的交互式立体显示,可以实现任意视点的实时绘制.     

光栅式自由立体显示器概述

文章介绍了光栅式自由立体显示器的结构及原理,分析了影响其立体效果及性能的因素,如人眼调节和会聚特性、多视点技术、亮度及分辨率损失、串扰、2D／3D切换及兼容性等,并简要介绍了相应的提高立体显示效果的方法。     

基于多视点立体角度模型的相关研究

多视点立体视角是FTV(Free-viewpoint TV)多视点采集/立体显示的关键因素,该文建立了多视点立体视角的数学模型。根据此模型获得了制约立体角度的相关因素,并定量模拟出用水平摄像机阵列拍摄物体时,拍摄距离与立体视角的关系;进一步根据人眼最大融合极限求出可防止产生重影、双轮廓的最大立体角与拍摄距离和观看距离之间的关系。最后导出立体角度与视点数之间的制约关系。仿真实验验证了所得结果的正确性。该文结果可为优化自由视点多视采集/立体显示系统提供理论依据。     

多视点与深度视频编码技术研究综述

多视点与深度视频(MVD)可以有效表示自由视点视频,减少了需传输视点的个数,该表达形式正受到越来越多的关注,如何对MVD进行高效编码尤为重要.介绍了自由视点视频的发展现状及国内外研究概况,详细讨论了深度图像的高效编码技术及多视点与深度联合编码技术,并对多视点与深度视频编码技术进行了总结及展望.     

面向光场显示的虚拟视点生成技术进展

随着元宇宙产业的发展，光场显示技术因其可以将数字世界与物理世界完美融合，已经成为信息显示技术领域的研究热点，并呈现出视点数量更多、视点密度更大、渲染速度更快的发展趋势。然而，现有的光场显示技术面临着分辨率低、深度受限、视疲劳等多种挑战。本文从人眼立体视觉感知原理出发，对现有的双视点、多视点和超多视点光场显示技术的成像原理和典型方案进行整理和总结。同时，对现有基于单信源和多信源虚拟视点生成技术进行归纳对比，着重分析各项技术在虚拟视点生成质量和渲染速度等方面的可行性和实现效率，并对光场显示技术的未来发展方向进行了展望。     

立体视频编码技术的专利申请分析

立体视频编码技术通过挖掘多个视点之间的时空相关性对立体视频进行编码,以提高传输和存储性能,是目前电视技术的研究热点。关注立体视频编码技术的专利申请,基于CPRSABS(中国专利检索系统文摘数据库)和VEN(虚拟外文数据库)数据库中3D编码技术领域的专利文献,从年度申请数量、申请人总体情况、公司方面专利情况以及科研院所方面的专利情况进行多角度分析,并总结关于3D编码的专利申请特点。     

基于棱镜反射光栅的低串扰自由立体投影显示方法

为解决传统柱透镜自由立体投影显示中像差和视几何引起的串扰和视点数受限问题,基于回归反射,提出了一种棱镜反射光栅自由立体投影显示方法。通过分析其3D成像的原理,对棱镜反射光栅自由立体投影显示进行仿真,发现该方法在水平视宽相同的条件下,视场照度是柱透镜光栅投影的10倍,而其串扰比是柱透镜光栅投影的1/5,且不存在次视区。制作了棱镜反射光栅屏,并搭建系统进行实验,验证了棱镜反射光栅自由立体投影显示方案的可行性。     

Android系统立体视频播放关键技术研究

为了解决立体视频在Android系统上的播放问题,对在Android系统进行立体视频播放的关键技术进行了研究.与传统2D视频播放器相比,立体视频播放器的关键技术是立体视频解码和立体视频显示.文中对这两种关键技术的实现方法进行了详细阐述,并据此开发了一款立体视频播放器.该立体视频播放器,支持常见的左/右、上/下格式立体视频,有7种视频显示方式可供选择.该视频播放器在Android 2.3系统的平板电脑上进行了测试,测试结果表明在Android系统上播放立体视频的基本功能均已实现,可以供用户使用.     

Real-time generation of multi-view video plus depth content using mixed narrow and wide baseline

Content production for stereoscopic 3D-TV displays has become mature in the past years while huge progress has also been achieved in the improvement of the image quality of glasses-free auto-stereoscopic displays and light-field displays. Concerning the latter two display families, the content production workflow is less elaborated and more complex, as the number of required views not only differs considerably but is also likely to increase in the near future. As a co-existence of all 3D display families can be expected for the next years, one aims to establish an efficient content production workflow which yields to high quality content for all 3D-TV displays.Against this background we present a real-time capable multi-view video plus depth (MVD) content production workflow based on a four-camera rig with mixed narrow and wide baseline. Results show the suitability of the approach to simultaneously produce high quality MVD4 and native stereoscopic 3D content.     

Architectures for multi-threaded MVC-compliant multi-view video decoding and benchmark tests

3D video based on stereo/multi-view representations is becoming widely popular. Real-time encoding/decoding of such video is an important concern as the number and spatial/temporal resolution of views increase. We present a systematic method for design and optimization of multi-threaded multi-view video encoding/decoding algorithms using multi-core processors and provide benchmark results for real-time decoding. The proposed multi-core decoding architectures are compliant with the current MVC extension of H.264/AVC international standard, and enable multi-threaded processing with negligible loss of encoding efficiency and minimum processing overhead. Benchmark results show that multi-core processors and multi-threading decoding are necessary for real-time high-definition multi-view video decoding and display.     

Multi-stream 3D video distribution over peer-to-peer networks

The recent advances in stereoscopic video capture, compression, and display have made 3-dimensional (3D) video a visually appealing and costly affordable technology. There have been a series of pioneer works on streaming 3D video over the Internet. Yet the remarkably increased data volume of 3D videos poses great challenges to the conventional client/server design, which has already suffered from supporting 2D videos.In this paper, we present an initial attempt toward efficient streaming of 3D videos over a peer-to-peer network. We show that the inherent multi-stream nature of 3D video makes playback synchronization more difficult, which is particularly acute with the existence of multiple senders in a peer-to-peer overlay. We address this by a novel 2-stream 2-stage buffer design, together with weighted data scheduling and light-weight synchronization. We further discuss a series of key practical issues toward implementing our peer-to-peer 3D video streaming system, including the weight modeling for data segments, the interactions with the RTP/RTCP protocol stack, and the inter-operability with monoscopic video as well as extension to multi-view video. We have evaluated the performance of our system under different end-system and network configurations with typical 3D video streams. The simulation results demonstrate the superiority of our system in terms of both scalability and streaming quality.     

End-to-end stereoscopic video streaming with content-adaptive rate and format control

We address efficient compression and real-time streaming of stereoscopic video over the current Internet. We first propose content-adaptive stereo video coding (CA-SC), where additional coding gain, over that can be achieved by exploiting only inter-view correlations, is targeted by down-sampling one of the views spatially or temporally depending on the content, based on the well-known theory that the human visual system can perceive high frequencies in three-dimensional (3D) from the higher quality view. We also developed stereoscopic 3D video streaming server and clients by modifying available open source platforms, where each client can view the video in mono or stereo mode depending on its display capabilities. The performance of the end-to-end stereoscopic streaming system is demonstrated using subjective quality tests.     

A Stereoscopic Video Generation Method Using Stereoscopic Display Characterization and Motion Analysis

Stereoscopic video generation methods can produce stereoscopic content from conventional video filmed with monoscopic cameras. In this paper, we propose a stereoscopic video generation method using motion analysis which converts motion into disparity values and considers multi-user conditions and the characteristics of the display device. The field of view and the maximum and minimum disparity values were calculated in the stereoscopic display characterization stage and were then applied to various types of 3D displays. After motion estimation, we used three cues to decide the scale factor of motion-to-disparity conversion. These cues were the magnitude of motion, camera movements and scene complexity. A subjective evaluation showed that the proposed method generated more satisfactory video sequence.     

一种基于立体视觉显著性的多视点视频比特分配方法

针对多视点立体视频压缩编码,提出了一种基于立 体视觉显著性的比 特分配方法。研究综合利用多视点立体视频数据中场景的运动、深度以及深度边缘信息提取 人眼感兴趣区 域(ROI)的方法;然后根据ROI的划分结果优化区域比特分配。实验结果表 明,本文提出的算法能有效提 高ROI区域的编码性能,同时整体视频的率失真性能有一定程度的提高。