Computer-generated kinoforms of real-existing full-color 3D objects using pure-phase look-up-table method

A computational method based on pure-phase look-up-table (LUT) is proposed for generating kinoforms of full-color real-existing three-dimensional (3D) objects. The principle of the pure-phase LUT method is described. 3D depth as well as color information of a full-color 3D object is obtained by the full-color 3D profile measurement approach based on binocular vision. The obtained full-color 3D data is decomposed into red (R), green (G), and blue (B) channels, and kinoforms of each channel are calculated from the depth map and color information of the corresponding channel using the pure-phase LUT method. In order to reduce the speckle noise of reconstructed full-color 3D image, sequential kinoforms of each color channel are generated by adding dynamic-pseudorandom phase factor into the object domain. Numerical reconstruction and optical reconstruction with a phase-only spatial light modulator (SLM) show that, with the proposed method, full-color holographic 3D display of real-existing full-color 3D objects is available.     

面向真彩色三维显示的分层角谱算法和Gerchberg-Saxton算法研究

分层角谱算法可用于三维物体全息图的生成计算,在计算时间、占用内存和算法复杂度方面占有优势.本文基于强度图和深度图的分层角谱算法,对多波长采样进行分析,有效抑制混频现象,实现了真彩色物体的计算全息图生成.针对分层角谱算法重建时产生的散斑噪声问题,引入Gerchberg-Saxton(GS)算法,提出基于分层角谱算法的GS算法.通过计算比较引入GS算法前后再现像的均方根误差和峰值信噪比,证明该算法可有效地抑制散斑噪声,提高全息图的再现像质量,更适用于复杂形貌三维物体的计算.     

Depth map resolution improvement for 3D range-intensity correlation laser imaging

This Letter proposes a high bit-depth coding method to improve depth map resolution and render it suitable to human-eye observation in 3D range-intensity correlation laser imaging. In this method, a high bit-depth CCD camera with a nanosecond-scaled gated intensifier is used as an image sensor; subsequently two high bit-depth gate images with specific range-intensity profiles are obtained to establish the gray depth map and finally the gray depth map is encoded by an equidensity pseudocolor. With this method, a color depth map is generated with higher range resolution. In our experimental work, the range resolution of the depth map is improved by a factor of 1.67.     

ETM图像地物反射率光谱反演

用搭载在卫星Landsat-7上的多光谱成像仪ETM记录的来自地气系统的辐亮度光谱图像,反演地物反射率光谱,在ETM 1波段,反射率反演的不确定度基本上保证在17%以内,2,3波段在10%以内,优于目前常用的简易算法。用反演的地物辐亮度光谱合成的sRGB真彩色图像,清晰度欠佳,未作经验调整时明显偏色,用于航天对地真彩色摄影这一反演精度还不够,但用于目视判读明显优于原图像。     

Orthoscopic integral imaging display by use of the computational method based on lenslet model

In this paper, we propose a computational depth conversion method based on the lenslet model to display the orthoscopic 3D images in 3D integral imaging display. The proposed method permits the synthesis of elemental images for the orthoscopic 3D images at any arbitrary position without any restrictions and requires no additional procedure during the depth conversion process. Due to the lenslet model involved in the depth conversion procedure, the proposed method can broaden the flexibility of 3D image reconstruction in the integral imaging display system. We carry out the preliminary experiments to prove the feasibility of the proposed method. The experimental results reveal that the proposed method is an effective depth conversion method that allows the reconstruction of the orthoscopic 3D images at any arbitrary position.     

An improved edge detection algorithm for depth map inpainting

Three-dimensional (3D) measurement technology has been widely used in many scientific and engineering areas. The emergence of Kinect sensor makes 3D measurement much easier. However the depth map captured by Kinect sensor has some invalid regions, especially at object boundaries. These missing regions should be filled firstly. This paper proposes a depth-assisted edge detection algorithm and improves existing depth map inpainting algorithm using extracted edges. In the proposed algorithm, both color image and raw depth data are used to extract initial edges. Then the edges are optimized and are utilized to assist depth map inpainting. Comparative experiments demonstrate that the proposed edge detection algorithm can extract object boundaries and inhibit non-boundary edges caused by textures on object surfaces. The proposed depth inpainting algorithm can predict missing depth values successfully and has better performance than existing algorithm around object boundaries.     

A thin and compact compound-eye imaging system incorporated with an image restoration considering color shift, brightness variation, and defocus

A compact system of the thin observation module by bound optics (TOMBO) imager based on compound-eye imaging has been constructed to demonstrate its advantages over single-eye imaging systems such as thinner hardware. To reconstruct a high-resolution image from low resolution images captured by the compound-eye optics, we propose an image restoration scheme based on the iterative back-projection algorithm with depth map estimated from the disparities on the captured image. The scheme includes suppression of unit-by-unit color shift caused by the offset microlenses and the color filters on the commercial image sensors and deblurring of defocus by geometrical optics using the depth map. In the experiment, three-dimensional objects were captured by the TOMBO imager and reconstructed with the scheme. After the processing, the power spectrum of the captured image was improved by up to 19 dB, and the power spectrum of the effect of the color shift was reduced by 7 dB.     

真实场景的三维视频采集及显示

提出了一种真实场景三维视频采集及彩色显示的方法.设计了一种采用条纹投影的实时三维成像系统及采用液晶空间光调制器的实时全息彩色三维显示系统.在三维成像系统中采用π相移正弦条纹与编码图案结合实现绝对相位测量,从而可以测量孤立物体.同时对采用数字微镜的投影仪进行改造,实现高速投影,并与高速摄像机配合实现三维视频采集.首先利用实时三维成像系统同时获取三维场景的彩色强度像和距离像;然后根据这些三维成像数据, 设计和制作计算菲涅耳全息图;最后在实时全息彩色三维显示系统中再现.三维信息的采集和显示速度达到了60帧每秒.     

Three-dimensional color photon counting microscopy using Bayesian estimation with adaptive priori information

In this Letter, we propose a novel three-dimensional(3D) color microscopy for microorganisms under photonstarved conditions using photon counting integral imaging and Bayesian estimation with adaptive priori information. In photon counting integral imaging, 3D images can be visualized using maximum likelihood estimation(MLE). However, since MLE does not consider a priori information of objects, the visual quality of 3D images may not be accurate. In addition, the only grayscale image can be reconstructed. Therefore, to enhance the visual quality of 3D images, we propose photon counting microscopy using maximum a posteriori with adaptive priori information. In addition, we consider a wavelength of each basic color channel to reconstruct 3D color images. To verify our proposed method, we carry out optical experiments.     

Improved depth extraction method of 3D objects using computational integral imaging reconstruction based on multiple windowing techniques

This paper presents an improved depth extraction method of 3D objects using computational integral imaging reconstruction (CIIR) based on the multiple windowing models. The proposed method records 3D objects using the lenslet array; and it reconstructs multiple sets of slice images from multiple CIIR methods based on the different windowing models. A depth map is then extracted by a block matching algorithm among multiple set of slice images. A preliminary experiment is carried out to show the feasibility of the proposed method. Experimental results indicate the proposed method outperforms the previous method with two windowing models.     

Modified smart pixel mapping method for displaying orthoscopic 3D images in integral imaging

In this paper, we propose a modified smart pixel mapping (MSPM) method for displaying orthoscopic three-dimensional (3D) images with a function of depth control in integral imaging system. In the proposed MSPM, the depth-converted elemental image array (EIA) is obtained through the pixel mapping process and the image interpolation technique. The proposed method gives us the depth conversion at distances different from the position of 3D object and provides various types of EIAs using only an original EIA for orthoscopic images. To show the usefulness of the proposed method, we carry out the preliminary experiments and present the experimental results.     

Fresnel hologram reconstruction of complex three-dimensional object based on compressive sensing

Reconstruction the computer generated Fresnel hologram of complex 3D object based on compressive sensing （CS） is presented. The hologram is synthesized from a color image and the depth map of the 3D object. With the depth map, the intensity of the color image can be divided into multiple slices, which satisfy the condition of the sparsity of CS. Thus, the hologram can be reconstructed at different distances with corresponding scene focused using the CS method. The quality of the recovered images can be greatly improved compared with that from the back-propagation method. What＇s more, with the sub-sampled hologram, the image can be ideally reconstructed by the CS method, which can reduce the data-rate for transmission or storage.     

Holographic imaging of full-color real-existing three-dimensional objects with computer-generated sequential kinoforms

We propose a computational method for generating sequential kinoforms of real-existing full-color threedimensional (3D) objects and realizing high-quality 3D imaging.The depth map and color information are obtained using non-contact full-color 3D measurement system based on binocular vision.The obtained full-color 3D data are decomposed into multiple slices with RGB channels.Sequential kinoforms of each channel are calculated and reconstructed using a Fresnel-diffraction-based algorithm called the dynamicpseudorandom-phase tomographic computer holography (DPP-TCH).Color dispersion introduced by different wavelengths is well compensated by zero-padding operation in the red and green channels of object slices.Numerical reconstruction results show that the speckle noise and color-dispersion are well suppressed and that high-quality full-color holographic 3D imaging is feasible.The method is useful for improving the 3D image quality in holographic displays with pixelated phase-type spatial light modulators (SLMs).     

基于偏振测量的雾天图像场景分割

现有场景分割方法主要依赖于图像亮度、颜色和纹理等特征,然而在雾天图像中提取这些特征将变得困难且不稳定.基于此本文提出了适用于雾天图像场景分割的特征矢量,以及相应的特征提取算法.特征矢量由目标偏振度、深度和颜色三部分组成.特征提取算法分别为:用去相关的方法从图像偏振度分离出大气偏振度和目标偏振度;根据雾天退化模型和雾天图像偏振表示形式推导出场景深度信息;利用两幅偏振图像求出非偏振彩色图像,从而得到场景的颜色信息.将这些特征构成的特征矢量用于基于图的分割算法中,并从两个方面比较了仅使用颜色特征和使用本文特征矢量的分割结果.最后得出结论:对于雾天图像而言,这些特征比通常的颜色特征更加有效和鲁棒.     

Pixel-by-pixel absolute phase retrieval using three phase-shifted fringe patterns without markers

This paper presents a method that can recover absolute phase pixel by pixel without embedding markers on three phase-shifted fringe patterns, acquiring additional images, or introducing additional hardware component(s). The proposed three-dimensional (3D) absolute shape measurement technique includes the following major steps: (1) segment the measured object into different regions using rough priori knowledge of surface geometry; (2) artificially create phase maps at different z planes using geometric constraints of structured light system; (3) unwrap the phase pixel by pixel for each region by properly referring to the artificially created phase map; and (4) merge unwrapped phases from all regions into a complete absolute phase map for 3D reconstruction. We demonstrate that conventional three-step phase-shifted fringe patterns can be used to create absolute phase map pixel by pixel even for large depth range objects. We have successfully implemented our proposed computational framework to achieve absolute 3D shape measurement at 40 Hz.     

Fusion of 3D laser scanner and depth images for obstacle recognition in mobile applications

The problem of obstacle detection and recognition or, generally, scene mapping is one of the most investigated problems in computer vision, especially in mobile applications. In this paper a fused optical system using depth information with color images gathered from the Microsoft Kinect sensor and 3D laser range scanner data is proposed for obstacle detection and ground estimation in real-time mobile systems. The algorithm consists of feature extraction in the laser range images, processing of the depth information from the Kinect sensor, fusion of the sensor information, and classification of the data into two separate categories: road and obstacle. Exemplary results are presented and it is shown that fusion of information gathered from different sources increases the effectiveness of the obstacle detection in different scenarios, and it can be used successfully for road surface mapping.     

Investigation of resolution of the stereoscopic 3D images

Evaluation of 3D images is an important part of 3D display developments. In this paper, we propose an evaluation method which can reflect the characteristics of the stereoscopic 3D images in the depth direction. Perception of the depth planes is verified using a subjective evaluation method. Resolution of the stereoscopic 3D images which represents the distribution of the 3D images in the depth direction quantitatively is calculated and analyzed.     

基于小波概率估计的图像融合方法研究

在研究了已有的图像融合方法后,提出基于小波变换和最大似然概率估计(MLE)相综合的融合方法,利用概率估计融合模型,首先对不同的传感器图像进行小波分解,然后对相应的子带求解仿射变换参数,根据Bayes规则进行最大后验概率似然估计,得到估计子带系数,最后通过小波反变换得到融合图像.在仿射变换的假设条件下定义融合规则,更适合传感器图像具有局部相反对比度的情况,采用此方法对航空可见光图像和红外图像进行融合实验,其结果与采用其它方法进行了对比,表明该方法的有效性.     

Three-dimensional recognition of occluded objects by using computational integral imaging

We have proposed a method to recognize partially occluded three-dimensional (3D) objects by using 3D volumetric reconstruction integral imaging (II). An II system captures multiple perspectives of occluded objects by using a microlens array. The reconstruction of the occluded 3D scene and target recognition are done digitally to reduce the effects of the occlusion. To verify system performance, we have implemented an optimum filter for object recognition. Both two-dimensional (2D) images and 3D II volumetric reconstructed images are considered. The correlation results of occluded 3D images for volumetric reconstruction show substantial improvements compared with those for conventional 2D imaging of occluded images.