Stereoscopic depth perception survives significant interocular luminance differences

Abstract— The effects of interocular luminance differences on stereoscopic depth perception has been investigated. The stimuli were stereoscopic square‐shaped targets created from disparity embedded in a dynamic random‐dot stereogram, which eliminated other cues to depth perception. The results revealed that stereoscopic depth perception survived significant interocular differences in luminance levels, even up to differences of 60%, provided that display luminance was approximately 0.63 cd/m² or higher. In terms of design criteria, developers of stereo displays can use a fairly large range of interocular luminance levels and still induce good stereo depth perception.     

Human stereopsis.

This paper reviews much of the basic literature on stereopsis for the purpose of providing information about the ability of humans to utilize stereoscopic information under operational conditions. This review is organized around five functional topics that may be important for the design of many stereoscopic display systems: geometry of stereoscopic depth perception, visual persistence, perceptual interaction among stereoscopic stimuli, neurophysiology of stereopsis, and theoretical considerations. The paper concludes with the presentation of several basic ideas related to the design of stereoscopic displays.     

Depth perception for moving images shown on a large LED display with an aperture grille

Abstract— A type of depth illusion created by the use of an aperture grille is reported. When viewing a moving target through multiple slits, a movement with depth is perceived, which was originally reported (see Ref. 11). The binocular delay is considered to cause a virtual disparity between both perspective images with apparent movement. By using an LED display with an aperture grille as a stereoscopic display, perceived distance caused by a binocular delay has been measured. The measured distance is compared with the perceived distance for stereoscopic still images shown on a stereoscopic LED panel. The comparison supported that the binocular delay is converted into binocular disparity. Furthermore, pair‐comparison tests were conducted to investigate depth impressions. It was found that use of an aperture grille improves depth impression for a movie that was taken with a laterally moving camera.     

A method for reproducing apparent continuous depth in a stereoscopic display using “Depth‐Fused 3D” technology

Abstract— A new method that can present fine depth increments in a stereoscopic display is proposed. In typical stereoscopic displays, depth can be presented by binocular disparity, but binocular disparity of less than one pixel cannot be displayed because, in general, electronic displays have discrete pixels. We combined binocular disparity and modulation of the edge luminance in DFD (depth‐fused 3D) displays. In an experiment, the perceived depth could be continuously changed by modulating the edge luminance only. Therefore, continuous depth can be produced by combining binocular disparity and modulation of edge luminance distribution.     

Factors that affect depth perception in stereoscopic displays.

This study investigated several factors that affect depth perception in stereoscopic displays: half-image separation magnitude, separation direction (crossed vs. uncrossed), viewing distance, stimulus size, and exposure duration. The depth perceived under various combinations of levels of these factors was compared with depth predicted by the geometry of stereopsis. Perceived depth in the crossed-separation direction was frequently close to predictions, such that increases in separation and viewing distance produced appropriate increases in perceived depth. Depth in the uncrossed direction was frequently less than that predicted, especially for small stimuli presented at a long viewing distance, with a large half-image separation, and/or with a brief duration. Thus depth in both crossed and uncrossed directions equaled predictions only for large stimuli exposed for a long duration.     

Can movement parallax compensate lacking stereopsis in spatial explorative search tasks?

In an explorative task subjects were asked to track a line presented in combination with other confusing lines on a 3D display. 24 subjects performed the explorative task under three depth cue conditions which were: stereopsis, movement parallax or a combination of stereopsis and movement parallax (stereo and parallax).

Task performance was assessed by recording completion time and correctness of answer.

The combination of stereopsis and movement parallax gave rise to highest percentage of correct answers (84%), followed by the condition where movement parallax was the only depth cue (80%). Percentage of correct answers in both conditions was found to be significantly higher than it was in the condition with stereopsis (60%).

Mean completion time was about the same in the stereo and parallax condition and the stereopsis condition. Compared to the movement parallax condition both means were significantly decreased.

Accuracy in completing the task was found to be similar in 3D displays enabling movement parallax and in 3D displays presenting stereoscopic images.     

New 3-D display that can display 3-D images at long distances and that can control their 3-D positions using changing size as a cue to depth perception

This paper presents a new three-dimensional (3-D) display that can display 3-D images at long distances of tens or hundreds of meters in the depth direction and that can control their 3-D positions to meet new requirements for outdoor use. The proposed display uses changing size as a cue to depth perception, i.e., the smoothly expanding motion of virtual images formed with optical systems according to the forward movements of the users to display 3-D images at more distant positions in the depth direction than positions where virtual images are formed with optical systems because conventional 3-D displays that use binocular disparity are only able to display 3-D images at short distances in the depth direction. The feasibility of the proposed display was evaluated by subjective tests using a moving minivan in which observers viewed a test pattern that overlapped the real view ahead of the automobile observed through the windshield. The results obtained from the subjective tests revealed that the test pattern was observed at long distances over tens and hundreds of meters in the depth direction and that the position in the depth direction of the test pattern could be controlled by changing the rate at which the motion of the test pattern smoothly expanded. These results demonstrated that the proposed display was feasible.     

Visual comfort enhancement study based on visual attention detection for stereoscopic displays

Although numerous potential causes may lead to visual discomfort when viewing content on three‐dimensional (3D) displays, vergence–accommodation conflict is a particular cause of binocular parallax‐based stereoscopic displays, and it is unavoidable. Based on the study of 3D content visual attention, we proposed a novel stereoscopic depth adjustment method to improve the visual comfort and enhance perceived naturalness. The proposed method combined the 3D image saliency and specific viewing condition to establish a novel model for computing the optimum zero‐disparity plane of stereoscopic image. The results of perception experiments, focused on visual comfort and stereoscopic sensation, supported that the proposed method can significantly enhance stereoscopic viewing comfort and even can improve the stereoscopic sensation by insuring the 3D image fusion.     

Cross‐talk acceptability in natural still images for different (auto)stereoscopic display technologies

Abstract— One of the most annoying distortions in (auto)stereoscopic displays is probably cross‐talk, visible as double edges, which is mainly caused by an imperfect separation of left‐ and right‐eye images. For different types of three‐dimensional (3‐D) displays, cross‐talk is caused by different origins, which could result in different levels of perceived image distortion. To evaluate the influence of (auto)stereoscopic display technology on cross‐talk perception, optical measurements and subjective assessments were performed with three different types of 3‐D displays. It is shown with natural still images that the 3‐D display technology with the lowest luminance and contrast level tolerates the highest level of cross‐talk, while still maintaining an acceptable image‐quality level.     

Measurement of binocular disparity in polarized based stereoscopic display by using digital camera

This work presents an image displacement measurement by using a box pattern and the edge spread function analysis in the polarized based stereoscopic displays. The measurement determines to identify three factors (i.e., box size, image displacement, and spatial frequency response (SFR)) from the box patterns. The polarized based stereoscopic displays might sacrifice pixels for producing 3D images, which might produce errors in the image displacement and then affect the depth perception indirectly. Based on the measurement, the errors can be quantified by using the three factors. Owing to the light leakage distorting the edge spread function to obtain an inferior SFR, exactly how light leakage affects the edge spread function can be resolved on the basis of the SFR results, especially at a frequency (1/display pixel) of 1.9 in the case of the horizontal displacement. Light leakage also induces the error of the box height in even and odd intervals of the vertical displacements more than 2 pixels and 0.5 pixels, respectively. The image displacement measurement provides a simple and comprehensive means of evaluating the optical characteristics, disparity, and sharpness of the stereoscopic displays, via the three factors.     

Stereo Viewing and Virtual Reality Technologies in Mobile Robot Teleguide

The use of 3-D stereoscopic visualization may provide a user with higher comprehension of remote environments in teleoperation when compared with 2-D viewing, in particular, a higher perception of environment depth characteristics, spatial localization, remote ambient layout, faster system learning, and decision performance. Works in the paper have demonstrated how stereo vision contributes to the improvement of the perception of some depth cues, often for abstract tasks, while it is hard to find works addressing stereoscopic visualization in mobile robot teleguide applications. This paper intends to contribute to this aspect by investigating the stereoscopic robot teleguide under different conditions, including typical navigation scenarios and the use of synthetic and real images. This paper also investigates how user performance may vary when employing different display technologies. Results from a set of test trials run on seven virtual reality systems, from laptop to large panorama and from head-mounted display to Cave automatic virtual environment (CAVE), emphasized few aspects that represent a base for further investigations as well as a guide when designing specific systems for telepresence.      

Stereoscopic video images for telerobotic applications

This article addresses the use of stereoscopic images in teleoperated tasks. Depth perception is a key point in the ability to skillfully manipulate in remote environments. Displaying three‐dimensional images is a complex process but it is possible to design a teleoperation interface that displays stereoscopic images to assist in manipulation tasks. The appropriate interface for image viewing must be chosen and the stereoscopic video cameras must be calibrated so that the image disparity is natural for the observer. Attention is given to the calculation of stereoscopic image disparity, and suggestions are made as to the limits within which adequate stereoscopic image perception takes place. The authors have designed equipment for image visualization in teleoperated systems. These devices are described and their performance evaluated. Finally, an architecture for the transmission of stereoscopic video images via network is proposed, which in the future will substitute for current image processing devices. © 2005 Wiley Periodicals, Inc.     

Influence of 3‐D cross‐talk on qualified viewing spaces in two‐ and multi‐view autostereoscopic displays

Abstract— To estimate the qualified viewing spaces for two‐ and multi‐view autostereoscopic displays, the relationship between image quality (image comfort, annoying ghost image, depth perception) and various pairings between 3‐D cross‐talk in the left and right views are studied subjectively using a two‐view autostereoscopic display and test charts for the left and right views with ghost images due to artificial 3‐D cross‐talk. The artificial 3‐D cross‐talk was tuned to simulate the view in the intermediate zone of the viewing spaces. It was shown that the stereoscopic images on a two‐view autostereoscopic display cause discomfort when they are observed by the eye in the intermediate zone between the viewing spaces. This is because the ghost image due to large 3‐D cross‐talk in the intermediate zone elicits different depth perception from the depth induced by the original images for the left and right views, so the observer's depth perception is confused. Image comfort is also shown to be better for multi‐views, especially the width of the viewing space, which is narrower than the interpupillary distance, where the parallax of the cross‐talking image is small.     

Preferred and maximally acceptable color gamut for reproducing natural image content

Abstract— With the development of wide‐gamut display technology, the need is clear for understanding the required size and shape of color gamut from the viewers' perspective. To that end, experiments were conducted to explore color‐gamut requirements based on viewers' preferred level of chroma enhancement of standard‐gamut images. Chroma preferences were measured for multiple hues using single‐hue images, and a corresponding hue‐dependent preferred chroma enhancement was successfully applied to natural, multi‐hue images. The multi‐hue images showed overall success, though viewers indicated that reds could be decreased even further in colorfulness, and yellows could be increased, which may argue in favor of multi‐primary displays. Viewer preferences do vary within the population, primarily in overall chroma level, and the differences can be largely accounted for with a single parameter for chroma‐level adjustment that includes the preferred hue dependence. Image content dependencies were also found, but they remain too complex to model. The hue‐dependent chroma preference results can be applied to display design and color‐enhancement algorithms.     

Transformations for stereoscopic visual simulation

Stereoscopic display devices are now standard offerings for graphics workstations. These displays find application in medical, scientific, and engineering visualization. Several geometric models can be used to determine the projections for stereoscopic images. In some circumstances, however, the perceived image may be uncomfortable to view, or it may contain undesirable depth distortions. We present a geometric model for stereoscopic viewing that can accurately model most viewing situations. Using this model, the viewer comfortably perceives realistic size and depth relationships among objects in the stereoscopic image. We relate this model to human visual constraints, and develop the geometric transformations required to use this method on graphics workstations.     

Angular dependence of the performance of stereoscopic liquid‐crystal‐display (LCD) television using shutter glasses (SG)

Abstract— 3‐D cross‐talk typically represents the ratio of image overlap between the left and right views. For stereoscopic LCDs using shutter‐glasses technology, 3‐D cross‐talk for stereoscopic LCD TV with a diagonal size of 46 in. and vertical alignment (VA) mode was measured to change from 1% to 10% when the stereoscopic display is rotated around the vertical axis. Input signals consist of the left and right images that include patterns of different amounts of binocular disparity and various gray levels. Ghost‐like artifacts are observed. Furthermore, intensities of these artifacts are observed to change as the stereoscopic display is rotated about the vertical axis. The temporal luminance of the LCD used in stereoscopic TV was found to be dependent on the viewing direction and can be considered as one cause of the phenomenon of angular dependence of performance for stereoscopic displays.     

New technique of obtaining visually perceived positions of 3-D images using movements of users’ bodies

Three-dimensional (3-D) images are perceived as images that float in front of the screens of 3-D displays. Users should be able to interact with these images instantaneously and accurately in applications where their bodies actually seen by them interact with the images. However, conventional techniques using just binocular disparity are too slow and inaccurate. Therefore, we propose a new technique where the visually perceived positions of images are obtained from the body movements of users. The feasibility of this technique was evaluated in an experiment using the positions obtained from users as they reached out to touch the images. These positions were closer to the visually perceived positions of the images than those calculated from binocular disparity. These findings demonstrate the feasibility of the proposed technique for 3-D interactive applications.     

基于视差重映射的立体图像视觉舒适度提升

目的 针对人眼观看立体图像内容可能存在的视觉不舒适性,基于视差对立体图像视觉舒适度的影响,提出了一种结合全局线性和局部非线性视差重映射的立体图像视觉舒适度提升方法。方法 首先,考虑双目融合限制和视觉注意机制,分别结合空间频率和立体显著性因素提取立体图像的全局和局部视差统计特征,并利用支持向量回归构建客观的视觉舒适度预测模型作为控制视差重映射程度的约束;然后,通过构建的预测模型对输入的立体图像的视觉舒适性进行分析,就欠舒适的立体图像设计了一个两阶段的视差重映射策略,分别是视差范围的全局线性重映射和针对提取的潜在欠舒适区域内视差的局部非线性重映射;最后,根据重映射后的视差图绘制得到舒适度提升后的立体图像。结果 在IVY Lab立体图像舒适度测试库上的实验结果表明,相较于相关有代表性的视觉舒适度提升方法对于欠舒适立体图像的处理结果,所提出方法在保持整体场景立体感的同时,能更有效地提升立体图像的视觉舒适度。结论 所提出方法能够根据由不同的立体图像特征构建的视觉舒适度预测模型来自动实施全局线性和局部非线性视差重映射过程,达到既改善立体图像视觉舒适度、又尽量减少视差改变所导致的立体感削弱的目的,从而提升立体图像的整体3维体验。     

Surface textures improve the robustness of stereoscopic depth cues

This research develops design recommendations for surface textures (patterns of color on object surfaces) rendered with stereoscopic displays. In 3 method-of-adjustment procedure experiments, 8 participants matched the disparity of a circular probe and a planar stimulus rendered using a single visible edge. The experiments varied stimulus orientation and surface texture. Participants more accurately matched the depth of vertical stimuli than that of horizontal stimuli, consistent with previous studies and existing theory. Participants matched the depth of surfaces with large pixel-to-pixel luminance variations more accurately than they did surfaces with a small pixel-to-pixel luminance variation. Finally, they matched the depth of surfaces with vertical line patterns more accurately than they did surfaces with horizontal-striped texture patterns. These results suggest that designers can enhance depth perception in stereoscopic displays, and also reduce undesirable sensitivity to orientation, by rendering objects with surface textures using large pixel-to-pixel luminance variations.     

Binocular vision in a bi-ocular world: new-generation head-mounted displays avoid causing visual deficit

Our previous research highlighted adverse visual effects after wearing a binocular head-mounted display (HMD) for a 10 min stereoscopic visualization task. We have since proposed a theoretical, explanation based on the conflict between the depth. Such cues presented by image disparity and image focal depth. Such conflict, however, is not evident in all HMD configurations, and we replicated our early trials using a new-generation bi-ocular HMD produced by Virtuality Entertainment Ltd. Using similar, conventional optometric procedures with 50 participants, we observed no problems in the use of this display for immersion periods of to 30 min. This study demonstrates that effective HMDs can be produced through careful design and precision engineering. It also suggests a difference between the presentation of binocular and bi-ocular images and the requirements that they place on the visual system. Factors to consider in the future development of binocular displays are discussed.