A portable stereo vision system for whole body surface imaging

This paper presents a whole body surface imaging system based on stereo vision technology. We have adopted a compact and economical configuration which involves only four stereo units to image the frontal and rear sides of the body. The success of the system depends on a stereo matching process that can effectively segment the body from the background in addition to recovering sufficient geometric details. For this purpose, we have developed a novel sub-pixel, dense stereo matching algorithm which includes two major phases. In the first phase, the foreground is accurately segmented with the help of a predefined virtual interface in the disparity space image, and a coarse disparity map is generated with block matching. In the second phase, local least squares matching is performed in combination with global optimization within a regularization framework, so as to ensure both accuracy and reliability. Our experimental results show that the system can realistically capture smooth and complete whole body shapes with high accuracy.     

增强现实中基于轮廓深度恢复的虚实遮挡方法研究

针对增强现实系统中的虚实场景遮挡问题,提出一种基于立体视觉与前景轮廓深度重建的虚实遮挡恢复新方法.首先设计了一种基于色彩与亮度相结合的前景物体轮廓提取方法,以避免阴影对轮廓提取所造成的负面影响,系统随后利用立体视觉原理与插值技术恢复出前景轮廓以及轮廓内部的深度信息,为恢复虚拟与真实场景之间的正确遮挡关系提供依据.实验结...     

基于区域间协同优化的立体匹配算法

提出了一种基于分割区域间协同优化的立体匹配算法. 该算法以图像区域为匹配基元, 利用区域的彩色特征以及相邻区域间应满足的平滑和遮挡关系定义了区域的匹配能量函数, 并引入区域之间的合作竞争机制, 通过协同优化使所定义的匹配能量极小化, 从而得到比较理想的视差结果. 算法首先对参考图像进行分割, 利用相关法得到各分割区域的初始匹配; 然后用平面模型对各区域的视差进行拟合, 得到各区域的视差平面参数; 最后, 基于协同优化的思想, 采用局部优化的方法对各区域的视差平面参数进行迭代优化, 直至得到比较合理的视差图为止. 采用Middlebury test set进行的实验结果表明, 该方法在性能上可以和目前最好的立体匹配算法相媲美, 得到的视差结果接近于真实视差.     

基于立体视觉的机器人手眼无标定三维视觉跟踪

本文在未标定手眼关系及摄像机模型的情况下,建立了机器人立体视觉跟踪问题非线性视觉 映射关系模型,并据此设计了基于人工神经网络的视觉跟踪控制器．仿真结果表明该算法能 完全消除稳态跟踪误差,具有很强的环境适应性和容错能力,算法简单,易于实时实现．     

Stereo audio source separation based on time–frequency masking and multilevel thresholding

Source separation and up-mixing in real commercial music recordings is a challenging problem. In the last few years, some algorithms have provided interesting results, but the problem remains unsolved. In this paper we describe a method for separating the sources present in a two channel mixture based on the panning coefficients used in the stereo mixdown. The sources are separated by estimating time–frequency masks using the multilevel extension of the Otsu thresholding algorithm used in image segmentation. A refinement step is also carried out for extraction and reassignment of inter-source residuals. Examples of application and performance evaluation are also discussed.     

基于免疫算法的立体匹配

立体匹配是立体视觉中的关键问题,提出了基于免疫算法的多分辨率立体匹配方法,为了提高匹配的准确性,同时利用和图象的灰度和梯信息进行匹配,并给出了匹配的准则函数;将免疫算法用于该问题的求解,以避免局部最优;实验结果证明了该方法的有效性。     

Design of an auditory guidance system for the blind with signal transformation from stereo ultrasonic to binaural audio

We have designed an auditory guidance system for the blind using ultrasonic-to-audio signal transformation. We first investigated the system requirements, and designed a simple but useful portable guidance system for the blind. The system derives visual information using multiple ultrasonic sensors, and transforms it to binaural auditory information using a suitable technique. The user can recognize the position of obstacles and the surrounding environment. The system is composed of two parts. One is a glasses-type system, and the other is a cane-type system with guide wheels. The former functions as an environment sensor, and the latter functions as a clear-path indicator. Wide-beam-angle ultrasonic sensors are used to detect bojects over a broader range. The system is designed as a battery-supplied portable model. Our design is focused on low power consumption, small size, light weight, and easy manipulation.     

小视差交又视差认知过程研究

采用静态随机点图做为刺激,对15名正常人在交叉视差条件下,针对小视差（3．27’,6．54＇,8．18’,11．45’,14．72’,17．99’,21．26’,24．53’）状态进行认知过程研究。结果为：随着视差的增大,识别靶刺激的平均反应时和正确率基本呈现出逐渐增加的趋势。在小视差交叉视差条件下,视觉系统对6t左右的视差反应时最为敏感,为立体电影的拍摄提供了理论依据,并为进一步探索精细立体视的脑神经机制提供了有力的支持。     

立体显示虚拟射击训练系统的设计与实现

应用MultiGen-Creator制作三维模型，以VC＋＋6．0为软件开发环境，调用MultiGen-Vega仿真软件提供的Api函数，设计立体显示虚拟射击训练系统；研究了一种用于Vega的实时碰撞检测方法。根据立体视觉的原理，在平面显示器上实现了立体显示。采用双中心投影算法，设置双观察者，来获取左右眼的具有视差的图像；设置双视景显示通道，分别显示左右眼图像；训练员通过控制键盘和鼠标来控制导弹打击敌方目标，同时戴上立体眼镜，可以产生身临其境的真实感，从而准确判断目标位置并击中目标，达到良好的训练效果。