Evaluation of stereo correspondence algorithms and their implementation on FPGA

The accuracy of stereo vision has been considerably improved in the last decade, but real-time stereo matching is still a challenge for embedded systems where the limited resources do not permit fast operation of sophisticated approaches. This work presents an evaluation of area-based algorithms used for calculating distance in stereoscopic vision systems, their hardware architectures for implementation on FPGA and the cost of their accuracies in terms of FPGA hardware resources. The results show the trade-off between the quality of such maps and the hardware resources which each solution demands, so they serve as a guide for implementing stereo correspondence algorithms in real-time processing systems.     

基于免疫算法的立体匹配

立体匹配是立体视觉中的关键问题,提出了基于免疫算法的多分辨率立体匹配方法,为了提高匹配的准确性,同时利用和图象的灰度和梯信息进行匹配,并给出了匹配的准则函数;将免疫算法用于该问题的求解,以避免局部最优;实验结果证明了该方法的有效性。     

Reconfigurable hardware implementation of a phase-correlation stereoalgorithm

This paper describes the implementation of a stereo-vision system using Field Programmable Gate Arrays (FPGAs). Reconfigurable hardware, including FPGAs, is an attractive platform for implementing vision algorithms due to its ability to exploit parallelism often found in these algorithms, and due to the speed with which applications can be developed as compared to hardware. The system outputs 8-bit, subpixel disparity estimates for 256× 360 pixel images at 30,fps. A local-weighted phase correlation algorithm for stereo disparity [Fleet, D. J.: {Int. Conf. Syst. Man Cybernetics 1:48–54 (1994)] is implemented. Despite the complexity of performing correlations on multiscale, multiorientation phase data, the system runs as much as 300 times faster in hardware than its software implementation. This paper describes the hardware platform used, the algorithm, and the issues encountered during its hardware implementation. Of particular interest is the implementation of multiscale, steerable filters, which are widely used in computer vision algorithms. Several trade-offs (reducing the number of filter orientations from three to two, using fixed-point computation, changing the location of one localized low-pass filter, and using L1 instead of L2 norms) were required to both fit the design into the available hardware and to achieve video-rate processing. Finally, results from the system are given both for synthetic data sets as well as several standard stereo-pair test images.     

基于DSP芯片和无线收发技术的立体车库电气控制系统

为解决立体车库布线复杂、故障定位不准确、电机控制速度缓慢的问题,提出了一种基于DSP和无线收发技术的立体车库电气控制系统。介绍了该系统硬件整体设计及各部分的功能,其中重点介绍利用Atmel公司的AT89C51单片机的数据采集与无线收发单元和利用TI公司的TMS320F2812DSP芯片无线收发与中央处理单元这两部分的设计方法。理论表明,该立体车库电气控制系统可完全满足设计和使用要求。     

基于双目视觉的工业机器人运动轨迹准确度检测

针对工业机器人运动轨迹准确度检测困难的问题,提出了一种基于双目视觉理论的检测方法。根据空间解析几何学中点、线和面三者之间的约束关系,建立了基于直线特征匹配的工业机器人运动轨迹位姿视觉检测模型。基于此模型对一种典型六轴工业机器人运动轨迹的位置偏差和姿态偏差进行了测量。测量结果表明采用这种方法的测量系统结构相对简单,能够方便地进行工业机器人动态轨迹准确度的测量。     

大视场双目视觉传感器现场标定方法

针对大视场视觉测量应用,分析了摄像机和双目视觉传感器的数学模型,提出了一种基于基线尺的大视场双目视觉传感器标定方法。在测量空间内任意多次摆放基线尺,两摄像机拍摄基线尺图像。利用基本矩阵及基线尺上两特征点之间距离的约束,采用线性解和非线性优化方法结合同时估计摄像机的内部参数以及双目视觉传感器的结构参数。该标定方法操作简单,标定效率高,无需初始参数即可估计双目立体传感器的全部参数。实验结果表明该方法在6000mm×4500mm的范围内可以达到0.06mm的测量精度,适合双目立体视觉传感器的现场标定。     

一种适应无人机平台的快速立体匹配方法

设计了一种高质量和快速的立体匹配方法,首先在粗分辨率的影像上获取立体影像的重叠区域和初始视差值,而后采用互信息作为匹配测度并采用一种通过一维路径聚合的全局优化方法得到精确的视差值。匹配方法采用图形处理器进行了加速,得到了很好的加速比。实验结果表明了该匹配方法的正确性和高效率性     

基于区域间协同优化的立体匹配算法

提出了一种基于分割区域间协同优化的立体匹配算法. 该算法以图像区域为匹配基元, 利用区域的彩色特征以及相邻区域间应满足的平滑和遮挡关系定义了区域的匹配能量函数, 并引入区域之间的合作竞争机制, 通过协同优化使所定义的匹配能量极小化, 从而得到比较理想的视差结果. 算法首先对参考图像进行分割, 利用相关法得到各分割区域的初始匹配; 然后用平面模型对各区域的视差进行拟合, 得到各区域的视差平面参数; 最后, 基于协同优化的思想, 采用局部优化的方法对各区域的视差平面参数进行迭代优化, 直至得到比较合理的视差图为止. 采用Middlebury test set进行的实验结果表明, 该方法在性能上可以和目前最好的立体匹配算法相媲美, 得到的视差结果接近于真实视差.