一种自适应的光流估计方法

本文通过对光流基本约束项和平滑约束项加以改进,提出一种自应用的光流估计算法。这种算不能够较精确进行光流运动估计,减轻Horn方法中全局平滑约束对运动边界的影响,提高估计的峰值信噪比。实验结果表明：这种算法是有效的。     

FRFCM聚类与深度优化的RGBD场景流计算

针对现有RGBD场景流计算模型在复杂场景、非刚性运动和运动遮挡等情况下易产生场景过度平滑和运动边缘模糊的问题,提出一种基于FRFCM（Fast and Robust Fuzzy C-Means）聚类与深度优化的RGBD场景流计算方法.首先以图像序列连续帧间光流信息为基准,利用FRFCM聚类算法对输入图像进行初始分割,然后根据深度图像的运动边缘信息优化初始分割结果,提取高置信度的运动分层信息.最后设计基于图像分割的RGBD场景流能量函数,采用金字塔变形策略计算精确的场景流结果.分别采用Middlebury和MPI-Sintel数据库所提供的测试图像集对本文方法和现有的RGBD场景流算法进行综合对比分析,实验结果表明本文方法相对于其他方法具有更好的场景流估计精度和鲁棒性,有效改善了场景过度平滑和运动边缘模糊问题.     

光流法在冠状动脉运动分析中的应用

采用光流法,由单面冠状动脉造影图像序列估计冠状动脉血管的二维运动。通过分析冠状动脉血管造影图像序列,计算出相关的血管运动参数,得到对心脏运动的定量估计。分别介绍了梯度光流法和特征光流法2种算法,并对其优缺点进行了比较。为了验证该运动估计方法的准确性,对临床得到的造影图像进行了实验。实验结果表明,算法具有可行性。     

基于图像局部结构的区域匹配变分光流算法

针对变分光流算法的计算精度与鲁棒性问题,提出一种基于图像局部结构的区域匹配变分光流算法.光流估计能量泛函的数据项采用图像结构守恒与灰度守恒相结合,并引入规则化非平方惩罚函数,保证了光流估计的精度与鲁棒性;平滑项采用随图像局部结构自适应变化的扩散策略结合区域匹配约束函数能够有效地保护运动物体或场景的边缘轮廓信息;在光流计算过程中引入金字塔分层细化策略克服图像序列中大位移运动引起的像素点漂移现象,并采用数学方法证明光流估计模型的鲁棒性和收敛性.多组实验表明,本文方法在图像中存在剧烈光照变化、非刚性物体复杂运动以及多目标大位移运动等情况下具有较高的计算精度、较好的鲁棒性.     

基于语义分割的双目场景流估计

针对现有场景流计算方法在复杂场景、大位移和运动遮挡等情况下易产生运动边缘模糊的问题,提出一种基于语义分割的双目场景流估计方法.首先,根据图像中的语义信息类别,通过深度学习的卷积神经网络模型将图像划分为带有语义标签的区域;针对不同语义类别的图像区域分别进行运动建模,利用语义知识计算光流信息并通过双目立体匹配的半全局匹配方法计算图像视差信息.然后,对输入图像进行超像素分割,通过最小二乘法耦合光流和视差信息,分别求解每个超像素块的运动参数.最后,在优化能量函数中添加语义分割边界的约束信息,通过更新像素到超像素块的映射关系和超像素块到移动平面的映射关系得到最终的场景流估计结果.采用KITTI 2015标准测试图像序列对本文方法和代表性的场景流计算方法进行对比分析.实验结果表明,本文方法具有较高的精度和鲁棒性,尤其对于复杂场景、运动遮挡和运动边缘模糊的图像具有较好的边缘保护作用.     

光流向量补偿模型的运动目标检测

基金项目：黑龙江省教育厅科学研究项目（No.11541057）资助。摘要：针对计算机视觉中的运动目标跟踪与检测问题,特别是运动目标被遮挡丢失和大幅度机动现象,提出了一种基于Lucas-Kanade光流向量补偿算法的运动目标检测方法。该方法利用Lucas-Kanade光流算法计算帧间的光流向量,并选用丢失目标的图像附近若干帧序列图像之间的光流关系,对丢失的光斑目标位置进行估计,以此对序列图像进行补全。实验表明该算法相对于其他传统光流法,提高了光流估算的精确性和可靠性,能更好地检测出运动目标。     

融合序列影像相关区域信息的光流估计网络

针对现有光流估计方法在目标轮廓分割不清晰、缺乏细粒度的问题，本文提出融合序列影像相关区域信息的光流估计网络。通过特征编码器和全局编码器分别提取图像的编码特征和上下文特征，并通过下采样处理缩减特征尺寸。在构建4D相关体前，对输入的连续两帧特征图进行分区处理，以强弱相关的方式计算稠密的视觉相似度，建立更为精细的4D相关体积。在迭代更新阶段，提出残差卷积滤波器和细粒度模块，分别应用于处理相关体和光流传递，使得在融合相关体信息和光流信息前保留更多的局部小位移信息。在KITTI-2015数据集和MPI-Sintel数据集上与其他方法进行对比，光流估计评价指标分别提升了8.2%和6.15%。本文给出的网络模型可以更好地提高光流估计的准确性，有效解决了光流场过于平滑、缺乏细粒度和忽略小物体运动等问题。     

分布式视频编码中一种基于混合模型的边信息生成算法

提出了一种基于块匹配模型和光流模型的混合式边信息生成方法.该方法对块匹配效果较差的区域采用光流法重新估计其运动矢量,得到了更为精确的运动场.实验表明,该算法生成的边信息质量明显高于传统的基于块匹配的运动估计内插法.     

基于光流与Mean Shift算法的运动目标检测

为了改善传统光流法不能很好地解决背景运动带来影响的问题,提出了一种基于光流矢量与Mean Shift算法的运动目标检测方法。结合图像中边缘信息和灰度信息,用金字塔法计算出特定像素点的Lucas-Kanade光流矢量。再利用Mean Shift算法的梯度搜索原理找出运动背景的光流矢量,进而找出运动目标的光流矢量。实验结果表明,融入Mean Shift算法后的光流法高精度地检测出了目标,显著降低背景运动所带来的影响。文中所提方法比传统几种方法更加准确地得到了所需结果。     

结合Gaussian分布和LK光流法的视频对象分割算法

为了提高视频对象分割的性能,在传统光流法的基础上,提出了一种改进算法.该算法首先对序列图像中的帧进行预处理,平滑序列图像;然后用Gaussian金字塔降低图像的分辨率,使运动对象的速度降低;再使用结合Gaussian分布的LK光流法进行分割,得到运动对象;最后使用帧相"与"运算做进一步的分割.实验结果表明:该算法减少了运算时间,能更精确地分割出运动对象,取得较好的效果.     

Video super resolution based on non-local regularization and reliable motion estimation

Video super-resolution (SR) is a process for reconstructing high-resolution (HR) images by utilizing complementary information among multiple low-resolution (LR) images. Accurate estimation of the motion among the LR images significantly affects the quality of the reconstructed HR image. In this paper, we analyze the possible reasons for the inaccuracy of motion estimation and then propose a multi-lateral filter to regularize the process of motion estimation. This filter can adaptively correct motion estimation according to the estimation reliability, image intensity discontinuity, and motion dissimilarity. Furthermore, we introduce a non-local prior to solve the ill-posed problem of HR image reconstruction. This prior can fully utilize the self-similarities existing in natural images to regularize the HR image reconstruction. Finally, we employ a Bayesian formulation to incorporate the two regularizations into one Maximum a Posteriori (MAP) estimation model, where the HR image and the motion estimation can be refined progressively in an alternative and iterative manner. In addition, an algorithm that estimates the blur kernel by analyzing edges in an image is also presented in this paper. Experimental results demonstrate that the proposed approaches are highly effective and compare favorably to state-of-the-art SR algorithms.     

基于头肩图像中脸部轮廓的运动估值

对于可视电话中的头肩图像,在提取出脸部轮廓后,在脸部区通过搜索出全局的二维运动参数来确定各像块运动矢量的初始搜索点。在此基础上搜索精确的运动矢量时,搜索范围很小,搜索结果更符合真实运动,保证了运动矢量场的一致性。因此,既加快了运动估值的速度,又节省了编码运动矢量所用的比特数,使图像的质量有所提高。     

Bayesian motion estimation for temporally recursive noise reduction in X-ray fluoroscopy

This paper develops a Bayesian motion estimation algorithm for motion-compensated temporally recursive filtering of moving low-dose X-ray images (X-ray fluoroscopy). These images often exhibit a very low signal-to-noise ratio. The described motion estimation algorithm is made robust against noise by spatial and temporal regularization. A priori expectations about the spatial and temporal smoothness of the motion vector field are expressed by a generalized Gauss-Markov random field. The advantage of using a generalized Gauss-Markov random field is that, apart from smoothness, it also captures motion edges without requiring an edge detection threshold. The costs of edges are controlled by a single parameter, by means of which the influence of the regularization can be tuned from a median-filter-like behaviour to a linear-filter-like one.     

Improvement of Matching Criterion for Motion Estimation in H.263

ＩｍｐｒｏｖｅｍｅｎｔｏｆＭａｔｃｈｉｎｇＣｒｉｔｅｒｉｏｎｆｏｒＭｏｔｉｏｎＥｓｔｉｍａｔｉｏｎｉｎＨ．２６３ＱｉｕＪｕｎｈａｉＺｈａｎｇＣｈｕｎｔｉａｎ（ＴｉａｎｊｉｎＵｎｉｖｅｒｓｉｔｙ，Ｔｉａｎｊｉｎ３０００７２）ＡｂｓｔｒａｃｔＴｈｅｒｅ...     

A Modified Block Matching Motion Estimation Algorithm for the Very Low Bit-Rate video Coding

1IntroductionMohonestimationplaysanimportantroleindigitalvideocompression.Block-matchingtechniquehasbeenadoptedinmanyvideocompressionstandardssuchasH.261,MPEG-l,MPEG-2andH.263.Eventhoughthealgorithmtoestimatethemotionvectorsisnotspecifiedexplicitly.However,despiteitssuccessfulapplications,itproducesarathernoisyinchonfield.Inverylowbit-ratevideocodingapplications,theamountofthesideinformationfortheinchonfieldrepresentsanimPOrtantportionofthetotalbit-rate.Therefore,motionestimatetechniques…     

基于边界约束的样品视频非对称运动估计方法

针对常规运动估计方法应用到样品视频编码时存在无效搜索点冗余搜索、有效搜索点遗漏的问题,提出基于边界约束的非对称运动估计方法。首先,在原有预定搜索范围的基础上,采用定点统计运动参量的方法对科学仪器的样品视频运动性能进行测试统计,根据统计结果,对视频运动范围设定边界,减少运动搜索点数;然后提出了基于边界约束的非对称搜索模型,依据样品视频的运动特征,优化搜索算法。来自电子探针和电子显微镜的不同样品视频编码实验表明,与多方向搜索算法(MDS)比较,所提方法的运动估计时间缩短了约33%,编码性能保持甚至超过了多方向搜索算法。     

Stereo image analysis for multi-viewpoint telepresence applications

An improved method for combined motion and disparity estimation in stereo sequences to synthesize temporally and perspectively intermediate views is presented. The main problems of matching methods for motion and disparity analysis are summarised. The improved concept is based on a modified block matching algorithm in which a cost function consisting of feature- and area-based correlation together with an appropriately weighted temporal smoothness term is applied. Considerable improvements have been obtained with respect to the motion and disparity assignments by introducing a confidence measure to evaluate the reliability of estimated correspondences. In occluded image areas, enhanced results are obtained applying an edge-assisted vector interpolation strategy. Two different image synthesis concepts are presented. The first concept is suitable for processing natural stereo sequences. It comprises the detection of covered and uncovered image areas caused by motion or disparity. This information is used to switch between different interpolation and extrapolation modes during the computation of intermediate views. The proposed object-based approach is suitable for processing typical video conference scenes containing extremely large occluded image regions and keeping implementation costs low. A set of stereo sequences has been processed. The performed computer simulations show that a continuous motion parallax can be obtained with good image quality by using sequences taken with stereo cameras having large interaxial distances.     

Tracking the left ventricle in echocardiographic images by learningheart dynamics

In this paper a temporal learning-filtering procedure is applied to refine the left ventricle (LV) boundary detected by an active-contour model. Instead of making prior assumptions about the LV shape or its motion, this information is incrementally gathered directly from the images and is exploited to achieve more coherent segmentation. A Hough transform technique is used to find an initial approximation of the object boundary at the first frame of the sequence. Then, an active-contour model is used in a coarse-to-fine framework, for the estimation of a noisy LV boundary. The PCA transform is applied to form a reduced ordered orthonormal basis of the LV deformations based on a sequence of noisy boundary observations. Then this basis is used to constrain the motion of the active contour in subsequent frames, and thus provide more coherent identification. Results of epicardial boundary identification in B-mode images are presented.     

一种快速、鲁棒的压缩视频光流场估计算法

该文针对视频运动特性的快速分析需求,提出了一种压缩域中的光流场估计算法。首先利用DCT变换后的两个AC系数估计出图像的空间偏导数,在此基础上再利用预测残差以及运动矢量对图像的时间偏导数进行估计。另外对编码过程中未进行前向运动预测的宏块特性进行了详细的分析,给出了这些宏块相对于前向参考帧的运动信息估计方法,并对时域不连续的图像块给出了一种修正的偏导数估计方法,以此解决遮挡、切换等现象。然后通过最小二乘法并结合图像的偏导数进行光流场估计。实验表明该方法在准确度上可以达到或超过像素域中的L-K估计方法,比起现有的压缩域估计方法也有一定提高,而在计算时间上相比像素域估计有了大幅度降低。