基于B 样条Snake模型的人体运动跟踪方法研究*

提出了一种基于B-样条曲线Snake模型的新的人体运动跟踪方法.Snake算法是通过最小能量来逼近物体的轮廓.采用改进的B-样条曲线Snake模型,每一帧图像中的目标轮廓用三次样条曲线准确地表示,使Snake模型更加稳定和具有较快的收敛速度.计算相邻帧之间的差分图像,通过利用一种基于统计关系双阈值分割方法,有效地检测出图像中运动人体,初步确定目标在每帧图像中的粗略位置.把从上一帧图像中得到的目标轮廓置于该位置,作为B-样条曲线Snake算法中轮廓提取的初始值,经运算后可得到对人体目标的准确分割与跟踪.     

基于改进Snake模型的人体运动跟踪算法

提出一种改进Snake模型与光流估计相结合的人体运动自动实时跟踪算法.利用角点检测得到接近人体真实轮廓的初始轮廓,减少了迭代次数,降低了Snake模型收敛到局部极值的概率;同时针对Snake模型跟踪不够稳定、容易出现跟踪丢失问题,结合KLT光流法,选取当前帧所得到的轮廓点中的强特征点进行光流估计,将估计结果作为下一帧Snake的初始轮廓,有效地解决了这一难题.实验结果表明改进Snake模型可使初始轮廓形变到人体真实轮廓,同时实现了视频序列中自动、实时的人体跟踪.     

基于Snake模型的视频对象分割和跟踪算法

视频对象的分割是基于内容的视频处理中重要的组成部分。提出并实现了一种半自动视频对象分割和跟踪算法。算法主要基于Williams活动轮廓模型，通过求取轮廓点的局部能量最小值对轮廓线进行更新。轮廓扩张技术用来追踪变形的轮廓边缘。通过对轮廓中心点运动的统计，预测对象的运动方向和大小。实验仿真结果表明，这种改进的Snake算法能够收缩到图像的凹陷部分，而且能较好地跟踪视频对象的运动。     

基于改进活动轮廓的视频对象自动分割及跟踪算法

为了能够从视频序列图像中准确地提取出运动视频对象,提出了一种基于改进活动轮廓的视频对象自动分割及跟踪方法。该方法首先采用连续帧间差的4次统计量假设检验来确定视频对象的运动区域,并使用形态滤波消除残余噪声和空洞;然后根据3帧序列图像得到的前后运动区域的相与运算来有效地解决运动视频对象前后帧的遮挡问题,以获得视频对象模板,当提取出视频对象模板的边缘轮廓后,再用梯度向量流场作为外力的改进活动轮廓算法来获得视频对象的精确轮廓;最后以此视频对象的轮廓为基础进行运动补偿,以得到下一帧图像的初始曲线,再使用改进的活动轮廓算法对下一帧图像进行分割,即可实现视频对象的跟踪。该方法不仅能够消除差分图像中的显露背景,得到运动视频对象精确的轮廓,并且可进行多目标的分割与跟踪。     

一种新的FAST-Snake目标跟踪方法

提出一种新的FAST-Snake目标跟踪方法,利用改进的FAST角点特征匹配来估计目标轮廓在帧间的全局仿射变换,将投影轮廓点作为Snake模型的初始化轮廓.为提高跟踪实时性,在Snake能量模型中定义了先验约束能,并用限定搜索方向的贪婪算法（Greedy algorithm）实现局部轮廓优化.实验包括三维目标数据库及真实场景视频,验证了提出方法的均方误差（Means quare error,MSE）及收敛速度评估均优于对比算法,并具备对复杂运动及局部遮挡的适应能力.     

交互式分割视频运动对象的研究与实现

在 MPEG- 4视频编码标准中 ,为了实现基于视频内容的交互功能 ,视频序列的每一帧由视频对象面来表示 ,而生成视频对象面 ,需要对视频序列中运动对象进行有效分割 ,并跟踪运动对象随时间的变化 .在视频分割方法中 ,交互式分割视频对象能满足分割的效率与质量指标要求 ,因此提出了一种交互分割与自动跟踪相结合的方式来分割视频语义对象 ,即在初始分割时 ,依据用户的交互与形态学的分水线分割算法相结合提取视频对象轮廓 ,并用改进的轮廓跟踪方法有效提高视频对象轮廓的精度 ;对后续帧的跟踪 ,采用六参数仿射变换跟踪运动对象轮廓的变化 ,用平移估算的运动矢量作为初始值 ,计算六参数仿射变换的参数 .实验结果表明 ,该方法能有效地分割并跟踪视频运动对象     

基于块仿射分类和HD跟踪的视频分割方法*

提出一种自动视频分割方法,分为运动对象检测、对象跟踪、模型更新、分水岭轮廓提取四个阶段。与变化检测方法不同,该基于块的运动分类器能够检测背景具有一致运动情况下的运动对象。自动得到运动对象的二值模型并在随后帧中使用Hausdorff距离进行跟踪。将视频对象运动分为慢变和快变两部分,分别结合背景边缘模型进行匹配更新。最后提出彩色多尺度梯度修正的分水岭算法提取对象的轮廓。实验证明了算法的有效性。     

基于边界矢量场的视频运动目标检测与跟踪

提出了一种新的视频运动目标检测与跟踪方法.该方法首先采用自适应帧间差分法对视频序列图像的运动目标进行粗检测,进而采用BVF(边界矢量场)Snake方法准确地检测出运动目标轮廓;其次获得轮廓质心后,对传统的α-β-γ滤波器进行了改进,实现对运动目标的实时跟踪;最后根据预测的质心位置来自动完成下一帧轮廓初始化.实验结果表明,该方法具有良好的实时性和准确性.     

分水岭优化的Snake模型肝脏图像分割

Snake算法是主动轮廓模型的经典算法,是近年来图像分割和视频领域研究的热点。针对Snake模型中存在的初始轮廓敏感和能量函数中曲率约束不足等问题,提出将分水岭变换和主动轮廓模型相结合的主动轮廓分割算法。首先通过引入标记函数和强制最小值技术解决传统分水岭变换可能导致的过分割问题,然后利用改进的强制标记分水岭算法优化Snake模型的初始轮廓曲线,最后通过在Snake模型中增加一项与曲线形状相关的外部力弥补能量约束函数中曲率约束的不足,从而实现更精确的图像分割。改进后的Snake模型应用于腹部MR图像中,对肝脏图像的识别和分割取得了良好效果。     

在线学习机制下的Snake轮廓跟踪

针对复杂环境下非刚体目标轮廓跟踪存在跟踪失败的问题,提出一种基于在线学习的Snake模型及其轮廓跟踪算法。利用跟踪-学习-检测( TLD)机制实现目标快速跟踪,通过跟踪结果在线更新Snake模型约束,进而提高目标轮廓跟踪的准确性。初始化阶段,在GrabCut算法的基础上,将待跟踪目标分成若干个子块,并在后续跟踪过程中,利用TLD实现各子目标的定位跟踪,形成目标的轮廓置信图。同时针对各子目标提取特征,产生正负样本,更新各子目标跟踪模型。应用置信图建立参数化Snake模型的约束条件,进而得到目标轮廓。实验结果表明,该算法能适应光暗变化与较为复杂坏境下的跟踪,并获得精确的轮廓。     

适用于遮挡问题的目标跟踪算法

提出一种基于网格模型的目标跟踪算法．该算法首先进行遮挡区域检测，然后进行网格结点的运动估计和网格更新过程完成目标的多帧跟踪．改进的遮挡区域检测算法有效地提高了检测准确度，从而确保遮挡区域的准确跟踪；网格结点的运动估计是通过特征窗口运动补偿匹配完成，可以有效地克服块效应．实验证明，该算法解决了二维运动估计时网格模型在遮挡区域存在的问题，并可以有效地进行目标准确跟踪．     

Binocular motion tracking by gaze fixation control and three-dimensional shape reconstruction

It is an easy task for the human visual system to gaze continuously at an object moving in three-dimensional (3-D) space. While tracking the object, human vision seems able to comprehend its 3-D shape with binocular vision. We conjecture that, in the human visual system, the function of comprehending the 3-D shape is essential for robust tracking of a moving object. In order to examine this conjecture, we constructed an experimental system of binocular vision for motion tracking. The system is composed of a pair of active pan-tilt cameras and a robot arm. The cameras are for simulating the two eyes of a human while the robot arm is for simulating the motion of the human body below the neck. The two active cameras are controlled so as to fix their gaze at a particular point on an object surface. The shape of the object surface around the point is reconstructed in real-time from the two images taken by the cameras based on the differences in the image brightness. If the two cameras successfully gaze at a single point on the object surface, it is possible to reconstruct the local object shape in real-time. At the same time, the reconstructed shape is used for keeping a fixation point on the object surface for gazing, which enables robust tracking of the object. Thus these two processes, reconstruction of the 3-D shape and maintaining the fixation point, must be mutually connected and form one closed loop. We demonstrate the effectiveness of this framework for visual tracking through several experiments.     

基于形变模型由立体序列图象恢复物体的3D形状

结合立体视觉和形变模型提出了一种新的物体3D形状的恢复方法。采用立体视觉方法导出物体表面的3D坐标;利用光流模型估计物体的3D运动,根据此运动移动形变模型,使其对准物体的表面块;由形变模型将由各幅图象得到的离散的3D点融为一起,得到物体的表面形状。实验结果表明该方法能用于形状复杂的物体恢复。     

Genetic programming extension to APF-based monocular human body pose estimation

New method of the human body pose estimation based on a single camera 2D observation is presented, aimed at smart surveillance related video analysis and action recognition. It employs 3D model of the human body, and genetic algorithm combined with annealed particle filter for searching the global optimum of model state, best matching the object’s 2D observation. Additionally, new motion cost metric is employed, considering current pose and history of the body movement, favouring the estimates with the lowest changes of motion speed comparing to previous poses. The “genetic memory” concept is introduced for the genetic processing of both current and past states of 3D model. State-of-the-art in the field of human body tracking is presented and discussed. Details of implemented method are described. Results of experimental evaluation of developed algorithm are included and discussed.     

人体三维运动实时跟踪与建模系统

提出了一种新的人体三维运动实时跟踪与建模系统设计方法,并基于此实现了一套鲁棒的参考应用系统.针对人机交互等对跟踪精度要求不是很高的应用场合,系统在跟踪精确性和简易性与可推广性之间做了很好的折中.系统使用多个摄像头采集图像,实时计算场景深度信息,然后结合使用深度和颜色信息进行人体跟踪.应用一个简易的人体上半身三维模型,并使用基于颜色直方图的粒子滤波算法对头部和手部进行跟踪,从而恢复出模型的各个参数.系统以人脸检测和人手肤色聚类算法为初始化方法.大量实验证明,该系统能在复杂背景下进行人体上半身的跟踪和三维模型恢复,能进行完全自动的初始化,有较强的抗干扰能力和自动错误恢复能力.系统在2.4GHz PC机上能以25帧/秒的速度运行.     

基于视频的三维人体运动跟踪系统的设计与实现

在优化粒子滤波跟踪框架下,设计并实现了一个结合多种图像特征、在多摄像机环境下跟踪人体运动的三维人体运动跟踪系统.通过定义三维人体模型、摄像机模型以及观测似然模型,得到跟踪所需目标函数,并使用优化粒子滤波算法进行求解.实验结果表明,该系统能够对人体运动进行准确的跟踪和三维重建,可应用于体育运动分析和动画制作等领域.     

Non-rigid 3D shape tracking from multiview video

We present a fast and efficient non-rigid shape tracking method for modeling dynamic 3D objects from multiview video. Starting from an initial mesh representation, the shape of a dynamic object is tracked over time, both in geometry and topology, based on multiview silhouette and 3D scene flow information. The mesh representation of each frame is obtained by deforming the mesh representation of the previous frame towards the optimal surface defined by the time-varying multiview silhouette information with the aid of 3D scene flow vectors. The whole time-varying shape is then represented as a mesh sequence which can efficiently be encoded in terms of restructuring and topological operations, and small-scale vertex displacements along with the initial model. The proposed method has the ability to deal with dynamic objects that may undergo non-rigid transformations and topological changes. The time-varying mesh representations of such non-rigid shapes, which are not necessarily of fixed connectivity, can successfully be tracked thanks to restructuring and topological operations employed in our deformation scheme. We demonstrate the performance of the proposed method both on real and synthetic sequences.     

Hyperpatches for 3D model acquisition and tracking

Automatic 3D model acquisition and 3D tracking of simple objects under motion using a single camera is often difficult due to the sparsity of information from which to establish the model. We developed an automatic scheme that first computes a simple Euclidean model of the object and then enriches this model using hyperpatches. These hyperpatches contain information on both the orientation and intensity pattern variation of roughly planar patches on an object. This information allows both the spatial and intensity distortions of the projected patch to be modeled accurately under 3D object motion. Considering human tracking as a specific application, we show that hyperpatches can not only be computed automatically during model acquisition from a monocular image sequence, but that they are also extremely appropriate for the task of visual tracking     

Incremental model-based estimation using geometric constraints

We present a model-based framework for incremental, adaptive object shape estimation and tracking in monocular image sequences. Parametric structure and motion estimation methods usually assume a fixed class of shape representation (splines, deformable superquadrics, etc.) that is initialized prior to tracking. Since the model shape coverage is fixed a priori, the incremental recovery of structure is decoupled from tracking, thereby limiting both processes in their scope and robustness. In this work, we describe a model-based framework that supports the automatic detection and integration of low-level geometric primitives (lines) incrementally. Such primitives are not explicitly captured in the initial model, but are moving consistently with its image motion. The consistency tests used to identify new structure are based on trinocular constraints between geometric primitives. The method allows not only an increase in the model scope, but also improves tracking accuracy by including the newly recovered features in its state estimation. The formulation is a step toward automatic model building, since it allows both weaker assumptions on the availability of a prior shape representation and on the number of features that would otherwise be necessary for entirely bottom-up reconstruction. We demonstrate the proposed approach on two separate image-based tracking domains, each involving complex 3D object structure and motion.