一种新的外耳轮廓跟踪算法

针对人耳识别中因人耳与肤色部分颜色接近，时比不鲜明而导致的很难进行边缘检测的问题，该文提出了一种新的外耳轮廓跟踪算法。算法首先运用阈值分割和形状匹配的方法找到外耳轮廓顶点，并将外耳轮廓分为左右两部分。从顶点开始，通过四个方向的Prewitt算子和一个最佳方向模板首先确定外耳轮廓的基本走向，然后分别从左右两个方向进行轮廓跟踪，得到外耳轮廓。将该算法与其它算法进行比较实验，结果表明了该算法的有效性。     

基于肤色信息的实时人脸跟踪方法

提出一种基于人脸检测与肤色信息相结合的人脸实时跟踪方法。该方法先用Adaboost算法进行人脸检测，在此基础上，CAMSHIFT算法跟据人脸肤色信息实现对人脸的自动跟踪。实验表明，该算法具有快速、鲁棒的特点，能够满足实时系统的需要。     

基于肤色检测的人耳图像去噪方法

针对人耳图像中存在的噪声问题,提出一种基于肤色检测的人耳图像去噪方法.利用在HSI色彩空间下的肤色检测将人耳图像分割成肤色区域和非肤色区域,将被肤色区域包围的非肤色区域判别为噪声区域,并利用修复算法修复此区域.实验结果表明,该方法可以有效去除噪声,能较好保留边缘等重要信息,并具有算法简单、处理速度快等优点.     

一种基于改进GVFSnake的自动人耳检测方法

近几年对人耳这种生物特征的研究大都只能依靠手工定位和分割人耳,这大大减缓人耳识别技术的实用化进程。文中提出一种人耳自动检测方法。该方法首先利用YCbCr肤色模型和Gentle AdaBoost 级联分类器检测出人耳块,然后运用改进的GVF Snake方法提取外耳轮廓。该方法通过构造耳形图,提取非常接近于人耳实际边缘的初始轮廓线,不但节省迭代时间,还提高GVF Snake提取人耳边缘的准确率,在USTB人耳库上获得约97。3%的正确检测率。实验结果表明,该方法具有较好的检测效果和鲁棒性。     

基于粒子滤波与改进水平集的人手跟踪

提出一种基于肤色信息的改进水平集分割算法,给出整个算法的推导和实现过程,实现复杂背景下的精确人手轮廓分割,在进行人手跟踪时,使用粒子滤波对手的位置和大小进行跟踪,并用跟踪结果初始化水平集函数,以此加快轮廓曲线的收敛速度,获得手的轮廓后,对指尖位置进行定位。实验结果表明,该算法能够在复杂背景下实时、准确地跟踪人手轮廓和指尖位置。     

类肤色背景中提取人脸轮廓的方法研究

提出了一个基于肤色并融合多种信息的人脸轮廓提取方法。首先在TSL色彩空间求取肤色概率图,选取种子点,然后利用多源信息进行区域生长,提取出人脸轮廓;为克服区域生长计算量大的缺点,采用了变分辨率图像金字塔策略。经实例验证,该算法能够快速准确地从类肤色背景中较好地提取出人脸轮廓,且具有较高的抗噪性和应用适应性。     

实时视频图像中的人脸检测与跟踪

视频图像目标检测与跟踪是远程协作系统中感兴趣的研究课题之一。文中提出了一种协同系统中视频序列图像人脸检测及实时跟踪的方法。该方法根据用户选定的目标(如人脸)的颜色分布特点，用多幅训练样本图像建立人脸肤色模型，然后根据该模型和人脸特征对待检测的彩色图像进行分割与匹配，从而确定候选区域是否人脸。在视频图像跟踪中用此方法可实现人脸的实时检测跟踪，为了提高跟踪速度，提出了改进的基于运动预测的快速跟踪法。该方法充分利用运动连续性规律，能较好地处理多干扰目标同时出现的情形。实验表明所提出的方法执行效率高，检测跟踪正确率高．对有旋转的非正面人脸图像也有较好的适应性。     

基于边缘跟踪方法的肤色区域检测

常用的肤色模型只针对肤色的颜色信息,在较复杂的光照情况下检测效果不理想。为此,结合肤色在HSV颜色空间的分布特点以及肤色区域的边缘信息,提出一种应用于肤色区域检测的边缘跟踪方法。实验结果表明,该方法能准确检测图像中的肤色区域,检测结果优于传统的肤色模型,且对侧光、阴影等具有较好的鲁棒性。     

基于规则与卡尔曼滤波的人眼跟踪

本文提出一种基于YCbCr空间、规则和卡尔曼滤波的人眼跟踪方法。该方法首先利用肤色在YCbCr空间的特性建立肤色模型分割出肤色,然后通过设定的规则得到人眼区域,最后利用卡尔曼滤波的方法实时跟踪人眼。实验表明,该方法能达到实时效果且跟踪正确率较高。     

基于肤色的实时人脸跟踪新方法

提出一种基于混合肤色模型的实时人脸跟踪方法。该方法采用基于点的运动预测来减少搜索区域并使用MJSEG算法进一步分离人脸和其他类肤色区域。实验结果表明，该方法有效地解决了复杂背景下人脸自由运动、光照变化及部分遮挡的问题。系统跟踪速度达到实时，并给出精确的人脸边界。     

Multiple 3D object position estimation and tracking using double filtering on multi-core processor

We present a new algorithm to tracking multiple 3D objects that has robustness, real-time processing ability and fast object registration. Usually, many augmented reality applications want to track 3D object using natural features in real-time, more accuracy and want to register target object immediately in few seconds. Prevalent object tracking algorithm uses FERN for feature extraction that takes long time to register and learning target object for high quality performance. Our method provides not only high accuracy but also fast target object registering time about 0.3 ms in same environment and real-time processing. These features are presented by using SURF, ROI, double robust filtering and optimized multi-core parallelization. Using our methods, tracking multiple 3D objects with fast and high accuracy is available.     

Observation-oriented silhouette-aware fast full body tracking with Kinect

We present a novel approach to track full human body mesh with a single depth camera, e.g. Microsoft Kinect, using a template body model. The proposed observation-oriented tracking mainly targets at fitting the body mesh silhouette to the 2D user boundary in video stream by deforming the body. It is fast to be integrated into real-time or interactive applications, which is impossible with traditional iterative optimization based approaches. Our method is a composite of two main stages: user-specific body shape estimation and on-line body tracking. We first develop a novel method to fit a 3D morphable human model to the actual body shape of the user in front of the depth camera. A strategy, making use of two constrains, i.e. point clouds from depth images and correspondence between foreground user mask contour and the boundary of projected body model, is designed. On-line tracking is made possible in successive steps. At each frame, the joint angles of template skeleton are optimized towards the captured Kinect skeleton. Then, the aforementioned contour correspondence is adopted to adjust the projected body model vertices towards the contour points of foreground user mask, using a Laplacian deformation technique. Experimental results show that our method achieves fast and high quality tracking. We also show that the proposed method is benefit to three applications: virtual try-on, full human body scanning and applications in manufacturing systems.     

人体三维运动实时跟踪与建模系统

提出了一种新的人体三维运动实时跟踪与建模系统设计方法,并基于此实现了一套鲁棒的参考应用系统.针对人机交互等对跟踪精度要求不是很高的应用场合,系统在跟踪精确性和简易性与可推广性之间做了很好的折中.系统使用多个摄像头采集图像,实时计算场景深度信息,然后结合使用深度和颜色信息进行人体跟踪.应用一个简易的人体上半身三维模型,并使用基于颜色直方图的粒子滤波算法对头部和手部进行跟踪,从而恢复出模型的各个参数.系统以人脸检测和人手肤色聚类算法为初始化方法.大量实验证明,该系统能在复杂背景下进行人体上半身的跟踪和三维模型恢复,能进行完全自动的初始化,有较强的抗干扰能力和自动错误恢复能力.系统在2.4GHz PC机上能以25帧/秒的速度运行.     

Features extraction from hand images based on new detection operators

Human hand shape features extraction from image frame sequences is one of the key steps in human hand 2D/3D tracking system and human hand shape recognition system. In order to satisfy the need of human hand tracking in real time, a fast and accurate method for acquirement of edge features from human hand images without consideration of hand over face is put forward in this paper. The proposed approach is composed of two steps, the coarse location phase (CLP) and the refined location phase (RLP) from coarseness to refinement. In the phase of CLP, the hand contour is approximately described by a polygon with concave and convex, an approach to obtaining hand shape polygon using locating points and locating lines is meticulously discussed. Then, a coarse location (CL) algorithm for extraction of interested hand shape features, such as contour, fingertips, roots of fingers, joints and the intersection of knuckle on different fingers, is proposed. In the phase of RLP, a multi-scale approach is introduced into our study to refine the features obtained by the CL algorithm. By means of defining the response strength of different types of features, a refined location (RL) algorithm is proposed. The major contribution of this paper is that the novel detection operators for features of hand images are presented in the above two steps, which have been successfully applied to our 3D hand shape tracking system and 2D hand shape recognition system. A number of comparative studies with real images and online videos demonstrate that the proposed method can extract the three defined human hand image features with high accuracy and high speed.     

基于视点跟踪的感兴趣区检测方法

针对目前基于内容的图像检索系统中,难以客观弥补语义鸿沟的问题,提出了一种利用视点跟踪技术检测感兴趣区的方法.人眼注视运动传递了大量反映个体心理活动的信息.通过实时捕获人眼的注视点,客观地获得用户兴趣信息,根据注视点位置计算用户兴趣度,最终提取图像感兴趣区.本文提出了一种低复杂度的实时视点跟踪方法,定义了兴趣度的度量公式,并建立了一套基于视点跟踪的感兴趣区检测实验平台.实验结果表明,该方法可以有效地提取用户感兴趣区,弥补语义鸿沟.     

视频中多特征融合人体姿态跟踪

目的 目前已有的人体姿态跟踪算法的跟踪精度仍有待提高,特别是对灵活运动的手臂部位的跟踪。为提高人体姿态的跟踪精度,本文首次提出一种将视觉时空信息与深度学习网络相结合的人体姿态跟踪方法。方法 在人体姿态跟踪过程中,利用视频时间信息计算出人体目标区域的运动信息,使用运动信息对人体部位姿态模型在帧间传递;考虑到基于图像空间特征的方法对形态较为固定的人体部位如躯干和头部能够较好地检测,而对手臂的检测效果较差,构造并训练一种轻量级的深度学习网络,用于生成人体手臂部位的附加候选样本;利用深度学习网络生成手臂特征一致性概率图,与视频空间信息结合计算得到最优部位姿态,并将各部位重组为完整人体姿态跟踪结果。结果 使用两个具有挑战性的人体姿态跟踪数据集VideoPose2.0和YouTubePose对本文算法进行验证,得到的手臂关节点平均跟踪精度分别为81.4%和84.5%,与现有方法相比有明显提高;此外,通过在VideoPose2.0数据集上的实验,验证了本文提出的对下臂附加采样的算法和手臂特征一致性计算的算法能够有效提高人体姿态关节点的跟踪精度。结论 提出的结合时空信息与深度学习网络的人体姿态跟踪方法能够有效提高人体姿态跟踪的精度,特别是对灵活运动的人体姿态下臂关节点的跟踪精度有显著提高。     

一种人头部实时跟踪方法

为了能够在视频监控、人机交互、视频会议等领域对人头部运动实施实时跟踪 ,给出了一种使用黑白摄像机对人平移或转身时的头部运动进行实时跟踪的方法 .该方法主要由基于块特征的跟踪和基于头部几何特征的校正两个步骤组成 .块特征跟踪算法仅利用图象低层信息而不依赖于目标的具体模型 ,可实现对头部自由运动的跟踪 .为解决块特征跟踪误差累积等原因造成的目标丢失问题 ,又采用了头部轮廓几何特征检验方法 ,根据跟踪窗口中头部轮廓位置的偏移来对块特征跟踪结果进行校正 .另外 ,为提高转身运动时相邻两帧图象的特征跟踪正确率 ,还引入圆柱模型来拟合头部 ,并在展开柱面内进行块特征选取和跟踪 .本文方法在 P 35 0微机上进行了实验 ,实验结果表明 ,系统能对长时间图象序列中人平移或转身时头部运动实施准确跟踪 .当跟踪窗口大小为12 0× 180 pixels,块特征数目为 80个时 ,系统的处理速度达到 30帧 /s     

Real-Time Dynamic Visual Tracking Using PSD Sensors and Extended Trapezoidal Motion Planning

A real-time visual servo tracking system for an industrial robot has been implemented using PSD (Position Sensitive Detector) cameras, neural networks, and an extended trapezoidal motion planning method. PSD and directly transduces the light's projected position on its sensor plane into an analog current and lends itself to fast real-time tracking. A neural network, after proper training, transforms the PSD sensor reading into a 3D position of the target, which is then input to an extended trapezoidal motion planning algorithm. This algorithm implements a continuous motion update strategy in response to an ever-changing sensor information from the moving target, while greatly reducing the tracking delay. This planning method is found to be very useful for sensor-based control such as moving target tracking or weld-seam tracking in which the robot needs to change its motion in real time in response to incoming sensor information. Further, for real-time usage of the neural net, a new architecture called LANN (Locally Activated Neural Network) has been developed based on the concept of CMAC input partitioning and local learning. Experimental evidence shows that an industrial robot can smoothly track a moving target of unknown motion with speeds of up to 1 m/s and with oscillation frequency up to 5 Hz.     

基于可变模型的目标实时跟踪

为了在图像序列中实现目标的快速定位和实时跟踪,该文提出了一种基于可变模型的快速目标跟踪算法,在已知模型条件下,利用区域模型相关匹配的思想对目标模型进行实时更新,充分利用目标莲续运动过程中目标形状在两个连续帧中变化不大、相邻两帧中目标的速度和位移变化不大的特点,以当前帧目标模型作为下一帧的先验模型;综合运用模型梯度信息、运动信息和模型区域特征匹配的方法来跟踪目标。由于算法综合考虑了目标模型的区域信息和轮廓信息,因此对背景干扰不太敏感。在头部跟踪实验过程中,该文算法跟踪移动目标的实时性和准确性比较好,抗干扰能力较强,基本上可以满足鲁棒性和快速性的要求。     

Using incremental subspace and contour template for object tracking

Object tracking in the presence of appearance variation and occlusion is a hot topic in research, many algorithms were proposed in recent years. Early contour tracking algorithms used particle filter in a high dimensional space. In practice, contour points can move independently, hence contour deformation forms a high dimensional deformation space. As a result, the application of particle filter is calculation expensive. In this paper, we address the problem of tracking contour in complex environments by involving subspace and a contour template. Specifically, our algorithm tracks the global motion and the local contour deformation separately. We track the global motion by weighted distance to subspace, which is adaptive to the complex environment variation by incremental learning, and then use contour model to track local deformation and evolve the contour to the edge points. The experimental results show that our method can track object contour undergoing partially occlusion and shape deforming, which verify the effectiveness of the proposed algorithm.