基于SACON背景模型的人体检测与跟踪

提出了一种基于抽样一致性(SACON)的背景模型。采用七种典型视频序列进行了实验,SACON背景模型较目前常用五种背景模型具有较高的准确性,适用于复杂场景下的目标检测与跟踪。应用于人体检测与跟踪时,将目标作为非刚性物体进行处理,结合颜色和空域信息建立一种新的目标外观模型。实验证明,该方法能较准确的描述人体特征,即使在有遮挡、颜色相近及小目标等情况下也均能准确的对人体目标进行检测和跟踪。     

Robust background maintenance by estimating global intensity level changes for dynamic scenes

The maintenance of relevant backgrounds under various scene changes is very crucial to detect foregrounds robustly. We propose a background maintenance method for dynamic scenes including global intensity level changes caused by changes of illumination conditions and camera settings. If the global level of the intensity changes abruptly, the conventional background models cannot discriminate true foreground pixels from the background. The proposed method adaptively modifies the background model by estimating the level changes. Because there are changes caused by moving objects as well as global intensity level changes, we estimate the dominant level change over the whole image regions by mean shift. Then, the problem caused by saturated pixels are handled by an additional scheme. In the experiments for dynamic scenes, our proposed method outperforms previous methods by adaptive background maintenance and handling of saturated pixels.     

一种用于智能监控的目标检测和跟踪方法*

在对现有目标检测、跟踪算法进行分析对比的基础上,设计并实现了一种简单有效的目标检测和跟踪方案。首先提出了一种基于像素灰度归类和单模态高斯模型的背景重构算法,能够利用多帧包含前景目标的场景图像重构准确的背景模型。进而以此为基础采用背景减法进行各帧中目标的检测,并选取形心作为匹配特征实现了场景中多个目标的有效跟踪。实验表明,该方法实现简单,无须事先提供背景图像即可实现目标的准确检测和跟踪,其性能明显优于传统基于时间平均背景模型的方法。     

一种基于改进码本的车辆检测与跟踪方法

为了解决固定摄像机下车辆跟踪过程中阴影对检测的影响,提出一种改进型码本模型的车辆检测方法。该方法直接对YUV空间的车辆序列进行处理,将采样到的背景值聚类成码本,对于新输入的像素值与其对应位置的码本作比较判断,提取出前景区域。车辆跟踪中采用Kalman预测的方法来处理车辆遮挡问题。实验结果表明,本算法可以从复杂交通场景图像序列中快速有效地检测出运动目标,能较好地处理阴影、高亮、遮挡和背景变化等问题,且计算复杂度小,能满足实时跟踪的需要。     

Shadow removal for pedestrian detection and tracking in indoor environments

This paper presents a method of shadow removal to improve the accuracy of pedestrian detection and tracking in indoor environments. The proposed method can be divided into four steps: building a background model which can be automatically updated, extract moving objects region, eliminating moving objects shadows, classifying and track pedestrians. The background model is built with pixel value and the updating of Gussian. The approach for real time background-foreground extraction is used to extract pedestrian region that may contains multiple shadows. In the gray histogram space, based on the depth value of the gray images, a reasonable threshold is set to remove shadows from various pedestrians. In this work, we propose a methodology using the foreground frames without shadows to detect and track the pedestrians across training datasets. Comparative experimental results show that our method is capable of dealing with shadows and detecting moving pedestrians in cluttered environments.     

基于GMM-RBMCDA的实时监控多目标跟踪方法

为了有效提取视频监控场景中的前景目标信息并准确跟踪目标的状态,提出一种基于混合高斯模型和Rao-Blackwellized蒙特卡洛数据关联的视频多目标跟踪方法。该方法根据场景中像素点的特征信息,利用混合高斯模型进行建模,并对前景目标进行检测,使用Rao-Blackwellized蒙特卡洛数据关联算法来降低可能的目标交叉及杂波干扰带来的影响,通过设置目标存在和消失参数,实现了实时多目标跟踪。实验结果表明,该方法不仅能对场景中未知目标的个数进行有效估计,而且可以准确地跟踪目标的状态,取得了良好的实际效果。     

融合时域信息的修正分水岭视频分割新方法

提出一种将时域信息融入分水岭的视频分割新方法,以帧间变化检测为基础,通过运动边缘信息得到对象的初始模型,利用时域信息得到前景和背景的标识,结合提出的彩色多尺度形态学梯度算子进行分水岭分割,得到具有精确边界的视频对象,对慢变和快变的目标均有良好的效果,能够检测新出现的运动对象和现有对象的消失,能够定位和跟踪运动目标.继承了变化检测和分水岭算法速度快的优点,克服了两者易受噪声影响的缺点.     

Pedestrian detection and tracking in infrared imagery using shape and appearance

In this paper, we present an approach toward pedestrian detection and tracking from infrared imagery using joint shape and appearance cues. A layered representation is first introduced and a generalized expectation-maximization (EM) algorithm is developed to separate infrared images into background (still) and foreground (moving) layers regardless of camera panning. In the two-pass scheme of detecting pedestrians from the foreground layer: shape cue is first used to eliminate non-pedestrian moving objects and then appearance cue helps to locate the exact position of pedestrians. Templates with varying sizes are sequentially applied to detect pedestrians at multiple scales to accommodate different camera distances. To facilitate the task of pedestrian tracking, we formulate the problem of shot segmentation and present a graph matching-based tracking algorithm that jointly exploits the shape, appearance and distance information. Experimental results with both OSU Infrared Image Database and WVU Infrared Video Database are reported to demonstrate the accuracy and robustness of our algorithm.     

基于SACON模型和五帧差分法的目标检测算法

在充分研究现有运动目标检测算法的基础上,针对当前常用运动目标检测算法易受光照和噪声的影响,不易提取完整运动目标,提出了一种新的结合SACON背景模型与五帧差分法的运动目标检测算法.对传统的SACON算法进行改进得到运动区域,与五帧差分算法提取的运动目标相结合,采用动态阈值以适应光线突变,通过孔洞填充等后处理,综合得到运动前景图像.该算法有效地处理了孔洞和噪声问题,具有很好的实时性以及抗干扰能力,能够精确地检测出运动目标.     

Motion detection with nonstationary background

Abstract. This paper proposes a new background subtraction method for detecting moving foreground objects from a nonstationary background. While background subtraction has traditionally worked well for a stationary background, the same cannot be implied for a nonstationary viewing sensor. To a limited extent, motion compensation for the nonstationary background can be applied. However, in practice, it is difficult to realize the motion compensation to sufficient pixel accuracy, and the traditional background subtraction algorithm will fail for a moving scene. The problem is further complicated when the moving target to be detected/tracked is small, since the pixel error in motion that is compensating the background will subsume the small target. A spatial distribution of Gaussians (SDG) model is proposed to deal with moving object detection having motion compensation that is only approximately extracted. The distribution of each background pixel is temporally and spatially modeled. Based on this statistical model, a pixel in the current frame is then classified as belonging to the foreground or background. For this system to perform under lighting and environmental changes over an extended period of time, the background distribution must be updated with each incoming frame. A new background restoration and adaptation algorithm is developed for the nonstationary background. Test cases involving the detection of small moving objects within a highly textured background and with a pan-tilt tracking system are demonstrated successfully. Received: 30 July 2001 / Accepted: 20 April 2002 Correspondence to: Chin-Seng Chau     

基于二维主成分分析的运动目标检测

运动目标检测是计算机视觉研究的重要领域,在视频监控和智能交通等领域应用广泛.本文提出了一种自适应的运动目标检测方法.该方法采用二维主成分分析建立背景模型,通过比较重建图像和原图像的差异来检测运动目标.为了自适应动态变化的复杂背景,该模型由增量算法在线更新.实验结果表明,提出的方法可以在复杂变化的动态背景环境下进行有效的运动目标检测.     

A dynamic conditional random field model for foreground and shadow segmentation

This paper proposes a dynamic conditional random field (DCRF) model for foreground object and moving shadow segmentation in indoor video scenes. Given an image sequence, temporal dependencies of consecutive segmentation fields and spatial dependencies within each segmentation field are unified by a dynamic probabilistic framework based on the conditional random field (CRF). An efficient approximate filtering algorithm is derived for the DCRF model to recursively estimate the segmentation field from the history of observed images. The foreground and shadow segmentation method integrates both intensity and gradient features. Moreover, models of background, shadow, and gradient information are updated adaptively for nonstationary background processes. Experimental results show that the proposed approach can accurately detect moving objects and their cast shadows even in monocular grayscale video sequences.     

基于改进光流特征的运动目标跟踪

在城市智能视频监控中需要对运动目标进行实时跟踪,针对传统的运动目标检测中出现的跟踪目标易丢失、跟踪率低、实时性差等问题,提出一种基于改进光流特征的运动目标跟踪检测方法,对运动行人目标进行跟踪。该方法首先采用改进的Vibe运动背景建模法对视频中存在的运动行人进行检测,再将Shi-Tomasi角点检测与LK光流法进行结合,将角点检测结果融入到LK光流法中,并对检测到的角点进行运动光流特征提取,最后通过卡尔曼滤波对出现的行人进行预测跟踪,采用匈牙利最优匹配算法实现对运动目标的持续匹配以及对运动目标的跟踪。仿真结果表明,本文提出的方法能够对视频中出现的运动目标进行检测跟踪,具有较好的识别效果,且检测效率得到提高。      

基于局部纹理不变性的运动阴影去除算法

视频序列运动目标检测过程中,运动目标往往会连同其投射阴影一起被检测为前景,这不利于对运动目标的进一步分类、识别等高层次视觉处理。为了提高运动目标检测的准确性,提出利用局部纹理不变性去除运动目标阴影。首先根据阴影的亮度色度属性分割出疑似阴影区域,然后在疑似阴影区域采用增强的局部纹理描述算子(ILT)提取纹理特征,利用背景在阴影覆盖前后的纹理相似性来去除阴影,最后结合阴影的空间几何属性优化运动目标检测结果。实验结果表明该算法可以有效去除阴影,并且具有较好的实时性。     

基于视觉背景提取的自适应运动目标提取算法

在复杂场景下的视频运动目标提取是视频分析技术的首要工作。为了解决前景运动目标提取的精确度不高的问题,提出一种基于视觉背景提取(ViBE)的改进视频运动目标提取算法(ViBE⁺)。首先,在背景模型初始化阶段采用像素的菱形邻域来简化样本信息;其次,在前景运动目标提取阶段引入自适应分割阈值来适应场景的动态变化;最后,在更新阶段提出背景重建和调整更新因子方法来处理光照变化的情形。实验结果表明,对于复杂视频场景LightSwitch的运动目标提取结果在相似度指标上,改进后的算法与混合高斯模型(GMM)算法、码本模型算法以及原始ViBE算法相比,分别提高了1.3倍、1.9倍以及3.8倍。所提算法能够在有效时间内对复杂场景具有较好的自适应性,且性能明显优于对比算法。     

融合SPA遮挡分割的多目标跟踪方法

复杂环境下的多目标视频跟踪是计算机视觉领域的一个难点,有效处理目标间遮挡是解决多目标跟踪问题的关键。将运动分割方法引入目标跟踪领域,提出一种融合骨架点指派(SPA)遮挡分割的多目标跟踪方法。由底层光流信息得到骨架点,并估计骨架点遮挡状态;综合使用目标外观、运动、颜色信息等高级语义信息,将骨架点指派给各个目标;最后以骨架点为核,对运动前景密集分类,得到准确的目标前景像素;在粒子滤波器跟踪框架下,使用概率外观模型进行多目标跟踪。在PETS2009数据集上的实验结果表明,文中方法能够改进现有多目标跟踪方法对目标间交互适应性较差的缺点,更好地处理动态遮挡问题。     

Incremental Tensor Subspace Learning and Its Applications to Foreground Segmentation and Tracking

Appearance modeling is very important for background modeling and object tracking. Subspace learning-based algorithms have been used to model the appearances of objects or scenes. Current vector subspace-based algorithms cannot effectively represent spatial correlations between pixel values. Current tensor subspace-based algorithms construct an offline representation of image ensembles, and current online tensor subspace learning algorithms cannot be applied to background modeling and object tracking. In this paper, we propose an online tensor subspace learning algorithm which models appearance changes by incrementally learning a tensor subspace representation through adaptively updating the sample mean and an eigenbasis for each unfolding matrix of the tensor. The proposed incremental tensor subspace learning algorithm is applied to foreground segmentation and object tracking for grayscale and color image sequences. The new background models capture the intrinsic spatiotemporal characteristics of scenes. The new tracking algorithm captures the appearance characteristics of an object during tracking and uses a particle filter to estimate the optimal object state. Experimental evaluations against state-of-the-art algorithms demonstrate the promise and effectiveness of the proposed incremental tensor subspace learning algorithm, and its applications to foreground segmentation and object tracking.     

Bayesian modeling of dynamic scenes for object detection

Accurate detection of moving objects is an important precursor to stable tracking or recognition. In this paper, we present an object detection scheme that has three innovations over existing approaches. First, the model of the intensities of image pixels as independent random variables is challenged and it is asserted that useful correlation exists in intensities of spatially proximal pixels. This correlation is exploited to sustain high levels of detection accuracy in the presence of dynamic backgrounds. By using a nonparametric density estimation method over a joint domain-range representation of image pixels, multimodal spatial uncertainties and complex dependencies between the domain (location) and range (color) are directly modeled. We propose a model of the background as a single probability density. Second, temporal persistence is proposed as a detection criterion. Unlike previous approaches to object detection which detect objects by building adaptive models of the background, the foregrounds modeled to augment the detection of objects (without explicit tracking) since objects detected in the preceding frame contain substantial evidence for detection in the current frame. Finally, the background and foreground models are used competitively in a MAP-MRF decision framework, stressing spatial context as a condition of detecting interesting objects and the posterior function is maximized efficiently by finding the minimum cut of a capacitated graph. Experimental validation of the proposed method is performed and presented on a diverse set of dynamic scenes.     

基于区域相关性的全局运动视频中非刚性对象跟踪

提出一种适合全局运动视频中自动探测与跟踪非刚性对象的OT-GAV模型.该模型首先利用基于区域相关性的RDM算法计算相邻帧区域匹配,并结合Q学习与K-S统计法优化匹配结果,获得较为精确的区域运动向量.然后,利用前景和背景存在的运动形态差异,区域动态纹理一致性及对象运动过程中保持区域完整性的特点,逐步实现前景对象区域的探测与合并.实验证明,本模型及其相关算法可在室内和室外环境下,自动探测前景关注对象,获得其较为精确的边缘信息,并实施有效的跟踪.同时,该模型还能够解决对象跟踪过程中的"空洞"问题.     

结合加权Schatten-p范数与3D全变分的前景检测

针对低秩与稀疏方法一般将前景看作背景中存在的异常像素点，从而使得在复杂场景中前景检测精确度下降的问题，提出一种结合加权Schatten-p范数与3D全变分（3D-TV）的前景检测模型。该模型首先将观测数据三分为低秩背景、运动前景和动态干扰；然后利用3D全变分来约束运动前景，并加强对前景目标时空连续性的先验考虑，有效抑制了不连续动态背景异常点的随机扰动；最后利用加权Schatten-p范数约束视频背景的低秩性能，去除噪声干扰。实验结果表明，与鲁棒主成分分析（RPCA）、高阶RPCA（HoRPCA）和张量RPCA（TRPCA）等模型相比，所提模型的综合衡量指标F-measure值是最高的，查全率与查准率也处于最优或次优状态。由此可知，所提模型在动态背景、恶劣天气等复杂场景中能有效提高运动目标的提取精确度，且提取的前景目标视觉效果较好。