Extracting mobile objects by sequential background detection on a video

This paper describes a technique for extracting moving objects from a video image sequence taken by a slowly moving camera as well as a fixed camera. The background subtraction method is effective for extracting moving objects from a video. But the latest background image should be employed for the subtraction in the mobile camera case and in order not to be influenced by the light intensity change. A temporal median technique is proposed in this paper which detects the background at every moment. The camera motion is estimated using a local correlation map and the temporal median filter is applied to the common image area among a set of successive image frames to extract the background. The technique was applied to the video images obtained at a junction from a hand-held camera and those taken at a pedestrians crossing by a camera fixed in a car and successfully detected pedestrians. This work was presented in part at the 13th International Symposium on Artificial Life and Robotics, Oita, Japan, January 31–February 2, 2008     

Semantic Plane-Structure based motion detection with a nonstationary camera

This paper presents a novel method to accurately detect moving objects from a video sequence captured using a nonstationary camera. Although common methods provide effective motion detection for static backgrounds or through only planar-perspective transformation, many detection errors occur when the background contains complex dynamic interferences or the camera undergoes unknown motions. To solve this problem, this study proposed a motion detection method that incorporates temporal motion and spatial structure. In the proposed method, first, spatial semantic planes are segmented, and image registration based on stable background planes is applied to overcome the interferences of the foreground and dynamic background. Thus, the estimated dense temporal motion ensures that small moving objects are not missed. Second, motion pixels are mapped on semantic planes, and then, the spatial distribution constraints of motion pixels, regional shapes and plane semantics, which are integrated into a planar structure, are used to minimise false positives. Finally, based on the dense temporal motion and spatial structure, moving objects are accurately detected. The experimental results on CDnet dataset, Pbi dataset, Aeroscapes dataset, and other challenging self-captured videos under difficult conditions, such as fast camera movement, large zoom variation, video jitters, and dynamic background, revealed that the proposed method can remove background movements, dynamic interferences, and marginal noises and can effectively obtain complete moving objects.© 2017 ElsevierInc.Allrightsreserved.     

摄像机运动情况下的运动对象检测

在监控应用中,由于场景是已知的,因此可以使用背景减去法检测运动对象.当摄像机进行扫描和倾斜运动时,需要使用多个图像帧才能完整地表示监控场景.如何组织和索引这些背景帧属于摄像机跟踪问题.提出一种无需摄像机标定的背景帧索引和访问方法.这一方法需要使用图像配准技术估计图像初始运动参数.提出一种屏蔽外点的图像配准算法,综合利用线性回归和稳健回归快速估计初始运动参数.为了快速计算连续帧之间的运动参数,提出一种基于四参数模型的优化算法.利用非参数背景维护模型抑制虚假运动象素.室内和户外实验结果表明本文方法是有效的.     

Visible and infrared image registration using trajectories and composite foreground images

The registration of images from multiple types of sensors (particularly infrared sensors and visible color sensors) is a step toward achieving multi-sensor fusion. This paper proposes a registration method using a novel error function. Registration of infrared and visible color images is performed by using the trajectories of moving objects obtained using background subtraction and simple tracking. The trajectory points are matched using a RANSAC-based algorithm and a novel registration criterion, which is based on the overlap of foreground pixels in composite foreground images. This criterion allows performing registration when there are few trajectories and gives more stable results. Our method was tested and its performance quantified using nine scenarios. It outperforms a related method only based on trajectory points in cases where there are few moving objects.     

基于自适应核密度估计的运动目标检测

在计算机视频监控系统中,主要的目的是在摄像机固定的视频图像中检测出运动目标,在诸多检测方法中最常用的是减背景技术。减背景技术的关键是背景建模,噪声的干扰、检测方法的自适应性、模型的正确性等问题都是在背景建模过程中必须解决的问题。为了提高建模精度,本文提出了一个非参数化建模技术,称为自适应核密度估计,具有较好的适应性和鲁棒性。它是一种基于场景中像素的概率密度函数来构建的非参数核密度估计的统计模型。     

Fast Lighting Independent Background Subtraction

This paper describes a simple method of fast background subtraction based upon disparity verification that is invariant to arbitrarily rapid run-time changes in illumination. Using two or more cameras, the method requires the off-line construction of disparity fields mapping the primary background images. At runtime, segmentation is performed by checking background image to each of the additional auxiliary color intensity values at corresponding pixels. If more than two cameras are available, more robust segmentation can be achieved and, in particular, the occlusion shadows can be generally eliminated as well. Because the method only assumes fixed background geometry, the technique allows for illumination variation at runtime. Since no disparity search is performed, the algorithm is easily implemented in real-time on conventional hardware.     

Light-weight salient foreground detection for embedded smart cameras

An embedded smart camera is a stand-alone unit that not only captures images, but also includes a processor, memory and communication interface. Battery-powered, embedded smart cameras introduce many additional challenges since they have very limited resources, such as energy, processing power and memory. Computer vision algorithms running on these camera boards should be light-weight and efficient. Considering the memory requirements of an algorithm and its portability to an embedded processor should be an integral part of the algorithm design in addition to the accuracy requirements. This paper presents a light-weight and efficient background modeling and foreground detection algorithm that is highly robust against lighting variations and non-static backgrounds including scenes with swaying trees, water fountains and rain. Compared to many traditional methods, the memory requirement for the data saved for each pixel is very small in the proposed algorithm. Moreover, the number of memory accesses and instructions are adaptive, and are decreased depending on the amount of activity in the scene. Each pixel is treated differently based on its history, and instead of requiring the same number of memory accesses and instructions for every pixel, we require less instructions for stable background pixels. The plot of the number of unstable pixels at each frame also serves as a tool to find the video portions with high activity. The proposed method selectively updates the background model with an automatically adaptive rate, thus can adapt to rapid changes. As opposed to traditional methods, pixels are not always treated individually, and information about neighbors is incorporated into decision making. The results obtained with nine challenging outdoor and indoor sequences are presented, and compared with the results of different state-of-the-art background subtraction methods. The ROC curves and memory comparison of different background subtraction methods are also provided. The experimental results demonstrate the success of the proposed light-weight salient foreground detection method.     

河道监控视频的运动对象分割算法

针对内河航道监控视频的特点,提出一种基于背景差法的对象分割算法。首先在HSI颜色空间里利用像素的色调和亮度对其进行归类;然后利用基于块处理的方法确定背景像素,并在背景缓慢变化和急速变化时,采用定时和实时的背景重构方法进行背景更新;最后利用背景差提取运动对象。     

New trends on moving object detection in video images captured by a moving camera: A survey

This paper presents a survey on the latest methods of moving object detection in video sequences captured by a moving camera. Although many researches and excellent works have reviewed the methods of object detection and background subtraction for a fixed camera, there is no survey which presents a complete review of the existing different methods in the case of moving camera. Most methods in this field can be classified into four categories; modeling based background subtraction, trajectory classification, low rank and sparse matrix decomposition, and object tracking. We discuss in details each category and present the main methods which proposed improvements in the general concept of the techniques. We also present challenges and main concerns in this field as well as performance metrics and some benchmark databases available to evaluate the performance of different moving object detection algorithms.     

3D measures exploitation for a monocular semi-supervised fall detection system

Falls have been reported as the leading cause of injury-related visits to emergency departments and the primary etiology of accidental deaths in elderly. Thus, the development of robust home surveillance systems is of great importance. In this article, such a system is presented, which tries to address the fall detection problem through visual cues. The proposed methodology utilizes a fast, real-time background subtraction algorithm, based on motion information in the scene and pixels intensity, capable to operate properly in dynamically changing visual conditions, in order to detect the foreground object. At the same time, it exploits 3D space’s measures, through automatic camera calibration, to increase the robustness of fall detection algorithm which is based on semi-supervised learning approach. The above system uses a single monocular camera and is characterized by minimal computational cost and memory requirements that make it suitable for real-time large scale implementations.     

基于多特征融合的运动阴影去除算法

对视频监控中的运动阴影问题进行了研究,提出一种颜色特征、归一化向量距离、亮度比值相融合的阴影去除方法。首先,通过混合高斯模型建立背景图像,利用背景差分法分离运动区域。然后,采用串行处理方法检测运动区域中的阴影像素。在RGB颜色空间下根据颜色一致性特征消除阴影之后,根据运动区域的归一化向量距离分布直方图进一步检测阴影像素。最后,针对阴影检测过程中存在的误检问题,建立像素的光照模型,计算阴影像素与背景像素的亮度比值,并根据置信区间排除误检的前景像素。实验结果表明,该方法能够克服单特征方法的局限性,在多个真实场景下能有效检测与去除阴影,适应性强,鲁棒性好,处理时间适中。     

实时图像的运动目标检测及跟踪

在复杂背景的运动目标实时检测算法的研究中,由于目标受到外界环境影响,目标不能正确提取。针对克服背景干扰因素提取,干净的目标像素,大多数背景建模与背景更新算法计算复杂,难以满足视频监控的实时要求。为解决上述问题,提出一种根据像素特征的背景差法,将目标的边缘特征融入减背景算法,通过对离散的目标边缘梯度像素进行网格密度聚类法实现目标像素的提取,采用改进的均值漂移跟踪算法,在DM642平台上实现目标检测与跟踪。实验结果表明,改进的算法可以有效的克服光线变化、背景抖动、噪声等问题,实时检测、跟踪多个目标,并能解决目标遮挡问题。     

Density-based multifeature background subtraction with support vector machine

Background modeling and subtraction is a natural technique for object detection in videos captured by a static camera, and also a critical preprocessing step in various high-level computer vision applications. However, there have not been many studies concerning useful features and binary segmentation algorithms for this problem. We propose a pixelwise background modeling and subtraction technique using multiple features, where generative and discriminative techniques are combined for classification. In our algorithm, color, gradient, and Haar-like features are integrated to handle spatio-temporal variations for each pixel. A pixelwise generative background model is obtained for each feature efficiently and effectively by Kernel Density Approximation (KDA). Background subtraction is performed in a discriminative manner using a Support Vector Machine (SVM) over background likelihood vectors for a set of features. The proposed algorithm is robust to shadow, illumination changes, spatial variations of background. We compare the performance of the algorithm with other density-based methods using several different feature combinations and modeling techniques, both quantitatively and qualitatively.     

Multiple camera people detection and tracking using support integration

This paper proposes a method to locate and track people by combining evidence from multiple cameras using the homography constraint. The proposed method use foreground pixels from simple background subtraction to compute evidence of the location of people on a reference ground plane. The algorithm computes the amount of support that basically corresponds to the “foreground mass” above each pixel. Therefore, pixels that correspond to ground points have more support. The support is normalized to compensate for perspective effects and accumulated on the reference plane for all camera views. The detection of people on the reference plane becomes a search for regions of local maxima in the accumulator. Many false positives are filtered by checking the visibility consistency of the detected candidates against all camera views. The remaining candidates are tracked using Kalman filters and appearance models. Experimental results using challenging data from PETS’06 show good performance of the method in the presence of severe occlusion. Ground truth data also confirms the robustness of the method.     

Adaptation of known background subtraction methods in the case of a moving PTZ camera mounted on a mobile platform

A general method of adaptation of pixel-by-pixel background subtraction models designed for a fixed camera is developed in the case of a PTZ camera mounted on a mobile platform. The method involves the use of two identical pixellevel background models. The first one is directly applied to the classification of the current scene, while the second one is used to prepare the first model for the transformation to the new coordinate system, the one closer to the current position of the PTZ video camera. The chosen solution makes it possible to eliminate a large number of false positives, which inevitably occur after each transformation of the background model. The experimental verification of the developed method using two well-known background models GMM and ViBe demonstrated good quality of the scene classification and low computational load.     

Dark-spot detection from SAR intensity imagery with spatial density thresholding for oil-spill monitoring

Dark-spot detection is a critical and fundamental step in marine oil-spill detection and monitoring. In this paper, a novel approach for automated dark-spot detection using synthetic aperture radar (SAR) intensity imagery is presented. The key to the approach is making use of a spatial density feature to differentiate between dark spots and the background. A detection window is passed through the entire SAR image. First, intensity threshold segmentation is applied to each window. Pixels with intensities below the threshold are regarded as potential dark-spot pixels while the others are potential background pixels. Second, the density of potential background pixels is estimated using kernel density estimation within each window. Pixels with densities below a certain threshold are the real dark-spot pixels. Third, an area threshold and a contrast threshold are used to eliminate any remaining false targets. In the last step, the individual detection results are mosaicked to produce the final result. The proposed approach was tested on 60 RADARSAT-1 ScanSAR intensity images which contain verified oil-spill anomalies. The same parameters were used in all tests. For the overall dataset, the average of commission error, omission error, and average difference were 7.0%, 6.1%, and 0.4 pixels, respectively. The average number of false alarms was 0.5 per unit image and the average computational time for a detection window was 1.2 s using a PC-based MATLAB platform. Our experimental results demonstrate that the proposed approach is fast, robust and effective.     

基于像素灰度归类的背景重构算法

背景差法是一种重要的运动检测方法,其难点在于如何进行背景更新.针对该问题,提出一种基于像素灰度归类的背景重构算法,即在假设背景像素灰度以最大概率出现在图像序列的前提下,利用灰度差对相应像素点灰度进行归类,选择频率最高的灰度值作为该点的背景像素值.在背景缓慢变化和突变时,分别利用该算法进行定时和实时背景重构具有时显的优点.仿真结果表明,即使场景中存在运动前景,该算法也能够准确地重构背景,并有效地避免混合现象,从而实现对运动目标的完整提取,以便进一步识别或跟踪.     

移动机器人的运动目标实时检测与跟踪

运动目标检测及跟踪是机器视觉领域备受关注的前沿课题之一。该文针对移动机器人导航领域对检测与跟踪的实时性要求,基于Kalman滤波器实现了驱动单目摄像头的反馈控制系统。采用简单的三帧差背景剪除策略检测运动目标,合并运动估计和背景补偿以加快系统反应速度。系统误差保存在协方差阵中,以增益的形式参与控制。该文还详细分析了运动补偿对检测的影响及误差的变化趋势。实验表明,系统能够保持对运动目标稳定偏差的平滑跟踪,在480320的图像分辨率下控制速度达到20Hz(fps)。     

Robust background maintenance by estimating global intensity level changes for dynamic scenes

The maintenance of relevant backgrounds under various scene changes is very crucial to detect foregrounds robustly. We propose a background maintenance method for dynamic scenes including global intensity level changes caused by changes of illumination conditions and camera settings. If the global level of the intensity changes abruptly, the conventional background models cannot discriminate true foreground pixels from the background. The proposed method adaptively modifies the background model by estimating the level changes. Because there are changes caused by moving objects as well as global intensity level changes, we estimate the dominant level change over the whole image regions by mean shift. Then, the problem caused by saturated pixels are handled by an additional scheme. In the experiments for dynamic scenes, our proposed method outperforms previous methods by adaptive background maintenance and handling of saturated pixels.     

基于先验概率模型的自适应背景图像分割算法

在利用背景消减的视频图像分割过程中,背景模型假定为高斯模型下判断像素点是否为背景点一般采用规则。当模型中方差参数的值较大时,与背景相近的前景被误分割为背景的误差就较大。针对这一问题,提出了一种基于先验概率模型与距离因子对背景进行分割的算法,该算法判定当前帧像素点为背景的概率由其先验概率及该像素点在上一帧分割结果中与前景点的距离决定。实验结果表明,与判定规则相比,该方法在背景变化范围较大的情况下,可以减少前景点被误分割为背景点的误差。