Automatic motion detection for surveillance

Automatic motion detection features are able to enhance surveillance efficiency and quality. The aim of this research is to recognize and detect motion automatically around a robot's environment in order to equip a mobile robot for a surveillance task. The required information is based on the input obtained from a charge coupled device (CCD) camera mounted on the mobile robot. As the first step toward achieving the goal, it is necessary to have a stationary mobile robot and moving objects. Experiments in a different environment, such as different movements, size of moving objects, and lighting conditions, have also been conducted. The “adjacent pixels comparison” is the proposed method to detect motion in this experiment. The results have verified that the motion detection experiments operate as expected. This work was presented in part at the 11^th International Symposium on Artificial Life and Robotics, Oita, Japan, January 23–25, 2006     

一种交通监控场景下的多车道检测方法

为自动有效地获取交通监控场景中的多车道信息,提出一种利用骨架化边缘的多车道检测算法,以克服视频处理对固定场景和明确的先验车道位置信息的依赖。算法主要针对静态的交通背景图处理,采用背景提取、滤波和数字形态学预处理等,由Hough变换确定车道位置的骨架线;由行车方向约束车道线角度,利用车道线几何成像特性检测出准车道线,获取车道线和车道区域。实验表明,对不同的交通场景和不同光照条件,该方法能有效检测多车道,鲁棒性强,具有较高的工程应用价值。     

Extracting mobile objects by sequential background detection on a video

This paper describes a technique for extracting moving objects from a video image sequence taken by a slowly moving camera as well as a fixed camera. The background subtraction method is effective for extracting moving objects from a video. But the latest background image should be employed for the subtraction in the mobile camera case and in order not to be influenced by the light intensity change. A temporal median technique is proposed in this paper which detects the background at every moment. The camera motion is estimated using a local correlation map and the temporal median filter is applied to the common image area among a set of successive image frames to extract the background. The technique was applied to the video images obtained at a junction from a hand-held camera and those taken at a pedestrians crossing by a camera fixed in a car and successfully detected pedestrians. This work was presented in part at the 13th International Symposium on Artificial Life and Robotics, Oita, Japan, January 31–February 2, 2008     

Rolling and swaying motion estimation for a mobile robot by using omnidirectional optical flows

Described here is a method for estimating rolling and swaying motions of a mobile robot using optical flow. We have proposed an image sensor with a hyperboloidal mirror for the vision-based navigation of a mobile robot. Its name is HyperOmni Vision. The radial component of optical flow in HyperOmni Vision has a periodic characteristic. The circumferential component of optical flow has a symmetric characteristic. The proposed method makes use of these characteristic to estimate robustly the rolling and swaying motion of the mobile robot. Correspondence to: Y. Yagi e-mail: y-yagi@sys.es.osaka-u.ac.jp     

指纹图像的一种奇异性检测算法

分析了现有的指纹图像奇异性检测方法中存在的问题,提出了新方法。将指纹的方向图转换为类似灰度纹理,用所提出的改进的新纹理特征检测奇异性。实验表明新方法检测奇异性的正确率为90．2％。     

A region-based selective optical flow back-projection for genuine motion vector estimation

Motion vector plays one significant feature in moving object segmentation. However, the motion vector in this application is required to represent the actual motion displacement, rather than regions of visually significant similarity. In this paper, region-based selective optical flow back-projection (RSOFB) which back-projects optical flows in a region to restore the region's motion vector from gradient-based optical flows, is proposed to obtain genuine motion displacement. The back-projection is performed based on minimizing the projection mean square errors of the motion vector on gradient directions. As optical flows of various magnitudes and directions provide various degrees of reliability in the genuine motion restoration, the optical flows to be used in the RSOFB are optimally selected based on their sensitivity to noises and their tendency in causing motion estimation errors. In this paper a deterministic solution is also derived for performing the minimization and obtaining the genuine motion magnitude and motion direction.     

Combining 3D flow fields with silhouette-based human motion capture for immersive video

In recent years, the convergence of computer vision and computer graphics has put forth a new field of research that focuses on the reconstruction of real-world scenes from video streams. To make immersive 3D video reality, the whole pipeline spanning from scene acquisition over 3D video reconstruction to real-time rendering needs to be researched. In this paper, we describe latest advancements of our system to record, reconstruct and render free-viewpoint videos of human actors. We apply a silhouette-based non-intrusive motion capture algorithm making use of a 3D human body model to estimate the actor’s parameters of motion from multi-view video streams. A renderer plays back the acquired motion sequence in real-time from any arbitrary perspective. Photo-realistic physical appearance of the moving actor is obtained by generating time-varying multi-view textures from video. This work shows how the motion capture sub-system can be enhanced by incorporating texture information from the input video streams into the tracking process. 3D motion fields are reconstructed from optical flow that are used in combination with silhouette matching to estimate pose parameters. We demonstrate that a high visual quality can be achieved with the proposed approach and validate the enhancements caused by the the motion field step.     

视频信号的能量分析与运动检测

提出一种静止摄像机条件下干扰自适应的运动目标检测方法。将视频中同一像素的像素值的变化看做信号,先计算像素值信号的均值,再计算像素值信号围绕均值波动的能量,最后通过比较波动能量来判断像素点属于前景点或背景点。实验结果表明,与混合高斯模型等常用的运动目标检测算法相比,该方法有更强的干扰自适应性和更高的灵敏度。     

视频监控中人的运动检测方法研究与实现

为了提高视频监控的实时性、准确性和可靠性,引入运动目标检测非常必要,而在此基础上的人运动检测更是后续各种高级处理的基础。根据视频监控的特点,采用一种基于自适应背景图像估计与当前多帧图像的混合差的算法来实现快速精确地检测和提取运动目标区域,并充分利用视频图像的时域连续特性和人脸肤色信息,实现快速可靠的人脸定位,从而准确定位人运动区域。实验表明,该算法对人的运动检测在光线、姿势变化等情况下具有良好的鲁棒性,适于实时监控系统的应用。     

Reduction of artifacts in images from MR truncated data using singularity spectrum analysis

In this paper,the theory of signal singularity spectrum analysis (SSA) is proposed,Using SSA theory,a new method is presented to reduce truncation artifacts in magnetic resonance(MR) image due to truncated spectrum data.In the scheme,after detecting signal singulatrity locations using wavelet analysis in spectrum domain,SSA mathematic model is constructed,where weight coefficients are determined by known truncated spectrum data.Then,the remainder of the truncated spectrum can be obtained using SSA.Experiment and simulation results show that the SSA method will produce fewer artifacts in MR image from truncated spectrum than existing methods.     

Motion analysis for event detection and tracking with a mobile omnidirectional camera

A mobile platform mounted with omnidirectional vision sensor (ODVS) can be used to monitor large areas and detect interesting events such as independently moving persons and vehicles. To avoid false alarms due to extraneous features, the image motion induced by the moving platform should be compensated. This paper describes a formulation and application of parametric egomotion compensation for an ODVS. Omni images give 360 view of surroundings but undergo considerable image distortion. To account for these distortions, the parametric planar motion model is integrated with the transformations into omni image space. Prior knowledge of approximate camera calibration and camera speed is integrated with the estimation process using a Bayesian approach. Iterative, coarse-to-fine, gradient-based estimation is used to correct the motion parameters for vibrations and other inaccuracies in prior knowledge. Experiments with a camera mounted on various types of mobile platforms demonstrate successful detection of moving persons and vehicles.Published online: 11 October 2004     

面向监视视频实时分析的快速行人检测方法

为解决监视视频实时分析应用中行人检测效率低的问题,提出一种快速行人检测方法。首先,采用运动侦测方法提取运动区域,并结合行人检测要求对运动区域进行尺寸扩展、归一化和拼接操作;然后,在拼接图像上结合积分图快速提取各运动区域的Haar特征,并采用双支持向量机实现快速的特征分类;最后,结合包围盒相交策略进行帧间滤波,降低行人误检现象。实验表明,本文方法不仅可以实时检测行人目标,而且检测错误率低于现有主流方法。     

浅析网络异常流量分析检测研究与实现

伴随着互联网技术与网络业务的快速发展,网络规模逐渐扩大,网络运用开始逐步朝多元化、多样化以及复杂化的方向发展.现今,网络流量监测已经逐渐发展为计算机网络运用当中一个必不可少的内容与环节.文章将对网络异常流量加以说明,并对网络异常流量检测技术研究与实现进行分析与研究.     

Real‐time smart surveillance using motion analysis

Abstract: In the last years, smart surveillance has been one of the most active research topics in computer vision because of the wide spectrum of promising applications. Its main point is about the use of automatic video analysis technologies for surveillance purposes. In general, a processing framework for smart surveillance consists of a preliminary motion detection step in combination with high‐level reasoning that allows automatic understanding of evolutions of observed scenes. In this paper, we propose a surveillance framework based on a set of reliable visual algorithms that perform different tasks: a motion analysis approach that segments foreground regions is followed by three procedures, which perform object tracking, homographic transformations and edge matching, in order to achieve the real‐time monitoring of forbidden areas and the detection of abandoned or removed objects. Several experiments have been performed on different real image sequences acquired from a Messapic museum (indoor context) and the nearby archaeological site (outdoor context) to demonstrate the effectiveness and the flexibility of the proposed approach.     

Fuzzy-neural self-adapting background modeling with automatic motion analysis for dynamic object detection

In this paper we propose a system that involves a Background Subtraction, BS, model implemented in a neural Self Organized Map with a Fuzzy Automatic Threshold Update that is robust to illumination changes and slight shadow problems. The system incorporates a scene analysis scheme to automatically update the Learning Rates values of the BS model considering three possible scene situations. In order to improve the identification of dynamic objects, an Optical Flow algorithm analyzes the dynamic regions detected by the BS model, whose identification was not complete because of camouflage issues, and it defines the complete object based on similar velocities and direction probabilities. These regions are then used as the input needed by a Matte algorithm that will improve the definition of the dynamic object by minimizing a cost function. Among the original contributions of this work are; an adapting fuzzy-neural segmentation model whose thresholds and learning rates are adapted automatically according to the changes in the video sequence and the automatic improvement on the segmentation results based on the Matte algorithm and Optical flow analysis. Findings demonstrate that the proposed system produces a competitive performance compared with state-of-the-art reported models by using BMC and Li databases.     

Shadow elimination and vehicles classification approaches in traffic video surveillance context

Video surveillance on highway is a hot topic and a great challenge in Intelligent Transportation Systems. In such applications requiring objects extraction, cast shadows induce shape distortions and object fusions interfering performance of high level algorithms. Shadow elimination allows to improve the performances of video object extraction, classification and tracking. In other hand, it is very important to recognize the type of a detected object in order to track reliably and estimate traffic parameters correctly. This paper presents two approaches to enhance automatic traffic surveillance systems. The first deals with the elimination of shadows and the second concerns the classification of vehicles, based on robust vision and image processing. For moving shadow elimination, a contrast model is proposed to describe and remove dynamic shadows based on the idea that a shadow transformation is a change in contrast. For vehicles classification, Hu moments are calculated in a manner to reduce the perspective effects and used to describe vehicles in knowledge base. Experimental results on the various challenging video sequences show that the proposed approach outperforms classification methods of related works (with a classification accuracy of 96.96%), and that the shadow elimination approach performs better than compared works (with detection rate of 95–99% and discrimination rate of 85.7–89%).     

视频序列中运动对象检测技术的研究现状与展望*

将运动对象检测技术分为变化检测、运动检测和特征检测三类,介绍了各类技术的思想,对现有方法进行了归类,指出各方法的本质区别,从理论和实验两方面剖析其优势和不足并指出了适用场合。讨论了目前视频运动对象检测技术存在的问题,展望了未来的发展方向。     

Real-time traffic incident detection using a probabilistic topic model

Traffic congestion occurs frequently in urban settings, and is not always caused by traffic incidents. In this paper, we propose a simple method for detecting traffic incidents from probe-car data by identifying unusual events that distinguish incidents from spontaneous congestion. First, we introduce a traffic state model based on a probabilistic topic model to describe the traffic states for a variety of roads. Formulas for estimating the model parameters are derived, so that the model of usual traffic can be learned using an expectation–maximization algorithm. Next, we propose several divergence functions to evaluate differences between the current and usual traffic states and streaming algorithms that detect high-divergence segments in real time. We conducted an experiment with data collected for the entire Shuto Expressway system in Tokyo during 2010 and 2011. The results showed that our method discriminates successfully between anomalous car trajectories and the more usual, slowly moving traffic patterns.