Vision-based segmentation of continuous mechanomyographic grasping sequences.

In detecting motor related activity from mechanomyographic (MMG) recordings, the acquisition of long, continuous streams of MMG signals is typically preferred over the painstaking collection of individual, isolated contractions. However, a major challenge with continuous collection is the subsequent separation of the MMG data stream into segments representing individual contractions. This paper proposes a method for segmenting continuously recorded MMG data streams using computer vision while providing a highly reduced set of key images for rapid human expert verification. Transverse plane video recordings of functional grasp sequences were synchronized with the acquisition of MMG signals from the forearm. An automatic, vision-based algorithm exploiting skin color detection, motion estimation, and template matching provided segmentation cues for MMG signals arising from multiple grips. The automatic segmentation method tolerated extraneous hand movements, differentiated among multiple grips and estimated grip transition times. Our implementation segmented two grips with an average accuracy of 97.8 -/+ 4%, and up to seven grips with an accuracy of 73 -/+ 20%. The automatically extracted contraction initiation and termination times were within 173 -/+ 133 ms of the times obtained via manual segmentation. It is suggested that the proposed method would be particularly conducive to the assembly of large collections of signals for training MMG-driven prostheses.     

Automated extraction of temporal motor activity signals from video recordings of neonatal seizures based on adaptive block matching

This paper presents an automated procedure developed to extract quantitative information from video recordings of neonatal seizures in the form of motor activity signals. This procedure relies on optical flow computation to select anatomical sites located on the infants' body parts. Motor activity signals are extracted by tracking selected anatomical sites during the seizure using adaptive block matching. A block of pixels is tracked throughout a sequence of frames by searching for the most similar block of pixels in subsequent frames; this search is facilitated by employing various update strategies to account for the changing appearance of the block. The proposed procedure is used to extract temporal motor activity signals from video recordings of neonatal seizures and other events not associated with seizures.     

Extraction of motion strength and motor activity signals from video recordings of neonatal seizures

This paper presents two methods developed to extract quantitative information from video recordings of neonatal seizures in the form of temporal motion strength and motor activity signals. Motion strength signals are extracted by measuring the area of the body parts that move during the seizure and the relative speed of motion using a combination of spatiotemporal subband decomposition of video, nonlinear filtering, and segmentation. Motor activity signals are extracted by tracking selected anatomical sites during the seizure using a modified version of a feature-tracking procedure developed for video, known as the Kanade-Lucas-Tomasi (KLT) algorithm. The experiments indicate that the temporal signals produced by the proposed methods provide the basis for differentiating myoclonic from focal clonic seizures and distinguishing these types of neonatal seizures from normal infant behaviors.     

实时视频信号的Sobel边缘检测的FPGA实现

在实时视频信号处理中,由于边缘检测等图像处理算法的数据量大,系统采用FPGA+DSP的图像处理方案。利用FPGA可对数据并行处理的特点,在FPGA中实现数据量大、处理速度要求高,但算法结构简单的低层处理算法。文中介绍了在FPGA中实现Sobel边缘检测算法的方法,并提出了自适应阈值的处理方案。实验结果证明,FPGA能够对实时视频信号完成Sobel边缘检测,且自适应阈值模块保证了系统在环境亮度变化的情况下,得到良好的边缘检测效果。     

Selectivity of spatial filters for surface EMG detection from the tibialis anterior muscle

Many spatial filters have been proposed for surface electromyographic (EMG) signal detection. Although theoretical and modeling predictions on spatial selectivity are available, there are no extensive experimental validations of these techniques based on single motor unit (MU) activity detection. The aim of this study was to compare spatial selectivity of one- and two-dimensional (1-D and 2-D) spatial filters for EMG signal detection. Intramuscular and surface EMG signals were recorded from the tibialis anterior muscle of ten subjects. The simultaneous use of intramuscular wire and surface recordings (with the spike triggered averaging technique) allowed investigation of the activity of single MUs at the skin surface. The surface EMG signals were recorded with a grid of point electrodes (3 x 3 electrodes) and a ring electrode system at 15 locations over the muscle, with the wires detecting signals from the same intramuscular location. For most subjects, it was possible to classify, from the intramuscular recordings, the activity of the same MUs for all the contractions. The surface EMG signals were averaged with the intramuscularly detected MU action potentials as triggers. In this way, eight spatial filters--longitudinal and transversal, single and double differential (LSD, TSD, LDD, TDD), Laplacian (NDD), inverse binomial filter of the second order (IB2), inverse rectangle filter (IR), and differential ring system (C1)--could be compared on the basis of their spatial selectivity. The distance from the source (transversal with respect to the muscle fiber orientation) after which the surface detected potential did not exceed +/- 5% of the maximal peak-to-peak amplitude (detection distance) was statistically smaller for the 2-D systems and TDD than for the other filters. The MU action potential duration was significantly shorter with LDD and with the 2-D systems than with the other filters. The 2-D filters investigated (including C1) showed very similar performance and were, thus, considered equivalent from the point of view of spatial selectivity.     

Automated prediction of the apnea-hypopnea index from nocturnal oximetry recordings

Nocturnal polysomnography (PSG) is the gold-standard for sleep apnea-hypopnea syndrome (SAHS) diagnosis. It provides the value of the apnea-hypopnea index (AHI), which is used to evaluate SAHS severity. However, PSG is costly, complex, and time-consuming. We present a novel approach for automatic estimation of the AHI from nocturnal oxygen saturation (SaO(2)) recordings and the results of an assessment study designed to characterize its performance. A set of 240 SaO(2) signals was available for the assessment study. The data were divided into training (96 signals) and test (144 signals) sets for model optimization and validation, respectively. Fourteen time-domain and frequency-domain features were used to quantify the effect of SAHS on SaO(2) recordings. Regression analysis was performed to estimate the functional relationship between the extracted features and the AHI. Multiple linear regression (MLR) and multilayer perceptron (MLP) neural networks were evaluated. The MLP algorithm achieved the highest performance with an intraclass correlation coefficient (ICC) of 0.91. The proposed MLP-based method could be used as an accurate and cost-effective procedure for SAHS diagnosis in the absence of PSG.     

2-D direction finding of coherent signals VIA Temporo-Spatial processing

In most wireless communication systems, two-dimensional Directions-Of-Arrival (DOA) of multipath signals need to be found for spatial selective transmission. However, it is quite difficult to find their DOAs due to the coherent nature of multipath signals and considerable computations when performing 2-D searches. In this paper, a new algorithm to estimate 2-D DOA of multiple narrow-band signals is proposed. A DOA cyclic matrix is constructed whose eigenvalues and eigenvectors can be simultaneously used to extract 2-D DOA without 2-D searches. By exploiting the temporal property of cyclostationarity, the signal detection capability is significantly improved. Besides, based on the decorrelation model for mobile terminal signals, the algorithm can be effectively extended to the coherent case without spatial smoothing and the loss of array aperture. Simulation results are given to illustrate the performance of the new algorithm.     

视频图像中人脸自动检测与统计算法

针对视频中人脸检测由于成像角度、天气状况、遮挡等因素造成检测准确率偏低以及深度学习模型计算复杂度高的问题,文中提出了一种基于椭圆肤色模型与AdaBoost的人脸检测算法。算法通过选取Haar-like特征作为弱分类器,以裁剪过的CAS_PEAL数据集中的人脸图像作为训练集,利用AdaBoost算法将多个弱分类器组合成一个强分类器,最后将若干强分类器以级联的结构组成最终的分类器模型。为解决将非人脸区域检测为人脸的问题,引入椭圆肤色模型,利用椭圆肤色模型对视频帧进行处理使得图像中与肤色相似的区域进入后续的人脸检测过程以降低误检率。实验结果表明,算法能以平均26 ms(单人脸视频)和平均34 ms(多人脸视频)的检测速度进行实时的人脸检测,且达到了87.2%的检测准确率,具有较大的应用推广价值。     

Improving the accuracy and reliability of motion tracking methods used for extracting temporal motor activity signals from video recordings of neonatal seizures

This paper presents an approach for improving the accuracy and reliability of motion tracking methods developed for video based on block motion models. This approach estimates the displacement of a block of pixels between two successive frames by minimizing an error function defined in terms of the pixel intensities at these frames. The minimization problem is made analytically tractable by approximating the error function using a second-order Taylor expansion. The improved reliability of the proposed method is illustrated by its application in the extraction of temporal motor activity signals from video recordings of neonatal seizures.     

NeuroGlasses: a neural sensing healthcare system for 3-D vision technology

3-D vision technologies are extensively used in a wide variety of applications. Particularly glasses-based 3-D technology facilities are increasingly becoming affordable to our daily lives. Considering health issues raised by 3-D video technologies, to the best of our knowledge, most of the pilot studies are practiced in a highly-controlled laboratory environment only. In this paper, we present NeuroGlasses, a nonintrusive wearable physiological signal monitoring system to facilitate health analysis and diagnosis of 3-D video watchers. The NeuroGlasses system acquires health-related signals by physiological sensors and provides feedbacks of health-related features. Moreover, the NeuroGlasses system employs signal-specific reconstruction and feature extraction to compensate the distortion of signals caused by variation of the placement of the sensors. We also propose a server-based NeuroGlasses infrastructure where physiological features can be extracted for real-time response or collected on the server side for long term analysis and diagnosis. Through an on-campus pilot study, the experimental results show that NeuroGlasses system can effectively provide physiological information for healthcare purpose. Furthermore, it approves that 3-D vision technology has a significant impact on the physiological signals, such as EEG, which potentially leads to neural diseases.     

网格运动分析与形态学滤波相结合的视频对象分割

提出了一种基于二维网格运动分析与改进形态学滤波空域自动分割策略相结合的视频对象时空分割算法。该算法首先利用高阶统计方法对视频图像的二维网格表示进行运动分析，快速得到前景对象区域，通过后处理有效获得前景对象运动检测掩膜。然后，用一种结合交变序列重建滤波算法和自适应阈值判别算法的改进分水岭分割策略有效获得前景对象的精确边缘。最后，用区域基时空融合算法将时域分割结果和空域分割结果结合起来提取出边缘精细的视频对象。实验结果表明，本算法综合了多种算法的优点，主客观分割效果理想。     

Automatic decomposition of selective needle-detected myoelectricsignals

A procedure for the storage and documentation of myoelectric signals has been developed that consists of a selective needle signal detection protocol, a data collection-compression routine, an adaptive signal decomposition algorithm, and an error filter. The collection-compression routine stores only fixed-length signal epochs that contain motor unit action potentials (MUAPs) detected during individual motor unit firings. The decomposition algorithm assigns the collected MUAPs to candidate motor units, based on template matching using power-spectrum domain features and firing-time criteria calculated from the motor units' firing statistics. Power spectrum features allow the use of Nyquist sampling rates and remove the need for template alignment. The algorithm is adaptive and attempts to minimize dependent errors. The error filter, using firing statistics, accounts for unresolved superpositions and other decomposition errors. Using a standard TECA single-fiber needle electrode, signal recorded during isometric, constant, or slow force-varying contractions of up to 50% of the maximal voluntary contraction level, have been successfully analyzed     

基于少量样本学习的多目标检测跟踪方法

视频目标检测跟踪算法一直是计算机视觉领域的研究热点,目前大部分方法均需人工采集样本训练检测模型,搭建目标检测跟踪系统.当目标成像条件发生变化时,需重新采集样本,训练模型,调试整个检测跟踪系统,耗费大量人力、物力.本文提出一种基于少量样本学习的多目标检测跟踪算法,只需在监控视频第一帧指定待检测目标,即可自主生成混合分类模...     

Quantifying motion in video recordings of neonatal seizures by robust motion trackers based on block motion models

This paper introduces a methodology for the development of robust motion trackers for video based on block motion models. According to this methodology, the motion of a site between two successive frames is estimated by minimizing an error function defined in terms of the intensities at these frames. The proposed methodology is used to develop robust motion trackers that rely on fractional block motion models. The motion trackers developed in this paper are utilized to extract motor activity signals from video recordings of neonatal seizures. The experimental results reveal that the proposed motion trackers are more accurate and reliable than existing motion tracking methods relying on pure translation and affine block motion models.     

基于四阶累积量的相干信号频率和二维到达角联合估计的新算法

该文提出了一种基于四阶累积量的相干信号频率和二维到达角联合估计的新算法-CTSS算法.CTSS算法利用双平行线阵的时空数据以及平滑技术构造了一个时空平滑矩阵,通过对其进行特征分解,并利用分解得到的特征值和特征矢量估计出空间相干信号的三维参数.在色噪声环境下,该算法能够精确地估计空间相干信号的三维参数,无需多维谱峰搜索,能实现信号三维参数的自动配对,并有效地解决了信源参数兼并问题.计算机仿真结果验证了算法的有效性.     

Video object segmentation by 2-D mesh-based motion analysis

Video object extraction is a key technology in content-based video coding.A novel video object extracting algorithm by two Dimensional (2-D) mesh-based motion analysis is proposed in this paper.Firstly,a 2-D mesh fitting the original frame image is obtained via feature detection algorithm. Then,higher order statistics motion analysis is applied on the 2-D mesh representation to get an initial motion detection mask.After post-processing,the final segmenting mask is quickly obtained.And hence the video object is effectively extracted.Experimental results show that the proposed algorithm combines the merits of mesh-based segmenting algorithms and pixel-based segmenting algorithms,and hereby achieves satisfactory subjective and objective performance while dramatically increasing the segmenting speed.     

基于长时信息的自适应话音激活检测

语音信号的长时信息应用于话音激活检测中表现优越.利用三种听觉滤波器组,对语音信号进行非线性的谱分解,本文提出了六种基于听觉滤波器组的长时信息,并提出了基于长时信息的自适应话音激活检测算法.该算法无需训练数据,根据多种长时信息,直接在待测信号中挑选出类别明确的信号,然后利用这些信号训练分类模型,对待测信号按帧进行语音-非语音分类.在TIMIT语音库和NOISEX-92噪声库上的实验表明,该算法在极低信噪比环境下,仍表现出更高的准确性和更强的稳健性.同时,在线实验表明,算法在实时处理中仍能取得优异的性能.     

梯度直方图和光流特征融合的视频图像异常行为检测算法

异常行为检测在智能监控系统领域中有广泛的应用前景。本文针对此应用领域,提出了一种结合光流特征和梯度直方图特征的视频异常行为检测及定位方法。首先利用视频背景提取算法进行前景提取和标注,实现对前景信息的分割。然后利用光流和梯度直方图特征提取算法对前景图像分别提取光流和梯度直方图特征,其次,使用支持向量机对数据进行训练和测试。最后结合光流幅度信息与前景标记信息对判断出来的异常行为进行定位。实验结果表明,与先前算法相比,本文算法可以检测出异常行为,并且能够对异常帧进行异常行为定位。      

压缩域中基于支持向量机的镜头边界检测算法

针对如何进一步提高镜头边界检测精度问题,本文提出了一个基于支持向量机SVM (Support Vector Machine)的镜头边界检测算法.该算法利用视频压缩域中特征,如宏块类型,帧间对应宏块DC系数差和帧类型将视频帧分为发生切变的帧、发生渐变的帧和非镜头变换帧三类,从而实现视频的镜头分割.实验结果表明该算法对摄像机的运动和大物体的进入具有很好的鲁棒性,且没有大多数算法中阈值选择的困难,将我们的算法与2001 TREC评估中最佳指标进行了比较,在综合度量查全率和查准率的性能指标F1上,比2001 TREC评估中最佳指标高约8％.     

Moving foreground object detection via robust SIFT trajectories

In this paper, we present an automatic foreground object detection method for videos captured by freely moving cameras. While we focus on extracting a single foreground object of interest throughout a video sequence, our approach does not require any training data nor the interaction by the users. Based on the SIFT correspondence across video frames, we construct robust SIFT trajectories in terms of the calculated foreground feature point probability. Our foreground feature point probability is able to determine candidate foreground feature points in each frame, without the need of user interaction such as parameter or threshold tuning. Furthermore, we propose a probabilistic consensus foreground object template (CFOT), which is directly applied to the input video for moving object detection via template matching. Our CFOT can be used to detect the foreground object in videos captured by a fast moving camera, even if the contrast between the foreground and background regions is low. Moreover, our proposed method can be generalized to foreground object detection in dynamic backgrounds, and is robust to viewpoint changes across video frames. The contribution of this paper is trifold: (1) we provide a robust decision process to detect the foreground object of interest in videos with contrast and viewpoint variations; (2) our proposed method builds longer SIFT trajectories, and this is shown to be robust and effective for object detection tasks; and (3) the construction of our CFOT is not sensitive to the initial estimation of the foreground region of interest, while its use can achieve excellent foreground object detection results on real-world video data.