统计模式识别中的维数削减与低损降维

较为全面地回顾了统计模式识别中常用的一些特征选择、特征提取等主流特征降维方法,介绍了它们各自的特点及其适用范围,在此基础上,提出了一种新的基于最优分类器——贝叶斯分类器的可用于自动文本分类及其它大样本模式分类的特征选择方法——低损降维.在标准数据集Reuters-21578上进行的仿真实验结果表明,与互信息、χ^2统计量以及文档频率这三种主流文本特征选择方法相比,低损降维的降维效果与互信息、χ^2统计量相当,而优于文档频率.     

Exploring dimensionality reduction of EEG features in motor imagery task classification

A Brain-Computer Interface (BCI) system based on motor imagery (MI) identifies patterns of electrical brain activity to predict the user intention while certain movement imagination tasks are performed. Currently, one of the most important challenges is the adaptive design of a BCI system. For solving it, this work explores dimensionality reduction techniques: once features have been extracted from Electroencephalogram (EEG) signals, the high-dimensional EEG data has to be mapped onto a new reduced feature space to make easier the classification stage. Besides the standard sequential feature selection methods, this paper analyzes two unsupervised transformation-based approaches – Principal Component Analysis and Locality Preserving Projections – and the Local Fisher Discriminant Analysis (LFDA), which works in a supervised manner. The dimensionality in the projected space is chosen following a wrapper-based approach by an efficient leave-one-out estimation. Experiments have been conducted on five novice subjects during their first sessions with MI-based BCI systems in order to show that the appropriate use of dimensionality reduction methods allows increasing the performance. In particular, obtained results show that LFDA gives a significant enhancement in classification terms without increasing the computational complexity and, then, it is a promising technique for designing MI-based BCI system.     

Text-independent speaker verification using ant colony optimization-based selected features

With the growing trend toward remote security verification procedures for telephone banking, biometric security measures and similar applications, automatic speaker verification (ASV) has received a lot of attention in recent years. The complexity of ASV system and its verification time depends on the number of feature vectors, their dimensionality, the complexity of the speaker models and the number of speakers. In this paper, we concentrate on optimizing dimensionality of feature space by selecting relevant features. At present there are several methods for feature selection in ASV systems. To improve performance of ASV system we present another method that is based on ant colony optimization (ACO) algorithm. After feature reduction phase, feature vectors are applied to a Gaussian mixture model universal background model (GMM-UBM) which is a text-independent speaker verification model. The performance of proposed algorithm is compared to the performance of genetic algorithm on the task of feature selection in TIMIT corpora. The results of experiments indicate that with the optimized feature set, the performance of the ASV system is improved. Moreover, the speed of verification is significantly increased since by use of ACO, number of features is reduced over 80% which consequently decrease the complexity of our ASV system.     

基于特征的弹性图匹配人脸识别算法改进

针对传统人脸识别弹性图匹配算法空间复杂度高、实时性较差的问题,提出一种弹性图匹配改进算法,将人脸图片特征点经Gabor小波预处理后,结合主成分分析(PCA)和Fisher线性判别方法(FLD)对生成的特征矢量进行处理,降低维数,减少计算量,同时在不降低识别率的前提下,提高识别速度。与传统的PCA算法、FLD算法、EGM算法进行仿真比较,证明该改进算法识别率高、实时性好。     

鲁棒主元分析在掌纹识别中的应用

为了对存在异常值的图像构建低维线性子空间的描述,提出用鲁棒主元分析(RPCA)的新方法进行掌纹识别。运用图像下抽样方法降低掌纹空间的维数,在低维图像上应用RPCA提取低维的投影向量,然后将训练图像和待识别图像向投影向量上投影得到鲁棒主元特征,计算特征向量间的余弦距离进行掌纹匹配。运用PolyU掌纹图像库进行测试,结果表明,与主元分析(PCA)、独立元分析(ICA)和核主元分析(KPCA)相比,RPCA算法的识别率最高为99%,特征提取和匹配总时间0.032 s,满足了实时系统的要求。     

Computational Intelligence-Based Biometric Technologies

Computational intelligence (CI) technologies are robust, can be successfully applied to complex problems, are efficiently adaptive, and usually have a parallel computational architecture. For those reasons they have been proved to be effective and efficient in bio-metric feature extraction and biometric matching tasks, sometimes used in combination with traditional methods. In this article, we briefly survey two kinds of major applications of CI in biometric technologies, CI-based feature extraction and CI-based biometric matching. Varieties of evolutionary computation and neural networks techniques have been successfully applied to biometric data representation and dimensionality reduction. CI-based methods, including neural network and fuzzy technologies, have also been extensively investigated for biometric matching. CI-based biometric technologies are powerful when used in the representation and recognition of incomplete biometric data, discriminative feature extraction, biometric matching, and online template updating, and promise to have an important role in the future development of biometric technologies     

应用小波包变换和主成分分析识别亚健康状态

为了评估亚健康状态,提出一种基于心电信号小波包变换和主成分分析的亚健康状态识别新方法。采用小波包变换对心电信号进行特征提取;再利用主成分分析（PCA）对所提特征进行降维处理,以剔除特征之间的冗余信息;最后应用线性判别式分析（LDA）对亚健康状态进行分类识别。研究结果显示,该方法能获得较高的识别率,对于实现亚健康状态的评估具有一定的参考价值。     

Multiclass Support Vector Machines for Classification of ECG Data with Missing Values

The article presents an experimental study on multiclass Support Vector Machine (SVM) methods over a cardiac arrhythmia dataset that has missing attribute values for electrocardiogram (ECG) diagnostic application. The presence of an incomplete dataset and high data dimensionality can affect the performance of classifiers. Imputation of missing data and discriminant analysis are commonly used as preprocessing techniques in such large datasets. The article proposes experiments to evaluate performance of One-Against-All (OAA) and One-Against-One (OAO) approaches in kernel multiclass SVM for a heartbeat classification problem with imputation and dimension reduction techniques. The results indicate that the OAA approach has superiority over OAO in multiclass SVM for ECG data analysis with missing values.     

基于深度学习的虹膜人脸多特征融合识别

传统多生物特征融合识别方法中人工设计特征提取存在盲目性和差异性,特征融合存在空间不匹配或维度过高等问题,为此提出一种基于深度学习的多生物特征融合识别方法。通过卷积神经网络(convolutional neural networks,CNN)提取人脸和虹膜特征、参数化t-SNE算法特征降维和支持向量机(support vector machine,SVM)分类组合进行融合识别。实验结果表明,该融合识别方法与单一生物特征识别以及其它融合识别方法相比,鲁棒性增强,识别性能提升明显。     

基于FCA-ReliefF的融合生理信号情绪识别研究

针对当前情绪识别研究中特征维数多、识别率不高的问题,提出了基于多生理信号(心电、肌电、呼吸、皮肤电)融合及FCA-ReliefF特征选择的情绪识别方法。通过将从时域和频域两个维度提取的生理信号特征进行融合,作为分类器的输入进行情绪分类。为了降低特征维度,首先进行特征相关性分析(FCA)删除相关性较大的特征;再通过ReliefF剔除分类贡献弱的特征,达到降低特征维度的目的。在公开的数据集上进行验证,并与相关研究进行对比。结果表明,提出的方法在特征维度及识别率两个方面均有优势。提出的FCA-ReliefF降维策略有效地将特征从108维减少到60维,并且将识别精度提高到98.40%,验证了方法的有效性。     

间距判别投影及其在表情识别中的应用

针对全局降维方法判别信息不足,局部降维方法对邻域关系的判定存在缺陷的问题,提出一种新的基于间距的降维方法——间距判别投影（MDP）。首先,根据类的中心均值的异类近邻关系定义描述类边缘的边界向量;在这个基础上,MDP重新定义类间离散度矩阵,同时,使用全局的方法构造类内离散度矩阵;然后,MDP借鉴判别分析思想建立衡量类间距的准则,并通过类间距最大化增强样本在投影空间中的可分性。对MDP在人脸表情数据库JAFFE和Extended Cohn-Kanade上进行表情识别实验,并且跟传统的降维方法主成分分析（PCA）、最大间距准则（MMC）和边界Fisher分析（MFA）进行对比,实验结果表明,所提算法能够有效提取更具区分性的低维特征,比其他几种方法分类精度更高。     

基于人体轮廓宽度特征的步态识别

基于人体轮廓宽度特征提出了一种步态识别算法。首先对每个序列进行运动轮廓抽取,将这些时变的二维轮廓形状转换为对应的一维横向宽度信号,通过主元分析法(PCA)来提取低维步态特征,在此基础上采用线性判决分析(LDA),以获取最佳投影方向,达到提高数据分类能力的目的。在NLPR、CMU和UMF步态数据库中进行实验,结果表明算法具备快速、稳健特征,在实际应用中具备较大的价值。     

Kernel-based nonlinear dimensionality reduction for electrocardiogram recognition

The human heart is a complex system that reveals many clues about its condition in its electrocardiogram (ECG) signal, and ECG supervising is the most important and efficient way of preventing heart attacks. ECG analysis and recognition are both important and tempting topics in modern medical research. The purpose of this paper is to develop an algorithm which investigates kernel method, locally linear embedding (LLE), principal component analysis (PCA), and support vector machine(SVM) algorithms for dimensionality reduction, features extraction, and classification for recognizing and classifying the given ECG signals. In order to do so, a nonlinear dimensionality reduction kernel method based LLE is proposed to reduce the high dimensions of the variational ECG signals, and the principal characteristics of the signals are extracted from the original database by means of the PCA, each signal representing a single and complete heart beat. SVM method is applied to classify the ECG data into several categories of heart diseases. Experimental results obtained demonstrated that the performance of the proposed method was similar and sometimes better when compared to other ECG recognition techniques, thus indicating a viable and accurate technique.     

基于PSO-ICA的文本分类研究

文本分类在采用向量空间模型（VSM）表达文本特征时,容易出现特征向量高维且稀疏的现象,为了对原始的文本特征向量进行有效简化,提出了一种基于粒子群（PSO）优化独立分量分析（ICA）进行降维的方法,并将其运用到文本分类中。在该算法中,以负熵作为粒子群算法的适应度函数,依据其高斯性原理作为独立性判别标准对分离矩阵进行自适应更新。实验结果表明,相比于传统的特征降维方法,该方法可以解决高维度文本特征向量降维困难的问题,使得文本分类的效率、准确率显著提升。     

Dimensionality reduction based on binary encoding for hyperspectral data

Binary encoding is an approach that aims at summarizing the information contained in various spectral bands into a single image that stores the meaningful information of the bands. In this paper, it is introduced a feature extraction approach to reduce the dimensionality of hyperspectral data with binary encoding for classification purposes. Different options to reduce the radiometric information of the pixels are introduced, such as using a single threshold or multiple thresholds. After the dimensionality reduction, the separation of the spectral classes was analysed and the thematic classification of the reduced data was performed. In order to evaluate the performance of the proposed approach, experiments on AVIRIS (Airborne Visible/Infrared Imaging Spectrometer) image, ROSIS (Reflection Optics System Imaging Spectrometer) hyperspectral image and HYDICE (Hyperspectral Digital Imagery Collection Experiment) hyperspectral image are presented. In the experiments, neighbouring spectral bands are grouped and coded and the results of the classification are compared. The results show that the use of binary encoding based on three thresholds by spectral region is more efficient than with the use of one threshold. The thematic mapping of the hyperspectral data with reduced dimension confirms the competitiveness of the binary encoding method compared with other dimension reduction methods, such as the Principal Component Analysis (PCA), the Principal Component Analysis – Fisher’s Linear Discriminant Analysis (PCA-LDA), the Discriminant Analysis Feature Extraction (DAFE) and the Non-parametric Weighted Feature Extraction (NWFE). In this context, the present methodology shows to be promising, because it reduces the computational complexity and improves performance.     

基于主成分分析方向深度梯度直方图的立体视觉深度图特征提取

针对立体视觉深度图特征提取精确度低、复杂度高的问题,提出了一种基于主成分分析方向深度梯度直方图(PCA-HODG)的特征提取算法。首先,对双目立体视觉图像进行视差计算和深度图提取,获取高质量深度图;然后,基于预设大小窗口对所获取的深度图进行边缘检测和梯度计算,获得区域形状直方图特征并量化;同时运用主成分分析(PCA)进行降维;最后,为实现特征获取的精确性和完整性,采用滑动窗口检测方法实现整幅深度图的特征提取,并再次降维。在特征匹配分类实验中,对于Street测试序列帧,该算法比距离样本深度特征(RSDF)算法平均分类准确率提高了1.15%,而对于Tanks、Tunnel、Temple测试序列帧,该算法比测度不变特征(GIF)算法平均分类准确率分别提高了0.69%、1.95%、0.49%;同时与方向深度直方图(HOD)、RSDF、GIF算法相比,平均运行时间分别降低了71.65%、78.05%、80.06%。实验结果表明,该算法不仅能够更精确地检测和提取深度图特征,而且通过降低维数复杂度大大减少了运行时间;同时算法具有较好的鲁棒性。     

基于LBP和SVM的疼痛表情识别

对面部疼痛表情估计是疼痛评估中一条有效的途径,文中融合局部二元模式(LBP)分块加权和多尺度分区的特征提取方法用于面部疼痛表情识别.首先对预处理的图像在分块提取直方图后进行加权,然后采用多尺度分区直方图统计特征提取方法,串接不同尺寸分区块的直方图并级联分块加权的直方图为整个图像的特征向量,最后用主成分分析(PCA)的方法对特征向量进行降维后,输入支持向量机(SVM)进行分类识别,通过在自建的疼痛表情图像数据库进行实验,表明与传统的特征提取和融合前的特征提取方法相比,该方法能大大提高对疼痛表情的识别率,为目前对疼痛表情的识别与研究提供了一条有效的途径.     

Biometric dispersion matcher versus LDA

This paper compares the recently developed biometric dispersion matcher (BDM) with the classical linear discriminant analysis (LDA) for biometric pattern recognition. BDM is extended to the BDM with simultaneously diagonalization (BDMSD) of the covariance matrices and, from a theoretical point of view, it is demonstrated that the feature selection of LDA and BDMSD are equivalent. However, LDA uses the between-class scatter matrix (S_B) only for feature selection and BDMSD also uses it for classification. This implies a set of advantages. Mainly the BDMSD offers better generalization capability for classifying samples of users that have not been used for training the classifier. Experimental results show that BDM and BDMSD outperform LDA in face recognition and hand-geometry recognition. These two cases correspond to very different situations: number of samples greater than their dimensionality (hand-geometry) and number of samples similar to their dimensionality (face recognition).     

基于加权PCA的声音指纹降维技术

声音指纹技术现在已经广泛的应用到了歌曲搜索、乐曲识别、声音修复等各个领域，但其关键技术——音频降维技术仍存在分类效果不好、可靠性不高等问题。针对音频数据高维化存在较大随意性，提出了基于模式识别的音频数据高维化的最优方法。并在此基础上，提出了采用加权PCA方法作为声音指纹的降维技术，不仅分类效果大为明显，且由于方法还保持了线性方法的简单性，保证了大批量处理数据成为可能。     

A view-invariant gait recognition algorithm based on a joint-direct linear discriminant analysis

This paper proposes a view-invariant gait recognition algorithm, which builds a unique view invariant model taking advantage of the dimensionality reduction provided by the Direct Linear Discriminant Analysis (DLDA). Proposed scheme is able to reduce the under-sampling problem (USP) that appears usually when the number of training samples is much smaller than the dimension of the feature space. Proposed approach uses the Gait Energy Images (GEIs) and DLDA to create a view invariant model that is able to determine with high accuracy the identity of the person under analysis independently of incoming angles. Evaluation results show that the proposed scheme provides a recognition performance quite independent of the view angles and higher accuracy compared with other previously proposed gait recognition methods, in terms of computational complexity and recognition accuracy.