融合全局和局部特征并基于神经网络的表情识别

在表情中含有最多特征信息的是面部眉毛、眼睛和嘴巴这三个区域,为充分利用这些特征,减少图像中无用信息在识别过程中对计算机内存的占用,提高人脸表情识别系统的准确率和速度,首先采用haar 和 adaboost人脸检测算法,对图像中的人脸进行识别,获得人脸图像并提取眉毛、眼睛和嘴巴,生成局部(眉毛、眼睛、嘴巴)二值化图,利用PCA方法对人脸图像降维,降维后的全局和局部灰度特征值组成一个列向量。样本由表情数据库产生,经过神经网络样本训练后,进行表情识别。结果表明,该系统对人脸表情识别速度明显快于Gabor 小波算法;识别的准确率高于单独使用PCA算法和神经网络算法;消耗内存比用Gabor 小波算法少,运行较流畅。得出结论：因为提取出包含表情特征信息集中区的眉毛、眼睛和嘴巴,尽可能地多保留了这些局部特征信息,因而提高了表情识别准确率,同时,采用PCA方法对原始图像进行降维处理,有效的减少了信息冗余。     

Deformation modeling for robust 3D face matching

Face recognition based on 3D surface matching is promising for overcoming some of the limitations of current 2D image-based face recognition systems. The 3D shape is generally invariant to the pose and lighting changes, but not invariant to the non-rigid facial movement, such as expressions. Collecting and storing multiple templates to account for various expressions for each subject in a large database is not practical. We propose a facial surface modeling and matching scheme to match 2.5D facial scans in the presence of both non-rigid deformations and pose changes (multiview) to a 3D face template. A hierarchical geodesic-based resampling approach is applied to extract landmarks for modeling facial surface deformations. We are able to synthesize the deformation learned from a small group of subjects (control group) onto a 3D neutral model (not in the control group), resulting in a deformed template. A user-specific (3D) deformable model is built by combining the templates with synthesized deformations. The matching distance is computed by fitting this generative deformable model to a test scan. A fully automatic and prototypic 3D face matching system has been developed. Experimental results demonstrate that the proposed deformation modeling scheme increases the 3D face matching accuracy.     

结构特征下的可撤销人脸识别

目的 相对于其他生物特征识别技术,人脸识别具有非接触、不易察觉和易于推广等特点,在公共安全和日常生活中得到广泛应用。在移动互联网时代,云端人脸识别可以有效地提高识别精度,但是需要将大量的人脸数据上传到第三方服务器。由于人的面部特征是唯一的,一旦数据库泄露就会面临模板攻击和假冒攻击等安全威胁。为了保证人脸识别系统的安全性并提高其识别率,本文提出一种融合人脸结构特征的可撤销人脸识别算法。方法 首先,对原始人脸图像提取结构特征作为虚部分量,与原始人脸图像联合构建复数矩阵并通过随机二值矩阵进行置乱操作。然后,使用2维主成分分析方法将置乱的复数矩阵映射到新的特征空间。最后,采用基于曼哈顿距离的最近邻分类器计算识别率。结果 在4个不同人脸数据库上的实验结果表明,原始人脸图像和结构特征图像经过随机二值矩阵置乱后,人眼无法察觉出有用的信息且可以重新生成,而且融合方差特征后,在GT （Georgia Tech）、NIR （Near Infrared）、VIS （Visible Light）和YMU （YouTuBe Makeup）人脸数据库上,平均人脸识别率分别提高了4.9%、2.25%、2.25%和1.98%,且平均测试时间均在1.0 ms之内,表明该算法实时性强,能够满足实际应用场景的需求。结论 本文算法可在不影响识别率的情况下保证系统的安全性,满足可撤销性。同时,融合结构特征丰富了人脸信息的表征,提高了人脸识别系统的识别率。     

Face recognition based on 3D ridge images obtained from range data

In this paper, we present an approach for 3D face recognition from frontal range data based on the ridge lines on the surface of the face. We use the principal curvature, k_max, to represent the face image as a 3D binary image called ridge image. The ridge image shows the locations of the ridge points around the important facial regions on the face (i.e., the eyes, the nose, and the mouth). We utilized the robust Hausdorff distance and the iterative closest points (ICP) for matching the ridge image of a given probe image to the ridge images of the facial images in the gallery. To evaluate the performance of our approach for 3D face recognition, we performed experiments on GavabDB face database (a small size database) and Face Recognition Grand Challenge V2.0 (a large size database). The results of the experiments show that the ridge lines have great capability for 3D face recognition. In addition, we found that as long as the size of the database is small, the performance of the ICP-based matching and the robust Hausdorff matching are comparable. But, when the size of the database increases, ICP-based matching outperforms the robust Hausdorff matching technique.     

基于网格IC图象的多模板快速匹配算法

为了加快 IC图象中多个相似单元模板的匹配与定位 ,提出了一种基于网格 IC图象的多模板快速匹配算法 .该算法首先抽取网格图象和模板的二值拓扑结构 ,以构成图象和模板的粗分辨率表示 ;然后 ,在拓扑结构表示上通过综合来构造多模板的二叉树模型 ;接着 ,在二值拓扑结构表示上运用树模型进行搜索 ,在搜索过程中应用二叉决策树识别多个模板 ;最后 ,将粗匹配得到的目标 ,在原图象对应位置的小邻域内进行二次匹配 ,以确定模板和对应实例的位置 .应用此算法对 IC图象库进行测试 ,结果表明 ,所提出的多模板二叉决策树搜索算法与逐个模板匹配的方法相比 ,速度和效率均有较大幅度的提高     

基于标准肤色的人脸图像纹理合成与三维重建应用

本文提出一种基于单幅人脸图像并结合标准肤色的人脸图像纹理合成和三维重建算法.首先,利用ASM算法提取人脸特征点,并通过基于局部线性嵌入算法的编辑传播实现颜色转换,使图像人脸色调与三维人脸模型标准肤色一致.接着,将人脸图像五官区域与标准肤色图进行泊松融合,并考虑眉毛遮挡情况,利用人脸对称性或眉毛模板还原眉毛.尤其对于半遮挡眉毛,采用Li模型和角点检测相结合的方法重建眉毛轮廓,得到最终人脸纹理图.最后通过纹理映射将人脸纹理图映射到三维人脸模型上,得到较好的个性化三维人脸重建效果.实验表明,本文算法能够适用于不同复杂背景和光照条件下拍摄的人脸图像,具有较快的处理速度,能够应用于人脸实时重建产品中.     

基于模板匹配的手写数字决策分类器设计

针对手写数字识别提出一种基于模板匹配决策分类器设计方法。就该方法下的模式识别分类器设计进行详细论述,给出该分类器算法实现。该算法在对手写的数字图像进行预处理的基础上从待识别的手写数字图像中提取若干特征量与事先建立的标准模板库中模板对应的特征量进行比较,计算待识别图像和标准模板特征量之间的距离,用最小距离法判定其所属类。实验结果表明,该决策分类器算法实现容易,匹配速度快,保证字符识别的正确率。     

人脸图像的自动校准算法

人脸自动识别是计算机模式识别领域的一个活跃课题,有着十分广泛的应用前景。在人脸图像中人脸的尺度、位置与姿态变化影响了人脸特征的抽取,所以需要对人脸图像作人脸校准的预处理。文中提出的算法利用模板匹配方法从人脸图像中提取出人脸姿态校准图像,再从中抽取出两个眼睛的位置,从而对人脸的尺度、位置与姿态变化实现自动校准。对有２１６幅人脸图像的人脸图像数据库作人脸自动校准实验,成功率是１００％,而且利用所得到人脸脸部校准图像进行的人脸识别实验的正确识别率可达到９０％左右,这表明该算法是比较有效的     

基于模板匹配的手写数字决策分类器设计

针对手写数字识别提出一种基于模板匹配决策分类器设计方法。就该方法下的模式识别分类器设计进行详细论述,给出该分类器算法实现。该算法在对手写的数字图像进行预处理的基础上从待识剐的手写数字图像中提取若干特征量与事先建立的标准模板库中模板对应的特征量进行比较,计算待识别图像和标准模板特征量之间的距离,用最小距离法判定其所属类。实验结果表明,该决策分类器算法实现容易,匹配速度快,保证字符识别的正确率。     

基于模板聚类与综合的多模板快速定位算法

针对在一幅图像中定位多个模板的所有实例的情形，提出了一种基于多模板聚类和综合的快速目标定位方法。该方法首先使用带反馈的分级聚类算法对多模板进行聚类，并对每类模板用建立的数学模型综合出一个母板；然后，应用每类的母板在平移空间内搜索和匹配，且只在与母板相匹配的那些位置上才引导类内各子模板在该位置的匹配运算，最后用该算法对边缘图像进行了聚类、综合和匹配实验。实验结果表明，该算法在集成电路显微图像的多模板定位中是非常有效的。     

From scores to face templates: a model-based approach

Regeneration of templates from match scores has security and privacy implications related to any biometric authentication system. We propose a novel paradigm to reconstruct face templates from match scores using a linear approach. It proceeds by first modeling the behavior of the given face recognition algorithm by an affine transformation. The goal of the modeling is to approximate the distances computed by a face recognition algorithm between two faces by distances between points, representing these faces, in an affine space. Given this space, templates from an independent image set (break-in) are matched only once with the enrolled template of the targeted subject and match scores are recorded. These scores are then used to embed the targeted subject in the approximating affine (non-orthogonal) space. Given the coordinates of the targeted subject in the affine space, the original template of the targeted subject is reconstructed using the inverse of the affine transformation. We demonstrate our ideas using three, fundamentally different, face recognition algorithms: Principal Component Analysis (PCA) with Mahalanobis cosine distance measure, Bayesian intra-extrapersonal classifier (BIC), and a feature-based commercial algorithm. To demonstrate the independence of the break-in set with the gallery set, we select face templates from two different databases: Face Recognition Grand Challenge (FRGC) and Facial Recognition Technology (FERET) Database (FERET). With an operational point set at 1 percent False Acceptance Rate (FAR) and 99 percent True Acceptance Rate (TAR) for 1,196 enrollments (FERET gallery), we show that at most 600 attempts (score computations) are required to achieve a 73 percent chance of breaking in as a randomly chosen target subject for the commercial face recognition system. With similar operational set up, we achieve a 72 percent and 100 percent chance of breaking in for the Bayesian and PCA based face recognition systems, respectively. With three different levels of score quantization, we achieve 69 percent, 68 percent and 49 percent probability of break-in, indicating the robustness of our proposed scheme to score quantization. We also show that the proposed reconstruction scheme has 47 percent more probability of breaking in as a randomly chosen target subject for the commercial system as compared to a hill climbing approach with the same number of attempts. Given that the proposed template reconstruction method uses distinct face templates to reconstruct faces, this work exposes a more severe form of vulnerability than a hill climbing kind of attack where incrementally different versions of the same face are used. Also, the ability of the proposed approach to reconstruct actual face templates of the users increases privacy concerns in biometric systems.     

基于模板匹配与支持矢量机的人脸检测

人脸检测是人脸识别与基于内容的图像及视频检索的一项重要任务。由于非人脸样本相对于人脸样本的多样性和复杂性，使得人脸模式分类器的训练十分困难。该文提出了一种将模板匹配与支持矢量机（SVM）相结合的人脸检测算法。算法首先使用双眼－人脸模板对进行粗筛选，然后使用SVM分类器进行分类。在模板匹配限定的子空间内采用“自举”方法收集“非人脸”样本训练SVM，有效地降低了训练的难度，实验结果的对比数据表明，该算法是十分有效的。     

An entropy based method for extracting robust binary-templates

In applications based on template matching, the design of the template is a critical point and has a considerable effect on the overall performance that can be obtained. In this paper we present a method, applicable to binary images, for extracting robust templates. Starting from a provisional prototype (defined as the image that minimizes its overall distance from the samples of a training set), the template is obtained by eliminating unreliable pixels determined by means of an entropy-based criterion. The method is compared experimentally with the matched filtering technique in the recognition of symbols on topographic maps and shows promising results regarding the recognition rate and the computational cost of the matching process.     

Integrating face and gait for human recognition at a distance in video.

This paper introduces a new video-based recognition method to recognize noncooperating individuals at a distance in video who expose side views to the camera. Information from two biometrics sources, side face and gait, is utilized and integrated for recognition. For side face, an enhanced side-face image (ESFI), a higher resolution image compared with the image directly obtained from a single video frame, is constructed, which integrates face information from multiple video frames. For gait, the gait energy image (GEI), a spatio-temporal compact representation of gait in video, is used to characterize human-walking properties. The features of face and gait are obtained separately using the principal component analysis and multiple discriminant analysis combined method from ESFI and GEI, respectively. They are then integrated at the match score level by using different fusion strategies. The approach is tested on a database of video sequences, corresponding to 45 people, which are collected over seven months. The different fusion methods are compared and analyzed. The experimental results show that: 1) the idea of constructing ESFI from multiple frames is promising for human recognition in video, and better face features are extracted from ESFI compared to those from the original side-face images (OSFIs); 2) the synchronization of face and gait is not necessary for face template ESFI and gait template GEI; the synthetic match scores combine information from them; and 3) an integrated information from side face and gait is effective for human recognition in video.     

纹理特征和两级分类器相结合的人脸识别

为了提高人脸识别率和识别效率,提出一种纹理特征和两级分类器相结合的人脸识别方法。采用灰度共生矩阵表示人脸图像的纹理特征,计算待识别人脸图像与模板间欧式距离,采用拒识阈值进行评判,如果人脸图像归属类别清楚,则采用欧式距离分类器进行识别,否则将待识人脸图像送入SVM分类器进行识别,采用ORL人脸数据库和Yale人脸数据库进行仿真实验。仿真结果表明,相对于单一人脸识别器,两级分类器不仅提高了人脸识别效率,而且提高了人脸识别率,具有更好的人脸识别性能。     

频谱脸：一种基于小波变换和Fourier变换的人像识别新方法

提出了一人基于小波变换和Ｆｏｕｒｉｅｒ变换的人像识别新方法,它首先对人像作适当层数的二维小波分解,然后对其低频的子图象作Ｆｏｕｒｉｅｒ变换,从而获得原人像的一个低维空间的表达,该表达是振幅谱位移不变的。在Ｙａｌｅ和Ｏｌｉｖｅｔｔｉ人像数据库上的实验表明,频谱脸的方法比ＰＣＡ的方法和空间模式匹配法有更佳的识别效果,特别是它能有效地消除因为人像的表情变化和少许遮掩带来的识别误差。     

基于傅立叶变换的掌纹识别方法

掌纹识别是指由计算机自动识别哪些掌纹图像来自同一只手掌,哪些来自不同的手掌.在掌纹识别中,特征提取算法的优劣至关重要.提出了一种基于傅立叶变换的掌纹特征提取方法.该方法的基本思想是先将掌纹图像应用傅立叶变换转换到频域,然后在频域中进行特征提取和描述.提取出来的特征备用来索引掌纹数据库,以便当一个新的掌纹图像被输入时,可以很快确定该手掌是否已经在掌纹库中注册.该方法可以用来做基于人体生物特征的身份识别,在安全领域有广泛的应用前景.实验验证了该方法的有效性.     

机器人系统中人脸特征提取技术的研究与实现

该文描述了在智能机器人系统中人脸特征提取技术的研究与实现,提出了一种新的并且在机器人系统中实现的人脸特征提取方法,该方法首先利用基于Adaboost的人脸检测算法对采集到的原始图像进行人脸检测,从而得到人脸图像;然后让人脸图像通过一个空间掩模滤波器,去除图像中明显非人脸特征的区域,再经过二值化后得到二值化图像;将二值化图像与一个矩形模板相卷积,得到卷积值与模板索引数的二维曲线图,在二维曲线图中,最高的两个峰就分别对应了眼睛和眉毛,再根据人脸特征几何分布关系判断出眼睛,眉毛和嘴,从而得到最终的人脸特征.该方法检测率高,计算量小,实时性很强,满足了机器人系统中资源有限的约束条件.     

融合人脸多特征信息的表情识别系统

基于对处于不同表情中人脸特征差异的分析,发现用同种方法提取面部各部分特征无法达到信息利用度的最大化,会产生有用信息丢失或者冗余计算,降低了算法的识别准确率和运行速度。针对面部表情改变时,变化最大的3个部分——嘴、额头和眉毛在形状、纹理和距离上的差异,提出用模板匹配法提取嘴部特征,用边缘检测法提取额头特征,用外轮廓检测法提取眉毛特征,并综合这三者的输出得到最终面部表情识别结果的多特征提取识别系统。实验结果验证了该方法的稳定性与有效性,该算法无论在识别准确率还是在整体运行速度上都达到了较高的水平。