一种基于遮挡区域补偿的眼镜去除方法

为了提高戴眼镜人脸图像的识别率, 提出了一种从人脸图像中检测并去除眼镜的方法。首先对输入的戴眼镜人脸图像与系统预留的无眼镜人脸图像进行基于人眼位置的标定, 检测出眼镜遮挡区域, 再用无眼镜人脸图像中对应的遮挡区域对戴眼镜人脸图像进行补偿, 从而合成了对应输入图像的不戴眼镜的人脸图像。实验结果表明, 该方法能有效地合成无眼镜人脸图像, 将合成后的人脸图像再应用于人脸识别系统, 识别率显著提高。     

眼镜遮挡下的正面人脸识别

针对眼镜遮档对人脸识别影响较大这一问题,提出一种从正面人脸图像中提取并摘除眼镜的方法。首先利用主成分分析和独立成分分析法对输入的戴眼镜人脸进行重建,对比重建人脸和输入人脸,从而提取眼镜遮档区域;然后经过迭代误差补偿合成相应的无眼镜人脸;最后考虑到合成图像的特殊性,使用改进的特征加权方法实现人脸识别。实验结果表明,利用提出的人脸重建和特征加权方法进行戴眼镜人脸识别,正确率可以达到91%,优于传统方法。     

Fast, automatic and fine-grained tampered JPEG image detection via DCT coefficient analysis

The quick advance in image/video editing techniques has enabled people to synthesize realistic images/videos conveniently. Some legal issues may arise when a tampered image cannot be distinguished from a real one by visual examination. In this paper, we focus on JPEG images and propose detecting tampered images by examining the double quantization effect hidden among the discrete cosine transform (DCT) coefficients. To our knowledge, our approach is the only one to date that can automatically locate the tampered region, while it has several additional advantages: fine-grained detection at the scale of 8×8 DCT blocks, insensitivity to different kinds of forgery methods (such as alpha matting and inpainting, in addition to simple image cut/paste), the ability to work without fully decompressing the JPEG images, and the fast speed. Experimental results on JPEG images are promising.     

Human eyebrow recognition in the matching-recognizing framework

This paper studies the problem of automatically recognizing human eyebrows using a frontal view. In the matching-recognizing framework for image-based object classification, we design an automatic human eyebrow recognition system via fast template matching and Fourier spectrum distance. Fast template matching is used to locate the target subregion of a gallery template or a pure eyebrow image in a probe original eyebrow image, whereas Fourier spectrum distance is used to determine the final identity of the probe original eyebrow image. We conducted a number of experiments to demonstrate the efficacy of the proposed system and corroborate the validity of eyebrow recognition on the BJUT eyebrow database. Moreover, we also tested the system on the color FERET database. Experimental results show that our approach can be directly applied to face recognition by only replacing eyebrow templates with face templates, and may achieve higher accuracy in eyebrow recognition than in small face recognition. This is a strong argument for eyebrow recognition to replace face recognition as an independent biometric in certain scenarios, especially where relatively large eyebrows can be cropped.     

An eye detection method robust to eyeglasses for mobile iris recognition

Finding the accurate position of an eye is crucial for mobile iris recognition system in order to extract the iris region quickly and correctly. Unfortunately, this is very difficult to accomplish when a person is wearing eyeglasses because of the interference from the eyeglasses. This paper proposes an eye detection method that is robust to eyeglass interference in mobile environment. The proposed method comprises two stages: eye candidate generation and eye validation. In the eye candidate generation stage, multi-scale window masks consisting of 2 × 3 subblocks are used to generate all image blocks possibly containing an eye image. In the ensuing eye validation stage, two methods are employed to determine which blocks actually contain true eye images and locate their precise positions as well: the first method searches for the glint of an NIR illuminator on the pupil region. If this first method fails, the next method computes the intensity difference between the assumed pupil and its surrounding region using multi-scale 3 × 3 window masks. Experimental results show that the proposed method detects the eye position more accurately and quickly than competing methods in the presence of interference from eyeglass frames.     

基于图像的个性化卡通系统

介绍了一个卡通动画系统.该系统可使用户很方便地生成个性化的卡通头像,并通过简单的交互定制各种夸张而生动的表情,还可以实时生成语音驱动的卡通动画.系统主要包括3部分:基于图像的卡通自动生成模块、交互的卡通表情编辑模块和语音驱动的卡通动画模块.卡通自动生成模块采用基于样本学习的方法生成具有特定艺术风格的卡通头像.这里使用了一种非参数化采样算法来学习原始照片和画像间复杂的统计关系.在此基础上,卡通表情编辑器可以通过预先设计的模板生成各种具有生动表情的卡通.同时,用户也可以定制自己的表情模板.卡通动画模块使用了实时的唇形合成算法,可以生成语音驱动的卡通动画.该系统可以使普通用户很方便地生成个性化的卡通头像和动画,在这一点上优于其他动画制作系统.     

Weighted pose space editing for facial animation

Blendshapes are the most commonly used approach to realistic facial animation in production. A blendshape model typically begins with a relatively small number of blendshape targets reflecting major muscles or expressions. However, the majority of the effort in constructing a production quality model occurs in the subsequent addition of targets needed to reproduce various subtle expressions and correct for the effects of various shapes in combination. To make this subsequent modeling process much more efficient, we present a novel editing method that removes the need for much of the iterative trial-and-error decomposition of an expression into targets. Isolated problematic frames of an animation are re-sculpted as desired and used as training for a nonparametric regression that associates these shapes with the underlying blendshape weights. Using this technique, the artist’s correction to a problematic expression is automatically applied to similar expressions in an entire sequence, and indeed to all future sequences. The extent and falloff of editing is controllable and the effect is continuously propagated to all similar expressions. In addition, we present a search scheme that allows effective reuse of pre-sculpted editing examples. Our system greatly reduces time and effort required by animators to create high quality facial animations.     

Accurate visible speech synthesis based on concatenating variable length motion capture data

We present a novel approach to synthesizing accurate visible speech based on searching and concatenating optimal variable-length units in a large corpus of motion capture data. Based on a set of visual prototypes selected on a source face and a corresponding set designated for a target face, we propose a machine learning technique to automatically map the facial motions observed on the source face to the target face. In order to model the long distance coarticulation effects in visible speech, a large-scale corpus that covers the most common syllables in English was collected, annotated and analyzed. For any input text, a search algorithm to locate the optimal sequences of concatenated units for synthesis is described. A new algorithm to adapt lip motions from a generic 3D face model to a specific 3D face model is also proposed. A complete, end-to-end visible speech animation system is implemented based on the approach. This system is currently used in more than 60 kindergartens through third grade classrooms to teach students to read using a lifelike conversational animated agent. To evaluate the quality of the visible speech produced by the animation system, both subjective evaluation and objective evaluation are conducted. The evaluation results show that the proposed approach is accurate and powerful for visible speech synthesis.     

Object Repositioning Based on the Perspective in a Single Image

We propose an image editing system for repositioning objects in a single image based on the perspective of the scene. In our system, an input image is transformed into a layer structure that is composed of object layers and a background layer, and then the scene depth is computed from the ground region that is specified by the user using a simple boundary line. The object size and order of overlapping are automatically determined during the reposition based on the scene depth. In addition, our system enables the user to move shadows along with objects naturally by extracting the shadow mattes using only a few user‐specified scribbles. Finally, we demonstrate the versatility of our system through applications to depth‐of‐field effects, fog synthesis and 3D walkthrough in an image.     

基于样本学习的肖像画自动生成算法

提出了一种基于样本学习的人脸肖像画自动生成算法，文章采用非均匀的马尔科夫随机场模型来描述肖像画与人脸图像之间的统计关系，并使用基于训练样本的非参数化的概率表示，在贝叶斯优化的框架下设计了迭代采样算法，可以自动的从人脸图像生成特定风格的肖像画，在该方法中，使用非均匀的统计模型是保持肖像中人脸结构准确性的关键，文中所提供的例子表明了该文方法的有效性。     

一种新型的人脸眼睛定位方法

提出了一种在复杂背景、光照、姿势变化条件下的人脸眼睛定位系统。首先采用Adaboost方法提取人脸，并提出了解决平面旋转和深度旋转的方法。接着，采用数学形态学提取人脸特征并用各种规则去过滤特征点。然后采用SVM眼睛确认方法确认眼睛对。最后采用Camshift和Kalman滤波进行跟踪。基于IFACE数据库的实验结果表明我们的算法具有很高的眼睛定位准确率并对光照、姿势、复杂背景不敏感．     

Hallucinating faces: LPH super-resolution and neighbor reconstruction for residue compensation

A two-phase face hallucination approach is proposed in this paper to infer high-resolution face image from the low-resolution observation based on a set of training image pairs. The proposed locality preserving hallucination (LPH) algorithm combines locality preserving projection (LPP) and radial basis function (RBF) regression together to hallucinate the global high-resolution face. Furthermore, in order to compensate the inferred global face with detailed inartificial facial features, the neighbor reconstruction based face residue hallucination is used. Compared with existing approaches, the proposed LPH algorithm can generate global face more similar to the ground truth face efficiently, moreover, the patch structure and search strategy carefully designed for the neighbor reconstruction algorithm greatly reduce the computational complexity without diminishing the quality of high-resolution face detail. The details of synthetic high-resolution face are further improved by a global linear smoother. Experiments indicate that our approach can synthesize distinct high-resolution faces with various facial appearances such as facial expressions, eyeglasses efficiently.     

人脸图像中眼镜检测与边框去除方法

眼镜边框是影响精确提取人脸图像特征的因素之一,为此提出了一种眼镜检测和边框去除的方法。该方法由眼镜检测、眼镜边框定位和被遮挡图像修复三部分构成。提取眼睛估计区域的边缘特征并基于神经网络的方法检测眼镜;利用二值化和数学形态学的方法定位眼镜边框;通过插值的方法修复被眼镜边框遮挡的图像。实验结果表明,该方法与传统基于PCA的方法相比,眼镜去除后的人脸图像更加自然。同时,实验结果也表明该方法有助于人脸识别性能的提升。     

基于可视信息眼镜摘除的热红外人脸识别方法

在热红外人脸识别中,眼镜作为人脸图像中常见的遮挡物,造成了人脸眼睛区域信息的丢失,严重影响了人脸识别效果。针对该问题,提出了一种在热红外图像中去除眼镜的算法,对热红外图像进行眼镜检测,使用无眼镜的热红外图像的平均眼睛模板来代替有眼镜的热红外图像的眼镜区域,再基于核主成分分析算法利用可视化图像和热红外图像融合的方法,进行图像融合,获得较好的无眼镜热红外图像,通过分类识别来实现人脸识别。实验结果表明,在热红外人脸识别中,该方法在戴眼镜的情况下能够提高人脸识别的准确率和取得较好的识别效果。     

Convolutional face finder: a neural architecture for fast and robust face detection

In this paper, we present a novel face detection approach based on a convolutional neural architecture, designed to robustly detect highly variable face patterns, rotated up to /spl plusmn/20 degrees in image plane and turned up to /spl plusmn/60 degrees, in complex real world images. The proposed system automatically synthesizes simple problem-specific feature extractors from a training set of face and nonface patterns, without making any assumptions or using any hand-made design concerning the features to extract or the areas of the face pattern to analyze. The face detection procedure acts like a pipeline of simple convolution and subsampling modules that treat the raw input image as a whole. We therefore show that an efficient face detection system does not require any costly local preprocessing before classification of image areas. The proposed scheme provides very high detection rate with a particularly low level of false positives, demonstrated on difficult test sets, without requiring the use of multiple networks for handling difficult cases. We present extensive experimental results illustrating the efficiency of the proposed approach on difficult test sets and including an in-depth sensitivity analysis with respect to the degrees of variability of the face patterns.     

Geometry-driven photorealistic facial expression synthesis

Expression mapping (also called performance driven animation) has been a popular method for generating facial animations. A shortcoming of this method is that it does not generate expression details such as the wrinkles due to skin deformations. In this paper, we provide a solution to this problem. We have developed a geometry-driven facial expression synthesis system. Given feature point positions (the geometry) of a facial expression, our system automatically synthesizes a corresponding expression image that includes photorealistic and natural looking expression details. Due to the difficulty of point tracking, the number of feature points required by the synthesis system is, in general, more than what is directly available from a performance sequence. We have developed a technique to infer the missing feature point motions from the tracked subset by using an example-based approach. Another application of our system is expression editing where the user drags feature points while the system interactively generates facial expressions with skin deformation details.     

Peek‐in‐the‐Pic: Flying Through Architectural Scenes From a Single Image*

Many casually taken ‘tourist’ photographs comprise of architectural objects like houses, buildings, etc. Reconstructing such 3D scenes captured in a single photograph is a very challenging problem. We propose a novel approach to reconstruct such architectural scenes with minimal and simple user interaction, with the goal of providing 3D navigational capability to an image rather than acquiring accurate geometric detail. Our system, Peek‐in‐the‐Pic, is based on a sketch‐based geometry reconstruction paradigm. Given an image, the user simply traces out objects from it. Our system regards these as perspective line drawings, automatically completes them and reconstructs geometry from them. We make basic assumptions about the structure of traced objects and provide simple gestures for placing additional constraints. We also provide a simple sketching tool to progressively complete parts of the reconstructed buildings that are not visible in the image and cannot be automatically completed. Finally, we fill holes created in the original image when reconstructed buildings are removed from it, by automatic texture synthesis. Users can spend more time using interactive texture synthesis for further refining the image. Thus, instead of looking at flat images, a user can fly through them after some simple processing. Minimal manual work, ease of use and interactivity are the salient features of our approach.     

Image-based color ink diffusion rendering

This paper proposes an image-based painterly rendering algorithm for automatically synthesizing an image with color ink diffusion. We suggest a mathematical model with a physical base to simulate the phenomenon of color colloidal ink diffusing into absorbent paper. Our algorithm contains three main parts: a feature extraction phase, a Kubelka-Munk (KM) color mixing phase, and a color ink diffusion synthesis phase. In the feature extraction phase, the information of the reference image is simplified by luminance division and color segmentation. In the color mixing phase, the KM theory is employed to approximate the result when one pigment is painted upon another pigment layer. Then, in the color ink diffusion synthesis phase, the physically-based model that we propose is employed to simulate the result of color ink diffusion in absorbent paper using a texture synthesis technique. Our image-based ink diffusing rendering (IBCIDR) algorithm eliminates the drawback of conventional Chinese ink simulations, which are limited to the black ink domain, and our approach demonstrates that, without using any strokes, a color image can be automatically converted to the diffused ink style with a visually pleasing appearance     

应用于中医面诊的人脸区域分割方法

面诊是中医四诊之一,在中医面诊时通常将人脸区域分成5个部分,每个部分对应于不同的人体内脏部位,内脏的病变表现为人脸对应区域的颜色变化。实现了一种简单快速的人脸区域分割方法,首先用Gabor小波变换定位人眼,将AdaBoost和唇色模型相结合定位嘴角,然后根据先验知识确定内眉点位置,用提取轮廓算法确定人脸边界,从而实现人脸区域的自动分割。通过对样本图片的测试,实验结果表明该方法可以满足面诊实时分割人脸区域的需求。     

Scene Reconstruction and Robot Navigation Using Dynamic Fields

In this paper, we present an approach to autonomous robot navigation in an unknown environment. We design and integrate algorithms to reconstruct the scene, locate obstacles and do short-term field-based path planning. The scene reconstruction is done using a region matching flow algorithm to recover image deformation and structure from motion to recover depth. Obstacles are located by comparing the surface normal of the known floor with the surface normal of the scene. Our path planning method is based on electric-like fields and uses current densities that can guarantee fields without local minima and maxima which can provide solutions without the need of heuristics that plague the more traditional potential fields approaches. We implemented a modular distributed software platform (FBN) to test this approach and we ran several experiments to verify the performance with very encouraging results.