人脸检测中眼睛精确定位的研究

人脸检测在许多应用中都是重要的一个处理阶段,例如人脸识别、电视会议、人机界面等。眼睛是一个在人脸检测中极为重要的人脸特征,因此一种快速可靠的精确定位眼睛的算法对许多实际的应用是十分重要的。该文提出了一种新颖的精确定位眼睛的方法,该方法由两部分组成:第一部分,通过人脸区域分割、五官定位、人脸确认三个步骤在复杂背景中进行人脸区域的检测;第二部分,在检测到人脸区域和眼睛大致位置的基础上,用一种新的椭圆检测算法精确定位眼睛虹膜的位置。实验证明该文所提出的算法是快速可靠的。     

An effective method for detecting facial features and face in human-robot interaction

In this paper, an effective method of facial features detection is proposed for human-robot interaction (HRI). Considering the mobility of mobile robot, it is inevitable that any vision system for a mobile robot is bound to be faced with various imaging conditions such as pose variations, illumination changes, and cluttered backgrounds. To detecting face correctly under such difficult conditions, we focus on the local intensity pattern of the facial features. The characteristics of relatively dark and directionally different pattern can provide robust clues for detecting facial features. Based on this observation, we suggest a new directional template for detecting the major facial features, namely the two eyes and the mouth. By applying this template to a facial image, we can make a new convolved image, which we refer to as the edge-like blob map. One distinctive characteristic of this map image is that it provides the local and directional convolution values for each image pixel, which makes it easier to construct the candidate blobs of the major facial features without the information of facial boundary. Then, these candidates are filtered using the conditions associated with the spatial relationship of the two eyes and the mouth, and the face detection process is completed by applying appearance-based facial templates to the refined facial features. The overall detection results obtained with various color images and gray-level face database images demonstrate the usefulness of the proposed method in HRI applications.     

视线追踪系统眼部特征检测及视线方向计算方法研究

基于单视觉主动红外光源系统,提出了一种视线检测方法．在眼部特征检测阶段,采用投影法定位人脸;根据人脸对称性和五官分布的先验知识,确定瞳孔潜在区域;最后进行人眼特征的精确分割．在视线方向建模阶段,首先在头部静止的情况下采用非线性多项式建立从平面视线参数到视线落点的映射模型;然后采用广义回归神经网络对不同头部位置造成的视线偏差进行补偿,使非线性映射函数扩展到任何头部位置．实验结果及在交互式图形界面系统中的应用验证了该方法的有效性．     

视频中多线索的人脸特征检测与跟踪

针对目前的人脸特征检测与跟踪算法存在的对环境适应能力差、缺乏自我检错能力的缺点，该文提出了一种多线索综合的新方法，多线索中包括基于深度信息的人脸区域粗分割，基于多关联模板匹配的人脸检测，利用多尺度Sobel卷积的特征提取，基于“特征眼”的人眼验证以及基于多视图的校验方法，多种线索互相补充，自我检错和纠错，对背景，光照及姿态变化具有较强的适应能力，实验表明该方法是有效的，鲁棒的。     

一种基于肤色的人脸检测与定位方法

结合肤色信息与人脸几何分布特征,提出了一种快速的基于人脸特征的检测与定位方法。在标准RGB彩色空间,通过肤色轨迹进行肤色像素与嘴唇像素提取,根据提取的肤色区域是否有嘴唇像素可初步排除一些非人脸区域;利用人眼较高的蓝色分量及瞳孔反光形成的亮斑,在标准RGB色彩空间的B分量图中通过区域增长法产生潜在眼睛区域,利用人眼与嘴唇的面部几何分布特征,提出一些新的规则判断提取的肤色区域是否为人脸,如果是人脸,则对眼睛进行定位。实验结果表明,提出的方法是健壮的、有效的。     

基于差分投影和梯度向量流场的眼睛特征提取

提出了差分投影的方法确定眼睛区域,并根据人脸图像的边缘梯度图提出了一种新的基于梯度向量流场的眼睛特征提取方法。该算法改进原有的梯度向量流迭代方程求解梯度向量流场,以梯度向量流场中的汇点作为候选点,通过人脸器官的几何位置关系等方法评价候选点以定位眼球。算法能较好地容忍一定的光照变化、人脸的小角度倾斜和旋转、闭眼和眼镜等干扰。在具有以上干扰的ORL人脸库(400幅图像)和JAFFE人脸表情库(213幅图像)上的实验证明该算法具有较好的眼睛特征抽取能力。     

Eye detection in a facial image under pose variation based on multi-scale iris shape feature

The accurate location of eyes in a facial image is important to many human facial recognition-related applications, and has attracted considerable research interest in computer vision. However, most prevalent methods are based on the frontal pose of the face, where applying them to non-frontal poses can yield erroneous results.In this paper, we propose an eye detection method that can locate the eyes in facial images captured at various head poses. Our proposed method consists of two stages: eye candidate detection and eye candidate verification. In eye candidate detection, eye candidates are obtained by using multi-scale iris shape features and integral image. The size of the iris in face images varies as the head pose changes, and the proposed multi-scale iris shape feature method can detect the eyes in such cases. Since it utilizes the integral image, its computational cost is relatively low. The extracted eye candidates are then verified in the eye candidate verification stage using a support vector machine (SVM) based on the feature-level fusion of a histogram of oriented gradients (HOG) and cell mean intensity features.We tested the performance of the proposed method using the Chinese Academy of Sciences' Pose, Expression, Accessories, and Lighting (CAS-PEAL) database and the Pointing'04 database. The results confirmed the superiority of our method over the conventional Haar-like detector and two hybrid eye detectors under relatively extreme head pose variations.     

机器人系统中人脸特征提取技术的研究与实现

该文描述了在智能机器人系统中人脸特征提取技术的研究与实现,提出了一种新的并且在机器人系统中实现的人脸特征提取方法,该方法首先利用基于Adaboost的人脸检测算法对采集到的原始图像进行人脸检测,从而得到人脸图像;然后让人脸图像通过一个空间掩模滤波器,去除图像中明显非人脸特征的区域,再经过二值化后得到二值化图像;将二值化图像与一个矩形模板相卷积,得到卷积值与模板索引数的二维曲线图,在二维曲线图中,最高的两个峰就分别对应了眼睛和眉毛,再根据人脸特征几何分布关系判断出眼睛,眉毛和嘴,从而得到最终的人脸特征.该方法检测率高,计算量小,实时性很强,满足了机器人系统中资源有限的约束条件.     

基于肤色信息的人脸检测和人眼定位方法

提出的人脸检测和人眼定位方法利用人类肤色在YIQ颜色空间分布的稳定性,检测出图像中的皮肤区域,然后利用人脸的特征知识来判断人脸的存在,通过计算脸部特征的对称性,从而精确定位。实验结果证明了方法的有效性。     

基于颜色和特征匹配的视频图像人脸检测实现技术

A face detection method using statistical skin-color model and facial feature matching is presented in this paper.According to skin-color distribution in YUV color space,we develope a statistical skin-color model through interactive sample training and learning.Using this method we convert the color image to binary image and then segment face-candidate regions in the video images.In order to improve the quality of binary image and remove unwanted noises,filtering and mathematical morphology are empolied.After these two processing,we use facial feature matching for further detection.The presence or absence of a face in each region is verified by means of mouth detector based on a template matching method.The experimental results show the proposed method has the features of high speed and high efficiency,but also robust to face variation to some extent.So it is suitable to be applied to real-time face detection and tracking in video sequences.     

Real-time moustache detection by combining image decolorization and texture detection with applications to facial gender recognition

There are still many challenging problems in facial gender recognition which is mainly due to the complex variances of face appearance. Although there has been tremendous research effort to develop robust gender recognition over the past decade, none has explicitly exploited the domain knowledge of the difference in appearance between male and female. Moustache contributes substantially to the facial appearance difference between male and female and could be a good feature to be incorporated into facial gender recognition. Little work on moustache segmentation has been reported in the literature. In this paper, a novel real-time moustache detection method is proposed which combines face feature extraction, image decolorization and texture detection. Image decolorization, which converts a color image to grayscale, aims to enhance the color contrast while preserving the grayscale. On the other hand, moustache appearance is normally grayscale surrounded by the skin color face tissue. Hence, it is a fast and efficient way to segment the moustache by using the decolorization technology. In order to make the algorithm robust to the variances of illumination and head pose, an adaptive decolorization segmentation has been proposed in which both the segmentation threshold selection and the moustache region following are guided by some special regions defined by their geometric relationship with the salient facial features. Furthermore, a texture-based moustache classifier is developed to compensate the decolorization-based segmentation which could detect the darker skin or shadow around the mouth caused by the small lines or skin thicker from where he/she smiles as moustache. The face is verified as the face containing a moustache only when it satisfies: (1) a larger moustache region can be found by applying the decolorization segmentation; (2) the segmented moustache region is detected as moustache by the texture moustache detector. The experimental results on color FERET database showed that the proposed approach can achieve 89 % moustache face detection rate with 0.1 % false acceptance rate. By incorporating the moustache detector into a facial gender recognition system, the gender recognition accuracy on a large database has been improved from 91 to 93.5 %.     

基于变换投影的眼睛轮廓提取方法

眼睛作为人脸的重要器官,其特征对于人脸表情识别非常重要,因此需要对眼睛轮廓进行提取。该文根据眼睛的轮廓特征知识,提出一种利用变换投影估计形状参数,在形状区域内结合图像信息提取眼睛轮廓的新方法。在分析变形模板和变换投影的特点基础上,对基于变换投影提取眼睛轮廓的方法进行介绍。在人脸数据库JAFFE上的实验表明该方法是可行的。该方法同样可以用于其他形状的检测。     

基于彩色人脸模板的人脸检测算法

针对目前基于色彩的人脸检测只能用于人脸区域的粗检这一不足,提出一种利用人脸的五官位置及色彩信息建立彩色人脸模板的算法。采用光照补偿对图像进行预处理,利用YCbCr空间中的肤色模型进行粗检,确定出人脸候选区域,利用建构好的模板进行搜索比对定位出人脸。实验结果表明该方法对不同光照环境和复杂背景的图片均有较好的适应性,检测精度也得到了提高。     

基于广义对称变换的人脸检测和面部特征提取

该文提出了一种基于广义对称变换的从具有复杂背景的彩色图像中进行人脸检测的方法，它首先利用人类肤色在色度空间分布的稳定性，检测出图像中的皮肤区域，通过先验知识进行甄别，选出候选人脸区域，然后根据在人脸图像中人的双眼具有的高对称性，利用广义对称变换来求得具有高对称性的点即为双眼的位置，最后采用通用人眼图像进行模板匹配来验证，实验证明，该方法具有良好的效果。     

融合人脸轮廓和区域信息改进人脸检测

基于人脸轮廓信息和面部区域信息的互补性，提出了一种新颖的基于融合算法的轮廓一区域人脸检测器：采用一种新的特征提取方法有效地刻画人脸轮廓模式；基于支持向量机分别训练人脸轮廓分类器和面部区域分类器；基于最小错误率Bayes决策规则融合人脸轮廓和面部区域分类器。该文分别在标准头部图像库、BioID人脸图像库(灰度人脸图像库)和彩色人脸图像库上测试了轮廓一区域人脸检测器．大量的实验结果表明了所提出的轮廓一区域人脸检测器通过引入轮廓信息有效地提高了人脸检测算法的精度。     

Energy-based blob analysis for improving precision of skin segmentation

This paper addresses a problem of precise skin segmentation necessary for sign language recognition purposes. The main contribution of the presented research is an adaptive skin model enhanced with a blob analysis algorithm which significantly reduces false positives and improves skin segmentation precision. Adaptive skin detector utilizes a statistical skin color model updated dynamically based on a face region defined by eye positions. Face geometry is used for face and eye detection in luminance channel prior to the model adaptation. Color-based skin detectors classify every pixel separately which results in high false positives for background pixels which color is similar to human skin. The proposed blob analysis technique verifies detected skin regions by taking into account pixel topology. The experiments for ECU database showed that with the proposed approach false positive rate was reduced from 15.6% to 6% compared with a statistical model in RGB, which can be regarded as a significant improvement.     

一种鲁棒的人脸特征定位方法

提出了一种基于AdaBoost算法和C-V方法的人脸特征定位方法。首先根据AdaBoost算法训练样本得到脸、眼、鼻、嘴4个检测器；然后结合人脸边缘图像的先验规则，使用人脸检测器提取人脸区域；接着利用眼、鼻、嘴检测器从人脸区域中检测出人脸特征所在的矩形区域；最后利用C-V方法从各个特征区域中分割出人脸特征的轮廓，进而得到人脸关键特征点的位置。在DTU IMM人脸测试集上，眼睛的检测率为100%，鼻子的检测率为95.3%，嘴巴的检测率为98.4%，提取出的特征点位置准确。实验结果表明方法是有效和鲁棒的。     

基于肤色分割、区域分析和模板分布的人脸检测研究

提出了一种基于肤色分割、区域分析和模板分布的彩色图像人脸检测算法。首先对输入的彩色图像利用混合高斯模型和亮度模型进行分割,然后根据人脸五官的结构特征对得到的区域进一步分析处理,获得所有可能的候选人脸。接着构造了一种基于双眼和人脸模板的概率模型并利用其对候选人脸进行最终检测。实验结果表明,文章提出的算法具有较高的检测正确率和自适应能力;同时具有快速的检测速度。     

基于极坐标的改进灰度积分投影法的人眼检测

为了克服传统灰度积分投影方法无法有效定位旋转人脸图像中人眼的缺点,提出了一种基于极坐标系的灰度积分投影方法。利用肤色特征对给定图像进行人脸区域的确定,在人脸区域内按极角方向进行灰度积分投影,确定出人眼所在角度,将人眼角度方向的像素灰度值做水平方向积分投影,从而确定出人眼的位置。该方法能够实现同一幅图像中多个不同姿态人脸的人眼定位。大量的仿真实验表明,该方法的识别性能对人脸的旋转变化具有良好的鲁棒性,能够提高灰度积分投影方法对人眼定位的适用范围。     

基于多尺度自商图和改进积分投影法的人眼定位

针对传统的投影方法在人眼定位时易受光照干扰以及难以获得精准的人眼中心点的问题,提出一种基于多尺度自商图和改进的积分投影法的人眼定位算法.首先利用多尺度自商图消除人脸图像的光照影响;然后分析眼睛在水平方向上灰度分布的特点,采用两个行梯度算子对积分投影法进行了改进,以提升眼睛区域特征并初步定位人眼区域;接着采用Sobel算子对人眼区域进行滤波得到人眼滤波图,并对人眼滤波图的垂直积分投影曲线进行高斯函数拟合,根据拟合结果分割出左眼窗口和右眼窗口;最后,计算左眼窗口和右眼窗口的尺寸,获取左眼窗口和右眼窗口的中心点,即为人眼中心点.在YaleB人脸数据库和JAFFE人脸数据库上测试表明,本文方法对复杂光照、人脸边缘以及人脸表情适应性强,可以获得较为精准的人眼中心点.