Eye detection in a facial image under pose variation based on multi-scale iris shape feature

Hyunjun Kim, Jaeik Jo, Kar Ann Toh, Jaihie Kim

Research output: Contribution to journalArticle

6 Citations (Scopus)

Abstract

The accurate location of eyes in a facial image is important to many human facial recognition-related applications, and has attracted considerable research interest in computer vision. However, most prevalent methods are based on the frontal pose of the face, where applying them to non-frontal poses can yield erroneous results. In this paper, we propose an eye detection method that can locate the eyes in facial images captured at various head poses. Our proposed method consists of two stages: eye candidate detection and eye candidate verification. In eye candidate detection, eye candidates are obtained by using multi-scale iris shape features and integral image. The size of the iris in face images varies as the head pose changes, and the proposed multi-scale iris shape feature method can detect the eyes in such cases. Since it utilizes the integral image, its computational cost is relatively low. The extracted eye candidates are then verified in the eye candidate verification stage using a support vector machine (SVM) based on the feature-level fusion of a histogram of oriented gradients (HOG) and cell mean intensity features. We tested the performance of the proposed method using the Chinese Academy of Sciences’ Pose, Expression, Accessories, and Lighting (CAS-PEAL) database and the Pointing'04 database. The results confirmed the superiority of our method over the conventional Haar-like detector and two hybrid eye detectors under relatively extreme head pose variations.

Original languageEnglish
Pages (from-to)147-164
Number of pages18
JournalImage and Vision Computing
Volume57
DOIs
Publication statusPublished - 2017 Jan 1

Fingerprint

Detectors
Accessories
Computer vision
Support vector machines
Fusion reactions
Lighting
Costs

All Science Journal Classification (ASJC) codes

  • Signal Processing
  • Computer Vision and Pattern Recognition

Cite this

@article{4629ed27f4c940198103ccaae34ab365,
title = "Eye detection in a facial image under pose variation based on multi-scale iris shape feature",
abstract = "The accurate location of eyes in a facial image is important to many human facial recognition-related applications, and has attracted considerable research interest in computer vision. However, most prevalent methods are based on the frontal pose of the face, where applying them to non-frontal poses can yield erroneous results. In this paper, we propose an eye detection method that can locate the eyes in facial images captured at various head poses. Our proposed method consists of two stages: eye candidate detection and eye candidate verification. In eye candidate detection, eye candidates are obtained by using multi-scale iris shape features and integral image. The size of the iris in face images varies as the head pose changes, and the proposed multi-scale iris shape feature method can detect the eyes in such cases. Since it utilizes the integral image, its computational cost is relatively low. The extracted eye candidates are then verified in the eye candidate verification stage using a support vector machine (SVM) based on the feature-level fusion of a histogram of oriented gradients (HOG) and cell mean intensity features. We tested the performance of the proposed method using the Chinese Academy of Sciences’ Pose, Expression, Accessories, and Lighting (CAS-PEAL) database and the Pointing'04 database. The results confirmed the superiority of our method over the conventional Haar-like detector and two hybrid eye detectors under relatively extreme head pose variations.",
author = "Hyunjun Kim and Jaeik Jo and Toh, {Kar Ann} and Jaihie Kim",
year = "2017",
month = "1",
day = "1",
doi = "10.1016/j.imavis.2016.10.003",
language = "English",
volume = "57",
pages = "147--164",
journal = "Image and Vision Computing",
issn = "0262-8856",
publisher = "Elsevier Limited",

}

Eye detection in a facial image under pose variation based on multi-scale iris shape feature. / Kim, Hyunjun; Jo, Jaeik; Toh, Kar Ann; Kim, Jaihie.

In: Image and Vision Computing, Vol. 57, 01.01.2017, p. 147-164.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Eye detection in a facial image under pose variation based on multi-scale iris shape feature

AU - Kim, Hyunjun

AU - Jo, Jaeik

AU - Toh, Kar Ann

AU - Kim, Jaihie

PY - 2017/1/1

Y1 - 2017/1/1

N2 - The accurate location of eyes in a facial image is important to many human facial recognition-related applications, and has attracted considerable research interest in computer vision. However, most prevalent methods are based on the frontal pose of the face, where applying them to non-frontal poses can yield erroneous results. In this paper, we propose an eye detection method that can locate the eyes in facial images captured at various head poses. Our proposed method consists of two stages: eye candidate detection and eye candidate verification. In eye candidate detection, eye candidates are obtained by using multi-scale iris shape features and integral image. The size of the iris in face images varies as the head pose changes, and the proposed multi-scale iris shape feature method can detect the eyes in such cases. Since it utilizes the integral image, its computational cost is relatively low. The extracted eye candidates are then verified in the eye candidate verification stage using a support vector machine (SVM) based on the feature-level fusion of a histogram of oriented gradients (HOG) and cell mean intensity features. We tested the performance of the proposed method using the Chinese Academy of Sciences’ Pose, Expression, Accessories, and Lighting (CAS-PEAL) database and the Pointing'04 database. The results confirmed the superiority of our method over the conventional Haar-like detector and two hybrid eye detectors under relatively extreme head pose variations.

AB - The accurate location of eyes in a facial image is important to many human facial recognition-related applications, and has attracted considerable research interest in computer vision. However, most prevalent methods are based on the frontal pose of the face, where applying them to non-frontal poses can yield erroneous results. In this paper, we propose an eye detection method that can locate the eyes in facial images captured at various head poses. Our proposed method consists of two stages: eye candidate detection and eye candidate verification. In eye candidate detection, eye candidates are obtained by using multi-scale iris shape features and integral image. The size of the iris in face images varies as the head pose changes, and the proposed multi-scale iris shape feature method can detect the eyes in such cases. Since it utilizes the integral image, its computational cost is relatively low. The extracted eye candidates are then verified in the eye candidate verification stage using a support vector machine (SVM) based on the feature-level fusion of a histogram of oriented gradients (HOG) and cell mean intensity features. We tested the performance of the proposed method using the Chinese Academy of Sciences’ Pose, Expression, Accessories, and Lighting (CAS-PEAL) database and the Pointing'04 database. The results confirmed the superiority of our method over the conventional Haar-like detector and two hybrid eye detectors under relatively extreme head pose variations.

UR - http://www.scopus.com/inward/record.url?scp=85007015080&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85007015080&partnerID=8YFLogxK

U2 - 10.1016/j.imavis.2016.10.003

DO - 10.1016/j.imavis.2016.10.003

M3 - Article

VL - 57

SP - 147

EP - 164

JO - Image and Vision Computing

JF - Image and Vision Computing

SN - 0262-8856

ER -