Detecting faces in images: A survey

Ming Hsuan Yang, David J. Kriegman, Narendra Ahuja

Research output: Contribution to journalArticle

2454 Citations (Scopus)

Abstract

Images containing faces are essential to intelligent vision-based human computer interaction, and research efforts in face processing include face recognition, face tracking, pose estimation, and expression recognition. However, many reported methods assume that the faces in an image or an image sequence have been identified and localized. To build fully automated systems that analyze the information contained in face images, robust and efficient face detection algorithms are required. Given a single image, the goal of face detection is to identify all image regions which contain a face regardless of its three-dimensional position, orientation, and lighting conditions. Such a problem is challenging because faces are nonrigid and have a high degree of variability in size, shape, color, and texture. Numerous techniques have been developed to detect faces in a single image, and the purpose of this paper is to categorize and evaluate these algorithms. We also discuss relevant issues such as data collection, evaluation metrics, and benchmarking. After analyzing these algorithms and identifying their limitations, we conclude with several promising directions for future research.

Original languageEnglish
Pages (from-to)34-58
Number of pages25
JournalIEEE transactions on pattern analysis and machine intelligence
Volume24
Issue number1
DOIs
Publication statusPublished - 2002 Jan 1

Fingerprint

Face recognition
Face
Benchmarking
Human computer interaction
Face Detection
Textures
Lighting
Color
Face Tracking
Processing
Pose Estimation
Image Sequence
Face Recognition
Texture
Metric
Three-dimensional
Evaluate
Evaluation
Interaction

All Science Journal Classification (ASJC) codes

  • Software
  • Computer Vision and Pattern Recognition
  • Computational Theory and Mathematics
  • Artificial Intelligence
  • Applied Mathematics

Cite this

Yang, Ming Hsuan ; Kriegman, David J. ; Ahuja, Narendra. / Detecting faces in images : A survey. In: IEEE transactions on pattern analysis and machine intelligence. 2002 ; Vol. 24, No. 1. pp. 34-58.
@article{067cd6eb6c2f4c18b7e74837d144aad5,
title = "Detecting faces in images: A survey",
abstract = "Images containing faces are essential to intelligent vision-based human computer interaction, and research efforts in face processing include face recognition, face tracking, pose estimation, and expression recognition. However, many reported methods assume that the faces in an image or an image sequence have been identified and localized. To build fully automated systems that analyze the information contained in face images, robust and efficient face detection algorithms are required. Given a single image, the goal of face detection is to identify all image regions which contain a face regardless of its three-dimensional position, orientation, and lighting conditions. Such a problem is challenging because faces are nonrigid and have a high degree of variability in size, shape, color, and texture. Numerous techniques have been developed to detect faces in a single image, and the purpose of this paper is to categorize and evaluate these algorithms. We also discuss relevant issues such as data collection, evaluation metrics, and benchmarking. After analyzing these algorithms and identifying their limitations, we conclude with several promising directions for future research.",
author = "Yang, {Ming Hsuan} and Kriegman, {David J.} and Narendra Ahuja",
year = "2002",
month = "1",
day = "1",
doi = "10.1109/34.982883",
language = "English",
volume = "24",
pages = "34--58",
journal = "IEEE Transactions on Pattern Analysis and Machine Intelligence",
issn = "0162-8828",
publisher = "IEEE Computer Society",
number = "1",

}

Detecting faces in images : A survey. / Yang, Ming Hsuan; Kriegman, David J.; Ahuja, Narendra.

In: IEEE transactions on pattern analysis and machine intelligence, Vol. 24, No. 1, 01.01.2002, p. 34-58.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Detecting faces in images

T2 - A survey

AU - Yang, Ming Hsuan

AU - Kriegman, David J.

AU - Ahuja, Narendra

PY - 2002/1/1

Y1 - 2002/1/1

N2 - Images containing faces are essential to intelligent vision-based human computer interaction, and research efforts in face processing include face recognition, face tracking, pose estimation, and expression recognition. However, many reported methods assume that the faces in an image or an image sequence have been identified and localized. To build fully automated systems that analyze the information contained in face images, robust and efficient face detection algorithms are required. Given a single image, the goal of face detection is to identify all image regions which contain a face regardless of its three-dimensional position, orientation, and lighting conditions. Such a problem is challenging because faces are nonrigid and have a high degree of variability in size, shape, color, and texture. Numerous techniques have been developed to detect faces in a single image, and the purpose of this paper is to categorize and evaluate these algorithms. We also discuss relevant issues such as data collection, evaluation metrics, and benchmarking. After analyzing these algorithms and identifying their limitations, we conclude with several promising directions for future research.

AB - Images containing faces are essential to intelligent vision-based human computer interaction, and research efforts in face processing include face recognition, face tracking, pose estimation, and expression recognition. However, many reported methods assume that the faces in an image or an image sequence have been identified and localized. To build fully automated systems that analyze the information contained in face images, robust and efficient face detection algorithms are required. Given a single image, the goal of face detection is to identify all image regions which contain a face regardless of its three-dimensional position, orientation, and lighting conditions. Such a problem is challenging because faces are nonrigid and have a high degree of variability in size, shape, color, and texture. Numerous techniques have been developed to detect faces in a single image, and the purpose of this paper is to categorize and evaluate these algorithms. We also discuss relevant issues such as data collection, evaluation metrics, and benchmarking. After analyzing these algorithms and identifying their limitations, we conclude with several promising directions for future research.

UR - http://www.scopus.com/inward/record.url?scp=0036223025&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0036223025&partnerID=8YFLogxK

U2 - 10.1109/34.982883

DO - 10.1109/34.982883

M3 - Article

AN - SCOPUS:0036223025

VL - 24

SP - 34

EP - 58

JO - IEEE Transactions on Pattern Analysis and Machine Intelligence

JF - IEEE Transactions on Pattern Analysis and Machine Intelligence

SN - 0162-8828

IS - 1

ER -