Age face simulation using aging functions on global and local features with residual images

Sung Eun Choi, Jaeik Jo, Sanghak Lee, Heeseung Choi, Ig Jae Kim, Jaihie Kim

Research output: Contribution to journalArticle

4 Citations (Scopus)

Abstract

In many previous methods for facial age simulation, the shape and appearance features of Active Appearance Models (AAM) are widely used to model the global facial characteristics. However, they cannot sufficiently represent facial details such as spots, scars, fine wrinkles, and skin blemishes, because many of them are removed from the AAM features during the dimension reduction process. Therefore, previous methods are not suitable for real-world applications, such as forensics, face recognition, and entertainment production systems, which require more accurate and realistic age simulation. To overcome the limitation, this paper proposes an automatic age simulation method based on a synergetic combination of the residual image, local features, and AAM global features. The residual image, which is the difference between a facial image and its reconstructed image by using AAM features, contains facial details of the input image that are not included in the AAM features. Representation of facial details in the age simulation process is achieved by generating and adding a targeted age-weighted residual image to the facial image synthesized by the AAM features. Further, facial details such as wrinkles and skin blemishes that have not yet appeared at the current age but normally appear as aging proceeds, are supplemented, and represented by local features that show locally different aging characteristics. The experimental results show that the proposed method simulates a face more accurately and realistically than previous methods, thereby confirming that it is more suitable for the real-world applications.

Original languageEnglish
Pages (from-to)107-125
Number of pages19
JournalExpert Systems with Applications
Volume80
DOIs
Publication statusPublished - 2017 Sep 1

Fingerprint

Aging of materials
Skin
Face recognition

All Science Journal Classification (ASJC) codes

  • Engineering(all)
  • Computer Science Applications
  • Artificial Intelligence

Cite this

Choi, Sung Eun ; Jo, Jaeik ; Lee, Sanghak ; Choi, Heeseung ; Kim, Ig Jae ; Kim, Jaihie. / Age face simulation using aging functions on global and local features with residual images. In: Expert Systems with Applications. 2017 ; Vol. 80. pp. 107-125.
@article{c827bd10107740de89ce86bdbe029857,
title = "Age face simulation using aging functions on global and local features with residual images",
abstract = "In many previous methods for facial age simulation, the shape and appearance features of Active Appearance Models (AAM) are widely used to model the global facial characteristics. However, they cannot sufficiently represent facial details such as spots, scars, fine wrinkles, and skin blemishes, because many of them are removed from the AAM features during the dimension reduction process. Therefore, previous methods are not suitable for real-world applications, such as forensics, face recognition, and entertainment production systems, which require more accurate and realistic age simulation. To overcome the limitation, this paper proposes an automatic age simulation method based on a synergetic combination of the residual image, local features, and AAM global features. The residual image, which is the difference between a facial image and its reconstructed image by using AAM features, contains facial details of the input image that are not included in the AAM features. Representation of facial details in the age simulation process is achieved by generating and adding a targeted age-weighted residual image to the facial image synthesized by the AAM features. Further, facial details such as wrinkles and skin blemishes that have not yet appeared at the current age but normally appear as aging proceeds, are supplemented, and represented by local features that show locally different aging characteristics. The experimental results show that the proposed method simulates a face more accurately and realistically than previous methods, thereby confirming that it is more suitable for the real-world applications.",
author = "Choi, {Sung Eun} and Jaeik Jo and Sanghak Lee and Heeseung Choi and Kim, {Ig Jae} and Jaihie Kim",
year = "2017",
month = "9",
day = "1",
doi = "10.1016/j.eswa.2017.03.008",
language = "English",
volume = "80",
pages = "107--125",
journal = "Expert Systems with Applications",
issn = "0957-4174",
publisher = "Elsevier Limited",

}

Age face simulation using aging functions on global and local features with residual images. / Choi, Sung Eun; Jo, Jaeik; Lee, Sanghak; Choi, Heeseung; Kim, Ig Jae; Kim, Jaihie.

In: Expert Systems with Applications, Vol. 80, 01.09.2017, p. 107-125.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Age face simulation using aging functions on global and local features with residual images

AU - Choi, Sung Eun

AU - Jo, Jaeik

AU - Lee, Sanghak

AU - Choi, Heeseung

AU - Kim, Ig Jae

AU - Kim, Jaihie

PY - 2017/9/1

Y1 - 2017/9/1

N2 - In many previous methods for facial age simulation, the shape and appearance features of Active Appearance Models (AAM) are widely used to model the global facial characteristics. However, they cannot sufficiently represent facial details such as spots, scars, fine wrinkles, and skin blemishes, because many of them are removed from the AAM features during the dimension reduction process. Therefore, previous methods are not suitable for real-world applications, such as forensics, face recognition, and entertainment production systems, which require more accurate and realistic age simulation. To overcome the limitation, this paper proposes an automatic age simulation method based on a synergetic combination of the residual image, local features, and AAM global features. The residual image, which is the difference between a facial image and its reconstructed image by using AAM features, contains facial details of the input image that are not included in the AAM features. Representation of facial details in the age simulation process is achieved by generating and adding a targeted age-weighted residual image to the facial image synthesized by the AAM features. Further, facial details such as wrinkles and skin blemishes that have not yet appeared at the current age but normally appear as aging proceeds, are supplemented, and represented by local features that show locally different aging characteristics. The experimental results show that the proposed method simulates a face more accurately and realistically than previous methods, thereby confirming that it is more suitable for the real-world applications.

AB - In many previous methods for facial age simulation, the shape and appearance features of Active Appearance Models (AAM) are widely used to model the global facial characteristics. However, they cannot sufficiently represent facial details such as spots, scars, fine wrinkles, and skin blemishes, because many of them are removed from the AAM features during the dimension reduction process. Therefore, previous methods are not suitable for real-world applications, such as forensics, face recognition, and entertainment production systems, which require more accurate and realistic age simulation. To overcome the limitation, this paper proposes an automatic age simulation method based on a synergetic combination of the residual image, local features, and AAM global features. The residual image, which is the difference between a facial image and its reconstructed image by using AAM features, contains facial details of the input image that are not included in the AAM features. Representation of facial details in the age simulation process is achieved by generating and adding a targeted age-weighted residual image to the facial image synthesized by the AAM features. Further, facial details such as wrinkles and skin blemishes that have not yet appeared at the current age but normally appear as aging proceeds, are supplemented, and represented by local features that show locally different aging characteristics. The experimental results show that the proposed method simulates a face more accurately and realistically than previous methods, thereby confirming that it is more suitable for the real-world applications.

UR - http://www.scopus.com/inward/record.url?scp=85015418893&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85015418893&partnerID=8YFLogxK

U2 - 10.1016/j.eswa.2017.03.008

DO - 10.1016/j.eswa.2017.03.008

M3 - Article

VL - 80

SP - 107

EP - 125

JO - Expert Systems with Applications

JF - Expert Systems with Applications

SN - 0957-4174

ER -