3D face modeling using the multi-deformable method

Jinkyu Hwang, Sunjin Yu, Joongrock Kim, Sang Youn Lee

Research output: Contribution to journalArticle

9 Citations (Scopus)

Abstract

In this paper, we focus on the problem of the accuracy performance of 3D face modeling techniques using corresponding features in multiple views, which is quite sensitive to feature extraction errors. To solve the problem, we adopt a statistical model-based 3D face modeling approach in a mirror system consisting of two mirrors and a camera. The overall procedure of our 3D facial modeling method has two primary steps: 3D facial shape estimation using a multiple 3D face deformable model and texture mapping using seamless cloning that is a type of gradient-domain blending. To evaluate our method's performance, we generate 3D faces of 30 individuals and then carry out two tests: accuracy test and robustness test. Our method shows not only highly accurate 3D face shape results when compared with the ground truth, but also robustness to feature extraction errors. Moreover, 3D face rendering results intuitively show that our method is more robust to feature extraction errors than other 3D face modeling methods. An additional contribution of our method is that a wide range of face textures can be acquired by the mirror system. By using this texture map, we generate realistic 3D face for individuals at the end of the paper.

Original languageEnglish
Pages (from-to)12870-12889
Number of pages20
JournalSensors (Switzerland)
Volume12
Issue number10
DOIs
Publication statusPublished - 2012 Oct 1

Fingerprint

pattern recognition
Feature extraction
textures
Textures
mirrors
Mirrors
ground truth
Cloning
Cameras
cameras
gradients
Statistical Models
Organism Cloning

All Science Journal Classification (ASJC) codes

  • Analytical Chemistry
  • Atomic and Molecular Physics, and Optics
  • Biochemistry
  • Instrumentation
  • Electrical and Electronic Engineering

Cite this

Hwang, Jinkyu ; Yu, Sunjin ; Kim, Joongrock ; Lee, Sang Youn. / 3D face modeling using the multi-deformable method. In: Sensors (Switzerland). 2012 ; Vol. 12, No. 10. pp. 12870-12889.
@article{56d49d5623024dc1bc8f293464ae290a,
title = "3D face modeling using the multi-deformable method",
abstract = "In this paper, we focus on the problem of the accuracy performance of 3D face modeling techniques using corresponding features in multiple views, which is quite sensitive to feature extraction errors. To solve the problem, we adopt a statistical model-based 3D face modeling approach in a mirror system consisting of two mirrors and a camera. The overall procedure of our 3D facial modeling method has two primary steps: 3D facial shape estimation using a multiple 3D face deformable model and texture mapping using seamless cloning that is a type of gradient-domain blending. To evaluate our method's performance, we generate 3D faces of 30 individuals and then carry out two tests: accuracy test and robustness test. Our method shows not only highly accurate 3D face shape results when compared with the ground truth, but also robustness to feature extraction errors. Moreover, 3D face rendering results intuitively show that our method is more robust to feature extraction errors than other 3D face modeling methods. An additional contribution of our method is that a wide range of face textures can be acquired by the mirror system. By using this texture map, we generate realistic 3D face for individuals at the end of the paper.",
author = "Jinkyu Hwang and Sunjin Yu and Joongrock Kim and Lee, {Sang Youn}",
year = "2012",
month = "10",
day = "1",
doi = "10.3390/s121012870",
language = "English",
volume = "12",
pages = "12870--12889",
journal = "Sensors",
issn = "1424-3210",
publisher = "Multidisciplinary Digital Publishing Institute (MDPI)",
number = "10",

}

3D face modeling using the multi-deformable method. / Hwang, Jinkyu; Yu, Sunjin; Kim, Joongrock; Lee, Sang Youn.

In: Sensors (Switzerland), Vol. 12, No. 10, 01.10.2012, p. 12870-12889.

Research output: Contribution to journalArticle

TY - JOUR

T1 - 3D face modeling using the multi-deformable method

AU - Hwang, Jinkyu

AU - Yu, Sunjin

AU - Kim, Joongrock

AU - Lee, Sang Youn

PY - 2012/10/1

Y1 - 2012/10/1

N2 - In this paper, we focus on the problem of the accuracy performance of 3D face modeling techniques using corresponding features in multiple views, which is quite sensitive to feature extraction errors. To solve the problem, we adopt a statistical model-based 3D face modeling approach in a mirror system consisting of two mirrors and a camera. The overall procedure of our 3D facial modeling method has two primary steps: 3D facial shape estimation using a multiple 3D face deformable model and texture mapping using seamless cloning that is a type of gradient-domain blending. To evaluate our method's performance, we generate 3D faces of 30 individuals and then carry out two tests: accuracy test and robustness test. Our method shows not only highly accurate 3D face shape results when compared with the ground truth, but also robustness to feature extraction errors. Moreover, 3D face rendering results intuitively show that our method is more robust to feature extraction errors than other 3D face modeling methods. An additional contribution of our method is that a wide range of face textures can be acquired by the mirror system. By using this texture map, we generate realistic 3D face for individuals at the end of the paper.

AB - In this paper, we focus on the problem of the accuracy performance of 3D face modeling techniques using corresponding features in multiple views, which is quite sensitive to feature extraction errors. To solve the problem, we adopt a statistical model-based 3D face modeling approach in a mirror system consisting of two mirrors and a camera. The overall procedure of our 3D facial modeling method has two primary steps: 3D facial shape estimation using a multiple 3D face deformable model and texture mapping using seamless cloning that is a type of gradient-domain blending. To evaluate our method's performance, we generate 3D faces of 30 individuals and then carry out two tests: accuracy test and robustness test. Our method shows not only highly accurate 3D face shape results when compared with the ground truth, but also robustness to feature extraction errors. Moreover, 3D face rendering results intuitively show that our method is more robust to feature extraction errors than other 3D face modeling methods. An additional contribution of our method is that a wide range of face textures can be acquired by the mirror system. By using this texture map, we generate realistic 3D face for individuals at the end of the paper.

UR - http://www.scopus.com/inward/record.url?scp=84868228128&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84868228128&partnerID=8YFLogxK

U2 - 10.3390/s121012870

DO - 10.3390/s121012870

M3 - Article

VL - 12

SP - 12870

EP - 12889

JO - Sensors

JF - Sensors

SN - 1424-3210

IS - 10

ER -