Towards Generating High Definition Face Images from Deep Templates

Xingbo Dong, Zhe Jin, Zhenhua Guo, Andrew Beng Jin Teoh

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Face recognition based on deep convolutional neural networks (CNN) has manifested superior accuracy. Despite the high discriminability of deep features generated by CNN, the vulnerability of the deep feature is often overlooked and leads to the security and privacy concerns, particularly the risks of reconstructing face images from the deep templates. In this paper, we propose a method to generate high definition (HD) face images from deep features. To be specific, the deep features extracted from CNN are mapped to the input (latent vector) of the pre-trained StyleGAN2 using a regression model. Subsequently, HD face images can be generated based on the latent vector by the pre-trained StyleGAN2 model. To evaluate our method, we derived the face features from the generated HD face images and compared them against the bona fide face features. In the sense of face image reconstruction, our method is simple, yet the experimental results suggest the effectiveness, which achieves an attack performance as high as SAR=46.08% (18.30%) @ FAR=0.1 threshold under type-I (type-II) attack settings. Besides, experiment results also indicate that 50.7% of the generated HD face images can pass one commercial off-the-shelf (COTS) liveness detection.

Original languageEnglish
Title of host publicationBIOSIG 2021 - Proceedings of the 20th International Conference of the Biometrics Special Interest Group
EditorsArslan Bromme, Christoph Busch, Naser Damer, Antitza Dantcheva, Marta Gomez-Barrero, Kiran Raja, Christian Rathgeb, Ana F. Sequeira, Andreas Uhl
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9783885797098
DOIs
Publication statusPublished - 2021 Sep
Event20th International Conference of the Biometrics Special Interest Group, BIOSIG 2021 - Darmstadt, Germany
Duration: 2021 Sep 152021 Sep 17

Publication series

NameBIOSIG 2021 - Proceedings of the 20th International Conference of the Biometrics Special Interest Group

Conference

Conference20th International Conference of the Biometrics Special Interest Group, BIOSIG 2021
Country/TerritoryGermany
CityDarmstadt
Period21/9/1521/9/17

Bibliographical note

Funding Information:
This work was supported by grants from Ministry of Higher Education (MOHE) Malaysia through Fundamental Research Grant Scheme (FRGS/1/2018/ICT02/ MUSM/03/3). The authors would like to thank Dr. Mai Guangcan for his gratitude in offering the reconstructed face images.

Publisher Copyright:
© 2021 IEEE.

All Science Journal Classification (ASJC) codes

  • Computer Vision and Pattern Recognition
  • Safety, Risk, Reliability and Quality

Fingerprint

Dive into the research topics of 'Towards Generating High Definition Face Images from Deep Templates'. Together they form a unique fingerprint.

Cite this