Compressed face hallucination

Sifei Liu, Ming Hsuan Yang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Citations (Scopus)

Abstract

In this paper, we propose an algorithm to hallucinate faces in the JPEG compressed domain, which has not been well addressed in the literature. The proposed approach hallucinates compressed face images through an exemplar-based framework and solves two main problems. First, image noise introduced by JPEG compression is exacerbated through the super-resolution process. We present a novel formulation for face hallucination that uses the JPEG quantization intervals as constraints to recover the feasible intensity values from each image patch of a low-resolution input. Second, existing face hallucination methods are sensitive to noise contained in the compressed images. We regularize the compression noise caused by block discrete cosine transform coding, and reconstruct high-resolution images with the proposed gradient-guided total variation. Numerous experimental results show that the proposed algorithm generates favorable results than the combination of state-of-the-art face hallucination and de-noising algorithms.

Original languageEnglish
Title of host publication2014 IEEE International Conference on Image Processing, ICIP 2014
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages4032-4036
Number of pages5
ISBN (Electronic)9781479957514
DOIs
Publication statusPublished - 2014 Jan 28

Publication series

Name2014 IEEE International Conference on Image Processing, ICIP 2014

Fingerprint

Discrete cosine transforms
Image resolution

All Science Journal Classification (ASJC) codes

  • Computer Vision and Pattern Recognition

Cite this

Liu, S., & Yang, M. H. (2014). Compressed face hallucination. In 2014 IEEE International Conference on Image Processing, ICIP 2014 (pp. 4032-4036). [7025819] (2014 IEEE International Conference on Image Processing, ICIP 2014). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICIP.2014.7025819
Liu, Sifei ; Yang, Ming Hsuan. / Compressed face hallucination. 2014 IEEE International Conference on Image Processing, ICIP 2014. Institute of Electrical and Electronics Engineers Inc., 2014. pp. 4032-4036 (2014 IEEE International Conference on Image Processing, ICIP 2014).
@inproceedings{41328dad08dc4dc79f5f34985b4a706b,
title = "Compressed face hallucination",
abstract = "In this paper, we propose an algorithm to hallucinate faces in the JPEG compressed domain, which has not been well addressed in the literature. The proposed approach hallucinates compressed face images through an exemplar-based framework and solves two main problems. First, image noise introduced by JPEG compression is exacerbated through the super-resolution process. We present a novel formulation for face hallucination that uses the JPEG quantization intervals as constraints to recover the feasible intensity values from each image patch of a low-resolution input. Second, existing face hallucination methods are sensitive to noise contained in the compressed images. We regularize the compression noise caused by block discrete cosine transform coding, and reconstruct high-resolution images with the proposed gradient-guided total variation. Numerous experimental results show that the proposed algorithm generates favorable results than the combination of state-of-the-art face hallucination and de-noising algorithms.",
author = "Sifei Liu and Yang, {Ming Hsuan}",
year = "2014",
month = "1",
day = "28",
doi = "10.1109/ICIP.2014.7025819",
language = "English",
series = "2014 IEEE International Conference on Image Processing, ICIP 2014",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "4032--4036",
booktitle = "2014 IEEE International Conference on Image Processing, ICIP 2014",
address = "United States",

}

Liu, S & Yang, MH 2014, Compressed face hallucination. in 2014 IEEE International Conference on Image Processing, ICIP 2014., 7025819, 2014 IEEE International Conference on Image Processing, ICIP 2014, Institute of Electrical and Electronics Engineers Inc., pp. 4032-4036. https://doi.org/10.1109/ICIP.2014.7025819

Compressed face hallucination. / Liu, Sifei; Yang, Ming Hsuan.

2014 IEEE International Conference on Image Processing, ICIP 2014. Institute of Electrical and Electronics Engineers Inc., 2014. p. 4032-4036 7025819 (2014 IEEE International Conference on Image Processing, ICIP 2014).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Compressed face hallucination

AU - Liu, Sifei

AU - Yang, Ming Hsuan

PY - 2014/1/28

Y1 - 2014/1/28

N2 - In this paper, we propose an algorithm to hallucinate faces in the JPEG compressed domain, which has not been well addressed in the literature. The proposed approach hallucinates compressed face images through an exemplar-based framework and solves two main problems. First, image noise introduced by JPEG compression is exacerbated through the super-resolution process. We present a novel formulation for face hallucination that uses the JPEG quantization intervals as constraints to recover the feasible intensity values from each image patch of a low-resolution input. Second, existing face hallucination methods are sensitive to noise contained in the compressed images. We regularize the compression noise caused by block discrete cosine transform coding, and reconstruct high-resolution images with the proposed gradient-guided total variation. Numerous experimental results show that the proposed algorithm generates favorable results than the combination of state-of-the-art face hallucination and de-noising algorithms.

AB - In this paper, we propose an algorithm to hallucinate faces in the JPEG compressed domain, which has not been well addressed in the literature. The proposed approach hallucinates compressed face images through an exemplar-based framework and solves two main problems. First, image noise introduced by JPEG compression is exacerbated through the super-resolution process. We present a novel formulation for face hallucination that uses the JPEG quantization intervals as constraints to recover the feasible intensity values from each image patch of a low-resolution input. Second, existing face hallucination methods are sensitive to noise contained in the compressed images. We regularize the compression noise caused by block discrete cosine transform coding, and reconstruct high-resolution images with the proposed gradient-guided total variation. Numerous experimental results show that the proposed algorithm generates favorable results than the combination of state-of-the-art face hallucination and de-noising algorithms.

UR - http://www.scopus.com/inward/record.url?scp=84949929145&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84949929145&partnerID=8YFLogxK

U2 - 10.1109/ICIP.2014.7025819

DO - 10.1109/ICIP.2014.7025819

M3 - Conference contribution

AN - SCOPUS:84949929145

T3 - 2014 IEEE International Conference on Image Processing, ICIP 2014

SP - 4032

EP - 4036

BT - 2014 IEEE International Conference on Image Processing, ICIP 2014

PB - Institute of Electrical and Electronics Engineers Inc.

ER -

Liu S, Yang MH. Compressed face hallucination. In 2014 IEEE International Conference on Image Processing, ICIP 2014. Institute of Electrical and Electronics Engineers Inc. 2014. p. 4032-4036. 7025819. (2014 IEEE International Conference on Image Processing, ICIP 2014). https://doi.org/10.1109/ICIP.2014.7025819