This study proposes a fusion method for universal super-resolution (SR) that produces good results for both face and non-face regions. We observed that most general-purpose SR networks fail to sufficiently reconstruct facial features. In addition, face-specific networks degrade the performance on non-face regions. To reconstruct face regions well, face-specific SR networks are trained by employing a facial feature network. Then, to preserve the performance on the non-face regions, a region-adaptive fusion that uses both face-specific and general-purpose networks is proposed. In the fusion stage, a face detection algorithm is included, and detected masks are smoothed to avoid boundary artefacts. The results indicate that the proposed method significantly improves the performance on the face region and delivers a similar performance on the non-face region. In addition, the experimental results indicate that additional computations can be considerably reduced by sharing the front layers of the networks.
|Number of pages||8|
|Journal||Signal, Image and Video Processing|
|Publication status||Published - 2020 Nov 1|
Bibliographical noteFunding Information:
This material is based upon work supported by the Ministry of Trade, Industry & Energy (MOTIE, Korea) under Industrial Technology Innovation Program (10080619), and also supported by Graduate School of YONSEI University Research Scholarship Grants in 2019.
© 2020, Springer-Verlag London Ltd., part of Springer Nature.
All Science Journal Classification (ASJC) codes
- Signal Processing
- Electrical and Electronic Engineering