Continuous and Diverse Image-to-Image Translation via Signed Attribute Vectors

Qi Mao, Hung Yu Tseng, Hsin Ying Lee, Jia Bin Huang, Siwei Ma, Ming Hsuan Yang

Research output: Contribution to journalArticlepeer-review

5 Citations (Scopus)

Abstract

Recent image-to-image (I2I) translation algorithms focus on learning the mapping from a source to a target domain. However, the continuous translation problem that synthesizes intermediate results between two domains has not been well-studied in the literature. Generating a smooth sequence of intermediate results bridges the gap of two different domains, facilitating the morphing effect across domains. Existing I2I approaches are limited to either intra-domain or deterministic inter-domain continuous translation. In this work, we present an effectively signed attribute vector, which enables continuous translation on diverse mapping paths across various domains. In particular, we introduce a unified attribute space shared by all domains that utilize the sign operation to encode the domain information, thereby allowing the interpolation on attribute vectors of different domains. To enhance the visual quality of continuous translation results, we generate a trajectory between two sign-symmetrical attribute vectors and leverage the domain information of the interpolated results along the trajectory for adversarial training. We evaluate the proposed method on a wide range of I2I translation tasks. Both qualitative and quantitative results demonstrate that the proposed framework generates more high-quality continuous translation results against the state-of-the-art methods.

Original languageEnglish
Pages (from-to)517-549
Number of pages33
JournalInternational Journal of Computer Vision
Volume130
Issue number2
DOIs
Publication statusPublished - 2022 Feb

Bibliographical note

Funding Information:
Q. Mao and S. Ma are supported in part by the National Natural Science Foundation of China (62025101), China Scholarship Council for 1 year visiting at the University of California at Merced, and High-performance Computing Platform of Peking University, State Key Laboratory of Media Convergence and Communication (Communication University of China), and Fundamental Research Funds for the Central Universities. H.-Y. Lee, H.-Y. Tseng and M.-H. Yang are supported in part by NSF CAREER grant 1149783.

Publisher Copyright:
© 2021, The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature.

All Science Journal Classification (ASJC) codes

  • Software
  • Computer Vision and Pattern Recognition
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Continuous and Diverse Image-to-Image Translation via Signed Attribute Vectors'. Together they form a unique fingerprint.

Cite this