Vector Quantized Image-to-Image Translation

Yu Jie Chen, Shin I. Cheng, Wei Chen Chiu*, Hung Yu Tseng, Hsin Ying Lee

*此作品的通信作者

研究成果: Conference contribution同行評審

3 引文 斯高帕斯(Scopus)

摘要

Current image-to-image translation methods formulate the task with conditional generation models, leading to learning only the recolorization or regional changes as being constrained by the rich structural information provided by the conditional contexts. In this work, we propose introducing the vector quantization technique into the image-to-image translation framework. The vector quantized content representation can facilitate not only the translation, but also the unconditional distribution shared among different domains. Meanwhile, along with the disentangled style representation, the proposed method further enables the capability of image extension with flexibility in both intra- and inter-domains. Qualitative and quantitative experiments demonstrate that our framework achieves comparable performance to the state-of-the-art image-to-image translation and image extension methods. Compared to methods for individual tasks, the proposed method, as a unified framework, unleashes applications combining image-to-image translation, unconditional generation, and image extension altogether. For example, it provides style variability for image generation and extension, and equips image-to-image translation with further extension capabilities.

原文English
主出版物標題Computer Vision – ECCV 2022 - 17th European Conference, Proceedings
編輯Shai Avidan, Gabriel Brostow, Moustapha Cissé, Giovanni Maria Farinella, Tal Hassner
發行者Springer Science and Business Media Deutschland GmbH
頁面440-456
頁數17
ISBN(列印)9783031197864
DOIs
出版狀態Published - 2022
事件17th European Conference on Computer Vision, ECCV 2022 - Tel Aviv, Israel
持續時間: 23 10月 202227 10月 2022

出版系列

名字Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
13676 LNCS
ISSN(列印)0302-9743
ISSN(電子)1611-3349

Conference

Conference17th European Conference on Computer Vision, ECCV 2022
國家/地區Israel
城市Tel Aviv
期間23/10/2227/10/22

指紋

深入研究「Vector Quantized Image-to-Image Translation」主題。共同形成了獨特的指紋。

引用此