A fully-automatic image colorization scheme using improved CycleGAN with skip connections

Shanshan Huang, Xin Jin*, Qian Jiang, Jie Li, Shin Jye Lee, Puming Wang, Shaowen Yao

*此作品的通信作者

    研究成果: Article同行評審

    1 引文 斯高帕斯(Scopus)

    摘要

    Image colorization is the process of assigning different RGB values to each pixel of a given grayscale image to obtain the corresponding colorized image. In this work, we propose a new automatic image colorization method based on the modified cycle-consistent generative adversarial network (CycleGAN). This method can generate a natural color image with only one given gray image without reference image or manual interaction. In the proposed method, we first modify the original network structure by combining a u-shaped network with a skip connection to improve the ability of feature representation in image colorization. Meanwhile, we design a compounded loss function to measure the errors between the ground-truth image and the predicted result to improve the authenticity and naturalness of the colorized image; further, we also add the detail loss function to ensure that the details of the generated color and grayscale images are substantially similar. Finally, the performance of the proposed model is verified on different datasets. Experiments show that our method can generate more realistic color images when compared to other methods.

    原文English
    期刊Multimedia Tools and Applications
    DOIs
    出版狀態Accepted/In press - 2021

    指紋

    深入研究「A fully-automatic image colorization scheme using improved CycleGAN with skip connections」主題。共同形成了獨特的指紋。

    引用此