Deep neural network joint multi-scale attention for remote sensing image colorization

Yun Wang, Qian Jiang, Xin Jina*, Shin Jye Lee, Jianan Feng, Ding Zhou, Ya Zhang

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Image colorization is a technology to transform gray-scale image into natural color image, which is always a challenging task in image processing. In this paper, we design a deep neural network model including multi-scale convolutional down-sampling and attention mechanism, which can effectively solve the problem of coloring gray remote sensing image. First, we input the grayscale remote sensing image into the feature extractor of our model for feature extraction and multi-scale down-sampling. Second, the feature map extracted by the feature extractor is input into the squeeze-and-excitation attention mechanism module to enhance the extraction of key information. Finally, the feature map output by the feature extractor and squeeze-and-excitation module is input into the feature reconstructor for feature reconstruction and color restoration, and then color remote sensing images are obtained. Unlike the conventional methods, our method is an end-to-end model, and without any human interaction in the coloring process. The experimental results show that the color remote sensing image generated by our method is superior to the existing methods in both subjective and objective metrics.

Original languageEnglish
Title of host publicationThirteenth International Conference on Digital Image Processing, ICDIP 2021
EditorsXudong Jiang, Hiroshi Fujita
PublisherSPIE
Volume11878
ISBN (Electronic)9781510646001
DOIs
StatePublished - 30 Jun 2021
Event13th International Conference on Digital Image Processing, ICDIP 2021 - Singapore, Singapore
Duration: 20 May 202123 May 2021

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume11878
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X

Conference

Conference13th International Conference on Digital Image Processing, ICDIP 2021
Country/TerritorySingapore
CitySingapore
Period20/05/2123/05/21

Keywords

  • Deep learning
  • Image processing
  • Neural networks
  • Remote sensing image colorization

Fingerprint

Dive into the research topics of 'Deep neural network joint multi-scale attention for remote sensing image colorization'. Together they form a unique fingerprint.

Cite this