TY - JOUR
T1 - CASR-Net
T2 - A color-aware super-resolution network for panchromatic image
AU - Liu, Ling
AU - Jiang, Qian
AU - Jin, Xin
AU - Feng, Jianan
AU - Wang, Ruxin
AU - Liao, Hangying
AU - Lee, Shin Jye
AU - Yao, Shaowen
N1 - Publisher Copyright:
© 2022 Elsevier Ltd
PY - 2022/9
Y1 - 2022/9
N2 - Spatial resolution is the ability to distinguish the spatial details of remote sensing images, and high spatial resolution images are conducive to object recognition and visual interpretation. Spectral resolution is the ability to distinguish the spectral details of the ground objects in remote sensing images, and high spectral resolution images are of great significance to the classification and recognition of objects in remote sensing images. The image super-resolution model is used to enhance the spatial resolution of remote sensing image, but it cannot enhance the spectral resolution, while the image colorization model can increase the number of channels by predicting chromatic channels for the input image, thereby improving spectral resolution. In this paper, a color-aware super-resolution network that combines image colorization and super-resolution ideas is designed to improve the spectral and spatial resolution of panchromatic images. The color-aware super-resolution network mainly contains color-aware block and spatial-aware block, color-aware block is presented to predict color information for panchromatic images to improve the spectral resolution, meanwhile, spatial-aware block is used to restore the texture details for panchromatic images to improve the spatial resolution. The trained color-aware super-resolution network only needs to input panchromatic images to generate images with more spectral information and higher spatial resolution than input images. Extensive experiments demonstrate that our color-aware super-resolution network has a good performance in image colorization and super-resolution, and experimental results show that compare with some existing excellent image colorization methods and super-resolution methods, our method is excellent in objective indicators and visual effects.
AB - Spatial resolution is the ability to distinguish the spatial details of remote sensing images, and high spatial resolution images are conducive to object recognition and visual interpretation. Spectral resolution is the ability to distinguish the spectral details of the ground objects in remote sensing images, and high spectral resolution images are of great significance to the classification and recognition of objects in remote sensing images. The image super-resolution model is used to enhance the spatial resolution of remote sensing image, but it cannot enhance the spectral resolution, while the image colorization model can increase the number of channels by predicting chromatic channels for the input image, thereby improving spectral resolution. In this paper, a color-aware super-resolution network that combines image colorization and super-resolution ideas is designed to improve the spectral and spatial resolution of panchromatic images. The color-aware super-resolution network mainly contains color-aware block and spatial-aware block, color-aware block is presented to predict color information for panchromatic images to improve the spectral resolution, meanwhile, spatial-aware block is used to restore the texture details for panchromatic images to improve the spatial resolution. The trained color-aware super-resolution network only needs to input panchromatic images to generate images with more spectral information and higher spatial resolution than input images. Extensive experiments demonstrate that our color-aware super-resolution network has a good performance in image colorization and super-resolution, and experimental results show that compare with some existing excellent image colorization methods and super-resolution methods, our method is excellent in objective indicators and visual effects.
KW - Deep neural network
KW - Image colorization
KW - Image super-resolution
KW - Remote sensing image
UR - http://www.scopus.com/inward/record.url?scp=85133409811&partnerID=8YFLogxK
U2 - 10.1016/j.engappai.2022.105084
DO - 10.1016/j.engappai.2022.105084
M3 - Article
AN - SCOPUS:85133409811
SN - 0952-1976
VL - 114
JO - Engineering Applications of Artificial Intelligence
JF - Engineering Applications of Artificial Intelligence
M1 - 105084
ER -