Semisupervised Remote Sensing Image Fusion Using Multiscale Conditional Generative Adversarial Network with Siamese Structure

Xin Jin, Shanshan Huang, Qian Jiang, Shin Jye Lee, Liwen Wu, Shaowen Yao

研究成果: Article同行評審

14 引文 斯高帕斯(Scopus)

摘要

Remote sensing image fusion (RSIF) can generate an integrated image with high spatial and spectral resolution. The fused remote sensing image is conducive to applications including disaster monitoring, ecological environment investigation, and dynamic monitoring. However, most existing deep learning based RSIF methods require ground truths (or reference images) to train a model, and the acquisition of ground truths is a difficult problem. To address this, we propose a semisupervised RSIF method based on the multiscale conditional generative adversarial networks by combining the multiskip connection and pseudo-Siamese structure. This new method can simultaneously extract the features of panchromatic and multispectral images to fuse them without a ground truth; the adopted multiskip connection contributes to presenting image details. In addition, we propose a composite loss function, which combines the least squares loss, L1 loss, and peak signal-to-noise ratio loss to train the model; the composite loss function can help to retain the spatial details and spectral information of the source images. Moreover, we verify the proposed method by extensive experiments, and the results show that the new method can achieve outstanding performance without relying on the ground truth.

原文English
文章編號9461404
頁(從 - 到)7066-7084
頁數19
期刊IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
14
DOIs
出版狀態Published - 6月 2021

指紋

深入研究「Semisupervised Remote Sensing Image Fusion Using Multiscale Conditional Generative Adversarial Network with Siamese Structure」主題。共同形成了獨特的指紋。

引用此