Color multi-focus image fusion based on transfer learning

Yun Wang, Xin Jin, Jie Yang, Qian Jiang, Yue Tang, Puming Wang, Shin Jye Lee

研究成果: Article同行評審

1 引文 斯高帕斯(Scopus)


Multi-focus image fusion is a technique that integrates the focused areas in a pair or set of source images with the same scene into a fully focused image. Inspired by transfer learning, this paper proposes a novel color multi-focus image fusion method based on deep learning. First, color multi-focus source images are fed into VGG-19 network, and the parameters of convolutional layer of the VGG-19 network are then migrated to a neural network containing multilayer convolutional layers and multilayer skip-connection structures for feature extraction. Second, the initial decision maps are generated using the reconstructed feature maps of a deconvolution module. Third, the initial decision maps are refined and processed to obtain the second decision maps, and then the source images are fused to obtain the initial fused images based on the second decision maps. Finally, the final fused image is produced by comparing the QABF metrics of the initial fused images. The experimental results show that the proposed method can effectively improve the segmentation performance of the focused and unfocused areas in the source images, and the generated fused images are superior in both subjective and objective metrics compared with most contrast methods.

頁(從 - 到)2083-2102
期刊Journal of Intelligent and Fuzzy Systems
出版狀態Published - 2022


深入研究「Color multi-focus image fusion based on transfer learning」主題。共同形成了獨特的指紋。