Task-Adaptive Feature Matching Loss for Image Deblurring

Chiao Chang Chang*, Bo Cheng Yang, Yi Ting Liu, Jun Cheng Chen, I. Hong Jhuo, Yen Yu Lin

*此作品的通信作者

研究成果: Conference contribution同行評審

摘要

Image deblurring is a highly challenging and ill-posed image restoration problem. Contemporary deep learning-based approaches usually tackle this problem by exploiting the encoder-decoder-based models trained by the commonly used mean squared error loss with the feature matching loss as a regularization to obtain perceptual consistent restored results as the ground truths. We argue that since the general backbone models for computing feature matching loss are usually not trained on the image deblurring task, the loss lacks specific knowledge of blur and usually leads to suboptimal performance. To address this issue, we propose a task-adaptive feature matching loss for image deblurring where we synthesize blurred images in different blur extents and employ triplet loss to finetune the backbone model for learning specific blur priors. Then, we leverage the finetuned backbone to compute feature matching loss which can greatly enhance the existing image deblurring models for better perceptual results. With extensive experiments on the GoPro and RealBlur datasets, both qualitative and quantitative results show that the SOTA deblurring models trained with the proposed loss can effectively obtain better and sharper restored images in terms of various perceptual image quality metrics than the original models while maintaining comparable PSNR and SSIM performances.

原文English
主出版物標題2023 IEEE International Conference on Image Processing, ICIP 2023 - Proceedings
發行者IEEE Computer Society
頁面3135-3139
頁數5
ISBN(電子)9781728198354
DOIs
出版狀態Published - 2023
事件30th IEEE International Conference on Image Processing, ICIP 2023 - Kuala Lumpur, 馬來西亞
持續時間: 8 10月 202311 10月 2023

出版系列

名字Proceedings - International Conference on Image Processing, ICIP
ISSN(列印)1522-4880

Conference

Conference30th IEEE International Conference on Image Processing, ICIP 2023
國家/地區馬來西亞
城市Kuala Lumpur
期間8/10/2311/10/23

指紋

深入研究「Task-Adaptive Feature Matching Loss for Image Deblurring」主題。共同形成了獨特的指紋。

引用此