Generating Frequency-limited Adversarial Examples to Attack Multi-focus Image Fusion Models

Xin Jin*, Qian Jiang*, Peng Liu, Xueshuai Gao*, Puming Wang*, Shin Jye Lee

*此作品的通信作者

研究成果: Conference contribution同行評審

摘要

Multi-focus image fusion techniques aim to generate all-in-focus clear images by fusing a set of images with different focused areas. Recently various deep learning based methods have been proposed for image fusion, but the robustness of these models is ignored, while neural networks are vulnerable to adversarial examples. In this work, we proposed a generator based method to attack decision map based multi-focus image fusion models. First, we train a multi-focus image fusion model as the local surrogate model and freeze its weights. Then, adversarial loss and feature separation loss are used to train the attack generator. The two losses maximize the distance of decision maps and feature maps between clean images and adversarial images respectively. Finally, the generated perturbations are limited to certain frequency components using a mask in the discrete cosine transform domain. Experimental results show that the proposed attacks result in serious performance degradation of target models. Besides, we analyze how neural networks recognize focus areas, and find that small multi-focus image fusion models mainly concern high-frequency features and are vulnerable to high frequency noises.

原文English
主出版物標題Proceedings - 2022 IEEE SmartWorld, Ubiquitous Intelligence and Computing, Autonomous and Trusted Vehicles, Scalable Computing and Communications, Digital Twin, Privacy Computing, Metaverse, SmartWorld/UIC/ATC/ScalCom/DigitalTwin/PriComp/Metaverse 2022
發行者Institute of Electrical and Electronics Engineers Inc.
頁面1216-1223
頁數8
ISBN(電子)9798350346558
DOIs
出版狀態Published - 2022
事件2022 IEEE SmartWorld, 19th IEEE International Conference on Ubiquitous Intelligence and Computing, 2022 IEEE International Conference on Autonomous and Trusted Vehicles Conference, 22nd IEEE International Conference on Scalable Computing and Communications, 2022 IEEE International Conference on Digital Twin, 8th IEEE International Conference on Privacy Computing and 2022 IEEE International Conference on Metaverse, SmartWorld/UIC/ATC/ScalCom/DigitalTwin/PriComp/Metaverse 2022 - Haikou, 中國
持續時間: 15 12月 202218 12月 2022

出版系列

名字Proceedings - 2022 IEEE SmartWorld, Ubiquitous Intelligence and Computing, Autonomous and Trusted Vehicles, Scalable Computing and Communications, Digital Twin, Privacy Computing, Metaverse, SmartWorld/UIC/ATC/ScalCom/DigitalTwin/PriComp/Metaverse 2022

Conference

Conference2022 IEEE SmartWorld, 19th IEEE International Conference on Ubiquitous Intelligence and Computing, 2022 IEEE International Conference on Autonomous and Trusted Vehicles Conference, 22nd IEEE International Conference on Scalable Computing and Communications, 2022 IEEE International Conference on Digital Twin, 8th IEEE International Conference on Privacy Computing and 2022 IEEE International Conference on Metaverse, SmartWorld/UIC/ATC/ScalCom/DigitalTwin/PriComp/Metaverse 2022
國家/地區中國
城市Haikou
期間15/12/2218/12/22

指紋

深入研究「Generating Frequency-limited Adversarial Examples to Attack Multi-focus Image Fusion Models」主題。共同形成了獨特的指紋。

引用此