TY - GEN
T1 - Generating Frequency-limited Adversarial Examples to Attack Multi-focus Image Fusion Models
AU - Jin, Xin
AU - Jiang, Qian
AU - Liu, Peng
AU - Gao, Xueshuai
AU - Wang, Puming
AU - Lee, Shin Jye
N1 - Publisher Copyright:
© 2022 IEEE.
PY - 2022
Y1 - 2022
N2 - Multi-focus image fusion techniques aim to generate all-in-focus clear images by fusing a set of images with different focused areas. Recently various deep learning based methods have been proposed for image fusion, but the robustness of these models is ignored, while neural networks are vulnerable to adversarial examples. In this work, we proposed a generator based method to attack decision map based multi-focus image fusion models. First, we train a multi-focus image fusion model as the local surrogate model and freeze its weights. Then, adversarial loss and feature separation loss are used to train the attack generator. The two losses maximize the distance of decision maps and feature maps between clean images and adversarial images respectively. Finally, the generated perturbations are limited to certain frequency components using a mask in the discrete cosine transform domain. Experimental results show that the proposed attacks result in serious performance degradation of target models. Besides, we analyze how neural networks recognize focus areas, and find that small multi-focus image fusion models mainly concern high-frequency features and are vulnerable to high frequency noises.
AB - Multi-focus image fusion techniques aim to generate all-in-focus clear images by fusing a set of images with different focused areas. Recently various deep learning based methods have been proposed for image fusion, but the robustness of these models is ignored, while neural networks are vulnerable to adversarial examples. In this work, we proposed a generator based method to attack decision map based multi-focus image fusion models. First, we train a multi-focus image fusion model as the local surrogate model and freeze its weights. Then, adversarial loss and feature separation loss are used to train the attack generator. The two losses maximize the distance of decision maps and feature maps between clean images and adversarial images respectively. Finally, the generated perturbations are limited to certain frequency components using a mask in the discrete cosine transform domain. Experimental results show that the proposed attacks result in serious performance degradation of target models. Besides, we analyze how neural networks recognize focus areas, and find that small multi-focus image fusion models mainly concern high-frequency features and are vulnerable to high frequency noises.
KW - adversarial attack
KW - discrete cosine transform
KW - multi focus image fusion
UR - http://www.scopus.com/inward/record.url?scp=85168080577&partnerID=8YFLogxK
U2 - 10.1109/SmartWorld-UIC-ATC-ScalCom-DigitalTwin-PriComp-Metaverse56740.2022.00180
DO - 10.1109/SmartWorld-UIC-ATC-ScalCom-DigitalTwin-PriComp-Metaverse56740.2022.00180
M3 - Conference contribution
AN - SCOPUS:85168080577
T3 - Proceedings - 2022 IEEE SmartWorld, Ubiquitous Intelligence and Computing, Autonomous and Trusted Vehicles, Scalable Computing and Communications, Digital Twin, Privacy Computing, Metaverse, SmartWorld/UIC/ATC/ScalCom/DigitalTwin/PriComp/Metaverse 2022
SP - 1216
EP - 1223
BT - Proceedings - 2022 IEEE SmartWorld, Ubiquitous Intelligence and Computing, Autonomous and Trusted Vehicles, Scalable Computing and Communications, Digital Twin, Privacy Computing, Metaverse, SmartWorld/UIC/ATC/ScalCom/DigitalTwin/PriComp/Metaverse 2022
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2022 IEEE SmartWorld, 19th IEEE International Conference on Ubiquitous Intelligence and Computing, 2022 IEEE International Conference on Autonomous and Trusted Vehicles Conference, 22nd IEEE International Conference on Scalable Computing and Communications, 2022 IEEE International Conference on Digital Twin, 8th IEEE International Conference on Privacy Computing and 2022 IEEE International Conference on Metaverse, SmartWorld/UIC/ATC/ScalCom/DigitalTwin/PriComp/Metaverse 2022
Y2 - 15 December 2022 through 18 December 2022
ER -