TY - JOUR
T1 - Generalizable person re-identification with part-based multi-scale network
AU - Wu, Jia Jen
AU - Chang, Keng Hao
AU - Lin, I. Chen
N1 - Publisher Copyright:
© 2023, The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature.
PY - 2023/10
Y1 - 2023/10
N2 - Supervised person re-identification (Re-ID) has advanced significantly, but it suffers from the performance drop when the pretrained models are directly deployed to an unseen domain. Meanwhile, domain adaptation methods are widely investigated to decrease the performance degradation caused by domain gaps. However, it still requires training with unlabeled target-domain data and iteratively updating models. In this work, we proposed a generalizable person Re-ID framework named Part-based Multi-scale Network (PMN), which was trained on source domain(s) once and can be directly exploited to target domains with stable performance. To this end, we leveraged a part-based architecture which uniformly partitions feature maps into several horizontal stripes. The stripe features contain fine-grained information of human parts and therefore benefit learning discriminative features. The Scale Adjusting Module (SAM) is also designed to regulate the style differences appearing in lower-level feature maps and helps incorporation of features from different levels. When we integrated the style-adjusted features and fine-grained local features into our improved backbone, the proposed framework becomes generalized to variation of image styles and backgrounds from different datasets. Extensive experiments show the superiority of the proposed PMN over state-of-the-art generalizable methods on multiple popular Re-ID benchmarks with cross-domain setting. Furthermore, we also demonstrate the advantage of using our framework as a backbone for domain adaptation methods.
AB - Supervised person re-identification (Re-ID) has advanced significantly, but it suffers from the performance drop when the pretrained models are directly deployed to an unseen domain. Meanwhile, domain adaptation methods are widely investigated to decrease the performance degradation caused by domain gaps. However, it still requires training with unlabeled target-domain data and iteratively updating models. In this work, we proposed a generalizable person Re-ID framework named Part-based Multi-scale Network (PMN), which was trained on source domain(s) once and can be directly exploited to target domains with stable performance. To this end, we leveraged a part-based architecture which uniformly partitions feature maps into several horizontal stripes. The stripe features contain fine-grained information of human parts and therefore benefit learning discriminative features. The Scale Adjusting Module (SAM) is also designed to regulate the style differences appearing in lower-level feature maps and helps incorporation of features from different levels. When we integrated the style-adjusted features and fine-grained local features into our improved backbone, the proposed framework becomes generalized to variation of image styles and backgrounds from different datasets. Extensive experiments show the superiority of the proposed PMN over state-of-the-art generalizable methods on multiple popular Re-ID benchmarks with cross-domain setting. Furthermore, we also demonstrate the advantage of using our framework as a backbone for domain adaptation methods.
KW - Deep neural networks
KW - Domain generalization
KW - Re-identification of persons
UR - http://www.scopus.com/inward/record.url?scp=85150611742&partnerID=8YFLogxK
U2 - 10.1007/s11042-023-14718-1
DO - 10.1007/s11042-023-14718-1
M3 - Article
AN - SCOPUS:85150611742
SN - 1380-7501
VL - 82
SP - 38639
EP - 38666
JO - Multimedia Tools and Applications
JF - Multimedia Tools and Applications
IS - 25
ER -