TY - JOUR
T1 - Proxy Network for Few Shot Learning
AU - Xiao, Bin
AU - Liu, Chien Liang
AU - Hsaio, Wen Hoar
N1 - Publisher Copyright:
© 2020 B. Xiao, C.-L. Liu & W.-H. Hsaio.
PY - 2020
Y1 - 2020
N2 - The use of a few examples for each class to train a predictive model that can be generalized to novel classes is a crucial and valuable research direction in artificial intelligence. This work addresses this problem by proposing a few-shot learning (FSL) algorithm called proxy network under the architecture of meta-learning. Metric-learning based approaches assume that the data points within the same class should be close, whereas the data points in the different classes should be separated as far as possible in the embedding space. We conclude that the success of metric-learning based approaches lies in the data embedding, the representative of each class, and the distance metric. In this work, we propose a simple but effective end-to-end model that directly learns proxies for class representative and distance metric from data simultaneously. We conduct experiments on CUB and mini-ImageNet datasets in 1-shot-5-way and 5-shot-5-way scenarios, and the experimental results demonstrate the superiority of our proposed method over state-of-the-art methods. Besides, we provide a detailed analysis of our proposed method.
AB - The use of a few examples for each class to train a predictive model that can be generalized to novel classes is a crucial and valuable research direction in artificial intelligence. This work addresses this problem by proposing a few-shot learning (FSL) algorithm called proxy network under the architecture of meta-learning. Metric-learning based approaches assume that the data points within the same class should be close, whereas the data points in the different classes should be separated as far as possible in the embedding space. We conclude that the success of metric-learning based approaches lies in the data embedding, the representative of each class, and the distance metric. In this work, we propose a simple but effective end-to-end model that directly learns proxies for class representative and distance metric from data simultaneously. We conduct experiments on CUB and mini-ImageNet datasets in 1-shot-5-way and 5-shot-5-way scenarios, and the experimental results demonstrate the superiority of our proposed method over state-of-the-art methods. Besides, we provide a detailed analysis of our proposed method.
KW - Few-shot Learning
KW - Metric Learning
KW - Proxy Networks
UR - http://www.scopus.com/inward/record.url?scp=85140368124&partnerID=8YFLogxK
M3 - Conference article
AN - SCOPUS:85140368124
SN - 2640-3498
VL - 129
SP - 657
EP - 672
JO - Proceedings of Machine Learning Research
JF - Proceedings of Machine Learning Research
T2 - 12th Asian Conference on Machine Learning, ACML 2020
Y2 - 18 November 2020 through 20 November 2020
ER -