Litcius/Paper detail

Learning to Learn Adaptive Classifier–Predictor for Few-Shot Learning

Nan Lai, Meina Kan, Chunrui Han, Xingguang Song, Shiguang Shan

2020IEEE Transactions on Neural Networks and Learning Systems115 citationsDOI

Abstract

Few-shot learning aims to learn a well-performing model from a few labeled examples. Recently, quite a few works propose to learn a predictor to directly generate model parameter weights with episodic training strategy of meta-learning and achieve fairly promising performance. However, the predictor in these works is task-agnostic, which means that the predictor cannot adjust to novel tasks in the testing phase. In this article, we propose a novel meta-learning method to learn how to learn task-adaptive classifier-predictor to generate classifier weights for few-shot classification. Specifically, a meta classifier-predictor module, (MPM) is introduced to learn how to adaptively update a task-agnostic classifier-predictor to a task-specialized one on a novel task with a newly proposed center-uniqueness loss function. Compared with previous works, our task-adaptive classifier-predictor can better capture characteristics of each category in a novel task and thus generate a more accurate and effective classifier. Our method is evaluated on two commonly used benchmarks for few-shot classification, i.e., miniImageNet and tieredImageNet. Ablation study verifies the necessity of learning task-adaptive classifier-predictor and the effectiveness of our newly proposed center-uniqueness loss. Moreover, our method achieves the state-of-the-art performance on both benchmarks, thus demonstrating its superiority.

Topics & Concepts

Classifier (UML)Computer scienceArtificial intelligenceMachine learningMargin classifierPattern recognition (psychology)Domain Adaptation and Few-Shot LearningMultimodal Machine Learning ApplicationsMachine Learning and Data Classification
Learning to Learn Adaptive Classifier–Predictor for Few-Shot Learning | Litcius