Improved prior selection using semantics in maximum a posteriori for few-shot learning

Jiaying Wu, Jinglu Hu*

*この研究の対応する著者

研究成果: Article査読

1 被引用数 (Scopus)

抄録

Few-shot learning is to recognize novel concepts with few labeled samples. Recently, significant progress has been made to address the overfitting caused by data scarcity, especially those on modeling the distribution of novel categories given a single point. However, they often deeply rely on the prior knowledge from base set, which is generally hard to define, and its selection can easily bias the learning. A popular pipeline is to pretrain a feature extractor with base set and generate statistics from them as prior information. Since pretrained feature extractor cannot extract accurate representations for categories have never seen, and there is only 1 or 5 support images from novel categories, making it hard to acquire accurate priors, especially when they are far away from the class center. To address these issues, in this paper, we base our network on Maximum a posteriori (MAP), proposing a strategy for better prior selection from base set. We specially introduce semantic information, which are learned from unsupervised text corpora and easily available, to alleviate biases caused by unrepresentative support samples. Our intuition is that when the support from visual information is biased, semantics can provide strong prior knowledge to assist learning. Experimental results on four few-shot benchmarks also show that it outperforms the state-of-the-art methods by a large margin, improves around 2.08%∼12.68% than the best results in each dataset on both 1- and 5-shot tasks.

本文言語English
論文番号107688
ジャーナルKnowledge-Based Systems
237
DOI
出版ステータスPublished - 2022 2月 15

ASJC Scopus subject areas

  • 管理情報システム
  • ソフトウェア
  • 情報システムおよび情報管理
  • 人工知能

フィンガープリント

「Improved prior selection using semantics in maximum a posteriori for few-shot learning」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル