Two-stage discriminative re-ranking for large-scale landmark retrieval

Shuhei Yokoo, Kohei Ozaki, Edgar Simo-Serra, Satoshi Iizuka

研究成果: Conference contribution

1 被引用数 (Scopus)

抄録

We propose an efficient pipeline for large-scale landmark image retrieval that addresses the diversity of the dataset through two-stage discriminative re-ranking. Our approach is based on embedding the images in a feature-space using a convolutional neural network trained with a cosine softmax loss. Due to the variance of the images, which include extreme viewpoint changes such as having to retrieve images of the exterior of a landmark from images of the interior, this is very challenging for approaches based exclusively on visual similarity. Our proposed re-ranking approach improves the results in two steps: in the sort-step, k-nearest neighbor search with soft-voting to sort the retrieved results based on their label similarity to the query images, and in the insert-step, we add additional samples from the dataset that were not retrieved by image-similarity. This approach allows overcoming the low visual diversity in retrieved images. In-depth experimental results show that the proposed approach significantly outperforms existing approaches on the challenging Google Landmarks Datasets. Using our methods, we achieved 1st place in the Google Landmark Retrieval 2019 challenge on Kaggle. Our code is publicly available here: https://github.com/lyakaap/Landmark2019-1st-and-3rd-Place-Solution.

本文言語English
ホスト出版物のタイトルProceedings - 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2020
出版社IEEE Computer Society
ページ4363-4370
ページ数8
ISBN(電子版)9781728193601
DOI
出版ステータスPublished - 2020 6
イベント2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2020 - Virtual, Online, United States
継続期間: 2020 6 142020 6 19

出版物シリーズ

名前IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops
2020-June
ISSN(印刷版)2160-7508
ISSN(電子版)2160-7516

Conference

Conference2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2020
CountryUnited States
CityVirtual, Online
Period20/6/1420/6/19

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Electrical and Electronic Engineering

フィンガープリント 「Two-stage discriminative re-ranking for large-scale landmark retrieval」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル