Zero-shot video retrieval from a query phrase including multiple concepts - Efforts and challenges in trecvid avs task-

Kazuya Ueki, Koji Hirakawa, Kotaro Kikuchi, Tetsunori Kobayashi

Research output: Contribution to journalArticle

Abstract

In this paper, we report our efforts and challenges on the TRECVID ad-hoc video search (AVS) task. The goal of the AVS task it to build a zero-shot video retrieval system using a complicated query phrase. Our system has the following two characteristics. First, we prepared a large number of pre-trained concept classifiers in advance that can detect various kinds of objects, persons, scenes, and actions. This strategy contributes to improve the word coverage rate of keywords in query phrases. Second, we selected additional concept classifiers by natural language processing techniques such as using word similarities or synonyms. We submitted our systems with these two characteristics to the TRECVID AVS task in 2016 and 2017, and one of our systems ranked the highest among all the submitted systems for the second consecutive year.

Original languageEnglish
Pages (from-to)983-990
Number of pages8
JournalSeimitsu Kogaku Kaishi/Journal of the Japan Society for Precision Engineering
Volume84
Issue number12
DOIs
Publication statusPublished - 2018 Jan 1
Externally publishedYes

Keywords

  • Ad-hoc video search
  • Convolutional neural network
  • TRECVID
  • Video retrieval
  • Zero-shot learning

ASJC Scopus subject areas

  • Mechanical Engineering

Fingerprint Dive into the research topics of 'Zero-shot video retrieval from a query phrase including multiple concepts - Efforts and challenges in trecvid avs task-'. Together they form a unique fingerprint.

  • Cite this