Ad-hoc Video Search Improved by the Word Sense Filtering of Query Terms

Koji Hirakawa, Kotaro Kikuchi, Kazuya Ueki, Tetsunori Kobayashi, Yoshihiko Hayashi

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Abstract

    The performances of an ad-hoc video search (AVS) task can only be improved when the video processing for analyzing video contents and the linguistic processing for interpreting natural language queries are nicely combined. Among the several issues associated with this challenging task, this paper particularly focuses on the sense disambiguation/filtering (WSD/WSF) of the terms contained in a search query. We propose WSD/WSF methods which employ distributed sense representations, and discuss their efficacy in improving the performance of an AVS system which makes full use of a large bank of visual concept classifiers. The application of a WSD/WSF method is crucial, as each visual concept classifier is linked with the lexical concept denoted by a word sense. The results are generally promising, outperforming not only a baseline query processing method that only considers the polysemy of a query term but also a strong WSD baseline method.

    Original languageEnglish
    Title of host publicationInformation Retrieval Technology - 14th Asia Information Retrieval Societies Conference, AIRS 2018, Proceedings
    EditorsLun-Wei Ku, Jui-Feng Yeh, Liang-Chih Yu, Yuen-Hsien Tseng, Zhi-Hong Chen, Tetsuya Sakai, Jing Jiang, Lung-Hao Lee, Dae Hoon Park
    PublisherSpringer-Verlag
    Pages157-163
    Number of pages7
    ISBN (Print)9783030035198
    DOIs
    Publication statusPublished - 2018 Jan 1
    Event14th Asia Information Retrieval Societies conference, AIRS 2018 - Taipei, Taiwan, Province of China
    Duration: 2018 Nov 282018 Nov 30

    Publication series

    NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
    Volume11292 LNCS
    ISSN (Print)0302-9743
    ISSN (Electronic)1611-3349

    Other

    Other14th Asia Information Retrieval Societies conference, AIRS 2018
    CountryTaiwan, Province of China
    CityTaipei
    Period18/11/2818/11/30

    Fingerprint

    Classifiers
    Filtering
    Query
    Query languages
    Query processing
    Term
    Processing
    Linguistics
    Baseline
    Classifier
    Video Processing
    Query Processing
    Natural Language
    Efficacy
    Concepts
    Vision

    Keywords

    • Ad-hoc video search
    • Query processing
    • TRECVID AVS
    • Visual concepts
    • Word sense disambiguation

    ASJC Scopus subject areas

    • Theoretical Computer Science
    • Computer Science(all)

    Cite this

    Hirakawa, K., Kikuchi, K., Ueki, K., Kobayashi, T., & Hayashi, Y. (2018). Ad-hoc Video Search Improved by the Word Sense Filtering of Query Terms. In L-W. Ku, J-F. Yeh, L-C. Yu, Y-H. Tseng, Z-H. Chen, T. Sakai, J. Jiang, L-H. Lee, ... D. H. Park (Eds.), Information Retrieval Technology - 14th Asia Information Retrieval Societies Conference, AIRS 2018, Proceedings (pp. 157-163). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11292 LNCS). Springer-Verlag. https://doi.org/10.1007/978-3-030-03520-4_15

    Ad-hoc Video Search Improved by the Word Sense Filtering of Query Terms. / Hirakawa, Koji; Kikuchi, Kotaro; Ueki, Kazuya; Kobayashi, Tetsunori; Hayashi, Yoshihiko.

    Information Retrieval Technology - 14th Asia Information Retrieval Societies Conference, AIRS 2018, Proceedings. ed. / Lun-Wei Ku; Jui-Feng Yeh; Liang-Chih Yu; Yuen-Hsien Tseng; Zhi-Hong Chen; Tetsuya Sakai; Jing Jiang; Lung-Hao Lee; Dae Hoon Park. Springer-Verlag, 2018. p. 157-163 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11292 LNCS).

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Hirakawa, K, Kikuchi, K, Ueki, K, Kobayashi, T & Hayashi, Y 2018, Ad-hoc Video Search Improved by the Word Sense Filtering of Query Terms. in L-W Ku, J-F Yeh, L-C Yu, Y-H Tseng, Z-H Chen, T Sakai, J Jiang, L-H Lee & DH Park (eds), Information Retrieval Technology - 14th Asia Information Retrieval Societies Conference, AIRS 2018, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11292 LNCS, Springer-Verlag, pp. 157-163, 14th Asia Information Retrieval Societies conference, AIRS 2018, Taipei, Taiwan, Province of China, 18/11/28. https://doi.org/10.1007/978-3-030-03520-4_15
    Hirakawa K, Kikuchi K, Ueki K, Kobayashi T, Hayashi Y. Ad-hoc Video Search Improved by the Word Sense Filtering of Query Terms. In Ku L-W, Yeh J-F, Yu L-C, Tseng Y-H, Chen Z-H, Sakai T, Jiang J, Lee L-H, Park DH, editors, Information Retrieval Technology - 14th Asia Information Retrieval Societies Conference, AIRS 2018, Proceedings. Springer-Verlag. 2018. p. 157-163. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-030-03520-4_15
    Hirakawa, Koji ; Kikuchi, Kotaro ; Ueki, Kazuya ; Kobayashi, Tetsunori ; Hayashi, Yoshihiko. / Ad-hoc Video Search Improved by the Word Sense Filtering of Query Terms. Information Retrieval Technology - 14th Asia Information Retrieval Societies Conference, AIRS 2018, Proceedings. editor / Lun-Wei Ku ; Jui-Feng Yeh ; Liang-Chih Yu ; Yuen-Hsien Tseng ; Zhi-Hong Chen ; Tetsuya Sakai ; Jing Jiang ; Lung-Hao Lee ; Dae Hoon Park. Springer-Verlag, 2018. pp. 157-163 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
    @inproceedings{d506c7dc3aee471bb0e241c242fcd378,
    title = "Ad-hoc Video Search Improved by the Word Sense Filtering of Query Terms",
    abstract = "The performances of an ad-hoc video search (AVS) task can only be improved when the video processing for analyzing video contents and the linguistic processing for interpreting natural language queries are nicely combined. Among the several issues associated with this challenging task, this paper particularly focuses on the sense disambiguation/filtering (WSD/WSF) of the terms contained in a search query. We propose WSD/WSF methods which employ distributed sense representations, and discuss their efficacy in improving the performance of an AVS system which makes full use of a large bank of visual concept classifiers. The application of a WSD/WSF method is crucial, as each visual concept classifier is linked with the lexical concept denoted by a word sense. The results are generally promising, outperforming not only a baseline query processing method that only considers the polysemy of a query term but also a strong WSD baseline method.",
    keywords = "Ad-hoc video search, Query processing, TRECVID AVS, Visual concepts, Word sense disambiguation",
    author = "Koji Hirakawa and Kotaro Kikuchi and Kazuya Ueki and Tetsunori Kobayashi and Yoshihiko Hayashi",
    year = "2018",
    month = "1",
    day = "1",
    doi = "10.1007/978-3-030-03520-4_15",
    language = "English",
    isbn = "9783030035198",
    series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
    publisher = "Springer-Verlag",
    pages = "157--163",
    editor = "Lun-Wei Ku and Jui-Feng Yeh and Liang-Chih Yu and Yuen-Hsien Tseng and Zhi-Hong Chen and Tetsuya Sakai and Jing Jiang and Lung-Hao Lee and Park, {Dae Hoon}",
    booktitle = "Information Retrieval Technology - 14th Asia Information Retrieval Societies Conference, AIRS 2018, Proceedings",

    }

    TY - GEN

    T1 - Ad-hoc Video Search Improved by the Word Sense Filtering of Query Terms

    AU - Hirakawa, Koji

    AU - Kikuchi, Kotaro

    AU - Ueki, Kazuya

    AU - Kobayashi, Tetsunori

    AU - Hayashi, Yoshihiko

    PY - 2018/1/1

    Y1 - 2018/1/1

    N2 - The performances of an ad-hoc video search (AVS) task can only be improved when the video processing for analyzing video contents and the linguistic processing for interpreting natural language queries are nicely combined. Among the several issues associated with this challenging task, this paper particularly focuses on the sense disambiguation/filtering (WSD/WSF) of the terms contained in a search query. We propose WSD/WSF methods which employ distributed sense representations, and discuss their efficacy in improving the performance of an AVS system which makes full use of a large bank of visual concept classifiers. The application of a WSD/WSF method is crucial, as each visual concept classifier is linked with the lexical concept denoted by a word sense. The results are generally promising, outperforming not only a baseline query processing method that only considers the polysemy of a query term but also a strong WSD baseline method.

    AB - The performances of an ad-hoc video search (AVS) task can only be improved when the video processing for analyzing video contents and the linguistic processing for interpreting natural language queries are nicely combined. Among the several issues associated with this challenging task, this paper particularly focuses on the sense disambiguation/filtering (WSD/WSF) of the terms contained in a search query. We propose WSD/WSF methods which employ distributed sense representations, and discuss their efficacy in improving the performance of an AVS system which makes full use of a large bank of visual concept classifiers. The application of a WSD/WSF method is crucial, as each visual concept classifier is linked with the lexical concept denoted by a word sense. The results are generally promising, outperforming not only a baseline query processing method that only considers the polysemy of a query term but also a strong WSD baseline method.

    KW - Ad-hoc video search

    KW - Query processing

    KW - TRECVID AVS

    KW - Visual concepts

    KW - Word sense disambiguation

    UR - http://www.scopus.com/inward/record.url?scp=85057250392&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=85057250392&partnerID=8YFLogxK

    U2 - 10.1007/978-3-030-03520-4_15

    DO - 10.1007/978-3-030-03520-4_15

    M3 - Conference contribution

    SN - 9783030035198

    T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

    SP - 157

    EP - 163

    BT - Information Retrieval Technology - 14th Asia Information Retrieval Societies Conference, AIRS 2018, Proceedings

    A2 - Ku, Lun-Wei

    A2 - Yeh, Jui-Feng

    A2 - Yu, Liang-Chih

    A2 - Tseng, Yuen-Hsien

    A2 - Chen, Zhi-Hong

    A2 - Sakai, Tetsuya

    A2 - Jiang, Jing

    A2 - Lee, Lung-Hao

    A2 - Park, Dae Hoon

    PB - Springer-Verlag

    ER -