Image annotation fusing content-based and tag-based technique using support vector machine and vector space model

Shan Bin Chan, Hayato Yamana, Duy Dinh Le, Shinichi Satoh

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    1 Citation (Scopus)

    Abstract

    In this paper, we propose a new image annotation method by combining content-based image annotation and tag-based image annotation techniques. Content-based image annotation technique is adopted to extract 'loosely defined concepts' by analyzing pre-given images' features such as color moment (CM), edge orientation histogram (EOH), and local binary pattern (LBP), followed by constructing a set of SVMs for 100 loosely defined concepts. A base-vector for each concept, similar to tag-based image annotation technique, is then constructed by using SVMs' predicted probabilistic results for sample-images whose main concepts are known. Finally cosine similarity between a query-image vector and the base vector is calculated for each concept. Experimental results show that our proposed method outperforms content-based image annotation technique by about 23% in accuracy.

    Original languageEnglish
    Title of host publicationProceedings - 10th International Conference on Signal-Image Technology and Internet-Based Systems, SITIS 2014
    PublisherInstitute of Electrical and Electronics Engineers Inc.
    Pages272-276
    Number of pages5
    ISBN (Electronic)9781479979783
    DOIs
    Publication statusPublished - 2014
    Event10th International Conference on Signal-Image Technology and Internet-Based Systems, SITIS 2014 - Marrakech, Morocco
    Duration: 2014 Nov 232014 Nov 27

    Other

    Other10th International Conference on Signal-Image Technology and Internet-Based Systems, SITIS 2014
    CountryMorocco
    CityMarrakech
    Period14/11/2314/11/27

    Fingerprint

    Vector spaces
    Support vector machines
    Color

    Keywords

    • image annotation
    • support vector machine
    • vector space model

    ASJC Scopus subject areas

    • Computer Graphics and Computer-Aided Design
    • Signal Processing
    • Computer Networks and Communications

    Cite this

    Chan, S. B., Yamana, H., Le, D. D., & Satoh, S. (2014). Image annotation fusing content-based and tag-based technique using support vector machine and vector space model. In Proceedings - 10th International Conference on Signal-Image Technology and Internet-Based Systems, SITIS 2014 (pp. 272-276). [7081558] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/SITIS.2014.76

    Image annotation fusing content-based and tag-based technique using support vector machine and vector space model. / Chan, Shan Bin; Yamana, Hayato; Le, Duy Dinh; Satoh, Shinichi.

    Proceedings - 10th International Conference on Signal-Image Technology and Internet-Based Systems, SITIS 2014. Institute of Electrical and Electronics Engineers Inc., 2014. p. 272-276 7081558.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Chan, SB, Yamana, H, Le, DD & Satoh, S 2014, Image annotation fusing content-based and tag-based technique using support vector machine and vector space model. in Proceedings - 10th International Conference on Signal-Image Technology and Internet-Based Systems, SITIS 2014., 7081558, Institute of Electrical and Electronics Engineers Inc., pp. 272-276, 10th International Conference on Signal-Image Technology and Internet-Based Systems, SITIS 2014, Marrakech, Morocco, 14/11/23. https://doi.org/10.1109/SITIS.2014.76
    Chan SB, Yamana H, Le DD, Satoh S. Image annotation fusing content-based and tag-based technique using support vector machine and vector space model. In Proceedings - 10th International Conference on Signal-Image Technology and Internet-Based Systems, SITIS 2014. Institute of Electrical and Electronics Engineers Inc. 2014. p. 272-276. 7081558 https://doi.org/10.1109/SITIS.2014.76
    Chan, Shan Bin ; Yamana, Hayato ; Le, Duy Dinh ; Satoh, Shinichi. / Image annotation fusing content-based and tag-based technique using support vector machine and vector space model. Proceedings - 10th International Conference on Signal-Image Technology and Internet-Based Systems, SITIS 2014. Institute of Electrical and Electronics Engineers Inc., 2014. pp. 272-276
    @inproceedings{fc1160e533574bef82c229e73d7f6223,
    title = "Image annotation fusing content-based and tag-based technique using support vector machine and vector space model",
    abstract = "In this paper, we propose a new image annotation method by combining content-based image annotation and tag-based image annotation techniques. Content-based image annotation technique is adopted to extract 'loosely defined concepts' by analyzing pre-given images' features such as color moment (CM), edge orientation histogram (EOH), and local binary pattern (LBP), followed by constructing a set of SVMs for 100 loosely defined concepts. A base-vector for each concept, similar to tag-based image annotation technique, is then constructed by using SVMs' predicted probabilistic results for sample-images whose main concepts are known. Finally cosine similarity between a query-image vector and the base vector is calculated for each concept. Experimental results show that our proposed method outperforms content-based image annotation technique by about 23{\%} in accuracy.",
    keywords = "image annotation, support vector machine, vector space model",
    author = "Chan, {Shan Bin} and Hayato Yamana and Le, {Duy Dinh} and Shinichi Satoh",
    year = "2014",
    doi = "10.1109/SITIS.2014.76",
    language = "English",
    pages = "272--276",
    booktitle = "Proceedings - 10th International Conference on Signal-Image Technology and Internet-Based Systems, SITIS 2014",
    publisher = "Institute of Electrical and Electronics Engineers Inc.",
    address = "United States",

    }

    TY - GEN

    T1 - Image annotation fusing content-based and tag-based technique using support vector machine and vector space model

    AU - Chan, Shan Bin

    AU - Yamana, Hayato

    AU - Le, Duy Dinh

    AU - Satoh, Shinichi

    PY - 2014

    Y1 - 2014

    N2 - In this paper, we propose a new image annotation method by combining content-based image annotation and tag-based image annotation techniques. Content-based image annotation technique is adopted to extract 'loosely defined concepts' by analyzing pre-given images' features such as color moment (CM), edge orientation histogram (EOH), and local binary pattern (LBP), followed by constructing a set of SVMs for 100 loosely defined concepts. A base-vector for each concept, similar to tag-based image annotation technique, is then constructed by using SVMs' predicted probabilistic results for sample-images whose main concepts are known. Finally cosine similarity between a query-image vector and the base vector is calculated for each concept. Experimental results show that our proposed method outperforms content-based image annotation technique by about 23% in accuracy.

    AB - In this paper, we propose a new image annotation method by combining content-based image annotation and tag-based image annotation techniques. Content-based image annotation technique is adopted to extract 'loosely defined concepts' by analyzing pre-given images' features such as color moment (CM), edge orientation histogram (EOH), and local binary pattern (LBP), followed by constructing a set of SVMs for 100 loosely defined concepts. A base-vector for each concept, similar to tag-based image annotation technique, is then constructed by using SVMs' predicted probabilistic results for sample-images whose main concepts are known. Finally cosine similarity between a query-image vector and the base vector is calculated for each concept. Experimental results show that our proposed method outperforms content-based image annotation technique by about 23% in accuracy.

    KW - image annotation

    KW - support vector machine

    KW - vector space model

    UR - http://www.scopus.com/inward/record.url?scp=84988227368&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=84988227368&partnerID=8YFLogxK

    U2 - 10.1109/SITIS.2014.76

    DO - 10.1109/SITIS.2014.76

    M3 - Conference contribution

    AN - SCOPUS:84988227368

    SP - 272

    EP - 276

    BT - Proceedings - 10th International Conference on Signal-Image Technology and Internet-Based Systems, SITIS 2014

    PB - Institute of Electrical and Electronics Engineers Inc.

    ER -