On the design and exploitation of user's personal and public information for semantic personal digital photograph annotation

Supheakmungkol Sarin, Toshinori Nagahashi, Tadashi Miyosawa, Wataru Kameyama

    Research output: Contribution to journalArticle

    1 Citation (Scopus)

    Abstract

    Automating the process of semantic annotation of digital personal photographs is a crucial step towards efficient and effective management of this increasingly high volume of content. However, this is still a highly challenging task for the research community. This paper proposes a novel solution. Our solution integrates all contextual information available to and from the users, such as their daily emails, schedules, chat archives, web browsing histories, documents, online news, Wikipedia data, and so forth. We then analyze this information and extract important semantic terms, using them as semantic keyword suggestions for their photos. Those keywords are in the form of named entities, such as names of people, organizations, locations, and date/time as well as high frequency terms. Experiments conducted with 10 subjects and a total of 313 photos proved that our proposed approach can significantly help users with the annotation process. We achieved a 33 gain in annotation time as compared to manual annotation. We also obtained very positive results in the accuracy rate of our suggested keywords.

    Original languageEnglish
    Article number592690
    JournalAdvances in Multimedia
    Volume2008
    DOIs
    Publication statusPublished - 2008

    Fingerprint

    Semantics
    Electronic mail
    Experiments

    ASJC Scopus subject areas

    • Computer Science(all)

    Cite this

    On the design and exploitation of user's personal and public information for semantic personal digital photograph annotation. / Sarin, Supheakmungkol; Nagahashi, Toshinori; Miyosawa, Tadashi; Kameyama, Wataru.

    In: Advances in Multimedia, Vol. 2008, 592690, 2008.

    Research output: Contribution to journalArticle

    @article{6ead99e8c8bc4b3d900d6a6cebf4f9c1,
    title = "On the design and exploitation of user's personal and public information for semantic personal digital photograph annotation",
    abstract = "Automating the process of semantic annotation of digital personal photographs is a crucial step towards efficient and effective management of this increasingly high volume of content. However, this is still a highly challenging task for the research community. This paper proposes a novel solution. Our solution integrates all contextual information available to and from the users, such as their daily emails, schedules, chat archives, web browsing histories, documents, online news, Wikipedia data, and so forth. We then analyze this information and extract important semantic terms, using them as semantic keyword suggestions for their photos. Those keywords are in the form of named entities, such as names of people, organizations, locations, and date/time as well as high frequency terms. Experiments conducted with 10 subjects and a total of 313 photos proved that our proposed approach can significantly help users with the annotation process. We achieved a 33 gain in annotation time as compared to manual annotation. We also obtained very positive results in the accuracy rate of our suggested keywords.",
    author = "Supheakmungkol Sarin and Toshinori Nagahashi and Tadashi Miyosawa and Wataru Kameyama",
    year = "2008",
    doi = "10.1155/2008/592690",
    language = "English",
    volume = "2008",
    journal = "Advances in Multimedia",
    issn = "1687-5680",
    publisher = "Hindawi Publishing Corporation",

    }

    TY - JOUR

    T1 - On the design and exploitation of user's personal and public information for semantic personal digital photograph annotation

    AU - Sarin, Supheakmungkol

    AU - Nagahashi, Toshinori

    AU - Miyosawa, Tadashi

    AU - Kameyama, Wataru

    PY - 2008

    Y1 - 2008

    N2 - Automating the process of semantic annotation of digital personal photographs is a crucial step towards efficient and effective management of this increasingly high volume of content. However, this is still a highly challenging task for the research community. This paper proposes a novel solution. Our solution integrates all contextual information available to and from the users, such as their daily emails, schedules, chat archives, web browsing histories, documents, online news, Wikipedia data, and so forth. We then analyze this information and extract important semantic terms, using them as semantic keyword suggestions for their photos. Those keywords are in the form of named entities, such as names of people, organizations, locations, and date/time as well as high frequency terms. Experiments conducted with 10 subjects and a total of 313 photos proved that our proposed approach can significantly help users with the annotation process. We achieved a 33 gain in annotation time as compared to manual annotation. We also obtained very positive results in the accuracy rate of our suggested keywords.

    AB - Automating the process of semantic annotation of digital personal photographs is a crucial step towards efficient and effective management of this increasingly high volume of content. However, this is still a highly challenging task for the research community. This paper proposes a novel solution. Our solution integrates all contextual information available to and from the users, such as their daily emails, schedules, chat archives, web browsing histories, documents, online news, Wikipedia data, and so forth. We then analyze this information and extract important semantic terms, using them as semantic keyword suggestions for their photos. Those keywords are in the form of named entities, such as names of people, organizations, locations, and date/time as well as high frequency terms. Experiments conducted with 10 subjects and a total of 313 photos proved that our proposed approach can significantly help users with the annotation process. We achieved a 33 gain in annotation time as compared to manual annotation. We also obtained very positive results in the accuracy rate of our suggested keywords.

    UR - http://www.scopus.com/inward/record.url?scp=47649086912&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=47649086912&partnerID=8YFLogxK

    U2 - 10.1155/2008/592690

    DO - 10.1155/2008/592690

    M3 - Article

    VL - 2008

    JO - Advances in Multimedia

    JF - Advances in Multimedia

    SN - 1687-5680

    M1 - 592690

    ER -