Structured prediction with output embeddings for semantic image annotation

Ariadna Quattoni, Arnau Ramisa, Pranava Swaroop Madhyastha, Edgar Simo Serra, Francesc Moreno-Noguer

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

We address the task of annotating images with semantic tuples. Solving this problem requires an algorithm able to deal with hundreds of classes for each argument of the tuple. In such contexts, data sparsity becomes a key challenge. We propose handling this sparsity by incorporating feature representations of both the inputs (images) and outputs (argument classes) into a factorized log-linear model.

Original languageEnglish
Title of host publication2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL HLT 2016 - Proceedings of the Conference
PublisherAssociation for Computational Linguistics (ACL)
Pages552-557
Number of pages6
ISBN (Electronic)9781941643914
Publication statusPublished - 2016
Event15th Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL HLT 2016 - San Diego, United States
Duration: 2016 Jun 122016 Jun 17

Other

Other15th Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL HLT 2016
CountryUnited States
CitySan Diego
Period16/6/1216/6/17

Fingerprint

Semantics
semantics
linear model
Prediction
Annotation
Problem Solving

ASJC Scopus subject areas

  • Computer Science Applications
  • Linguistics and Language
  • Language and Linguistics

Cite this

Quattoni, A., Ramisa, A., Madhyastha, P. S., Simo Serra, E., & Moreno-Noguer, F. (2016). Structured prediction with output embeddings for semantic image annotation. In 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL HLT 2016 - Proceedings of the Conference (pp. 552-557). Association for Computational Linguistics (ACL).

Structured prediction with output embeddings for semantic image annotation. / Quattoni, Ariadna; Ramisa, Arnau; Madhyastha, Pranava Swaroop; Simo Serra, Edgar; Moreno-Noguer, Francesc.

2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL HLT 2016 - Proceedings of the Conference. Association for Computational Linguistics (ACL), 2016. p. 552-557.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Quattoni, A, Ramisa, A, Madhyastha, PS, Simo Serra, E & Moreno-Noguer, F 2016, Structured prediction with output embeddings for semantic image annotation. in 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL HLT 2016 - Proceedings of the Conference. Association for Computational Linguistics (ACL), pp. 552-557, 15th Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL HLT 2016, San Diego, United States, 16/6/12.
Quattoni A, Ramisa A, Madhyastha PS, Simo Serra E, Moreno-Noguer F. Structured prediction with output embeddings for semantic image annotation. In 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL HLT 2016 - Proceedings of the Conference. Association for Computational Linguistics (ACL). 2016. p. 552-557
Quattoni, Ariadna ; Ramisa, Arnau ; Madhyastha, Pranava Swaroop ; Simo Serra, Edgar ; Moreno-Noguer, Francesc. / Structured prediction with output embeddings for semantic image annotation. 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL HLT 2016 - Proceedings of the Conference. Association for Computational Linguistics (ACL), 2016. pp. 552-557
@inproceedings{7a41924c131d44bd8d165a02b8342d05,
title = "Structured prediction with output embeddings for semantic image annotation",
abstract = "We address the task of annotating images with semantic tuples. Solving this problem requires an algorithm able to deal with hundreds of classes for each argument of the tuple. In such contexts, data sparsity becomes a key challenge. We propose handling this sparsity by incorporating feature representations of both the inputs (images) and outputs (argument classes) into a factorized log-linear model.",
author = "Ariadna Quattoni and Arnau Ramisa and Madhyastha, {Pranava Swaroop} and {Simo Serra}, Edgar and Francesc Moreno-Noguer",
year = "2016",
language = "English",
pages = "552--557",
booktitle = "2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL HLT 2016 - Proceedings of the Conference",
publisher = "Association for Computational Linguistics (ACL)",

}

TY - GEN

T1 - Structured prediction with output embeddings for semantic image annotation

AU - Quattoni, Ariadna

AU - Ramisa, Arnau

AU - Madhyastha, Pranava Swaroop

AU - Simo Serra, Edgar

AU - Moreno-Noguer, Francesc

PY - 2016

Y1 - 2016

N2 - We address the task of annotating images with semantic tuples. Solving this problem requires an algorithm able to deal with hundreds of classes for each argument of the tuple. In such contexts, data sparsity becomes a key challenge. We propose handling this sparsity by incorporating feature representations of both the inputs (images) and outputs (argument classes) into a factorized log-linear model.

AB - We address the task of annotating images with semantic tuples. Solving this problem requires an algorithm able to deal with hundreds of classes for each argument of the tuple. In such contexts, data sparsity becomes a key challenge. We propose handling this sparsity by incorporating feature representations of both the inputs (images) and outputs (argument classes) into a factorized log-linear model.

UR - http://www.scopus.com/inward/record.url?scp=84994137617&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84994137617&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:84994137617

SP - 552

EP - 557

BT - 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL HLT 2016 - Proceedings of the Conference

PB - Association for Computational Linguistics (ACL)

ER -