Deep Neural Architectures for Joint Named Entity Recognition and Disambiguation

Qianwen Wang, Mizuho Iwaihara

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Current entity linking methods typically first apply a named entity recognition (NER) model to extract a named entity and classify it into a predefined category, then apply an entity disambiguation model to link the named entity to a corresponding entity in the reference knowledge base. However, these methods ignore the inter-relations between the two tasks. Our work jointly optimizes deep neural models of both NER and entity disambiguation. In the entity disambiguation task, our deep neural model includes a recursive neural network and convolutional neural network with attention mechanism. Our model compares similarities between a mention and candidate entities by simultaneously considering semantic and background information, including Wikipedia description pages, contexts where the mention occurs, and entity typing information. The experiments show that our model can effectively leverage the semantic information of context, and performs competitively to conventional approaches.

Original languageEnglish
Title of host publication2019 IEEE International Conference on Big Data and Smart Computing, BigComp 2019 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781538677896
DOIs
Publication statusPublished - 2019 Apr 1
Event2019 IEEE International Conference on Big Data and Smart Computing, BigComp 2019 - Kyoto, Japan
Duration: 2019 Feb 272019 Mar 2

Publication series

Name2019 IEEE International Conference on Big Data and Smart Computing, BigComp 2019 - Proceedings

Conference

Conference2019 IEEE International Conference on Big Data and Smart Computing, BigComp 2019
CountryJapan
CityKyoto
Period19/2/2719/3/2

Fingerprint

Semantics
Neural networks
Named entity recognition
Experiments
Named entity
Wikipedia
Knowledge base
Leverage
Experiment

Keywords

  • attention
  • convolutional neural network
  • entity disambiguation
  • named entity recognition
  • recursive neural network

ASJC Scopus subject areas

  • Information Systems and Management
  • Artificial Intelligence
  • Computer Networks and Communications
  • Information Systems

Cite this

Wang, Q., & Iwaihara, M. (2019). Deep Neural Architectures for Joint Named Entity Recognition and Disambiguation. In 2019 IEEE International Conference on Big Data and Smart Computing, BigComp 2019 - Proceedings [8679233] (2019 IEEE International Conference on Big Data and Smart Computing, BigComp 2019 - Proceedings). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/BIGCOMP.2019.8679233

Deep Neural Architectures for Joint Named Entity Recognition and Disambiguation. / Wang, Qianwen; Iwaihara, Mizuho.

2019 IEEE International Conference on Big Data and Smart Computing, BigComp 2019 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2019. 8679233 (2019 IEEE International Conference on Big Data and Smart Computing, BigComp 2019 - Proceedings).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Wang, Q & Iwaihara, M 2019, Deep Neural Architectures for Joint Named Entity Recognition and Disambiguation. in 2019 IEEE International Conference on Big Data and Smart Computing, BigComp 2019 - Proceedings., 8679233, 2019 IEEE International Conference on Big Data and Smart Computing, BigComp 2019 - Proceedings, Institute of Electrical and Electronics Engineers Inc., 2019 IEEE International Conference on Big Data and Smart Computing, BigComp 2019, Kyoto, Japan, 19/2/27. https://doi.org/10.1109/BIGCOMP.2019.8679233
Wang Q, Iwaihara M. Deep Neural Architectures for Joint Named Entity Recognition and Disambiguation. In 2019 IEEE International Conference on Big Data and Smart Computing, BigComp 2019 - Proceedings. Institute of Electrical and Electronics Engineers Inc. 2019. 8679233. (2019 IEEE International Conference on Big Data and Smart Computing, BigComp 2019 - Proceedings). https://doi.org/10.1109/BIGCOMP.2019.8679233
Wang, Qianwen ; Iwaihara, Mizuho. / Deep Neural Architectures for Joint Named Entity Recognition and Disambiguation. 2019 IEEE International Conference on Big Data and Smart Computing, BigComp 2019 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2019. (2019 IEEE International Conference on Big Data and Smart Computing, BigComp 2019 - Proceedings).
@inproceedings{4414ac730a6e47e29fb8599a423af1e3,
title = "Deep Neural Architectures for Joint Named Entity Recognition and Disambiguation",
abstract = "Current entity linking methods typically first apply a named entity recognition (NER) model to extract a named entity and classify it into a predefined category, then apply an entity disambiguation model to link the named entity to a corresponding entity in the reference knowledge base. However, these methods ignore the inter-relations between the two tasks. Our work jointly optimizes deep neural models of both NER and entity disambiguation. In the entity disambiguation task, our deep neural model includes a recursive neural network and convolutional neural network with attention mechanism. Our model compares similarities between a mention and candidate entities by simultaneously considering semantic and background information, including Wikipedia description pages, contexts where the mention occurs, and entity typing information. The experiments show that our model can effectively leverage the semantic information of context, and performs competitively to conventional approaches.",
keywords = "attention, convolutional neural network, entity disambiguation, named entity recognition, recursive neural network",
author = "Qianwen Wang and Mizuho Iwaihara",
year = "2019",
month = "4",
day = "1",
doi = "10.1109/BIGCOMP.2019.8679233",
language = "English",
series = "2019 IEEE International Conference on Big Data and Smart Computing, BigComp 2019 - Proceedings",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
booktitle = "2019 IEEE International Conference on Big Data and Smart Computing, BigComp 2019 - Proceedings",

}

TY - GEN

T1 - Deep Neural Architectures for Joint Named Entity Recognition and Disambiguation

AU - Wang, Qianwen

AU - Iwaihara, Mizuho

PY - 2019/4/1

Y1 - 2019/4/1

N2 - Current entity linking methods typically first apply a named entity recognition (NER) model to extract a named entity and classify it into a predefined category, then apply an entity disambiguation model to link the named entity to a corresponding entity in the reference knowledge base. However, these methods ignore the inter-relations between the two tasks. Our work jointly optimizes deep neural models of both NER and entity disambiguation. In the entity disambiguation task, our deep neural model includes a recursive neural network and convolutional neural network with attention mechanism. Our model compares similarities between a mention and candidate entities by simultaneously considering semantic and background information, including Wikipedia description pages, contexts where the mention occurs, and entity typing information. The experiments show that our model can effectively leverage the semantic information of context, and performs competitively to conventional approaches.

AB - Current entity linking methods typically first apply a named entity recognition (NER) model to extract a named entity and classify it into a predefined category, then apply an entity disambiguation model to link the named entity to a corresponding entity in the reference knowledge base. However, these methods ignore the inter-relations between the two tasks. Our work jointly optimizes deep neural models of both NER and entity disambiguation. In the entity disambiguation task, our deep neural model includes a recursive neural network and convolutional neural network with attention mechanism. Our model compares similarities between a mention and candidate entities by simultaneously considering semantic and background information, including Wikipedia description pages, contexts where the mention occurs, and entity typing information. The experiments show that our model can effectively leverage the semantic information of context, and performs competitively to conventional approaches.

KW - attention

KW - convolutional neural network

KW - entity disambiguation

KW - named entity recognition

KW - recursive neural network

UR - http://www.scopus.com/inward/record.url?scp=85064659846&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85064659846&partnerID=8YFLogxK

U2 - 10.1109/BIGCOMP.2019.8679233

DO - 10.1109/BIGCOMP.2019.8679233

M3 - Conference contribution

T3 - 2019 IEEE International Conference on Big Data and Smart Computing, BigComp 2019 - Proceedings

BT - 2019 IEEE International Conference on Big Data and Smart Computing, BigComp 2019 - Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

ER -