Hapax legomena: Their contribution in number and efficiency to word alignment

Adrien Lardilleux; Yves Lepage

doi:10.1007/978-3-642-04235-5_38

Hapax legomena: Their contribution in number and efficiency to word alignment

Adrien Lardilleux^*, Yves Lepage

^*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

2 Citations (Scopus)

Abstract

Current techniques in word alignment disregard words with a low frequency because they would not be useful. Against this belief, this paper shows that, in particular, the notion of hapax legomena may contribute to word alignment to a large extent. In an experiment, we show that pairs of corpus hapaxes contribute to the majority of the best word alignments. In addition, we show that the notion of sentence hapax justifies a practical and common simplification of standard alignment methods.

Original language	English
Title of host publication	Human Language Technology
Subtitle of host publication	Challenges of the Information Society - Third Language and Technology Conference, LTC 2007, Revised Selected Papers
Pages	440-450
Number of pages	11
DOIs	https://doi.org/10.1007/978-3-642-04235-5_38
Publication status	Published - 2009
Externally published	Yes
Event	3rd Language and Technology Conference, LTC 2007 - Poznan, Poland Duration: 2007 Oct 5 → 2007 Oct 7

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	5603 LNAI
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	3rd Language and Technology Conference, LTC 2007
Country/Territory	Poland
City	Poznan
Period	07/10/5 → 07/10/7

Keywords

Hapax
Low frequency term
Word alignment

ASJC Scopus subject areas

Theoretical Computer Science
Computer Science(all)

Access to Document

10.1007/978-3-642-04235-5_38

Cite this

Lardilleux, A., & Lepage, Y. (2009). Hapax legomena: Their contribution in number and efficiency to word alignment. In Human Language Technology: Challenges of the Information Society - Third Language and Technology Conference, LTC 2007, Revised Selected Papers (pp. 440-450). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 5603 LNAI). https://doi.org/10.1007/978-3-642-04235-5_38

Hapax legomena : Their contribution in number and efficiency to word alignment. / Lardilleux, Adrien; Lepage, Yves.

Human Language Technology: Challenges of the Information Society - Third Language and Technology Conference, LTC 2007, Revised Selected Papers. 2009. p. 440-450 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 5603 LNAI).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Lardilleux, A & Lepage, Y 2009, Hapax legomena: Their contribution in number and efficiency to word alignment. in Human Language Technology: Challenges of the Information Society - Third Language and Technology Conference, LTC 2007, Revised Selected Papers. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 5603 LNAI, pp. 440-450, 3rd Language and Technology Conference, LTC 2007, Poznan, Poland, 07/10/5. https://doi.org/10.1007/978-3-642-04235-5_38

Lardilleux A, Lepage Y. Hapax legomena: Their contribution in number and efficiency to word alignment. In Human Language Technology: Challenges of the Information Society - Third Language and Technology Conference, LTC 2007, Revised Selected Papers. 2009. p. 440-450. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-642-04235-5_38

Lardilleux, Adrien ; Lepage, Yves. / Hapax legomena : Their contribution in number and efficiency to word alignment. Human Language Technology: Challenges of the Information Society - Third Language and Technology Conference, LTC 2007, Revised Selected Papers. 2009. pp. 440-450 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{e7ce6072d69c4026a2ed249945bf7005,

title = "Hapax legomena: Their contribution in number and efficiency to word alignment",

abstract = "Current techniques in word alignment disregard words with a low frequency because they would not be useful. Against this belief, this paper shows that, in particular, the notion of hapax legomena may contribute to word alignment to a large extent. In an experiment, we show that pairs of corpus hapaxes contribute to the majority of the best word alignments. In addition, we show that the notion of sentence hapax justifies a practical and common simplification of standard alignment methods.",

keywords = "Hapax, Low frequency term, Word alignment",

author = "Adrien Lardilleux and Yves Lepage",

year = "2009",

doi = "10.1007/978-3-642-04235-5_38",

language = "English",

isbn = "3642042341",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

pages = "440--450",

booktitle = "Human Language Technology",

note = "3rd Language and Technology Conference, LTC 2007 ; Conference date: 05-10-2007 Through 07-10-2007",

}

TY - GEN

T1 - Hapax legomena

T2 - 3rd Language and Technology Conference, LTC 2007

AU - Lardilleux, Adrien

AU - Lepage, Yves

PY - 2009

Y1 - 2009

N2 - Current techniques in word alignment disregard words with a low frequency because they would not be useful. Against this belief, this paper shows that, in particular, the notion of hapax legomena may contribute to word alignment to a large extent. In an experiment, we show that pairs of corpus hapaxes contribute to the majority of the best word alignments. In addition, we show that the notion of sentence hapax justifies a practical and common simplification of standard alignment methods.

AB - Current techniques in word alignment disregard words with a low frequency because they would not be useful. Against this belief, this paper shows that, in particular, the notion of hapax legomena may contribute to word alignment to a large extent. In an experiment, we show that pairs of corpus hapaxes contribute to the majority of the best word alignments. In addition, we show that the notion of sentence hapax justifies a practical and common simplification of standard alignment methods.

KW - Hapax

KW - Low frequency term

KW - Word alignment

UR - http://www.scopus.com/inward/record.url?scp=70349330145&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=70349330145&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-04235-5_38

DO - 10.1007/978-3-642-04235-5_38

M3 - Conference contribution

AN - SCOPUS:70349330145

SN - 3642042341

SN - 9783642042348

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 440

EP - 450

BT - Human Language Technology

Y2 - 5 October 2007 through 7 October 2007

ER -

Hapax legomena: Their contribution in number and efficiency to word alignment

Abstract

Publication series

Conference

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this