Alert button

Using Multi-Sense Vector Embeddings for Reverse Dictionaries

Add code
Bookmark button
Alert button
Apr 02, 2019
Michael A. Hedderich, Andrew Yates, Dietrich Klakow, Gerard de Melo

Figure 1 for Using Multi-Sense Vector Embeddings for Reverse Dictionaries
Figure 2 for Using Multi-Sense Vector Embeddings for Reverse Dictionaries
Figure 3 for Using Multi-Sense Vector Embeddings for Reverse Dictionaries
Figure 4 for Using Multi-Sense Vector Embeddings for Reverse Dictionaries

Share this with someone who'll enjoy it:

Twitter IconFacebook IconLinkedin IconWhatsapp IconMessenger Icon

Popular word embedding methods such as word2vec and GloVe assign a single vector representation to each word, even if a word has multiple distinct meanings. Multi-sense embeddings instead provide different vectors for each sense of a word. However, they typically cannot serve as a drop-in replacement for conventional single-sense embeddings, because the correct sense vector needs to be selected for each word. In this work, we study the effect of multi-sense embeddings on the task of reverse dictionaries. We propose a technique to easily integrate them into an existing neural network architecture using an attention mechanism. Our experiments demonstrate that large improvements can be obtained when employing multi-sense embeddings both in the input sequence as well as for the target representation. An analysis of the sense distributions and of the learned attention is provided as well.

* Accepted as long paper at the 13th International Conference on Computational Semantics (IWCS 2019)  
View paper onarxiv icon

Share this with someone who'll enjoy it:

Twitter IconFacebook IconLinkedin IconWhatsapp IconMessenger Icon