Alert button

Improving part-of-speech tagging via multi-task learning and character-level word representations

Add code
Bookmark button
Alert button
Jul 02, 2018
Daniil Anastasyev, Ilya Gusev, Eugene Indenbom

Figure 1 for Improving part-of-speech tagging via multi-task learning and character-level word representations
Figure 2 for Improving part-of-speech tagging via multi-task learning and character-level word representations
Figure 3 for Improving part-of-speech tagging via multi-task learning and character-level word representations
Figure 4 for Improving part-of-speech tagging via multi-task learning and character-level word representations

Share this with someone who'll enjoy it:

Twitter IconFacebook IconLinkedin IconWhatsapp IconMessenger Icon

In this paper, we explore the ways to improve POS-tagging using various types of auxiliary losses and different word representations. As a baseline, we utilized a BiLSTM tagger, which is able to achieve state-of-the-art results on the sequence labelling tasks. We developed a new method for character-level word representation using feedforward neural network. Such representation gave us better results in terms of speed and performance of the model. We also applied a novel technique of pretraining such word representations with existing word vectors. Finally, we designed a new variant of auxiliary loss for sequence labelling tasks: an additional prediction of the neighbour labels. Such loss forces a model to learn the dependencies in-side a sequence of labels and accelerates the process of training. We test these methods on English and Russian languages.

* Computational Linguistics and Intellectual Technologies, Papers from the Annual International Conference "Dialogue" (2018) Issue 17, 14-27  
View paper onarxiv icon

Share this with someone who'll enjoy it:

Twitter IconFacebook IconLinkedin IconWhatsapp IconMessenger Icon