Learning Word Importance with the Neural Bag-of-Words Model
Résumé
The Neural Bag-of-Words (NBOW) model
performs classification with an average of
the input word vectors and achieves an impressive
performance. While the NBOW
model learns word vectors targeted for
the classification task it does not explicitly
model which words are important for
given task. In this paper we propose an
improved NBOW model with this ability
to learn task specific word importance
weights. The word importance weights
are learned by introducing a new weighted
sum composition of the word vectors.
With experiments on standard topic and
sentiment classification tasks, we show
that (a) our proposed model learns meaningful
word importance for a given task (b)
our model gives best accuracies among the
BOW approaches. We also show that the
learned word importance weights are comparable
to tf-idf based word weights when
used as features in a BOWSVM classifier.
Domaines
Interface homme-machine [cs.HC]Origine | Fichiers produits par l'(les) auteur(s) |
---|
Loading...