Geometry and Analogies: A Study and Propagation Method for Word Representations - Archive ouverte HAL Accéder directement au contenu
Chapitre D'ouvrage Année : 2019

Geometry and Analogies: A Study and Propagation Method for Word Representations

Sammy Khalife

Résumé

In this paper we discuss the well-known claim that language analogies yield almost parallel vector differences in word embeddings. On the one hand, we show that this property, while it does hold for a handful of cases, fails to hold in general especially in high dimension, using the best known publicly available word embeddings. On the other hand, we show that this property is not crucial for basic natural language processing tasks such as text classification. We achieve this by a simple algorithm which yields updated word embeddings where this property holds: we show that in these word representations, text classification tasks have about the same performance.
Fichier principal
Vignette du fichier
slsp19.pdf (513.06 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02350281 , version 1 (06-11-2019)

Identifiants

Citer

Sammy Khalife, Leo Liberti, Michalis Vazirgiannis. Geometry and Analogies: A Study and Propagation Method for Word Representations. Statistical Language and Speech Processing, pp.100-111, 2019, ⟨10.1007/978-3-030-31372-2_9⟩. ⟨hal-02350281⟩
61 Consultations
144 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More