Distance geometry for word representations and applications - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Journal of Computational Mathematics and Data Science Année : 2023

Distance geometry for word representations and applications

Résumé

Many machine learning methods used for the treatment of sequential data often rely on the construction of vector representations of unitary entities (e.g. words in natural language processing, or k-mers in bioinformatics). Traditionally, these representations are constructed with optimization formulations arising from co-occurrence based models. In this work, we propose a new method to embed these entities based on the Distance Geometry Problem: find object positions based on a subset of their pairwise distances or inner products. Considering the empirical Pointwise Mutual Information as a surrogate for the inner product, we discuss two Distance Geometry based algorithms to obtain word vector representations. The main advantage of such algorithms is their significantly lower computational complexity in comparison with state-of-the-art word embedding methods, which allows us to obtain word vector representations much faster. Furthermore, numerical experiments indicate that our word vectors behave quite well on text classification tasks in natural language processing as well as regression tasks in bioinformatics.
Fichier principal
Vignette du fichier
jcmds22.pdf (485.53 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04185621 , version 1 (23-08-2023)

Licence

Paternité

Identifiants

Citer

Sammy Khalife, Douglas S Gonçalves, Leo Liberti. Distance geometry for word representations and applications. Journal of Computational Mathematics and Data Science, In press, 6, pp.100073. ⟨10.1016/j.jcmds.2022.100073⟩. ⟨hal-04185621⟩
9 Consultations
37 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More