Communication Dans Un Congrès Année : 2024

Forget early exaggeration in t-SNE: early hierarchization preserves global structure

Résumé

As a local method of dimensionality reduction, t-SNE requires careful initialization in order to preserve the data global structure to the best extent. In regular t-SNE, the low-dimensional embedding is initialized either randomly or with PCA; next, gradient descent refines the embedding coordinates in two phases. In the first one, called early exaggeration, attractive forces between points are artificially strengthened to delay any detrimental effect of repulsive forces while points are still poorly organized. In this paper, a novel initialization of t-SNE is proposed. It works by hierarchizing the data points into a space-partitioning binary tree and successive runs of t-SNE with 4, 8, 16, ..., N points. Between two runs, the prototypical point in each tree branch is split into its two children prototypes, with some little random noise, and the embedding is rescaled to account for the increased population. Experimental results show the effectiveness of the method. The proposed method is compatible with any method of neighbor embedding (t-SNE, UMAP, etc.) provided early exaggeration can be disabled and initial coordinates can be fed into.

Fichier non déposé

Dates et versions

hal-04989121 , version 1 (17-03-2025)

Identifiants

  • HAL Id : hal-04989121 , version 1

Citer

John A Lee, Edouard Couplet, Pierre Lambert, Ludovic Journaux, Dounia Mulders, et al.. Forget early exaggeration in t-SNE: early hierarchization preserves global structure. European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning, Oct 2024, Bruges (Belgium), Belgium. ⟨hal-04989121⟩
54 Consultations
2 Téléchargements

Partager

  • More