A Flexible EM-like Clustering Algorithm for Noisy Data - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue IEEE Transactions on Pattern Analysis and Machine Intelligence Année : 2023

A Flexible EM-like Clustering Algorithm for Noisy Data

Résumé

Though very popular, it is well known that the Expectation-Maximisation (EM) algorithm for the Gaussian mixture model performs poorly for non-Gaussian distributions or in the presence of outliers or noise. In this paper, we propose a Flexible EM-like Clustering Algorithm (FEMCA): a new clustering algorithm following an EM procedure is designed. It is based on both estimations of cluster centers and covariances. In addition, using a semi-parametric paradigm, the method estimates an unknown scale parameter per data point. This allows the algorithm to accommodate heavier tail distributions, noise, and outliers without significantly losing efficiency in various classical scenarios. We first present the general underlying model for independent, but not necessarily identically distributed, samples of elliptical distributions. We then derive and analyze the proposed algorithm in this context, showing in particular important distribution-free properties of the underlying data distributions. The algorithm convergence and accuracy properties are analyzed by considering the first synthetic data. Finally, we show that FEMCA outperforms other classical unsupervised methods of the literature, such as k-means, EM for Gaussian mixture models, and its recent modifications or spectral clustering when applied to real data sets as MNIST, NORB, and 20newsgroups .
Fichier principal
Vignette du fichier
1907.01660.pdf (4.29 Mo) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte

Dates et versions

hal-04366787 , version 1 (02-02-2024)

Identifiants

Citer

Violeta Roizman, Matthieu Jonckheere, Frédéric Pascal. A Flexible EM-like Clustering Algorithm for Noisy Data. IEEE Transactions on Pattern Analysis and Machine Intelligence, inPress, pp.1-14. ⟨10.1109/TPAMI.2023.3337195⟩. ⟨hal-04366787⟩
90 Consultations
9 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More