Paving the way for next generation data-stream clustering: towards a unique and statistically valid cluster structure at any time step - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue International Journal of Data Mining, Modelling and Management Année : 2011

Paving the way for next generation data-stream clustering: towards a unique and statistically valid cluster structure at any time step

Résumé

In the domain of data-stream clustering, e.g., dynamic text mining as our application domain, our goal is two-fold and a long term one: 1 at each data input, the resulting cluster structure has to be unique, independent of the order the input vectors are presented 2 this structure has to be meaningful for an expert, e.g., not composed of a huge 'catch-all' cluster in a cloud of tiny specific ones, as is often the case with large sparse data tables. The first preliminary condition is satisfied by our Germen density-mode seeking algorithm, but the relevance of the clusters vis-à-vis expert judgment relies on the definition of a data density, relying itself on the type of graph chosen for embedding the similarities between text inputs. Having already demonstrated the dynamic behaviour of Germen algorithm, we focus here on appending a Monte-Carlo method for extracting statistically valid inter-text links, which looks promising applied both to an excerpt of the Pascal bibliographic database, and to the Reuters-RCV1 news test collection. Though not being a central issue here, the time complexity of our algorithms is eventually discussed.
Fichier principal
Vignette du fichier
IJDMMM030402_CUXAC.pdf (366.21 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00952855 , version 1 (28-02-2014)

Licence

Paternité

Identifiants

Citer

Pascal Cuxac, Alain Lelu, Martine Cadot. Paving the way for next generation data-stream clustering: towards a unique and statistically valid cluster structure at any time step. International Journal of Data Mining, Modelling and Management, 2011, 3 (4), pp.341-360. ⟨10.1504/IJDMMM.2011.042933⟩. ⟨hal-00952855⟩
392 Consultations
197 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More