Soft memberships for spectral clustering, with application to permeable language distinction - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Pattern Recognition Année : 2009

Soft memberships for spectral clustering, with application to permeable language distinction

Résumé

Recently, a large amount of work has been devoted to the study of spectral clustering — a powerful unsupervised classification method. This paper brings contributions to both its foundations, and its applications to text classification. Departing from the mainstream, concerned with hard membership, we study the extension of spectral clustering to soft membership (probabilistic, EM style) assignments. One of its key features is to avoid the complexity gap of hard membership. We apply this theory to a challenging problem, text clustering for languages having permeable borders, via a novel construction of Markov chains from corpora. Experiments with a readily available code clearly display the potential of the method, which brings a visually appealing soft distinction of languages that may define altogether a whole corpus.

Dates et versions

hal-00329991 , version 1 (13-10-2008)

Identifiants

Citer

Richard Nock, Pascal Vaillant, Claudia Henry, Frank Nielsen. Soft memberships for spectral clustering, with application to permeable language distinction. Pattern Recognition, 2009, 42 (1), pp.43-53. ⟨10.1016/j.patcog.2008.06.024⟩. ⟨hal-00329991⟩
130 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Mastodon Facebook X LinkedIn More