Soft memberships for spectral clustering, with application to permeable language distinction - Archive ouverte HAL Access content directly
Journal Articles Pattern Recognition Year : 2009

Soft memberships for spectral clustering, with application to permeable language distinction

Abstract

Recently, a large amount of work has been devoted to the study of spectral clustering — a powerful unsupervised classification method. This paper brings contributions to both its foundations, and its applications to text classification. Departing from the mainstream, concerned with hard membership, we study the extension of spectral clustering to soft membership (probabilistic, EM style) assignments. One of its key features is to avoid the complexity gap of hard membership. We apply this theory to a challenging problem, text clustering for languages having permeable borders, via a novel construction of Markov chains from corpora. Experiments with a readily available code clearly display the potential of the method, which brings a visually appealing soft distinction of languages that may define altogether a whole corpus.

Dates and versions

hal-00329991 , version 1 (13-10-2008)

Identifiers

Cite

Richard Nock, Pascal Vaillant, Claudia Henry, Frank Nielsen. Soft memberships for spectral clustering, with application to permeable language distinction. Pattern Recognition, 2009, 42 (1), pp.43-53. ⟨10.1016/j.patcog.2008.06.024⟩. ⟨hal-00329991⟩
129 View
0 Download

Altmetric

Share

Gmail Facebook X LinkedIn More