Technical report : SVM in Krein spaces - Archive ouverte HAL Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2013

Technical report : SVM in Krein spaces

Résumé

Support vector machines (SVM) and kernel methods have been highly successful in many application areas. However, the requirement that the kernel is symmetric positive semidefinite, Mercer's condition, is not always verifi ed in practice. When it is not, the kernel is called indefi nite. Various heuristics and specialized methods have been proposed to address indefi nite kernels, from simple tricks such as removing negative eigenvalues, to advanced methods that de-noise the kernel by considering the negative part of the kernel as noise. Most approaches aim at correcting an inde finite kernel in order to provide a positive one. We propose a new SVM approach that deals directly with inde finite kernels. In contrast to previous approaches, we embrace the underlying idea that the negative part of an inde finite kernel may contain valuable information. To de fine such a method, the SVM formulation has to be adapted to a non usual form: the stabilization. The hypothesis space, usually a Hilbert space, becomes a Krei n space. This work explores this new formulation, and proposes two practical algorithms (ESVM and KSVM) that outperform the approaches that modify the kernel. Moreover, the solution depends on the original kernel and thus can be used on any new point without loss of accuracy
Fichier principal
Vignette du fichier
npsvm-pp-2.pdf (3.74 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00869658 , version 1 (03-10-2013)

Identifiants

  • HAL Id : hal-00869658 , version 1

Citer

Gaëlle Loosli, Cheng Soon Ong, Stephane Canu. Technical report : SVM in Krein spaces. 2013. ⟨hal-00869658⟩
264 Consultations
462 Téléchargements

Partager

Gmail Facebook X LinkedIn More