Reconstruct & Crush Network - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2017

Reconstruct & Crush Network

Résumé

This article introduces an energy-based model that is adversarial regarding data: it minimizes the energy for a given data distribution (the positive samples) while maximizing the energy for another given data distribution (the negative or unlabeled samples). The model is especially instantiated with autoencoders where the energy, represented by the reconstruction error, provides a general distance measure for unknown data. The resulting neural network thus learns to reconstruct data from the first distribution while crushing data from the second distribution. This solution can handle different problems such as Positive and Unlabeled (PU) learning or covariate shift, especially with imbalanced data. Using autoencoders allows handling a large variety of data, such as images, text or even dialogues. Our experiments show the flexibility of the proposed approach in dealing with different types of data in different settings: images with CIFAR-10 and CIFAR-100 (not-in-training setting), text with Amazon reviews (PU learning) and dialogues with Facebook bAbI (next response classification and dialogue completion).
Fichier principal
Vignette du fichier
reconstruct-crush-network.pdf (1.69 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01629742 , version 1 (06-11-2017)

Identifiants

  • HAL Id : hal-01629742 , version 1

Citer

Erinc Merdivan, Mohammad Reza Loghmani, Matthieu Geist. Reconstruct & Crush Network. Advances in Neural Information Processing Systems, 2017, Long Beach, United States. ⟨hal-01629742⟩
234 Consultations
27 Téléchargements

Partager

Gmail Facebook X LinkedIn More