Energy-based Models in Earth Observation: from Generation to Semi-supervised Learning - Archive ouverte HAL
Article Dans Une Revue IEEE Transactions on Geoscience and Remote Sensing Année : 2022

Energy-based Models in Earth Observation: from Generation to Semi-supervised Learning

Résumé

Deep learning, together with the availability of large amounts of data, has transformed the way we process Earth observation (EO) tasks, such as land cover mapping or image registration. Yet, today, new models are needed to push further the revolution and enable new possibilities. This work focuses on a recent framework for generative modeling and explores its applicability to the EO images. The framework learns an energy-based model (EBM) to estimate the underlying joint distribution of the data and the categories, obtaining a neural network that is able to classify and synthesize images. On these two tasks, we show that EBMs reach comparable or better performances than convolutional networks on various public EO datasets and that they are naturally adapted to semisupervised settings, with very few labeled data. Moreover, models of this kind allow us to address high-potential applications, such as out-of-distribution analysis and land cover mapping with confidence estimation.
Fichier principal
Vignette du fichier
TGRS-v3.pdf (9.11 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03379500 , version 1 (26-11-2021)

Identifiants

Citer

Javiera Castillo-Navarro, Bertrand Le Saux, Alexandre Boulch, Sébastien Lefèvre. Energy-based Models in Earth Observation: from Generation to Semi-supervised Learning. IEEE Transactions on Geoscience and Remote Sensing, 2022, 60, pp.5613211. ⟨10.1109/TGRS.2021.3126428⟩. ⟨hal-03379500⟩
214 Consultations
165 Téléchargements

Altmetric

Partager

More