End-to-end Learning for Land Cover Classification using Irregular and Unaligned SITS by Combining Attention-Based Interpolation with Sparse Variational Gaussian Processes - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing Année : 2023

End-to-end Learning for Land Cover Classification using Irregular and Unaligned SITS by Combining Attention-Based Interpolation with Sparse Variational Gaussian Processes

Résumé

In this article, we propose a method exploiting irregular and unaligned Sentinel-2 satellite image time series (SITS) for large-scale land cover pixel-based classification. We perform end-to-end learning by combining a time and space informed kernel interpolator with a Sparse Variational Gaussian Processes (SVGP) classifier. The interpolator embeds irregular and unaligned SITS onto a fixed and reduced size latent representation. The spatial information is taken into account by using a spatial positional encoding. The obtained latent representation is given to the SVGP classifier and all the parameters are jointly optimized w.r.t. the classification task. We run experiments with irregular and unaligned Sentinel-2 SITS of the full year 2018 over an area of 200 000 km2 (about two billion pixels) in the south of France (27 MGRS tiles). Such experimental condition exacerbates the irregular and unaligned issues of SITS. In terms of overall accuracy, with the learned latent representation instead of linearly interpolated SITS, the results of the SVGP classifier are improved by about 10 points. Moreover, with the learned latent representation, the SVGP classifier outperforms the main state-of-the-art methods from the literature at large scale (e.g., seven points for the Multi-layer Perceptron) and is robust to the available timestamps used for training and testing.
Fichier principal
Vignette du fichier
final_version_hal_bellet_valentine.pdf (34.36 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04112115 , version 1 (01-06-2023)
hal-04112115 , version 2 (13-06-2023)
hal-04112115 , version 3 (13-07-2023)
hal-04112115 , version 4 (21-12-2023)

Identifiants

  • HAL Id : hal-04112115 , version 4

Citer

Valentine Bellet, Mathieu Fauvel, Jordi Inglada, Julien Michel. End-to-end Learning for Land Cover Classification using Irregular and Unaligned SITS by Combining Attention-Based Interpolation with Sparse Variational Gaussian Processes. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2023. ⟨hal-04112115v4⟩
153 Consultations
39 Téléchargements

Partager

Gmail Facebook X LinkedIn More