Spatiotemporal self-supervised pre-training on satellite imagery improves food insecurity prediction - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Environmental Data Science Année : 2023

Spatiotemporal self-supervised pre-training on satellite imagery improves food insecurity prediction

Résumé

Abstract Global warming will cause unprecedented changes to the world. Predicting events such as food insecurities in specific earth regions is a valuable way to face them with adequate policies. Existing food insecurity prediction models are based on handcrafted features such as population counts, food prices, or rainfall measurements. However, finding useful features is a challenging task, and data scarcity hinders accuracy. We leverage unsupervised pre-training of neural networks to automatically learn useful features from widely available L andsat -8 satellite images. We train neural feature extractors to predict whether pairs of images are coming from spatially close or distant regions on the assumption that close regions should have similar features. We also integrate a temporal dimension to our pre-training to capture the temporal trends of satellite images with improved accuracy. We show that with unsupervised pre-training on a large set of satellite images, neural feature extractors achieve a macro F1 of 65.4% on the Famine Early Warning Systems network dataset—a 24% improvement over handcrafted features. We further show that our pre-training method leads to better features than supervised learning and previous unsupervised pre-training techniques. We demonstrate the importance of the proposed time-aware pre-training and show that the pre-trained networks can predict food insecurity with limited availability of labeled data.
Fichier principal
Vignette du fichier
spatiotemporal_selfsupervised_pretraining_on_satellite_imagery_improves_food_insecurity_prediction.pdf (4.29 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04411802 , version 1 (23-01-2024)

Identifiants

Citer

Ruben Cartuyvels, Tom Fierens, Emiel Coppieters, Marie-Francine Moens, Damien Sileo. Spatiotemporal self-supervised pre-training on satellite imagery improves food insecurity prediction. Environmental Data Science, 2023, 2, pp.e48. ⟨10.1017/eds.2023.42⟩. ⟨hal-04411802⟩
9 Consultations
5 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More