Self-Supervised Pretraining on Satellite Imagery: A Case Study on Label-Efficient Vehicle Detection - Archive ouverte HAL Access content directly
Conference Papers Year : 2022

Self-Supervised Pretraining on Satellite Imagery: A Case Study on Label-Efficient Vehicle Detection

Préentraînement auto-supervisé sur imagerie satellite : un cas d'étude sur la détection de véhicules efficiente en annotation

Abstract

In defense-related remote sensing applications, such as vehicle detection on satellite imagery, supervised learning requires a huge number of labeled examples to reach operational performances. Such data are challenging to obtain as it requires military experts, and some observables are intrinsically rare. This limited labeling capability, as well as the large number of unlabeled images available due to the growing number of sensors, make object detection on remote sensing imagery highly relevant for self-supervised learning. We study in-domain self-supervised representation learning for object detection on very high resolution optical satellite imagery, that is yet poorly explored. For the first time to our knowledge, we study the problem of label efficiency on this task. We use the large land use classification dataset Functional Map of the World to pretrain representations with an extension of the Momentum Contrast framework. We then investigate this model’s transferability on a real-world task of fine-grained vehicle detection and classification on Preligens proprietary data, which is designed to be representative of an operational use case of strategic site surveillance. We show that our in domain self-supervised learning model is competitive with ImageNet pretraining, and outperforms it in the low-label regime.
Fichier principal
Vignette du fichier
93.pdf (1.52 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03881747 , version 1 (02-12-2022)

Licence

Attribution - NonCommercial - NoDerivatives

Identifiers

  • HAL Id : hal-03881747 , version 1

Cite

Jules Bourcier, Thomas Floquet, Gohar Dashyan, Tugdual Ceillier, Karteek Alahari, et al.. Self-Supervised Pretraining on Satellite Imagery: A Case Study on Label-Efficient Vehicle Detection. Conference on Artificial Intelligence for Defense, DGA Maîtrise de l'Information, Nov 2022, Rennes, France. ⟨hal-03881747⟩
72 View
87 Download

Share

Gmail Facebook X LinkedIn More