Segment-before-Detect: Vehicle Detection and Classification through Semantic Segmentation of Aerial Images - Archive ouverte HAL Access content directly
Journal Articles Remote Sensing Year : 2017

Segment-before-Detect: Vehicle Detection and Classification through Semantic Segmentation of Aerial Images

Segmenter-pour-détecter: détection et classification de véhicules par segmentation sémantique d'images aériennes

Abstract

Like computer vision before, remote sensing has been radically changed by the introduction of deep learning and, more notably, Convolution Neural Networks. Land cover classification, object detection and scene understanding in aerial images rely more and more on deep networks to achieve new state-of-the-art results. Recent architectures such as Fully Convolutional Networks can even produce pixel level annotations for semantic mapping. In this work, we present a deep-learning based segment-before-detect method for segmentation and subsequent detection and classification of several varieties of wheeled vehicles in high resolution remote sensing images. This allows us to investigate object detection and classification on a complex dataset made up of visually similar classes, and to demonstrate the relevance of such a subclass modeling approach. Especially, we want to show that deep learning is also suitable for object-oriented analysis of Earth Observation data as effective object detection can be obtained as a byproduct of accurate semantic segmentation. First, we train a deep fully convolutional network on the ISPRS Potsdam and the NZAM/ONERA Christchurch datasets and show how the learnt semantic maps can be used to extract precise segmentation of vehicles. Then, we show that those maps are accurate enough to perform vehicle detection by simple connected component extraction. This allows us to study the repartition of vehicles in the city. Finally, we train a Convolutional Neural Network to perform vehicle classification on the VEDAI dataset, and transfer its knowledge to classify the individual vehicle instances that we detected.
Fichier principal
Vignette du fichier
rs2017audebert.pdf (5.19 Mo) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-01529624 , version 1 (13-11-2019)

Identifiers

Cite

Nicolas Audebert, Bertrand Le Saux, Sébastien Lefèvre. Segment-before-Detect: Vehicle Detection and Classification through Semantic Segmentation of Aerial Images. Remote Sensing, 2017, 9 (4), page 1-18. ⟨10.3390/rs9040368⟩. ⟨hal-01529624⟩
754 View
181 Download

Altmetric

Share

Gmail Facebook X LinkedIn More