Autoencoder-Based Background Reconstruction and Foreground Segmentation With Background Noise Estimation - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Autoencoder-Based Background Reconstruction and Foreground Segmentation With Background Noise Estimation

Bruno Sauvalle
Arnaud de La Fortelle

Résumé

Even after decades of research, dynamic scene background reconstruction and foreground object segmentation are still considered as open problems due to various challenges such as illumination changes, camera movements, or background noise caused by air turbulence or moving trees. We propose in this paper to model the background of a frame sequence as a low dimensional manifold using an autoencoder and compare the reconstructed background provided by this autoencoder with the original image to compute the foreground/background segmentation masks. The main novelty of the proposed model is that the autoencoder is also trained to predict the background noise, which allows to compute for each frame a pixel-dependent threshold to perform the foreground segmentation. Although the proposed model does not use any temporal or motion information, it exceeds the state of the art for unsupervised background subtraction on the CDnet 2014 and LASIESTA datasets, with a significant improvement on videos where the camera is moving. It is also able to perform background reconstruction on some non-video image datasets.
Fichier principal
Vignette du fichier
AENE_final.pdf (15 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03931728 , version 1 (10-01-2023)

Identifiants

  • HAL Id : hal-03931728 , version 1

Citer

Bruno Sauvalle, Arnaud de La Fortelle. Autoencoder-Based Background Reconstruction and Foreground Segmentation With Background Noise Estimation. Winter Conference on Applications of Computer Vision (WACV), 2023, Jan 2023, Waikoloa, United States. ⟨hal-03931728⟩
35 Consultations
4 Téléchargements

Partager

Gmail Facebook X LinkedIn More