Correl-Net: Defect Segmentation in Old Films Using Correlation Networks - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Correl-Net: Defect Segmentation in Old Films Using Correlation Networks

Résumé

The old film restoration process involves many operations, one of which is the ability to identify defects that altered the film. This operation can be formulated as a binary segmentation problem and solved using state-of-the-art segmentation networks such as DeepLab v3+ or NAS-FPN. While being very powerful at describing the spatial characteristics of defects, these methods fail to take into account the fact that defects are also temporal anomalies. We therefore propose an architecture that builds on the correlation layer introduced in FlowNet to compensate for motion and eliminate potential false positives, features that look like defects but can be tracked over multiple images and are actually part of the scene. We also introduce a self-supervised pre-training process of the network, which precedes a fine-tuning phase to specifically adapt the detector to each film. Results show that our architecture, while being more compact and less resource-consuming than state-of-the-art methods, achieves higher precision and recall.
Fichier principal
Vignette du fichier
ARTHUR_SCIA_2023_article.pdf (4.5 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04492582 , version 1 (06-03-2024)

Identifiants

Citer

Arthur Renaudeau, Travis Seng, Axel Carlier, Jean-Denis Durou. Correl-Net: Defect Segmentation in Old Films Using Correlation Networks. 22nd Scandinavian Conference on Image Analysis (SCIA 2023), Apr 2023, Kittilä, Finland. pp.245--259, ⟨10.1007/978-3-031-31438-4_17⟩. ⟨hal-04492582⟩
14 Consultations
1 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More