Semi-Supervised Semantic Segmentation with Cross-Consistency Training - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2020

Semi-Supervised Semantic Segmentation with Cross-Consistency Training

Résumé

In this paper, we present a novel cross-consistency based semi-supervised approach for semantic segmentation. Consistency training has proven to be a powerful semisupervised learning framework for leveraging unlabeled data under the cluster assumption, in which the decision boundary should lie in low density regions. In this work, we first observe that for semantic segmentation, the low density regions are more apparent within the hidden representations than within the inputs. We thus propose crossconsistency training, where an invariance of the predictions is enforced over different perturbations applied to the outputs of the encoder. Concretely, a shared encoder and a main decoder are trained in a supervised manner using the available labeled examples. To leverage the unlabeled examples, we enforce a consistency between the main decoder predictions and those of the auxiliary decoders, taking as inputs different perturbed versions of the encoder's output, and consequently, improving the encoder's representations. The proposed method is simple and can easily be extended to use additional training signal, such as image-level labels or pixel-level labels across different domains. We perform an ablation study to tease apart the effectiveness of each component, and conduct extensive experiments to demonstrate that our method achieves stateof-the-art results in several datasets.
Fichier principal
Vignette du fichier
Ouali_Semi-Supervised_Semantic_Segmentation_With_Cross-Consistency_Training_CVPR_2020_paper.pdf (1.31 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03049937 , version 1 (10-12-2020)

Identifiants

Citer

Yassine Ouali, Céline Hudelot, Myriam Tami. Semi-Supervised Semantic Segmentation with Cross-Consistency Training. CVPR 2020, Jun 2020, Seattle (virtual), United States. ⟨10.1109/CVPR42600.2020.01269⟩. ⟨hal-03049937⟩
70 Consultations
318 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More