Semi-Supervised Semantic Segmentation with Cross-Consistency Training - Archive ouverte HAL Access content directly
Conference Papers Year :

Semi-Supervised Semantic Segmentation with Cross-Consistency Training


In this paper, we present a novel cross-consistency based semi-supervised approach for semantic segmentation. Consistency training has proven to be a powerful semisupervised learning framework for leveraging unlabeled data under the cluster assumption, in which the decision boundary should lie in low density regions. In this work, we first observe that for semantic segmentation, the low density regions are more apparent within the hidden representations than within the inputs. We thus propose crossconsistency training, where an invariance of the predictions is enforced over different perturbations applied to the outputs of the encoder. Concretely, a shared encoder and a main decoder are trained in a supervised manner using the available labeled examples. To leverage the unlabeled examples, we enforce a consistency between the main decoder predictions and those of the auxiliary decoders, taking as inputs different perturbed versions of the encoder's output, and consequently, improving the encoder's representations. The proposed method is simple and can easily be extended to use additional training signal, such as image-level labels or pixel-level labels across different domains. We perform an ablation study to tease apart the effectiveness of each component, and conduct extensive experiments to demonstrate that our method achieves stateof-the-art results in several datasets.
Fichier principal
Vignette du fichier
Ouali_Semi-Supervised_Semantic_Segmentation_With_Cross-Consistency_Training_CVPR_2020_paper.pdf (1.31 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03049937 , version 1 (10-12-2020)



Yassine Ouali, Céline Hudelot, Myriam Tami. Semi-Supervised Semantic Segmentation with Cross-Consistency Training. CVPR 2020, Jun 2020, Seattle (virtual), United States. ⟨10.1109/CVPR42600.2020.01269⟩. ⟨hal-03049937⟩
59 View
286 Download



Gmail Facebook Twitter LinkedIn More