Minimax semi-supervised set-valued approach to multi-class classification - Archive ouverte HAL Access content directly
Journal Articles Bernoulli Year : 2021

Minimax semi-supervised set-valued approach to multi-class classification

Abstract

We study supervised and semi-supervised algorithms in the set-valued classification framework with controlled expected size. While the former methods can use only n labeled samples, the latter are able to make use of N additional unlabeled data. We obtain semi-supervised minimax rates of convergence under the α-margin assumption and a β-Hölder condition on the conditional distribution of labels. Our analysis implies that if no further assumption is made, there is no supervised method that outperforms the semi-supervised estimator proposed in this work – the best achievable rate for any supervised method is O(n−1/2), even if the margin assumption is extremely favorable; on the contrary, the developed semi-supervised estimator can achieve faster O((n/logn)−(1+α)β/(2β+d)) rate of convergence provided that sufficiently many unlabeled samples are available. We also show that under additional smoothness assumption, supervised methods are able to achieve faster rates and the unlabeled sample cannot improve the rate of convergence. Finally, a numerical study supports our theory and emphasizes the relevance of the assumptions we required from an empirical perspective.
Fichier principal
Vignette du fichier
main.pdf (826.11 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-02112918 , version 1 (27-04-2019)

Identifiers

Cite

Evgenii Chzhen, Christophe Denis, Mohamed Hebiri. Minimax semi-supervised set-valued approach to multi-class classification. Bernoulli, 2021, ⟨10.3150/20-BEJ1313⟩. ⟨hal-02112918⟩
536 View
310 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More