Minimax semi-supervised set-valued approach to multi-class classification - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles Bernoulli Year : 2021

Minimax semi-supervised set-valued approach to multi-class classification

Abstract

We study supervised and semi-supervised algorithms in the set-valued classification framework with controlled expected size. While the former methods can use only n labeled samples, the latter are able to make use of N additional unlabeled data. We obtain semi-supervised minimax rates of convergence under the α-margin assumption and a β-Hölder condition on the conditional distribution of labels. Our analysis implies that if no further assumption is made, there is no supervised method that outperforms the semi-supervised estimator proposed in this work – the best achievable rate for any supervised method is O(n−1/2), even if the margin assumption is extremely favorable; on the contrary, the developed semi-supervised estimator can achieve faster O((n/logn)−(1+α)β/(2β+d)) rate of convergence provided that sufficiently many unlabeled samples are available. We also show that under additional smoothness assumption, supervised methods are able to achieve faster rates and the unlabeled sample cannot improve the rate of convergence. Finally, a numerical study supports our theory and emphasizes the relevance of the assumptions we required from an empirical perspective.
Fichier principal
Vignette du fichier
main.pdf (826.11 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-02112918 , version 1 (27-04-2019)

Identifiers

Cite

Evgenii Chzhen, Christophe Denis, Mohamed Hebiri. Minimax semi-supervised set-valued approach to multi-class classification. Bernoulli, 2021, ⟨10.3150/20-BEJ1313⟩. ⟨hal-02112918⟩
560 View
333 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More