How to deal with missing data in supervised deep learning? - Inria - Institut national de recherche en sciences et technologies du numérique
Conference Papers Year : 2022

How to deal with missing data in supervised deep learning?

Abstract

The issue of missing data in supervised learning has been largely overlooked, especially in the deep learning community. We investigate strategies to adapt neural architectures for handling missing values. Here, we focus on regression and classification problems where the features are assumed to be missing at random. Of particular interest are schemes that allow reusing as-is a neural discriminative architecture. To address supervised deep learning with missing values, we propose to marginalize over missing values in a joint model of covariates and outcomes. Thereby, we leverage both the flexibility of deep generative models to describe the distribution of the covariates and the power of purely discriminative models to make predictions. More precisely, a deep latent variable model can be learned jointly with the discriminative model, using importance-weighted variational inference, essentially using importance sampling to mimick averaging over multiple imputations. In low-capacity regimes, or when the discriminative model has a strong inductive bias, we find that our hybrid generative/discriminative approach generally outperforms single imputations methods.
Fichier principal
Vignette du fichier
how_to_deal_with_missing_data_ (1).pdf (4.58 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-03044144 , version 1 (07-12-2020)
hal-03044144 , version 2 (23-03-2022)

Identifiers

  • HAL Id : hal-03044144 , version 2

Cite

Niels Bruun Ipsen, Pierre-Alexandre Mattei, Jes Frellsen. How to deal with missing data in supervised deep learning?. ICLR 2022 - 10th International Conference on Learning Representations, Apr 2022, Virtual conference, France. ⟨hal-03044144v2⟩
908 View
3171 Download

Share

More