Sketching Datasets for Large-Scale Learning (long version) - Inria - Institut national de recherche en sciences et technologies du numérique
Pré-Publication, Document De Travail Année : 2021

Sketching Datasets for Large-Scale Learning (long version)

Résumé

This article considers "sketched learning," or "compressive learning," an approach to large-scale machine learning where datasets are massively compressed before learning (e.g., clustering, classification, or regression) is performed. In particular, a "sketch" is first constructed by computing carefully chosen nonlinear random features (e.g., random Fourier features) and averaging them over the whole dataset. Parameters are then learned from the sketch, without access to the original dataset. This article surveys the current state-of-the-art in sketched learning, including the main concepts and algorithms, their connections with established signal-processing methods, existing theoretical guarantees-on both information preservation and privacy preservation, and important open problems.
Fichier principal
Vignette du fichier
SPM_paper.pdf (7.94 Mo) Télécharger le fichier
SPM_paper.bcf (108.64 Ko) Télécharger le fichier
SPM_paper.run.xml (2.36 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-02909766 , version 1 (04-08-2020)
hal-02909766 , version 2 (26-01-2021)

Identifiants

Citer

Rémi Gribonval, Antoine Chatalic, Nicolas Keriven, Vincent Schellekens, Laurent Jacques, et al.. Sketching Datasets for Large-Scale Learning (long version). 2021. ⟨hal-02909766v2⟩
381 Consultations
187 Téléchargements

Altmetric

Partager

More