Decentralized Collaborative Learning of Personalized Models over Networks - Inria - Institut national de recherche en sciences et technologies du numérique
Communication Dans Un Congrès Année : 2017

Decentralized Collaborative Learning of Personalized Models over Networks

Résumé

We consider a set of learning agents in a col-laborative peer-to-peer network, where each agent learns a personalized model according to its own learning objective. The question addressed in this paper is: how can agents improve upon their locally trained model by communicating with other agents that have similar objectives? We introduce and analyze two asynchronous gossip algorithms running in a fully decentralized manner. Our first approach , inspired from label propagation, aims to smooth pre-trained local models over the network while accounting for the confidence that each agent has in its initial model. In our second approach, agents jointly learn and propagate their model by making iterative updates based on both their local dataset and the behavior of their neighbors. To optimize this challenging objective, our decentralized algorithm is based on ADMM.
Fichier principal
Vignette du fichier
supplementary.pdf (576.92 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01533182 , version 1 (06-06-2017)

Identifiants

Citer

Paul Vanhaesebrouck, Aurélien Bellet, Marc Tommasi. Decentralized Collaborative Learning of Personalized Models over Networks. International Conference on Artificial Intelligence and Statistics (AISTATS), Apr 2017, Fort Lauderdale, Florida., United States. ⟨hal-01533182⟩
737 Consultations
602 Téléchargements

Altmetric

Partager

More