The Role of Network Topology for Distributed Machine Learning - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2019

The Role of Network Topology for Distributed Machine Learning

Résumé

Many learning problems are formulated as minimization of some loss function on a training set of examples. Distributed gradient methods on a cluster are often used for this purpose. In this paper, we study how the variability of task execution times at cluster nodes affects the system throughput. In particular, a simple but accurate model allows us to quantity how the time to solve the minimization problem depends on the network of information exchanges among the nodes. Interestingly, we show that, even when communication overhead may be neglected, the clique is not necessarily the most effective topology, as commonly assumed in previous works.
Fichier principal
Vignette du fichier
neglia19infocom(5).pdf (688.31 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02411164 , version 1 (16-12-2019)

Identifiants

Citer

Giovanni Neglia, Gianmarco Calbi, Don Towsley, Gayane Vardoyan. The Role of Network Topology for Distributed Machine Learning. IEEE INFOCOM 2019 - IEEE Conference on Computer Communications, Apr 2019, Paris, France. pp.2350-2358, ⟨10.1109/INFOCOM.2019.8737602⟩. ⟨hal-02411164⟩
93 Consultations
722 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More