Fully Distributed Privacy Preserving Mini-batch Gradient Descent Learning - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2015

Fully Distributed Privacy Preserving Mini-batch Gradient Descent Learning

Gábor Danner
  • Function : Author
  • PersonId : 1031353
Márk Jelasity
  • Function : Author
  • PersonId : 1031354


In fully distributed machine learning, privacy and security are important issues. These issues are often dealt with using secure multiparty computation (MPC). However, in our application domain, known MPC algorithms are not scalable or not robust enough. We propose a light-weight protocol to quickly and securely compute the sum of the inputs of a subset of participants assuming a semi-honest adversary. During the computation the participants learn no individual values. We apply this protocol to efficiently calculate the sum of gradients as part of a fully distributed mini-batch stochastic gradient descent algorithm. The protocol achieves scalability and robustness by exploiting the fact that in this application domain a “quick and dirty” sum computation is acceptable. In other words, speed and robustness takes precedence over precision. We analyze the protocol theoretically as well as experimentally based on churn statistics from a real smartphone trace. We derive a sufficient condition for preventing the leakage of an individual value, and we demonstrate the feasibility of the overhead of the protocol.
Fichier principal
Vignette du fichier
978-3-319-19129-4_3_Chapter.pdf (233.45 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-01775029 , version 1 (24-04-2018)





Gábor Danner, Márk Jelasity. Fully Distributed Privacy Preserving Mini-batch Gradient Descent Learning. 15th IFIP International Conference on Distributed Applications and Interoperable Systems (DAIS), Jun 2015, Grenoble, France. pp.30-44, ⟨10.1007/978-3-319-19129-4_3⟩. ⟨hal-01775029⟩
85 View
85 Download



Gmail Facebook Twitter LinkedIn More