An Accurate, Scalable and Verifiable Protocol for Federated Differentially Private Averaging - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles Machine Learning Year : 2022

An Accurate, Scalable and Verifiable Protocol for Federated Differentially Private Averaging

Abstract

Learning from data owned by several parties, as in federated learning, raises challenges regarding the privacy guarantees provided to participants and the correctness of the computation in the presence of malicious parties. We tackle these challenges in the context of distributed averaging, an essential building block of federated learning algorithms. Our first contribution is a scalable protocol in which participants exchange correlated Gaussian noise along the edges of a graph, complemented by independent noise added by each party. We analyze the differential privacy guarantees of our protocol and the impact of the graph topology under colluding malicious parties, showing that we can nearly match the utility of the trusted curator model even when each honest party communicates with only a logarithmic number of other parties chosen at random. This is in contrast with protocols in the local model of privacy (with lower utility) or based on secure aggregation (where all pairs of users need to exchange messages). Our second contribution enables users to prove the correctness of their computations without compromising the efficiency and privacy guarantees of the protocol. Our construction relies on standard cryptographic primitives like commitment schemes and zero knowledge proofs.
Fichier principal
Vignette du fichier
main.pdf (837.27 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03820603 , version 1 (19-10-2022)
hal-03820603 , version 2 (19-10-2022)

Identifiers

Cite

César Sabater, Aurélien Bellet, Jan Ramon. An Accurate, Scalable and Verifiable Protocol for Federated Differentially Private Averaging. Machine Learning, 2022, ⟨10.1007/s10994-022-06267-9⟩. ⟨hal-03820603v2⟩
80 View
42 Download

Altmetric

Share

Gmail Facebook X LinkedIn More