MixNN: Protection of Federated Learning Against Inference Attacks by Mixing Neural Network Layers - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2022

MixNN: Protection of Federated Learning Against Inference Attacks by Mixing Neural Network Layers

Abstract

Machine Learning (ML) has emerged as a core technology to provide learning models to perform complex tasks. Boosted by Machine Learning as a Service (MLaaS), the number of applications relying on ML capabilities is ever increasing. However, ML models are the source of different privacy violations through passive or active attacks from different entities. In this paper, we present MixNN a proxy-based privacy-preserving system for federated learning to protect the privacy of participants against a curious or malicious aggregation server trying to infer sensitive information (i.e., membership and attribute inferences). MixNN receives the model updates from participants and mixes layers between participants before sending the mixed updates to the aggregation server. This mixing strategy drastically reduces privacy leaks without any trade-off with utility. Indeed, mixing the updates of the model has no impact on the result of the aggregation of the updates computed by the server. We report on an extensive evaluation of MixNN using several datasets and neural networks architectures to quantify privacy leakage through membership and attribute inference attacks as well the robustness of the protection. We show that MixNN significantly limits both the membership and attribute inferences compared to a baseline using model compression and noisy gradient (well known to damage the utility) while keeping the same level of utility as classic federated learning.
MixNN (49).pdf (1.64 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03795818 , version 1 (04-10-2022)

Identifiers

Cite

Thomas Lebrun, Antoine Boutet, Jan Aalmoes, Adrien Baud. MixNN: Protection of Federated Learning Against Inference Attacks by Mixing Neural Network Layers. MIDDLEWARE 2022 - 23rd ACM/IFIP International Middleware Conference, Nov 2022, Quebec, Canada. pp.1-11, ⟨10.1145/3528535.3565240⟩. ⟨hal-03795818⟩
75 View
109 Download

Altmetric

Share

Gmail Facebook X LinkedIn More