An Empirical Analysis of Fairness Notions under Differential Privacy * - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2023

An Empirical Analysis of Fairness Notions under Differential Privacy *

Abstract

Recent works have shown that selecting an optimal model architecture suited to the differential privacy setting is necessary to achieve the best possible utility for a given privacy budget using differentially private stochastic gradient descent (DP-SGD)(Tramèr and Boneh 2020; Cheng et al. 2022). In light of these findings, we empirically analyse how different fairness notions, belonging to distinct classes of statistical fairness criteria (independence, separation and sufficiency), are impacted when one selects a model architecture suitable for DP-SGD, optimized for utility. Using standard datasets from ML fairness literature, we show using a rigorous experimental protocol, that by selecting the optimal model architecture for DP-SGD, the differences across groups concerning the relevant fairness metrics (demographic parity, equalized odds and predictive parity) more often decrease or are negligibly impacted, compared to the non-private baseline, for which optimal model architecture has also been selected to maximize utility. These findings challenge the understanding that differential privacy will necessarily exacerbate unfairness in deep learning models trained on biased datasets.
Fichier principal
Vignette du fichier
empirical-fairness-dp.pdf (230.95 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-04387685 , version 1 (11-01-2024)

Licence

Attribution

Identifiers

Cite

Anderson Santana de Oliveira, Caelin Kaplan, Khawla Mallat, Tanmay Chakraborty. An Empirical Analysis of Fairness Notions under Differential Privacy *. PPAI 2023 - Fourth AAAI Workshop on Privacy-Preserving Artificial Intelligence, Feb 2023, Washington D.C., United States. ⟨hal-04387685⟩
16 View
13 Download

Altmetric

Share

Gmail Facebook X LinkedIn More