Total Effects with Constrained Features - Inria - Institut national de recherche en sciences et technologies du numérique
Article Dans Une Revue Statistics and Computing Année : 2024

Total Effects with Constrained Features

Résumé

Recent studies have emphasized the connection between machine learning feature importance measures and total order sensitivity indices (total effects, henceforth). Feature correlations and the need to avoid unrestricted permutations make the estimation of these indices challenging. Additionally, there is no established theory or approach for non-Cartesian domains. We propose four alternative strategies for computing total effects that account for both dependent and constrained features. Our first approach involves a generalized winding stairs design combined with the Knothe-Rosenblatt transformation. This approach, while applicable to a wide family of input dependencies, becomes impractical when inputs are physically constrained. Our second approach is a U-statistic that combines the Jansen estimator with a weighting factor. The U-statistic framework allows the derivation of a central limit theorem for this estimator. However, this design is computationally intensive. Then, our third approach uses derangements to significantly reduce computational burden. We prove consistency and central limit theorems for these estimators as well. Our fourth approach is based on a nearest-neighbour intuition and it further reduces computational burden. We test these estimators through a series of increasingly complex computational experiments with features constrained on compact and connected domains (circle, simplex), non-compact and non-connected domains (Sierpinski gaskets), we provide comparisons with machine learning approaches and conclude with an application to a realistic simulator.
Fichier principal
Vignette du fichier
TotalEffectsConstrainedFeatures_BorognovoPlischkePrieur_hal_V2.pdf (2.95 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04102882 , version 1 (22-05-2023)
hal-04102882 , version 2 (06-02-2024)

Licence

Identifiants

Citer

Emanuele Borgonovo, Elmar Plischke, Clémentine Prieur. Total Effects with Constrained Features. Statistics and Computing, 2024, 34 (87), pp.1-29. ⟨10.1007/s11222-024-10398-5⟩. ⟨hal-04102882v2⟩
220 Consultations
110 Téléchargements

Altmetric

Partager

More