An Abstract Interpretation-Based Data Leakage Static Analysis - Inria - Institut national de recherche en sciences et technologies du numérique
Communication Dans Un Congrès Année : 2024

An Abstract Interpretation-Based Data Leakage Static Analysis

Résumé

Data leakage is a well-known problem in machine learning which occurs when the training and testing datasets are not independent. This phenomenon leads to overly optimistic accuracy estimates at training time, followed by a significant drop in performance when models are deployed in the real world. This can be dangerous, notably when models are used for risk prediction in high-stakes applications. In this paper, we propose an abstract interpretation-based static analysis to prove the absence of data leakage. We implemented it in the NBLyzer framework and we demonstrate its performance and precision on 2111 Jupyter notebooks from the Kaggle competition platform.
Fichier principal
Vignette du fichier
tase2024.pdf (446.4 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04556578 , version 1 (23-04-2024)

Licence

Identifiants

  • HAL Id : hal-04556578 , version 1

Citer

Filip Drobnjaković, Pavle Subotic, Caterina Urban. An Abstract Interpretation-Based Data Leakage Static Analysis. 18th International Symposium on Theoretical Aspects of Software Engineering, Jul 2024, Guiyang, China. ⟨hal-04556578⟩
275 Consultations
26 Téléchargements

Partager

More