Filtering Outliers in One Step with Genetic Programming - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2018

Filtering Outliers in One Step with Genetic Programming


Outliers are one of the most difficult issues when dealing with real-world modeling tasks. Even a small percentage of outliers can impede a learning algorithm’s ability to fit a dataset. While robust regression algorithms exist, they fail when a dataset is corrupted by more than 50% of outliers (breakdown point). In the case of Genetic Programming, robust regression has not been properly studied. In this paper we present a method that works as a filter, removing outliers from the target variable (vertical outliers). The algorithm is simple, it uses a randomly generated population of GP trees to determine which target values should be labeled as outliers. The method is highly efficient. Results show that it can return a clean dataset when contamination reaches as high as 90%, and may be able to handle higher levels of contamination. In this study only synthetic univariate benchmarks are used to evaluate the approach, but it must be stressed that no other approaches can deal with such high levels of outlier contamination while requiring such small computational effort.
No file

Dates and versions

hal-01910433 , version 1 (31-10-2018)



Uriel Lopez, Leonardo Trujillo, Pierrick Legrand. Filtering Outliers in One Step with Genetic Programming. PPSN 2018 - Fifteenth International Conference on Parallel Problem Solving from Nature (PPSN XV), Sep 2018, Coimbra, Portugal. ⟨10.1007/978-3-319-99253-2_17⟩. ⟨hal-01910433⟩
36 View
0 Download



Gmail Facebook X LinkedIn More