A non-parametric k-nearest neighbor entropy estimator - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Article Dans Une Revue Physical Review E Année : 2016

A non-parametric k-nearest neighbor entropy estimator

Résumé

A non-parametric k-nearest neighbor based entropy estimator is proposed a. It improves on the classical Kozachenko-Leonenko estimator by considering non-uniform probability densities in the region of k-nearest neighbors around each sample point. It aims at improving the classical estimators in three situations: first, when the dimensionality of the random variable is large; second, when near-functional relationships leading to high correlation between components of the random variable are present; and third, when the marginal variances of random variable components vary significantly with respect to each other. Heuristics on the error of the proposed and classical estimators are presented. Finally, the proposed estimator is tested for a variety of distributions in successively increasing dimensions and in the presence of a near-functional relationship. Its performance is compared with a classical estimator and shown to be a significant improvement.
Fichier principal
Vignette du fichier
articleRev.pdf (1.12 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01272527 , version 1 (11-02-2016)

Identifiants

Citer

Damiano Lombardi, Sanjay Pant. A non-parametric k-nearest neighbor entropy estimator. Physical Review E , 2016, ⟨10.1103/PhysRevE.93.013310⟩. ⟨hal-01272527⟩
179 Consultations
2464 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More