fimpera: drastic improvement of Approximate Membership Query data-structures with counts - Inria - Institut national de recherche en sciences et technologies du numérique
Article Dans Une Revue Bioinformatics Année : 2023

fimpera: drastic improvement of Approximate Membership Query data-structures with counts

Résumé

Motivations: Approximate membership query data structures (AMQ) such as Cuckoo filters or Bloom filters are widely used for representing and indexing large sets of elements. AMQ can be generalized for additionally counting indexed elements, they are then called "counting AMQ". This is for instance the case of the "counting Bloom filters". However, counting AMQs suffer from false positive and overestimated calls. Results: In this work we propose a novel computation method, called fimpera, consisting of a simple strategy for reducing the false-positive rate of any AMQ indexing all k-mers (words of length k) from a set of sequences, along with their abundance information. This method decreases the false-positive rate of a counting Bloom filter by an order of magnitude while reducing the number of overestimated calls, as well as lowering the average difference between the overestimated calls and the ground truth. In addition, it slightly decreases the query run time. fimpera does not require any modification of the original counting Bloom filter, it does not generate false-negative calls, and it causes no memory overhead. The unique drawback is that fimpera yields a new kind of false positives and overestimated calls. However their amount is negligible. fimpera requires a unique parameter, and its results are only little impacted when using this parameter within recommended values. As a side note, for the algorithmic needs of the method, we also propose a novel generic algorithm for finding minimal values of a sliding window over a vector of x integers in O(x) time with zero memory allocation.
Fichier principal
Vignette du fichier
2022.06.27.497694v2.full.pdf (475.14 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03912993 , version 1 (26-12-2022)

Licence

Identifiants

Citer

Lucas Robidou, Pierre Peterlongo. fimpera: drastic improvement of Approximate Membership Query data-structures with counts. Bioinformatics, 2023, 39 (5), pp.1-16. ⟨10.1101/2022.06.27.497694⟩. ⟨hal-03912993⟩
127 Consultations
57 Téléchargements

Altmetric

Partager

More