An Algebra with a Fixpoint Operator for Distributed Data Collections - Inria - Institut national de recherche en sciences et technologies du numérique
Pré-Publication, Document De Travail Année : 2019

An Algebra with a Fixpoint Operator for Distributed Data Collections

Nils Gesbert
  • Fonction : Auteur
  • PersonId : 958488
Pierre Genevès
Nabil Layaïda

Résumé

We present an algebra with a fixpoint operator which is suitable for modeling computations with distributed collections found in big data frameworks. We show that under reasonable conditions this fixpoint can be evaluated by parallel loops with one final merge rather than by a global loop requiring network overhead after each iteration. We also show when and how filters can be pushed through recursive terms, proposing optimisation rules. This makes it possible to develop algebraic optimizations in the presence of recursion, in a way which is especially suited for query optimizers and compilers targeting big data frameworks.
Fichier principal
Vignette du fichier
article.pdf (662.59 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02066649 , version 1 (13-03-2019)
hal-02066649 , version 2 (16-10-2020)
hal-02066649 , version 3 (16-10-2020)
hal-02066649 , version 4 (16-10-2020)
hal-02066649 , version 5 (02-03-2021)
hal-02066649 , version 6 (24-05-2022)

Identifiants

  • HAL Id : hal-02066649 , version 1

Citer

Sarah Chlyah, Nils Gesbert, Pierre Genevès, Nabil Layaïda. An Algebra with a Fixpoint Operator for Distributed Data Collections. 2019. ⟨hal-02066649v1⟩
569 Consultations
615 Téléchargements

Partager

More