A Multi-Criteria Experimental Ranking of Distributed SPARQL Evaluators - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2018

A Multi-Criteria Experimental Ranking of Distributed SPARQL Evaluators

Damien Graux
Louis Jachiet
Pierre Genevès
Nabil Layaïda


SPARQL is the standard language for querying RDF data. There exists a variety of SPARQL query evaluation systems implementing different architectures for the distribution of data and computations. Differences in architectures coupled with specific optimizations, for e.g. preprocessing and indexing, make these systems incomparable from a purely theoretical perspective. This results in many implementations solving the SPARQL query evaluation problem while exhibiting very different behaviors, not all of them being adapted in any context. We provide a new perspective on distributed SPARQL eval-uators, based on multi-criteria experimental rankings. Our suggested set of 5 features (namely velocity, immediacy, dynamic-ity, parsimony, and resiliency) provides a more comprehensive description of the behaviors of distributed evaluators when compared to traditional runtime performance metrics. We show how these features help in more accurately evaluating to which extent a given system is appropriate for a given use case. For this purpose, we systematically benchmarked a panel of 10 state-of-the-art implementations. We ranked them using a reading grid that helps in pinpointing the advantages and limitations of current technologies for the distributed evaluation of SPARQL queries.
Fichier principal
Vignette du fichier
experiment-analysis.pdf (226.31 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-01381781 , version 1 (14-10-2016)
hal-01381781 , version 2 (22-11-2018)


  • HAL Id : hal-01381781 , version 2


Damien Graux, Louis Jachiet, Pierre Genevès, Nabil Layaïda. A Multi-Criteria Experimental Ranking of Distributed SPARQL Evaluators. Big Data 2018 - IEEE International Conference on Big Data, Dec 2018, Seattle, United States. pp.1-10. ⟨hal-01381781v2⟩
354 View
483 Download


Gmail Mastodon Facebook X LinkedIn More