A Methodology for Handling Data Movements by Anticipation - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2018

A Methodology for Handling Data Movements by Anticipation

Abstract

The enhanced capabilities of large scale parallel and distributed platforms produce a continuously increasing amount of data which have to be stored, exchanged and used by various tasks allocated on different nodes of the system. The management of such a huge communication demand is crucial for reaching the best possible performance of the system. Meanwhile, we have to deal with more interferences as the trend is to use a single all-purpose interconnection network whatever the interconnect (tree-based hierarchies or topology-based heterarchies). There are two different types of communications, namely, the flows induced by data exchanges during the computations, and the flows related to Input/Output operations. We propose in this paper a general model for interference-aware scheduling, where explicit communications are replaced by external topological constraints. Specifically, the interferences of both communication types are reduced by adding geometric constraints on the allocation of tasks into machines. The proposed constraints reduce implicitly the data movements by restricting the set of possible allocations for each task. This methodology has been proved to be efficient in a recent study for a restricted interconnection network (a line/ring of processors which is an intermediate between a tree and higher dimensions grids/torus). The obtained results illustrated well the difficulty of the problem even on simple topologies, but also provided a pragmatic greedy solution, which was assessed to be efficient by simulations. We are currently extending this solution for more complex topologies. This work is a position paper which describes the methodology, it does not focus on the solving part.
Fichier principal
Vignette du fichier
BleuseR2018Methodology.pdf (257.48 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-02066200 , version 1 (06-07-2021)

Identifiers

Cite

Raphaël Bleuse, Giorgio Lucarelli, Denis Trystram. A Methodology for Handling Data Movements by Anticipation: Position Paper. Euro-Par 2018 - 24th International European Conference on Parallel and Distributed Computing, Aug 2018, Turin, Italy. pp.134-145, ⟨10.1007/978-3-030-10549-5_11⟩. ⟨hal-02066200⟩
83 View
46 Download

Altmetric

Share

Gmail Facebook X LinkedIn More