Resilient Optimistic Termination Detection for the Async-Finish Model - Inria - Institut national de recherche en sciences et technologies du numérique
Communication Dans Un Congrès Année : 2019

Resilient Optimistic Termination Detection for the Async-Finish Model

Résumé

Driven by increasing core count and decreasing mean-time-to-failure in supercomputers, HPC runtime systems must improve support for dynamic task-parallel execution and resilience to failures. The async-finish task model, adapted for distributed systems as the asynchronous partitioned global address space programming model, provides a simple way to decompose a computation into nested task groups, each managed by a ‘finish’ that signals the termination of all tasks within the group. For distributed termination detection, maintaining a consistent view of task state across multiple unreliable processes requires additional book-keeping when creating or completing tasks and finish-scopes. Runtime systems which perform this book-keeping pessimistically, i.e. synchronously with task state changes, add a high communication overhead compared to non-resilient protocols. In this paper, we propose optimistic finish, the first message-optimal resilient termination detection protocol for the async-finish model. By avoiding the communication of certain task and finish events, this protocol allows uncertainty about the global structure of the computation which can be resolved correctly at failure time, thereby reducing the overhead for failure-free execution. Performance results using micro-benchmarks and the LULESH hydrodynamics proxy application show significant reductions in resilience overhead with optimistic finish compared to pessimistic finish. Our optimistic finish protocol is applicable to any task-based runtime system offering automatic termination detection for dynamic graphs of non-migratable tasks.
Fichier principal
Vignette du fichier
Hamouda2019_ISC_HPC.pdf (430.59 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02169496 , version 1 (11-07-2019)

Identifiants

Citer

Sara Hamouda, Josh Milthorpe. Resilient Optimistic Termination Detection for the Async-Finish Model. 34th International Conference on High Performance Computing, Jun 2019, Frankfurt, Germany. pp.291-311, ⟨10.1007/978-3-030-20656-7_15⟩. ⟨hal-02169496⟩
102 Consultations
244 Téléchargements

Altmetric

Partager

More