Conference Papers Year : 2024

Checkpointing strategies for a fixed-length execution

Abstract

This work considers checkpointing strategies for a parallel application executing on a large-scale platform whose nodes are subject to failures. The application executes for a fixed duration, namely the length of the reservation that it has been granted. We start with small examples that show the difficulty of the problem: it turns out that the optimal checkpointing strategy neither always uses periodic checkpoints nor always takes its last checkpoint exactly at the end of the reservation. Then, we introduce a dynamic heuristic that is periodic and decides for the checkpointing frequency based upon thresholds for the time left; we determine threshold times Tn such that it is best to plan for exactly n checkpoints if the time left (or initially the length of the reservation) is between Tn and Tn+1. Next, we use time discretization and design a (complicated) dynamic programming algorithm that computes the optimal solution, without any restriction on the checkpointing strategy. Finally, we report the results of an extensive simulation campaign that shows that the optimal solution is far more efficient than the Young/Daly periodic approach for short or mid-size reservations.
Fichier principal
Vignette du fichier
ckpt-resa.pdf (950.72 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-04714372 , version 1 (30-09-2024)

Licence

Identifiers

  • HAL Id : hal-04714372 , version 1

Cite

Anne Benoit, Lucas Perotin, Yves Robert, Frédéric Vivien. Checkpointing strategies for a fixed-length execution. 14th Workshop on Fault-Tolerance for HPC at eXtreme Scale (FTXS 2024), Nov 2024, Atlanta, United States. ⟨hal-04714372⟩
35 View
20 Download

Share

More