TINS: A Task-Based Dynamic Helper Core Strategy for In Situ Analytics - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2018

TINS: A Task-Based Dynamic Helper Core Strategy for In Situ Analytics

Abstract

The in situ paradigm proposes to co-locate simulation and analytics on the same compute node to analyze data while still resident in the compute node memory, hence reducing the need for post-processing methods. A standard approach that proved efficient for sharing resources on each node consists in running the analytics processes on a set of dedicated cores, called helper cores, to isolate them from the simulation processes. Simulation and analytics thus run concurrently with limited interference. In this paper we show that the performance can be improved through a dynamic helper core strategy. We rely on a work stealing scheduler to implement TINS, a task-based in situ framework with an on-demand analytics isolation. The helper cores are dedicated to analytics only when analytics tasks are available. Otherwise the helper cores join the other cores for processing simulation tasks. TINS relies on the Intel R TBB library. Experiments on up to 14,336 cores run a set of representative analytics parallelized with TBB coupled with the hybrid MPI+TBB ExaStamp molecular dynamics code. TINS shows up to 40% performance improvement over various other approaches including the standard helper core.
Fichier principal
Vignette du fichier
sca-final-version.pdf (338.82 Ko) Télécharger le fichier
Origin Files produced by the author(s)
Loading...

Dates and versions

hal-01730910 , version 1 (13-03-2018)

Identifiers

Cite

Estelle Dirand, Laurent Colombet, Bruno Raffin. TINS: A Task-Based Dynamic Helper Core Strategy for In Situ Analytics. SCA18 - Supercomputing Frontiers Asia 2018, Mar 2018, Singapore, Singapore. pp.159-178, ⟨10.1007/978-3-319-69953-0_10⟩. ⟨hal-01730910⟩
462 View
217 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More