Machine Learning Methods for Connection RTT and Loss Rate Estimation Using MPI Measurements Under Random Losses - Inria - Institut national de recherche en sciences et technologies du numérique
Communication Dans Un Congrès Année : 2020

Machine Learning Methods for Connection RTT and Loss Rate Estimation Using MPI Measurements Under Random Losses

Nageswara Rao
  • Fonction : Auteur
  • PersonId : 1102758
Neena Imam
  • Fonction : Auteur
  • PersonId : 1102759
Zhengchun Liu
  • Fonction : Auteur
  • PersonId : 1102760
Rajkumar Kettimuthu
  • Fonction : Auteur
  • PersonId : 1102761
Ian Foster
  • Fonction : Auteur
  • PersonId : 1102762

Résumé

Scientific computations are expected to be increasingly distributed across wide-area networks, and Message Passing Interface (MPI) has been shown to scale to support their communications over long distances. Application-level measurements of MPI operations reflect the connection Round-Trip Time (RTT) and loss rate, and machine learning methods have been previously developed to estimate them under deterministic periodic losses. In this paper, we consider more complex, random losses with uniform, Poisson and Gaussian distributions. We study five disparate machine leaning methods, with linear and non-linear, and smooth and non-smooth properties, to estimate RTT and loss rate over 10 Gbps connections with 0–366 ms RTT. The diversity and complexity of these estimators combined with the randomness of losses and TCP’s non-linear response together rule out the selection of a single best among them; instead, we fuse them to retain their design diversity. Overall, the results show that accurate estimates can be generated at low loss rates but become inaccurate at loss rates 10% and higher, thereby illustrating both their strengths and limitations.
Fichier principal
Vignette du fichier
487577_1_En_11_Chapter.pdf (1.87 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03266451 , version 1 (21-06-2021)

Licence

Identifiants

Citer

Nageswara Rao, Neena Imam, Zhengchun Liu, Rajkumar Kettimuthu, Ian Foster. Machine Learning Methods for Connection RTT and Loss Rate Estimation Using MPI Measurements Under Random Losses. 2nd International Conference on Machine Learning for Networking (MLN), Dec 2019, Paris, France. pp.154-174, ⟨10.1007/978-3-030-45778-5_11⟩. ⟨hal-03266451⟩
170 Consultations
40 Téléchargements

Altmetric

Partager

More