Implementation of the AdaBoost Algorithm for Large Scale Distributed Environments: Comparing JavaSpace and MPJ - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2009

Implementation of the AdaBoost Algorithm for Large Scale Distributed Environments: Comparing JavaSpace and MPJ

Virginie Galtier
Stéphane Genaud
  • Fonction : Auteur
  • PersonId : 846256
Stéphane Vialle

Résumé

This paper presents the parallelization of a machine learning method, called the adaboost algorithm. The parallel algorithm follows a dynamically load-balanced master-worker strategy, which is parameterized by the granularity of the tasks distributed to workers. We first show the benefits of this version with heterogeneous processors. Then, we study the application in a real, geographically distributed environment, hence adding network latencies to the execution. Performances of the application using more than a hundred processes are analyzed in both JavaSpace and {\pmpi}. We therefore present an head-to-head comparison of two parallel programming models. We study for each case the granularities yielding the best performance. We show that current network technologies enable to obtain interesting speedups in many situations for such an application, even when using a virtual shared memory paradigm in a large-scale distributed environment.
Fichier non déposé

Dates et versions

inria-00425518 , version 1 (21-10-2009)

Identifiants

Citer

Virginie Galtier, Stéphane Genaud, Stéphane Vialle. Implementation of the AdaBoost Algorithm for Large Scale Distributed Environments: Comparing JavaSpace and MPJ. Fifteenth International Conference on Parallel and Distributed Systems (ICPADS'09), Dec 2009, Shenzhen, China. ⟨10.1109/ICPADS.2009.67⟩. ⟨inria-00425518⟩
164 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More