Scheduling Data and Task on Data-Driven Master/Worker Platform - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2012

Scheduling Data and Task on Data-Driven Master/Worker Platform


With data intensive applications it can be interesting to resort to a distributed storage to reach scalability and avoid data-intensive problems. Storing data permanently on computing nodes can be an interesting approach especially with the frequent use and the large volume of this data. Moreover, processing large data is a computing intensive task which encourages parallel execution. Nevertheless, data placement on computing nodes should be optimal to reach load balancing. In this work, we investigate scheduling heuristics towards the optimization of data distribution on the computing nodes. Motivated by its capacity to control perfectly the common operations associated with data management, we use BitDew: a desktop grid middleware designed for large scale data management. With BitDew, we build a Data-Driven Master/Worker Platform to carry out the distribution of Magick, the OCR application based on Dynamic Time Warping (DTW) algorithm. We evaluate the benefit of the implementation of studied scheduling heuristics to achieve load balancing with both homogeneous and heterogeneous environment. We present experimental results which demonstrate the efficiency of our approach.
No file

Dates and versions

hal-00757065 , version 1 (26-11-2012)



Mohamed Labidi, Bing Tang, Gilles Fedak, Maher Khemakem, Mohamed Jemni. Scheduling Data and Task on Data-Driven Master/Worker Platform. PDCAT 2012 - 13th International Conference on Parallel and Distributed Computing, Applications and Technologies, Dec 2012, Beijing, China. pp.593-598, ⟨10.1109/PDCAT.2012.122⟩. ⟨hal-00757065⟩
386 View
0 Download



Gmail Facebook Twitter LinkedIn More