Two-Stage Job Scheduling Model Based on Revenues and Resources - Inria - Institut national de recherche en sciences et technologies du numérique
Communication Dans Un Congrès Année : 2017

Two-Stage Job Scheduling Model Based on Revenues and Resources

Yuliang Shi
  • Fonction : Auteur
  • PersonId : 1027987
Dong Liu
  • Fonction : Auteur
  • PersonId : 1027988
Jing Hu
  • Fonction : Auteur
  • PersonId : 1027989
Jianlin Zhang
  • Fonction : Auteur
  • PersonId : 1027990

Résumé

In the big data platform, multiple users share the resources of the platform. For platform providers, it is a problem to be solved urgently that how to multi-user jobs are scheduled efficiently to take full advantage of the resources of the platform, get the maximum revenue and meet the SLA requirements of the users. We research the project of job scheduling for MapReduce framework further. The paper proposes a two-stage job scheduling model based on revenues and resources. In the model, we design a scheduling algorithm of the maximum revenue (SMR) based on the latest start time of the jobs. The SMR algorithm ensures that the jobs which have larger revenues can be completed before the deadlines of the jobs, and then providers can gain the largest total revenue. Under the premise of ensuring the maximum revenue, a sequence adjustment scheduling algorithm based on the maximum resource utilization of the platform (SAS) is developed to improve the resource utilization of the platform. Experimental results show that the two-stage job scheduling model proposed in this paper not only realizes the maximum revenue of the provider, but also improves the resource utilization of the platform and the comprehensive performance of the platform. What is more, the model has great practicability and reliability.
Fichier principal
Vignette du fichier
457609_1_En_4_Chapter.pdf (585.93 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01705450 , version 1 (09-02-2018)

Licence

Identifiants

Citer

Yuliang Shi, Dong Liu, Jing Hu, Jianlin Zhang. Two-Stage Job Scheduling Model Based on Revenues and Resources. 14th IFIP International Conference on Network and Parallel Computing (NPC), Oct 2017, Hefei, China. pp.37-48, ⟨10.1007/978-3-319-68210-5_4⟩. ⟨hal-01705450⟩
105 Consultations
73 Téléchargements

Altmetric

Partager

More