Designing Parallel Data Processing for Large-Scale Sensor Orchestration - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2016

Designing Parallel Data Processing for Large-Scale Sensor Orchestration

Abstract

Masses of sensors are being deployed at the scale of cities to manage parking spaces, transportation infrastructures to monitor traffic, and campuses of buildings to reduce energy consumption. These large-scale infrastructures become a reality for citizens via applications that orchestrate sensors to deliver high-value, innovative services. These applications critically rely on the processing of large amounts of data to analyze situations, inform users, and control devices. This paper proposes a design-driven approach to developing orchestrating applications for masses of sensors that integrates parallel processing of large amounts of data. Specifically, an application design exposes declarations that are used to generate a programming framework based on the MapReduce programming model. We have developed a prototype of our approach, using Apache Hadoop. We applied it to a case study and obtained significant speedups by parallelizing computations over twelve nodes. In doing so, we demonstrate that our design-driven approach allows to abstract over implementation details, while exposing architectural properties used to generate high-performance code for processing large datasets.
Fichier principal
Vignette du fichier
main.pdf (310.34 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-01319730 , version 1 (23-05-2016)

Identifiers

  • HAL Id : hal-01319730 , version 1

Cite

Milan Kabáč, Charles Consel. Designing Parallel Data Processing for Large-Scale Sensor Orchestration. 13th IEEE International Conference on Ubiquitous Intelligence and Computing (UIC 2016), Jul 2016, Toulouse, France. ⟨hal-01319730⟩

Collections

CNRS INRIA INRIA2
343 View
325 Download

Share

Gmail Facebook X LinkedIn More