StreamDM: Advanced Data Mining in Spark Streaming - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2015

StreamDM: Advanced Data Mining in Spark Streaming

Albert Bifet
Jianfeng Qian
  • Function : Author
  • PersonId : 976396
Guangjian Tian
  • Function : Author
  • PersonId : 976397
Wei Fan

Abstract

Real-time analytics are becoming increasingly important due to the large amount of data that is being created continuously. Drawing from our experiences at Huawei Noah's Ark Lab, we present and demonstrate here StreamDM, a new open source data mining and machine learning library, designed on top of Spark Streaming, an extension of the core Spark API that enables scalable stream processing of data streams. StreamDM is designed to be easily extended and used, either practitioners, developers, or researchers, and is the first library to contain advanced stream mining algorithms for Spark Streaming .
Fichier principal
Vignette du fichier
bifet2015streamdm.pdf (386.16 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-01270606 , version 1 (08-02-2016)

Identifiers

Cite

Albert Bifet, Silviu Maniu, Jianfeng Qian, Guangjian Tian, Cheng He, et al.. StreamDM: Advanced Data Mining in Spark Streaming. International Conference on Data Mining Workshops (ICDMW), IEEE, Nov 2015, Atlantic City, NJ, United States. ⟨10.1109/ICDMW.2015.140⟩. ⟨hal-01270606⟩
447 View
904 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More