Evaluating Sequence Discovery Systems in an Abstraction-Aware Manner - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2018

Evaluating Sequence Discovery Systems in an Abstraction-Aware Manner

Eoin Rogers
  • Function : Author
  • PersonId : 1033482
Robert J. Ross
  • Function : Author
  • PersonId : 1033483
John D. Kelleher
  • Function : Author
  • PersonId : 1033484


Activity discovery is a challenging machine learning problem where we seek to uncover new or altered behavioural patterns in sensor data. In this paper we motivate and introduce a novel approach to evaluating activity discovery systems. Pre-annotated ground truths, often used to evaluate the performance of such systems on existing datasets, may exist at different levels of abstraction to the output of the output produced by the system. We propose a method for detecting and dealing with this situation, allowing for useful ground truth comparisons. This work has applications for activity discovery, and also for related fields. For example, it could be used to evaluate systems intended for anomaly detection, intrusion detection, automated music transcription and potentially other applications.
Fichier principal
Vignette du fichier
467708_1_En_23_Chapter.pdf (267.35 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-01821052 , version 1 (22-06-2018)





Eoin Rogers, Robert J. Ross, John D. Kelleher. Evaluating Sequence Discovery Systems in an Abstraction-Aware Manner. 14th IFIP International Conference on Artificial Intelligence Applications and Innovations (AIAI), May 2018, Rhodes, Greece. pp.261-272, ⟨10.1007/978-3-319-92007-8_23⟩. ⟨hal-01821052⟩
72 View
21 Download



Gmail Facebook X LinkedIn More