Evaluating Sequence Discovery Systems in an Abstraction-Aware Manner - Inria - Institut national de recherche en sciences et technologies du numérique
Conference Papers Year : 2018

Evaluating Sequence Discovery Systems in an Abstraction-Aware Manner

Eoin Rogers
  • Function : Author
  • PersonId : 1033482
Robert J. Ross
  • Function : Author
  • PersonId : 1033483
John D. Kelleher
  • Function : Author
  • PersonId : 1033484

Abstract

Activity discovery is a challenging machine learning problem where we seek to uncover new or altered behavioural patterns in sensor data. In this paper we motivate and introduce a novel approach to evaluating activity discovery systems. Pre-annotated ground truths, often used to evaluate the performance of such systems on existing datasets, may exist at different levels of abstraction to the output of the output produced by the system. We propose a method for detecting and dealing with this situation, allowing for useful ground truth comparisons. This work has applications for activity discovery, and also for related fields. For example, it could be used to evaluate systems intended for anomaly detection, intrusion detection, automated music transcription and potentially other applications.
Fichier principal
Vignette du fichier
467708_1_En_23_Chapter.pdf (267.35 Ko) Télécharger le fichier
Origin Files produced by the author(s)
Loading...

Dates and versions

hal-01821052 , version 1 (22-06-2018)

Licence

Identifiers

Cite

Eoin Rogers, Robert J. Ross, John D. Kelleher. Evaluating Sequence Discovery Systems in an Abstraction-Aware Manner. 14th IFIP International Conference on Artificial Intelligence Applications and Innovations (AIAI), May 2018, Rhodes, Greece. pp.261-272, ⟨10.1007/978-3-319-92007-8_23⟩. ⟨hal-01821052⟩
97 View
39 Download

Altmetric

Share

More