System Problem Detection by Mining Process Model from Console Logs - Inria - Institut national de recherche en sciences et technologies du numérique
Communication Dans Un Congrès Année : 2017

System Problem Detection by Mining Process Model from Console Logs

Jian Li
  • Fonction : Auteur
  • PersonId : 1027964
Jian Cao
  • Fonction : Auteur
  • PersonId : 968615

Résumé

Given the explosive growth of large-scale services, manually detecting problems from console logs is infeasible. In the current study, we propose a novel process mining algorithm to discover process model from console logs, and further use the obtained process model to detect anomalies. In brief, the console logs are first parsed into events, and the events from one single session are further grouped to event sequences. Then, a process model is mined from the event sequences to describe the main system behaviors. At last, we use the process model to detect anomalous log information. Experiments on Hadoop File System log dataset show that this approach can detect anomalies from log messages with high accuracy and few false positives. Compared with previously proposed automatic anomaly detection methods, our approach can provide intuitive and meaningful explanations to human operators as well as identify real problems accurately. Furthermore, the process model is easy to understand.
Fichier principal
Vignette du fichier
457609_1_En_16_Chapter.pdf (190.39 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01705438 , version 1 (09-02-2018)

Licence

Identifiants

Citer

Jian Li, Jian Cao. System Problem Detection by Mining Process Model from Console Logs. 14th IFIP International Conference on Network and Parallel Computing (NPC), Oct 2017, Hefei, China. pp.140-144, ⟨10.1007/978-3-319-68210-5_16⟩. ⟨hal-01705438⟩
119 Consultations
99 Téléchargements

Altmetric

Partager

More