Using Multimodal Contextual Process Information for the Supervised Detection of Connector Lock Events - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2020

Using Multimodal Contextual Process Information for the Supervised Detection of Connector Lock Events

David Bricher
  • Fonction : Auteur
  • PersonId : 1245228
Andreas Müller
  • Fonction : Auteur
  • PersonId : 1245229

Résumé

The field of sound event detection is a growing sector which has mainly focused on the identification of sound classes from daily life situations. In most cases these sound detection models are trained on publicly available sound databases, up to now, however, they do not include acoustic data from manufacturing environments. Within manufacturing industries, acoustic data can be exploited in order to evaluate the correct execution of assembling processes. As an example, in this paper the correct plugging of connectors is analyzed on the basis of multimodal contextual process information. The latter are the connector’s acoustic properties and visual information recorded in form of video files while executing connector locking processes.For the first time optical microphones are used for the acquisition and analysis of connector sound data in order to differentiate connector locking sounds from each other respectively from background noise and sound events with similar acoustic properties. Therefore, different types of feature representations as well as neural network architectures are investigated for this specific task.The results from the proposed analysis show, that multimodal approaches clearly outperform unimodal neural network architectures for the task of connector locking validation by reaching maximal accuracy levels close to 85$$\%$$. Since in many cases there are no additional validation methods applied for the detection of correctly locked connectors in manufacturing industries, it is concluded that the proposed connector lock event detection framework is a significant improvement for the qualitative validation of plugging operations.
Fichier principal
Vignette du fichier
500087_1_En_11_Chapter.pdf (946.94 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04060655 , version 1 (06-04-2023)

Licence

Paternité

Identifiants

Citer

David Bricher, Andreas Müller. Using Multimodal Contextual Process Information for the Supervised Detection of Connector Lock Events. 16th IFIP International Conference on Artificial Intelligence Applications and Innovations (AIAI), Jun 2020, Neos Marmaras, Greece. pp.123-134, ⟨10.1007/978-3-030-49186-4_11⟩. ⟨hal-04060655⟩
14 Consultations
5 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More