CAMUS: A Framework to Build Formal Specifications for Deep Perception Systems Using Simulators - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2020

CAMUS: A Framework to Build Formal Specifications for Deep Perception Systems Using Simulators

Abstract

The topic of provable deep neural network robustness has raised considerable interest in recent years. Most research has focused on adversarial robustness, which studies the robustness of perceptive models in the neighbourhood of particular samples. However, other works have proved global properties of smaller neural networks. Yet, formally verifying perception remains uncharted. This is due notably to the lack of relevant properties to verify, as the distribution of possible inputs cannot be formally specified. We propose to take advantage of the simulators often used either to train machine learning models or to check them with statistical tests, a growing trend in industry. Our formulation allows us to formally express and verify safety properties on perception units, covering all cases that could ever be generated by the simulator, to the difference of statistical tests which cover only seen examples. Along with this theoretical formulation , we provide a tool to translate deep learning models into standard logical formulae. As a proof of concept, we train a toy example mimicking an autonomous car perceptive unit, and we formally verify that it will never fail to capture the relevant information in the provided inputs.
Fichier principal
Vignette du fichier
main.pdf (597.02 Ko) Télécharger le fichier
Origin Files produced by the author(s)
Loading...

Dates and versions

hal-02440520 , version 1 (04-11-2020)

Identifiers

  • HAL Id : hal-02440520 , version 1

Cite

Julien Girard-Satabin, Guillaume Charpiat, Zakaria Chihani, Marc Schoenauer. CAMUS: A Framework to Build Formal Specifications for Deep Perception Systems Using Simulators. ECAI 2020 - 24th European Conference on Artificial Intelligence, Jun 2020, Santiago de Compostela, Spain. ⟨hal-02440520⟩
283 View
314 Download

Share

Gmail Mastodon Facebook X LinkedIn More