Bidirectional Reactive Programming for Machine Learning - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Preprints, Working Papers, ... (Preprint) Year : 2023

Bidirectional Reactive Programming for Machine Learning

Abstract

Reactive languages are dedicated to the programming of systems which interact continuously and concurrently with their environment. Values take the form of unbounded streams modeling the (discrete) passing of time or the sequence of concurrent interactions. While conventional reactivity models recurrences forward in time, we introduce a symmetric reactive construct enabling backward recurrences. Constraints on the latter allow to make the implementation practical. Machine Learning (ML) systems provide numerous motivations for all of this: we demonstrate that reverse-mode automatic differentiation, backpropagation, batch normalization, bidirectional recurrent neural networks, training and reinforcement learning algorithms, are all naturally captured as bidirectional reactive programs.
Fichier principal
Vignette du fichier
2311.16977.pdf (521.72 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Licence : CC BY NC ND - Attribution - NonCommercial - NoDerivatives

Dates and versions

hal-04354071 , version 1 (19-12-2023)

Licence

Attribution - NonCommercial - NoDerivatives

Identifiers

Cite

Dumitru Potop-Butucaru, Albert Cohen, Gordon Plotkin, Hugo Pompougnac. Bidirectional Reactive Programming for Machine Learning. 2023. ⟨hal-04354071⟩
43 View
14 Download

Altmetric

Share

Gmail Facebook X LinkedIn More