Kullback-Leibler-Quadratic Optimal Control in a Stochastic Environment - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2021

Kullback-Leibler-Quadratic Optimal Control in a Stochastic Environment


This paper presents advances in Kullback-Leibler-Quadratic (KLQ) optimal control: a stochastic control framework for Markovian models. The motivation is distributed control of large networked systems. The objective function is composed of a control cost in the form of Kullback-Leibler divergence plus a quadratic cost on the sequence of marginal distributions. With this choice of objective function, the optimal probability distribution of a population of agents over a finite time horizon is shown to be an exponential tilting of the nominal probability distribution. The same is true for the controlled transition matrices that induce the optimal probability distribution. However, one limitation of the previous work is that randomness can only be introduced via the control policy; all uncontrolled processes must be modeled as deterministic to render them immutable under an exponential tilting. In this work, only the controlled dynamics are subject to tilting, allowing for more general probabilistic models. Numerical experiments are conducted in the context of power networks. The distributed control techniques described in this paper can transform a large collection of flexible loads into a 'virtual battery' capable of delivering the same grid services as traditional batteries. Additionally, quality of service to the load owner is guaranteed, privacy is preserved, and computation and communication requirements are reduced, relative to alternative centralized control techniques.
Fichier principal
Vignette du fichier
CDC21_KLQ_final.pdf (510.83 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-03541774 , version 1 (24-01-2022)


  • HAL Id : hal-03541774 , version 1


Neil Cammardella, Ana Bušić, Sean Meyn. Kullback-Leibler-Quadratic Optimal Control in a Stochastic Environment. CDC 2021 - 60th IEEE conference on Decision and Control, Dec 2021, Austin (online), United States. ⟨hal-03541774⟩
60 View
113 Download


Gmail Mastodon Facebook X LinkedIn More