Leveraging Proximal Optimization for Differentiating Optimal Control Solvers - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2023

Leveraging Proximal Optimization for Differentiating Optimal Control Solvers

Abstract

Over the past few years, differentiable optimization has gained in maturity and attractivity within both machine learning and robotics communities. It consists in computing the derivatives of a given optimization problem which can then be used by learning algorithms, and enables to generically plug computational blocks reflecting the solving of generic mathematical programming problems into a learning pipeline. Until now, dedicated approaches have been proposed to compute the derivatives of various types of optimization problems (LPs, QPs, SOCPs, etc.). However, these approaches assume the problems are well-posed (e.g., satisfaction of the linearly independent constraint qualifications), limiting de facto their application to ill-posed problems. In this work, we focus on the differentiation of optimal control solvers widely used in robotics. We notably introduce a differentiable proximal formulation for solving equality-constrained LQR problems that is effective in solving ill-posed and rank-deficient problems accurately. Importantly, we show that this proximal formulation allows us to compute accurate gradients even in the case of ill-posed problems which do not satisfy the classical constraints qualification. Because any optimal control problem can be casted as an equalityconstrained LQR problem in the vicinity of the optimal solution, ours robust LQR derivatives computation can then be exploited to obtain the derivatives of general optimal control problems. We demonstrate the effectiveness of our approach in dynamics learning and system parameters identification experiments in linear optimal control problems.
Fichier principal
Vignette du fichier
CDC23_CDC23_cdc_camera_ready3.pdf (903.01 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-03786820 , version 1 (23-09-2022)
hal-03786820 , version 2 (17-05-2024)

Licence

Identifiers

  • HAL Id : hal-03786820 , version 2

Cite

Oumayma Bounou, Jean Ponce, Justin Carpentier. Leveraging Proximal Optimization for Differentiating Optimal Control Solvers. IEEE 62nd Conference on Decision and Control (CDC), Dec 2023, Singapore, Singapore. ⟨hal-03786820v2⟩
232 View
341 Download

Share

Gmail Mastodon Facebook X LinkedIn More