Driving from Vision through Differentiable Optimal Control
This repository complements the main paper "Driving from Vision through Differentiable Optimal Control" presented at IROS 2024, to enhance the transparency and reproducibility of the research presented. ArXiv preprint YouTube Video
This paper proposes DriViDOC: a framework for Driving from Vision through Differentiable Optimal Control, and its application to learn autonomous driving controllers from human demonstrations. DriViDOC combines the automatic inference of relevant features from camera frames with the properties of nonlinear model predictive control (NMPC), such as constraint satisfaction. Our approach leverages the differentiability of parametric NMPC, allowing for end-to-end learning of the driving model from images to control. The model is trained on an offline dataset comprising various human demonstrations collected on a motion-base driving simulator. During online testing, the model demonstrates successful imitation of different driving styles, and the interpreted NMPC parameters provide insights into the achievement of specific driving behaviors. Our experimental results show that DriViDOC outperforms other methods involving NMPC and neural networks, exhibiting an average improvement of 20% in imitation scores.
- Flavia Sofia Acerbo (Siemens Digital Industries Software, KU Leuven)
- Jan Swevers (KU Leuven)
- Tinne Tuytelaars (KU Leuven)
- Son Tong (Siemens Digital Industries Software)