Article Dans Une Revue IEEE Robotics and Automation Letters Année : 2026

TD-CD-MPPI: Temporal-Difference Constraint-Discounted Model Predictive Path Integral Control

Résumé

Path Integral methods have demonstrated remarkable capabilities for solving non-linear stochastic optimal control problems through sampling-based optimization. However, their computational complexity grows linearly with the prediction horizon, limiting long-term reasoning, while constraints are merely enforced through handcrafted penalties.

In this work, we propose a unified and efficient framework for enabling long-horizon reasoning and constraint enforcement within Model Predictive Path Integral (MPPI) control. First, we introduce a practical method to incorporate a terminal value function, learned offline via temporal-difference learning, to approximate the long-term cost-to-go. This allows for significantly shorter roll-outs while enabling infinite-horizon reasoning, thereby improving computational efficiency and motion performance. Second, we propose a discount modulation strategy that adjusts the return of sampled trajectories based on constraint violations. This provides a more interpretable and effective mechanism for enforcing constraints compared to traditional cost shaping. Our formulation retains the flexibility and sampling efficiency of MPPI while supporting structured integration of long-term objectives and constraint handling. We validate our approach on both simulated and real-world robotic locomotion tasks, demonstrating improved performance, constraint-awareness, and generalization under reduced computational budgets.

Fichier principal
Vignette du fichier
TD_CD_MPPI_v2.pdf (8.25 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence

Dates et versions

hal-05213269 , version 1 (18-08-2025)
hal-05213269 , version 2 (21-10-2025)

Licence

Identifiants

Citer

Pietro Noah Crestaz, Ludovic de Matteis, Elliot Chane-Sane, Nicolas Mansard, Andrea del Prete. TD-CD-MPPI: Temporal-Difference Constraint-Discounted Model Predictive Path Integral Control. IEEE Robotics and Automation Letters, 2026, 11 (1), pp.498-505. ⟨10.1109/LRA.2025.3632612⟩. ⟨hal-05213269v2⟩
1736 Consultations
1129 Téléchargements

Altmetric

Partager

  • More