mlsanityData to 14 Oct 2026

Adapting Generalist Vehicle Models for High-Speed MPC Across Terrains

arXiv 2607.13319 ↗First posted 14 Jul 2026cs.RO cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

High-speed off-road autonomy requires precise closed-loop control for a target vehicle while remaining robust across changing terrains. Recent forward kinodynamic (FKD) prediction foundation models suggest a promising path, starting from a generalist model and specializing it to the target platform. However, effective specialization remains challenging, as it often requires substantial real-world data, and models adapted to one setting can still overfit to specific terrains or driving regimes. We present OptCar (Optimized Car), a recipe for bridging the gap from generalist to specialist FKD models that preserves cross-terrain generalization while optimizing performance for a specific vehicle. OptCar introduces a transformer FKD architecture that uses FiLM to condition multi-step predictions on a single dynamics context token summarizing recent state-action history. It then specializes the generalist model using limited real-world data and targeted synthetic rollouts from environment-specific system identification. In closed-loop model predictive control (MPC) experiments across three terrains and an out-of-distribution cart-pulling task, the largest gains appear at 6 m/s, the highest speed evaluated and the regime in which slip dominates tracking error. On vegetation + dirt, the most slip-diverse terrain, OptCar reduces 6 m/s trajectory tracking error by roughly 55% relative to AnyCar fine-tuned on real data alone, and remains the most accurate even when an unseen cart payload changes the dynamics. With 5 minutes of real data per terrain, OptCar is competitive on road with a specialist trained on 30 minutes of road data and outperforms it when the terrain changes.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 34 references that are in the map. First posted on arXiv 14 Jul 2026.

Builds on

28 of 34 references.

References · 28

  1. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  2. 2016End to End Learning for Self-Driving Carscited by 1,009
  3. 2021RMA: Rapid Motor Adaptation for Legged Robotscited by 508
  4. 2018Closing the Sim-to-Real Loop: Adapting Simulation Randomization with Real World Experiencecited by 217
  5. 2017Preparing for the Unknown: Learning a Universal Policy with Online System Identificationcited by 141
  6. 2015Model Predictive Path Integral Control using Covariance Variable Importance Samplingcited by 124
  7. 2020Context-aware Dynamics Model for Generalization in Model-Based Reinforcement Learningcited by 98
  8. 2017Information Theoretic Model Predictive Control: Theory and Applications to Autonomous Drivingcited by 90
  9. 2019BayesSim: adaptive domain randomization via probabilistic inference for robotics simulatorscited by 85
  10. 2022Neural-Fly Enables Rapid Learning for Agile Flight in Strong Windscited by 85
  11. 2020Data-efficient Domain Randomization with Bayesian Optimizationcited by 47
  12. 2021Super Odometry: IMU-centric LiDAR-Visual-Inertial Estimator for Challenging Environmentscited by 26
16 more
  1. 2021Learning Inverse Kinodynamics for Accurate High-Speed Off-Road Navigation on Unstructured Terraincited by 25
  2. 2022VI-IKD: High-Speed Accurate Off-Road Navigation using Learned Visual-Inertial Inverse Kinodynamicscited by 21
  3. 2021Robust Model Predictive Path Integral Control: Analysis and Performance Guaranteescited by 17
  4. 2023DATT: Deep Adaptive Trajectory Tracking for Quadrotor Controlcited by 16
  5. 2024AnyCar to Anywhere: Learning Universal Dynamics Model for Agile and Adaptive Mobilitycited by 13
  6. 2023A Multi-step Dynamics Modeling Framework For Autonomous Driving In Multiple Environmentscited by 9
  7. 2023Learning Terrain-Aware Kinodynamic Model for Autonomous Off-Road Rally Driving With Model Predictive Path Integral Controlcited by 8
  8. 2023Autonomous Drifting with 3 Minutes of Data via Learned Tire Modelscited by 7
  9. 2023Adaptive Planning and Control with Time-Varying Tire Models for Autonomous Racing Using Extreme Learning Machinecited by 5
  10. 2023Learning Model Predictive Control with Error Dynamics Regression for Autonomous Racingcited by 5
  11. 2023Pay Attention to How You Drive: Safe and Adaptive Model-Based Reinforcement Learning for Off-Road Drivingcited by 5
  12. 2024Learning-Based On-Track System Identification for Scaled Autonomous Racing in Under a Minutecited by 5
  13. 2023A Tricycle Model to Accurately Control an Autonomous Racecar with Locked Differentialcited by 4
  14. 2025Meta-Learning Online Dynamics Model Adaptation in Off-Road Autonomous Drivingcited by 3
  15. 2024Online Adaptation of Learned Vehicle Dynamics Model with Meta-Learning Approachcited by 2
  16. 2025Beyond Constant Parameters: Hyper Prediction Models and HyperMPCcited by 1

Built on by

Not cited yet.