Efficient Virtuoso: A Latent Diffusion Transformer Model for Goal-Conditioned Trajectory Planning
On the map: Diffusion models → Diffusion and flow policies for robotics
Abstract (arXiv)
The ability to generate a diverse and plausible distribution of future trajectories is a critical capability for autonomous vehicle planning systems. While recent generative models have shown promise, achieving high fidelity, computational efficiency, and precise control remains a significant challenge. In this paper, we present the Efficient Virtuoso, a conditional latent diffusion model for goal-conditioned trajectory planning. Our approach introduces a novel two-stage normalization pipeline that first scales trajectories to preserve their geometric aspect ratio and then normalizes the resulting PCA latent space to ensure a stable training target. The denoising process is performed efficiently in this low-dimensional latent space by a simple MLP denoiser, which is conditioned on a rich scene context fused by a powerful Transformer-based StateEncoder. We demonstrate that our method achieves state-of-the-art performance on the Waymo Open Motion Dataset, achieving a minimum Average Displacement Error (minADE) of 0.25. Furthermore, through a rigorous ablation study on goal representation, we provide a key insight: while a single endpoint goal can resolve strategic ambiguity, a richer, multi-step sparse route is essential for enabling the precise, high-fidelity tactical execution that mirrors nuanced human driving behavior.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Diffusion and flow policies for robotics, one of 14 directions in Diffusion models. Builds on 18 of its 19 references that are in the map. First posted on arXiv 3 Sep 2025.
Builds on
18 of 19 references.
Closest ancestors · 1
Same direction, newest first
Other references · 17
- 2017Attention Is All You Needcited by 60,361
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 690
- 2021Large Scale Interactive Motion Forecasting for Autonomous Driving : The Waymo Open Motion Datasetcited by 537
- 2019MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Predictioncited by 420
- 2021DenseTNT: End-to-end Trajectory Prediction from Dense Goal Setscited by 295
- 2022Wayformer: Motion Forecasting via Simple & Efficient Attention Networkscited by 280
- 2021MultiPath++: Efficient Information Fusion and Trajectory Aggregation for Behavior Predictioncited by 246
- 2023MotionDiffuser: Controllable Multi-Agent Motion Prediction using Diffusioncited by 213
- 2022Stochastic Trajectory Prediction via Motion Indeterminacy Diffusioncited by 185
5 more
- 2021Scene Transformer: A unified architecture for predicting multiple agent trajectoriescited by 165
- 2021FloMo: Tractable Motion Prediction with Normalizing Flowscited by 21
- 2025From Imitation to Optimization: A Comparative Study of Offline Learning for Autonomous Drivingcited by 4
- 2023SIMMF: Semantics-aware Interactive Multiagent Motion Forecasting for Autonomous Vehicle Drivingcited by 2
- 2025Mining the Long Tail: A Comparative Study of Data-Centric Criticality Metrics for Robust Offline Reinforcement Learning in Autonomous Motion Planningcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025LAP: Fast LAtent Diffusion Planner for Autonomous Driving
- 2024Intention-aware Denoising Diffusion Model for Trajectory Prediction
- 2024Diffusion-ES: Gradient-free Planning with Diffusion for Autonomous Driving and Zero-Shot Instruction Following
- 2026Muninn: Your Trajectory Diffusion Model But Faster
- 2023Motion Planning Diffusion: Learning and Planning of Robot Motions with Diffusion Models
- 2025DiffRefiner: Coarse to Fine Trajectory Planning via Diffusion Refinement with Semantic Interaction for End to End Autonomous Driving
- 2024Denoising Diffusion Planner: Learning Complex Paths from Low-Quality Demonstrations
- 2026Temporally Decoupled Diffusion Planning for Autonomous Driving