mlsanityData to 14 Oct 2026

Extended Field of View Analysis for VideoGAN-based Trajectory Generation

arXiv 2608.02289 ↗First posted 3 Aug 2026cs.CV cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Realistic and diverse trajectory generation is central to enabling higher levels of vehicle automation. While rule-based and classical learning-based methods may struggle to capture the complexity of traffic behavior, generative models have already demonstrated in other fields that they can handle a comparable level of complexity. In this paper, we build upon previous work on generative adversarial network (GAN)-based semantic bird's-eye-view traffic generation and extend the proposed framework in several key aspects. We improve the semantic representation, replace the trajectory extraction procedure with a graph-based association method, and systematically investigate increasingly larger fields of view. In addition, we introduce a quantitative evaluation framework to assess hallucinations and object permanence in generated videos. Our experiments demonstrate that the framework generalizes to larger and more complex traffic scenes while maintaining statistically realistic trajectories and coherent spatial relationships between traffic participants. Within 150GPU hours of training and with inference times below 20ms for scenes of up to 20s, our results demonstrate that video-based GANs remain an efficient and scalable approach for realistic trajectory generation, even in substantially larger traffic scenes, making them well suited for downstream tasks such as prediction, planning, and simulation in automated driving.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 46 references that are in the map. First posted on arXiv 3 Aug 2026.

Builds on

31 of 46 references.

References · 31

  1. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  2. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
  3. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  4. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  5. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  6. 2019A Survey of Deep Learning Techniques for Autonomous Drivingcited by 403
  7. 2022ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learningcited by 368
  8. 2022Motion Transformer with Global Intention Localization and Local Movement Refinementcited by 270
  9. 2021FIERY: Future Instance Prediction in Bird's-Eye View from Surround Monocular Camerascited by 239
  10. 2022Stochastic Trajectory Prediction via Motion Indeterminacy Diffusioncited by 185
  11. 2021HOME: Heatmap Output for future Motion Estimationcited by 122
  12. 2024FasterCache: Training-Free Video Diffusion Model Acceleration with High Qualitycited by 122
19 more
  1. 2022Generating Long Videos of Dynamic Scenescited by 113
  2. 2022HDGT: Heterogeneous Driving Graph Transformer for Multi-Agent Trajectory Prediction via Scene Encodingcited by 110
  3. 2020MotionNet: Joint Perception and Motion Prediction for Autonomous Driving Based on Bird's Eye View Mapscited by 100
  4. 2021LookOut: Diverse Multi-Future Prediction and Planning for Self-Drivingcited by 96
  5. 2020TPNet: Trajectory Proposal Network for Motion Predictioncited by 80
  6. 2024OccSora: 4D Occupancy Generation Models as World Simulators for Autonomous Drivingcited by 78
  7. 2018Deep Imitative Models for Flexible Inference, Planning, and Controlcited by 76
  8. 2022Occupancy Flow Fields for Motion Forecasting in Autonomous Drivingcited by 62
  9. 2023Leveraging Future Relationship Reasoning for Vehicle Trajectory Predictioncited by 48
  10. 2024Efficient Video Diffusion Models via Content-Frame Motion-Latent Decompositioncited by 42
  11. 2019Scene Compliant Trajectory Forecast with Agent-Centric Spatio-Temporal Gridscited by 24
  12. 2023Machine Learning for Autonomous Vehicle's Trajectory Prediction: A comprehensive survey, Challenges, and Future Research Directionscited by 23
  13. 2025Generative Models in Decision Making: A Surveycited by 15
  14. 2021Vision-based Driver Assistance Systems: Survey, Taxonomy and Advancescited by 10
  15. 2023Kinematics-aware Trajectory Generation and Prediction with Latent Stochastic Differential Modelingcited by 5
  16. 2023Beyond 1D and oversimplified kinematics: A generic analytical framework for surrogate safety measurescited by 3
  17. 2025Fine-Grained Behavior and Lane Constraints Guided Trajectory Prediction Methodcited by 3
  18. 2025Generative AI for Autonomous Driving: A Reviewcited by 3
  19. 2025VideoGAN-based Trajectory Proposal for Automated Vehiclescited by 1

Built on by

Not cited yet.