mlsanityData to 14 Oct 2026

GeoRoute: Geometry-Aware Hybrid Inference for Traffic Future-Frame Prediction

arXiv 2608.09493 ↗First posted 10 Aug 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Long-horizon future-frame prediction is important for autonomous driving, traffic surveillance, and intelligent transportation systems, yet remains challenging due to temporal ghosting, geometry drift, and inconsistent object motion. Recent latent video diffusion models have achieved impressive visual quality, but directly applying them to structured traffic scenes often leads to unstable geometry and degraded temporal coherence over extended horizons. We present a training-free inference framework that stabilizes reliable static structure in pretrained video predictions through multi-frame temporal context and view-conditioned routing. For front-camera videos, our method refines generated futures with a multi-frame depth-layered renderer that projects static geometry from observed history frames while preserving dynamic regions from the generative base model. For heterogeneous traffic views, a frozen vision-language model infers a coarse camera group from the observed clip and selects a specialized motion-based predictor. The framework requires neither retraining nor fine-tuning of the underlying video model and can be applied directly to pretrained generators. We validate the proposed framework on the AI City Challenge Track 5 benchmark, where our final system achieves competitive performance among the top-ranked teams. These results demonstrate that geometry-aware inference-time refinement and view-conditioned hybrid inference can improve static-geometry stability and low-level structural fidelity without changing the original model architecture.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 38 of its 45 references that are in the map. First posted on arXiv 10 Aug 2026.

Builds on

38 of 45 references.

References · 38

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  5. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  6. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
  7. 2022Video Diffusion Modelscited by 2,305
  8. 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,161
  9. 2021Vision Transformers for Dense Predictioncited by 1,803
  10. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  11. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
  12. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
26 more
  1. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  2. 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,288
  3. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  4. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 727
  5. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 670
  6. 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
  7. 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
  8. 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 466
  9. 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
  10. 2015Unsupervised Learning of Video Representations using LSTMscited by 435
  11. 2019SynSin: End-to-end View Synthesis from a Single Imagecited by 364
  12. 2022MCVD: Masked Conditional Video Diffusion for Prediction, Generation, and Interpolationcited by 309
  13. 2020Softmax Splatting for Video Frame Interpolationcited by 279
  14. 2023Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translationcited by 253
  15. 2018Stochastic Video Generation with a Learned Priorcited by 245
  16. 2017Video Frame Synthesis using Deep Voxel Flowcited by 209
  17. 20203D Photography using Context-aware Layered Depth Inpaintingcited by 206
  18. 2016Deep Predictive Coding Networks for Video Prediction and Unsupervised Learningcited by 204
  19. 2022SimVP: Simpler yet Better Video Predictioncited by 184
  20. 2021PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive Learningcited by 182
  21. 2023VidToMe: Video Token Merging for Zero-Shot Video Editingcited by 113
  22. 2017Learning to Generate Long-term Future via Hierarchical Predictioncited by 88
  23. 2023FlowVid: Taming Imperfect Optical Flows for Consistent Video-to-Video Synthesiscited by 79
  24. 2017Dual Motion GAN for Future-Flow Embedded Video Predictioncited by 69
  25. 2022The 6th AI City Challengecited by 23
  26. 2024WTS: A Pedestrian-Centric Traffic Video Dataset for Fine-grained Spatial-Temporal Understandingcited by 17

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026JEPA Guided Diffusion: Predictive Vision-Language Conditioning for Generative Traffic Forecasting
  2. 2025EP-Diffuser: An Efficient Diffusion Model for Traffic Scene Generation and Prediction via Polynomial Representations
  3. 2026CosmosAlign: Adapting a World Foundation Model for Generative Traffic Video Forecasting
  4. 2026GeoFlow: Efficient Driving Video Generation via Geometry-Aligned Priors
  5. 2026VGGT-World: Transforming VGGT into an Autoregressive Geometry World Model
  6. 2026GeoWM: Efficient Direct World Modeling in Explicit Geometry
  7. 2026Representations Before Pixels: Semantics-Guided Hierarchical Video Prediction
  8. 2025Vision-LLMs for Spatiotemporal Traffic Forecasting