GeoRoute: Geometry-Aware Hybrid Inference for Traffic Future-Frame Prediction
Not on the map. Why?
Abstract (arXiv)
Long-horizon future-frame prediction is important for autonomous driving, traffic surveillance, and intelligent transportation systems, yet remains challenging due to temporal ghosting, geometry drift, and inconsistent object motion. Recent latent video diffusion models have achieved impressive visual quality, but directly applying them to structured traffic scenes often leads to unstable geometry and degraded temporal coherence over extended horizons. We present a training-free inference framework that stabilizes reliable static structure in pretrained video predictions through multi-frame temporal context and view-conditioned routing. For front-camera videos, our method refines generated futures with a multi-frame depth-layered renderer that projects static geometry from observed history frames while preserving dynamic regions from the generative base model. For heterogeneous traffic views, a frozen vision-language model infers a coarse camera group from the observed clip and selects a specialized motion-based predictor. The framework requires neither retraining nor fine-tuning of the underlying video model and can be applied directly to pretrained generators. We validate the proposed framework on the AI City Challenge Track 5 benchmark, where our final system achieves competitive performance among the top-ranked teams. These results demonstrate that geometry-aware inference-time refinement and view-conditioned hybrid inference can improve static-geometry stability and low-level structural fidelity without changing the original model architecture.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 38 of its 45 references that are in the map. First posted on arXiv 10 Aug 2026.
Builds on
38 of 45 references.
References · 38
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2022Video Diffusion Modelscited by 2,305
- 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,161
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
26 more
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,288
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 727
- 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 670
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
- 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
- 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 466
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
- 2015Unsupervised Learning of Video Representations using LSTMscited by 435
- 2019SynSin: End-to-end View Synthesis from a Single Imagecited by 364
- 2022MCVD: Masked Conditional Video Diffusion for Prediction, Generation, and Interpolationcited by 309
- 2020Softmax Splatting for Video Frame Interpolationcited by 279
- 2023Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translationcited by 253
- 2018Stochastic Video Generation with a Learned Priorcited by 245
- 2017Video Frame Synthesis using Deep Voxel Flowcited by 209
- 20203D Photography using Context-aware Layered Depth Inpaintingcited by 206
- 2016Deep Predictive Coding Networks for Video Prediction and Unsupervised Learningcited by 204
- 2022SimVP: Simpler yet Better Video Predictioncited by 184
- 2021PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive Learningcited by 182
- 2023VidToMe: Video Token Merging for Zero-Shot Video Editingcited by 113
- 2017Learning to Generate Long-term Future via Hierarchical Predictioncited by 88
- 2023FlowVid: Taming Imperfect Optical Flows for Consistent Video-to-Video Synthesiscited by 79
- 2017Dual Motion GAN for Future-Flow Embedded Video Predictioncited by 69
- 2022The 6th AI City Challengecited by 23
- 2024WTS: A Pedestrian-Centric Traffic Video Dataset for Fine-grained Spatial-Temporal Understandingcited by 17
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026The 10th AI City Challengecited by 8
- 2026The 10th AI City Challenge17 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026JEPA Guided Diffusion: Predictive Vision-Language Conditioning for Generative Traffic Forecasting
- 2025EP-Diffuser: An Efficient Diffusion Model for Traffic Scene Generation and Prediction via Polynomial Representations
- 2026CosmosAlign: Adapting a World Foundation Model for Generative Traffic Video Forecasting
- 2026GeoFlow: Efficient Driving Video Generation via Geometry-Aligned Priors
- 2026VGGT-World: Transforming VGGT into an Autoregressive Geometry World Model
- 2026GeoWM: Efficient Direct World Modeling in Explicit Geometry
- 2026Representations Before Pixels: Semantics-Guided Hierarchical Video Prediction
- 2025Vision-LLMs for Spatiotemporal Traffic Forecasting