mlsanityData to 14 Oct 2026

Envision4D: Envisioning Visual Futures via Feed-forward 4D Gaussian Splatting for Autonomous Driving

arXiv 2606.10656 ↗First posted 9 Jun 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Forecasting the future evolution of dynamic scenes is crucial in autonomous driving. However, existing feed-forward paradigms are primarily designed for interpolation. When extended to future extrapolation, they suffer from ghosting artifacts under large displacements and are constrained by simplified motion assumptions or strict future priors. To overcome these challenges, we propose Envision4D, a fully self-supervised feed-forward framework for pose-free future extrapolation. Specifically, we introduce a Future Pose Prediction module that infers future camera parameters via an iterative denoising process. Furthermore, to capture non-linear dynamics, we propose In-layer Temporal Attention and employ Conditioned Motion Lifting, which transforms the highly uncertain extrapolation process into robust relational mappings. Finally, a Progressive Training Strategy is utilized to stabilize unsupervised motion learning against error accumulation. Extensive experiments demonstrate that Envision4D achieves state-of-the-art performance, significantly outperforming existing methods in future view synthesis.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 56 of its 60 references that are in the map. First posted on arXiv 9 Jun 2026.

Builds on

56 of 60 references.

References · 56

  1. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  2. 2022Scalable Diffusion Models with Transformerscited by 6,054
  3. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  4. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  5. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  6. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  7. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
  8. 2022Video Diffusion Modelscited by 2,305
  9. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  10. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  11. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
  12. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
38 more
  1. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
  2. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
  3. 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 667
  4. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 477
  5. 2023Splatter Image: Ultra-Fast Single-View 3D Reconstructioncited by 364
  6. 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllabilitycited by 347
  7. 2024DepthSplat: Connecting Gaussian Splatting and Depthcited by 286
  8. 2024gsplat: An Open-Source Library for Gaussian Splattingcited by 285
  9. 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 250
  10. 2024No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Imagescited by 248
  11. 2025AnySplat: Feed-forward 3D Gaussian Splatting from Unconstrained Viewscited by 243
  12. 2024Street Gaussians: Modeling Dynamic Urban Scenes with Gaussian Splattingcited by 221
  13. 2025World Simulation with Video Foundation Models for Physical AIcited by 200
  14. 2025ORION: A Holistic End-to-End Autonomous Driving Framework by Vision-Language Instructed Action Generationcited by 178
  15. 2025OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Modelcited by 176
  16. 2024OmniRe: Omni Urban Scene Reconstructioncited by 161
  17. 2023Periodic Vibration Gaussian: Dynamic Urban Scene Reconstruction and Real-time Renderingcited by 143
  18. 2025Video World Models with Long-term Spatial Memorycited by 136
  19. 2025Epona: Autoregressive Diffusion World Model for Autonomous Drivingcited by 117
  20. 2024textitS3Gaussian: Self-Supervised Street Gaussians for Autonomous Drivingcited by 105
  21. 2025Geometry Forcing: Marrying Video Diffusion and 3D Representation for Consistent World Modelingcited by 96
  22. 2025Back to the Features: DINO as a Foundation for Video World Modelscited by 58
  23. 2024STORM: Spatio-Temporal Reconstruction Model for Large-Scale Outdoor Scenescited by 55
  24. 2024Feed-Forward Bullet-Time Reconstruction of Dynamic Scenes from Monocular Videoscited by 49
  25. 2024StreetCrafter: Street View Synthesis with Controllable Video Diffusion Modelscited by 49
  26. 20254DGT: Learning a 4D Gaussian Transformer Using Real-World Monocular Videoscited by 49
  27. 2026NeoVerse: Enhancing 4D World Model with in-the-wild Monocular Videoscited by 46
  28. 2024DINO-Foresight: Looking into the Future with DINOcited by 45
  29. 2025FantasyWorld: Geometry-Consistent World Modeling via Unified Video and 3D Predictioncited by 38
  30. 2025MoVieS: Motion-Aware 4D Dynamic View Synthesis in One Secondcited by 35
  31. 2026V-DPM: 4D Video Reconstruction with Dynamic Point Mapscited by 34
  32. 2026Gen3R: 3D Scene Generation Meets Feed-Forward Reconstructioncited by 31
  33. 2024Driv3R: Learning Dense 4D Reconstruction for Autonomous Drivingcited by 29
  34. 2025VGGT4D: Mining Motion Cues in Visual Geometry Transformers for 4D Scene Reconstructioncited by 28
  35. 2025DGGT: Feedforward 4D Reconstruction of Dynamic Driving Scenes using Unposed Imagescited by 24
  36. 2024GGRt: Towards Pose-free Generalizable 3D Gaussian Splatting in Real-timecited by 20
  37. 2026VGGT-World: Transforming VGGT into an Autoregressive Geometry World Modelcited by 13
  38. 2025Flux4D: Flow-based Unsupervised 4D Reconstructioncited by 9

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.