Envision4D: Envisioning Visual Futures via Feed-forward 4D Gaussian Splatting for Autonomous Driving
Not on the map. Why?
Abstract (arXiv)
Forecasting the future evolution of dynamic scenes is crucial in autonomous driving. However, existing feed-forward paradigms are primarily designed for interpolation. When extended to future extrapolation, they suffer from ghosting artifacts under large displacements and are constrained by simplified motion assumptions or strict future priors. To overcome these challenges, we propose Envision4D, a fully self-supervised feed-forward framework for pose-free future extrapolation. Specifically, we introduce a Future Pose Prediction module that infers future camera parameters via an iterative denoising process. Furthermore, to capture non-linear dynamics, we propose In-layer Temporal Attention and employ Conditioned Motion Lifting, which transforms the highly uncertain extrapolation process into robust relational mappings. Finally, a Progressive Training Strategy is utilized to stabilize unsupervised motion learning against error accumulation. Extensive experiments demonstrate that Envision4D achieves state-of-the-art performance, significantly outperforming existing methods in future view synthesis.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 56 of its 60 references that are in the map. First posted on arXiv 9 Jun 2026.
Builds on
56 of 60 references.
References · 56
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2022Video Diffusion Modelscited by 2,305
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
38 more
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
- 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 667
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 477
- 2023Splatter Image: Ultra-Fast Single-View 3D Reconstructioncited by 364
- 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllabilitycited by 347
- 2024DepthSplat: Connecting Gaussian Splatting and Depthcited by 286
- 2024gsplat: An Open-Source Library for Gaussian Splattingcited by 285
- 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 250
- 2024No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Imagescited by 248
- 2025AnySplat: Feed-forward 3D Gaussian Splatting from Unconstrained Viewscited by 243
- 2024Street Gaussians: Modeling Dynamic Urban Scenes with Gaussian Splattingcited by 221
- 2025World Simulation with Video Foundation Models for Physical AIcited by 200
- 2025ORION: A Holistic End-to-End Autonomous Driving Framework by Vision-Language Instructed Action Generationcited by 178
- 2025OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Modelcited by 176
- 2024OmniRe: Omni Urban Scene Reconstructioncited by 161
- 2023Periodic Vibration Gaussian: Dynamic Urban Scene Reconstruction and Real-time Renderingcited by 143
- 2025Video World Models with Long-term Spatial Memorycited by 136
- 2025Epona: Autoregressive Diffusion World Model for Autonomous Drivingcited by 117
- 2024textitS3Gaussian: Self-Supervised Street Gaussians for Autonomous Drivingcited by 105
- 2025Geometry Forcing: Marrying Video Diffusion and 3D Representation for Consistent World Modelingcited by 96
- 2025Back to the Features: DINO as a Foundation for Video World Modelscited by 58
- 2024STORM: Spatio-Temporal Reconstruction Model for Large-Scale Outdoor Scenescited by 55
- 2024Feed-Forward Bullet-Time Reconstruction of Dynamic Scenes from Monocular Videoscited by 49
- 2024StreetCrafter: Street View Synthesis with Controllable Video Diffusion Modelscited by 49
- 20254DGT: Learning a 4D Gaussian Transformer Using Real-World Monocular Videoscited by 49
- 2026NeoVerse: Enhancing 4D World Model with in-the-wild Monocular Videoscited by 46
- 2024DINO-Foresight: Looking into the Future with DINOcited by 45
- 2025FantasyWorld: Geometry-Consistent World Modeling via Unified Video and 3D Predictioncited by 38
- 2025MoVieS: Motion-Aware 4D Dynamic View Synthesis in One Secondcited by 35
- 2026V-DPM: 4D Video Reconstruction with Dynamic Point Mapscited by 34
- 2026Gen3R: 3D Scene Generation Meets Feed-Forward Reconstructioncited by 31
- 2024Driv3R: Learning Dense 4D Reconstruction for Autonomous Drivingcited by 29
- 2025VGGT4D: Mining Motion Cues in Visual Geometry Transformers for 4D Scene Reconstructioncited by 28
- 2025DGGT: Feedforward 4D Reconstruction of Dynamic Driving Scenes using Unposed Imagescited by 24
- 2024GGRt: Towards Pose-free Generalizable 3D Gaussian Splatting in Real-timecited by 20
- 2026VGGT-World: Transforming VGGT into an Autoregressive Geometry World Modelcited by 13
- 2025Flux4D: Flow-based Unsupervised 4D Reconstructioncited by 9
50 most cited of 56 All 56 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.