FRUC: Feedforward Dynamic Scene Reconstruction from Uncalibrated Collaborative Driving Views
Not on the map. Why?
Abstract (arXiv)
We present FRUC, a feedforward 3D Gaussian Splatting framework for dynamic scene reconstruction from uncalibrated collaborative driving views. Existing multi-agent reconstruction frameworks are often hindered by rigid prerequisites, demanding precise spatial calibration and slow per-scene optimization. In this paper, we rethink this task by conceptualizing a distributed multi-vehicle network as a spatio-temporally unstructured ego-centric multi-camera system, where the core challenge lies in enhancing ego-centric occluded geometry through collaboration without degrading the ego's accurately observed visible geometry, while preserving reconstruction efficiency. For efficient reconstruction, FRUC is built upon a visual grounded geometric Transformer backbone to enable one-shot, calibration-free inference from a flexible number of multi-vehicle views. To achieve non-destructive geometric supplementation under uncalibrated cross-agent misalignment, FRUC first introduces an ego-centric causal occlusion field that explicitly derives occlusion evolution as latent priors by modeling agent-wise spatio-temporal correlations. Guided by these occlusion priors, it further formulates cross-agent integration as a deterministic residual denoising process via zero-initialized injection, turning challenging cross-agent fusion into bounded residual learning for robust collaborative blind-spot completion. Through extensive evaluations on real-world V2X-Real and UrbanIng-V2X datasets, FRUC is shown to be a new state-of-the-art for the scene reconstruction of dynamic collaborative driving environments, significantly outperforming existing methods in both rendering quality and efficiency. Code is available at https://github.com/yihangtao/FRUC.git.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 40 of its 48 references that are in the map. First posted on arXiv 28 May 2026.
Builds on
40 of 48 references.
References · 40
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,299
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 684
28 more
- 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 566
- 2023Splatter Image: Ultra-Fast Single-View 3D Reconstructioncited by 364
- 2023DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving Scenescited by 360
- 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 349
- 2021OPV2V: An Open Benchmark Dataset and Fusion Pipeline for Perception with Vehicle-to-Vehicle Communicationcited by 304
- 2022Where2comm: Communication-Efficient Collaborative Perception via Spatial Confidence Mapscited by 255
- 2025AnySplat: Feed-forward 3D Gaussian Splatting from Unconstrained Viewscited by 243
- 2022Tensor4D : Efficient Neural 4D Decomposition for High-fidelity Dynamic Reconstruction and Renderingcited by 217
- 2023EmerNeRF: Emergent Spatial-Temporal Scene Decomposition via Self-Supervisioncited by 217
- 2021Learning Distilled Collaboration Graph for Multi-Agent Perceptioncited by 194
- 2023SparseGS: Sparse View Synthesis using 3D Gaussian Splattingcited by 134
- 2024OneRestore: A Universal Restoration Framework for Composite Degradationcited by 92
- 2024STORM: Spatio-Temporal Reconstruction Model for Large-Scale Outdoor Scenescited by 55
- 2024DrivingForward: Feed-forward 3D Gaussian Splatting for Driving Scene Reconstruction from Flexible Surround-view Inputcited by 53
- 2024FreeSim: Toward Free-viewpoint Camera Simulation in Driving Scenescited by 30
- 2024DrivingRecon: Large 4D Gaussian Reconstruction Model For Autonomous Drivingcited by 29
- 2025DGGT: Feedforward 4D Reconstruction of Dynamic Driving Scenes using Unposed Imagescited by 24
- 2025DVGT: Driving Visual Geometry Transformercited by 21
- 2024PACP: Priority-Aware Collaborative Perception for Connected and Autonomous Vehiclescited by 17
- 2025UrbanIng-V2X: A Large-Scale Multi-Vehicle, Multi-Infrastructure Dataset Across Multiple Intersections for Cooperative Perceptioncited by 15
- 2024Directed-CP: Directed Collaborative Perception for Connected and Autonomous Vehicles via Proactive Attentioncited by 14
- 2024R-ACP: Real-Time Adaptive Collaborative Perception Leveraging Robust Task-Oriented Communicationscited by 13
- 2025CRUISE: Cooperative Reconstruction and Editing in V2X Scenarios using Gaussian Splattingcited by 11
- 2025GCP: Guarded Collaborative Perception with Spatial-Temporal Aware Malicious Agent Detectioncited by 8
- 2025Neptune-X: Active X-to-Maritime Generation for Universal Maritime Object Detectioncited by 6
- 2026StreetForward: Perceiving Dynamic Street with Feedforward Causal Attentioncited by 4
- 2026Learning Mutual View Information Graph for Adaptive Adversarial Collaborative Perceptioncited by 3
- 2025DrivingScene: A Multi-Task Online Feed-Forward 3D Gaussian Splatting Method for Dynamic Driving Scenescited by 2
Built on by
Not cited yet.