Racing in Volume with Flow Ensembles
Not on the map. Why?
Abstract (arXiv)
Streaming 4D reconstruction has been demonstrated only indoors, on dense camera rigs surrounding subjects that move at human pace. Outdoor 4D reconstruction exists but relies either on cameras mounted on the moving vehicle itself, or on limited-coverage arrays observing quasi-static subjects offline. The case that actually matters for spectators is a fast-moving subject, watched from a sparse ring of allocentric cameras, streaming. No method targets this, and no benchmark exists to evaluate one. To this end, we introduce FastFlowGS, a streaming 4D Gaussian Splatting method for reconstructing fast-moving subjects from a small set of fixed external cameras, and Monaco4D, a photorealistic Unreal Engine 5 benchmark for high-speed outdoor reconstruction. FastFlowGS fuses sparse matches, semi-dense tracks, and dense optical flow by lifting each signal to 3D with geometric uncertainty and combining them through a Kalman-style temporal update. Monaco4D provides Formula 1 sequences under varied illumination from trackside, onboard, and drone viewpoints with dense ground truth. On CMU-Panoptic, FastFlowGS exceeds the strongest baseline by 12.6% VMAF at 35% greater efficiency. On Monaco4D, where existing streaming methods degrade severely, it improves dynamic-region PSNR by up to 18.6% with 28.3% lower per-frame optimization time. Dataset and additional details can be found at https://humansensinglab.github.io/monaco4d/.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 46 of its 57 references that are in the map. First posted on arXiv 14 Sep 2026.
Builds on
46 of 57 references.
References · 46
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 746
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
- 2023LightGlue: Local Feature Matching at Light Speedcited by 590
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 587
34 more
- 2021KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3Dcited by 575
- 2025Continuous 3D Perception Model with Persistent Statecited by 548
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 442
- 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 344
- 2023EmerNeRF: Emergent Spatial-Temporal Scene Decomposition via Self-Supervisioncited by 217
- 2024A Hierarchical 3D Gaussian Representation for Real-Time Rendering of Very Large Datasetscited by 216
- 2024Mini-Splatting: Representing Scenes with a Constrained Number of Gaussianscited by 213
- 2024VastGaussian: Vast 3D Gaussians for Large Scene Reconstructioncited by 209
- 2024Taming 3DGS: High-Quality Radiance Fields with Limited Resourcescited by 204
- 2016Panoptic Studio: A Massively Multiview System for Social Interaction Capturecited by 173
- 2022Fourier PlenOctrees for Dynamic Radiance Field Rendering in Real-timecited by 165
- 20243DGStream: On-the-Fly Training of 3D Gaussians for Efficient Streaming of Photo-Realistic Free-Viewpoint Videoscited by 160
- 2024CoTracker3: Simpler and Better Point Tracking by Pseudo-Labelling Real Videoscited by 128
- 2023StreetSurf: Extending Multi-view Implicit Surface Reconstruction to Street Viewscited by 120
- 2024BootsTAP: Bootstrapped Training for Tracking-Any-Pointcited by 120
- 2023GauFRe: Gaussian Deformation Fields for Real-time Dynamic Novel View Synthesiscited by 95
- 2024MotionGS: Exploring Explicit Motion Guidance for Deformable 3D Gaussian Splattingcited by 63
- 2023Dense Optical Tracking: Connecting the Dotscited by 61
- 2025Efficiently Reconstructing Dynamic Scenes One D4RT at a Timecited by 54
- 20254DGT: Learning a 4D Gaussian Transformer Using Real-World Monocular Videoscited by 49
- 2025LONG3R: Long Sequence Streaming 3D Reconstructioncited by 45
- 2023Flow supervision for Deformable NeRFcited by 42
- 2025Instant Gaussian Stream: Fast and Generalizable Streaming of Dynamic Scene Reconstruction via Gaussian Splattingcited by 36
- 2025Any4D: Unified Feed-Forward Metric 4D Reconstructioncited by 35
- 2019TrackNet: A Deep Learning Network for Tracking High-speed and Tiny Objects in Sports Applicationscited by 33
- 2024QUEEN: QUantized Efficient ENcoding of Dynamic Gaussians for Streaming Free-viewpoint Videoscited by 25
- 2025GIFStream: 4D Gaussian-based Immersive Video with Feature Streamcited by 24
- 2023VideoRF: Rendering Dynamic Radiance Fields as 2D Feature Video Streamscited by 22
- 2025Hybrid 3D-4D Gaussian Splatting for Fast Dynamic Scene Representationcited by 13
- 2025G-CUT3R: Guided 3D Reconstruction with Camera and Depth Prior Integrationcited by 12
- 2025ReCon-GS: Continuum-Preserved Gaussian Streaming for Fast and Compact Reconstruction of Dynamic Scenescited by 12
- 2024SEED4D: A Synthetic Ego--Exo Dynamic 4D Data Generator, Driving Dataset and Benchmarkcited by 8
- 2025TT3D: Table Tennis 3D Reconstructioncited by 5
- 2026TrackerSplat: Exploiting Point Tracking for Fast and Robust Dynamic 3D Gaussians Reconstructioncited by 3
Built on by
Not cited yet.