Gallileo-4D: Frozen Backbone Ensemble for Dynamic 4D Reconstruction
Not on the map. Why?
Abstract (arXiv)
We describe our entry to the PhysAI Dynamic 4D Reconstruction Challenge, which placed third of 27 teams at 0.58356 APD on the final leaderboard, without a single gradient update. This was not the plan: of thirteen fine-tuning configurations of a pre-trained 4D backbone, twelve degraded the challenge score, and eleven of those twelve improved local validation at the same time. We trace this inversion to the structure of the benchmark: only 25% of the evaluation set belongs to the data variant released for training, so updates that fit the available data damage the pre-trained features the remaining 75% relies on. Our system therefore freezes the backbone and spends its budget at inference time, fusing three decoding configurations -- temporal stride-3, horizontal-flip test-time augmentation, and dense stride-1 -- under a convex weighting. The ensemble recovers +0.041 APD over the frozen baseline, more than any training run achieved, at zero training cost.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 34 references that are in the map. First posted on arXiv 20 Aug 2026.
Builds on
29 of 34 references.
References · 29
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2019Do ImageNet Classifiers Generalize to ImageNet?cited by 1,515
- 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,396
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
- 2017PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruningcited by 898
- 2021Robust fine-tuning of zero-shot modelscited by 797
17 more
- 2022Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distributioncited by 739
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
- 2023CoTracker: It is Better to Track Togethercited by 522
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 442
- 2022Kubric: A scalable dataset generatorcited by 381
- 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 319
- 2023PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Trackingcited by 276
- 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 250
- 2024SpatialTracker: Tracking Any 2D Pixels in 3D Spacecited by 181
- 2020Better Aggregation in Test-Time Augmentationcited by 122
- 2025St4RTrack: Simultaneous 4D Reconstruction and Tracking in the Worldcited by 89
- 2024TAPVid-3D: A Benchmark for Tracking Any Point in 3Dcited by 72
- 2025Any4D: Unified Feed-Forward Metric 4D Reconstructioncited by 35
- 2026V-DPM: 4D Video Reconstruction with Dynamic Point Mapscited by 34
- 2025Trace Anything: Representing Any Video in 4D via Trajectory Fieldscited by 33
- 20264RC: 4D Reconstruction via Conditional Querying Anytime and Anywherecited by 22
- 2026Syn4D: A Multiview Synthetic 4D Datasetcited by 4
Built on by
Not cited yet.