Many Eyes, One World: Feed-Forward 3D Reconstruction from Mixed Cameras
Not on the map. Why?
Abstract (arXiv)
Real-world capture is heterogeneous: perspective, fisheye, and 360^circ panoramic images can coexist within a single reconstruction task, yet most feed-forward 3D reconstruction models assume perspective imagery and a uniform input representation. Recent models handling several camera types are either informed of the camera type for each view or reconstruct one image pair at a time. No single-pass method reconstructs mixed-camera tuples containing full panoramas from images alone. We present MEOW, a feed-forward system that jointly reconstructs metric pointmaps and camera poses from one N-view tuple mixing perspective, fisheye and full-panorama images, in a single forward pass from images alone: no calibration, distortion parameters, camera-type labels or poses are supplied for any view. Our guiding design philosophy is to treat heterogeneous-camera reconstruction as a data-adaptation problem rather than an architectural redesign. MEOW retains a perspective-pretrained backbone and learns heterogeneous cameras entirely from a procedural data engine, which renders each scene across a continuous manifold of camera models with exact rays and depth, and certifies covisibility for every camera-sampled training tuple. Trained on synthetic tuples only, MEOW transfers zero-shot to real captures: on heterogeneous 2D3DS tuples it achieves 79.9 mAA@30 against 53.8 for Wid3R given the camera type of every view; on our laser-scanned mixed-camera benchmark it registers every four-view mixed tuple with 79.4 AUC@30. The data engine, benchmark, and complete evaluation pipeline will be released.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 54 of its 66 references that are in the map. First posted on arXiv 28 Sep 2026.
Builds on
54 of 66 references.
References · 54
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2020Shortcut Learning in Deep Neural Networkscited by 1,928
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
- 2024Grounding Image Matching in 3D with MASt3Rcited by 960
- 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 885
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
- 2025Continuous 3D Perception Model with Persistent Statecited by 527
- 2017Joint 2D-3D-Semantic Data for Indoor Scene Understandingcited by 404
38 more
- 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 369
- 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 356
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
- 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 292
- 2019Structured3D: A Large Photo-realistic Dataset for Structured 3D Modelingcited by 285
- 2017A General and Adaptive Robust Loss Functioncited by 236
- 2023Aria Digital Twin: A New Benchmark Dataset for Egocentric 3D Machine Perceptioncited by 166
- 2023PoseDiffusion: Solving Pose Estimation via Diffusion-aided Bundle Adjustmentcited by 146
- 2025MUSt3R: Multi-view Network for Stereo 3D Reconstructioncited by 139
- 2022Perspective Fields for Single Image Camera Calibrationcited by 75
- 2025Pow3R: Empowering Unconstrained 3D Reconstruction with Camera and Scene Priorscited by 69
- 2025UniK3D: Universal Camera Monocular 3D Estimationcited by 60
- 2018The Double Sphere Camera Modelcited by 50
- 2024GeoCalib: Learning Single-image Calibration with Geometric Optimizationcited by 50
- 2025Depth Any Camera: Zero-Shot Metric Depth Estimation from Any Cameracited by 38
- 2025Depth Any Panoramas: A Foundation Model for Panoramic Depth Estimationcited by 24
- 2025DA2: Depth Anything in Any Directioncited by 22
- 2025AnyCalib: On-Manifold Learning for Model-Agnostic Single-View Camera Calibrationcited by 17
- 2021BabelCalib: A Universal Approach to Calibrating Central Camerascited by 14
- 2025Rig3R: Rig-Aware Conditioning for Learned 3D Reconstructioncited by 11
- 2026PanoVGGT: Feed-Forward 3D Reconstruction from Panoramic Imagerycited by 10
- 2025Extending Foundational Monocular Depth Estimators to Fisheye Cameras with Calibration Tokenscited by 9
- 2022A Deep Perceptual Measure for Lens and Camera Calibrationcited by 7
- 2026UniDAC: Universal Metric Depth Estimation for Any Cameracited by 7
- 2026Holo360D: A Large-Scale Real-World Dataset with Continuous Trajectories for Advancing Panoramic 3D Reconstruction and Beyondcited by 7
- 2026Fisheye3R: Adapting Unified 3D Feed-Forward Foundation Models to Fisheye Lensescited by 4
- 2026Wid3R: Wide Field-of-View 3D Reconstruction via Camera Model Conditioningcited by 3
- 2026X-Lens: Real-Time Metric Depth Estimation with Heterogeneous Camerascited by 3
- 2026SimpleProc: Fully Procedural Synthetic Data from Simple Rules for Multi-View Stereocited by 2
- 2026CalibAnyView: Beyond Single-View Camera Calibration in the Wildcited by 2
- 2026UniSHARP: Universal Sharp Monocular View Synthesiscited by 2
- 2025PFDepth: Heterogeneous Pinhole-Fisheye Joint Depth Estimation via Distortion-aware Gaussian-Splatted Volumetric Fusioncited by 1
- 2026CAM3R: Camera-Agnostic Model for 3D Reconstructioncited by 1
- 2026CM-EVS: Sparse Panoramic RGB-D-Pose Data for Complete Scene Coveragecited by 1
- 2026Unified Panoramic Geometry Estimation via Multi-View Foundation Modelscited by 1
- 2026Argus: Metric Panoramic 3D Reconstruction for Indoor Scenescited by 1
- 2026CasaMaestro: Multi-View Panoramas for House-Scale 3D Reconstructioncited by 1
- 2026RayTun3R: Online Camera Adaptation in 3D Foundation Modelscited by 1
50 most cited of 54 All 54 (JSON)
Built on by
Not cited yet.