H3R: Hybrid Multi-view Correspondence for Generalizable 3D Reconstruction
Not on the map. Why?
Abstract (arXiv)
Despite recent advances in feed-forward 3D Gaussian Splatting, generalizable 3D reconstruction remains challenging, particularly in multi-view correspondence modeling. Existing approaches face a fundamental trade-off: explicit methods achieve geometric precision but struggle with ambiguous regions, while implicit methods provide robustness but suffer from slow convergence. We present H3R, a hybrid framework that addresses this limitation by integrating volumetric latent fusion with attention-based feature aggregation. Our framework consists of two complementary components: an efficient latent volume that enforces geometric consistency through epipolar constraints, and a camera-aware Transformer that leverages Pl"ucker coordinates for adaptive correspondence refinement. By integrating both paradigms, our approach enhances generalization while converging 2× faster than existing methods. Furthermore, we show that spatial-aligned foundation models (e.g., SD-VAE) substantially outperform semantic-aligned models (e.g., DINOv2), resolving the mismatch between semantic representations and spatial reconstruction requirements. Our method supports variable-number and high-resolution input views while demonstrating robust cross-dataset generalization. Extensive experiments show that our method achieves state-of-the-art performance across multiple benchmarks, with significant PSNR improvements of 0.59 dB, 1.06 dB, and 0.22 dB on the RealEstate10K, ACID, and DTU datasets, respectively. Code is available at https://github.com/JiaHeng-DLUT/H3R.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 80 of its 88 references that are in the map. First posted on arXiv 5 Aug 2025.
Builds on
80 of 88 references.
References · 80
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023Segment Anythingcited by 8,234
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Training Compute-Optimal Large Language Modelscited by 3,019
38 more
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2020GLU Variants Improve Transformercited by 1,804
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,584
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
- 2024Depth Anything V2cited by 1,422
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 970
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
- 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 788
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
- 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 740
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 684
- 2019Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelinescited by 672
- 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 566
- 2022DeiT III: Revenge of the ViTcited by 419
- 2019Cascade Cost Volume for High-Resolution Multi-View Stereo and Stereo Matchingcited by 417
- 2023Splatter Image: Ultra-Fast Single-View 3D Reconstructioncited by 364
- 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 349
- 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 301
- 2023Hiera: A Hierarchical Vision Transformer without the Bells-and-Whistlescited by 290
- 2024DepthSplat: Connecting Gaussian Splatting and Depthcited by 286
- 2020Query-Key Normalization for Transformerscited by 280
- 2022Unifying Flow, Stereo and Depth Estimationcited by 275
- 2023Generative Novel View Synthesis with 3D-Aware Diffusion Modelscited by 274
- 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 258
- 2020Infinite Nature: Perpetual View Generation of Natural Scenes from a Single Imagecited by 243
- 2021Scene Representation Transformer: Geometry-Free Novel View Synthesis Through Set-Latent Scene Representationscited by 227
- 2023DMV3D: Denoising Multi-View Diffusion using 3D Large Reconstruction Modelcited by 214
- 2021GeoNeRF: Generalizing NeRF with Geometry Priorscited by 196
- 2021Neural Rays for Occlusion-aware Image-based Renderingcited by 192
- 2024LVSM: A Large View Synthesis Model with Minimal 3D Inductive Biascited by 189
- 2020GRF: Learning a General Radiance Field for 3D Representation and Renderingcited by 183
50 most cited of 80 All 80 (JSON)
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Feed-Forward 3D Scene Modeling: A Problem-Driven Perspectivecited by 6
- 2026StructSplat: Generalizable 3D Gaussian Splatting from Uncalibrated Sparse Viewscited by 2
- 2026AdaptSplat: Adapting Vision Foundation Models for Feed-Forward 3D Gaussian Splattingcited by 1
- 2026WorldRoPE: Probabilistic World-Centric Rotary Embedding for Multi-View Attentioncited by 0
- 2026WorldRoPE: Probabilistic World-Centric Rotary Embedding for Multi-View Attention12 Oct 2026
- 2026StructSplat: Generalizable 3D Gaussian Splatting from Uncalibrated Sparse Views26 Jun 2026
- 2026AdaptSplat: Adapting Vision Foundation Models for Feed-Forward 3D Gaussian Splatting11 May 2026
- 2026Feed-Forward 3D Scene Modeling: A Problem-Driven Perspective15 Apr 2026