mlsanityData to 14 Oct 2026

H3R: Hybrid Multi-view Correspondence for Generalizable 3D Reconstruction

arXiv 2508.03118 ↗First posted 5 Aug 2025cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

Despite recent advances in feed-forward 3D Gaussian Splatting, generalizable 3D reconstruction remains challenging, particularly in multi-view correspondence modeling. Existing approaches face a fundamental trade-off: explicit methods achieve geometric precision but struggle with ambiguous regions, while implicit methods provide robustness but suffer from slow convergence. We present H3R, a hybrid framework that addresses this limitation by integrating volumetric latent fusion with attention-based feature aggregation. Our framework consists of two complementary components: an efficient latent volume that enforces geometric consistency through epipolar constraints, and a camera-aware Transformer that leverages Pl"ucker coordinates for adaptive correspondence refinement. By integrating both paradigms, our approach enhances generalization while converging 2× faster than existing methods. Furthermore, we show that spatial-aligned foundation models (e.g., SD-VAE) substantially outperform semantic-aligned models (e.g., DINOv2), resolving the mismatch between semantic representations and spatial reconstruction requirements. Our method supports variable-number and high-resolution input views while demonstrating robust cross-dataset generalization. Extensive experiments show that our method achieves state-of-the-art performance across multiple benchmarks, with significant PSNR improvements of 0.59 dB, 1.06 dB, and 0.22 dB on the RealEstate10K, ACID, and DTU datasets, respectively. Code is available at https://github.com/JiaHeng-DLUT/H3R.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 80 of its 88 references that are in the map. First posted on arXiv 5 Aug 2025.

Builds on

80 of 88 references.

References · 80

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  6. 2023Segment Anythingcited by 8,234
  7. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  8. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  9. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  10. 2020Scaling Laws for Neural Language Modelscited by 6,586
  11. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  12. 2022Training Compute-Optimal Large Language Modelscited by 3,019
38 more
  1. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  2. 2020GLU Variants Improve Transformercited by 1,804
  3. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
  4. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,584
  5. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
  6. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
  7. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
  8. 2024Depth Anything V2cited by 1,422
  9. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
  10. 2024Grounding Image Matching in 3D with MASt3Rcited by 983
  11. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 970
  12. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
  13. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
  14. 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 788
  15. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
  16. 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 740
  17. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
  18. 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 684
  19. 2019Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelinescited by 672
  20. 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 566
  21. 2022DeiT III: Revenge of the ViTcited by 419
  22. 2019Cascade Cost Volume for High-Resolution Multi-View Stereo and Stereo Matchingcited by 417
  23. 2023Splatter Image: Ultra-Fast Single-View 3D Reconstructioncited by 364
  24. 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 349
  25. 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 301
  26. 2023Hiera: A Hierarchical Vision Transformer without the Bells-and-Whistlescited by 290
  27. 2024DepthSplat: Connecting Gaussian Splatting and Depthcited by 286
  28. 2020Query-Key Normalization for Transformerscited by 280
  29. 2022Unifying Flow, Stereo and Depth Estimationcited by 275
  30. 2023Generative Novel View Synthesis with 3D-Aware Diffusion Modelscited by 274
  31. 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 258
  32. 2020Infinite Nature: Perpetual View Generation of Natural Scenes from a Single Imagecited by 243
  33. 2021Scene Representation Transformer: Geometry-Free Novel View Synthesis Through Set-Latent Scene Representationscited by 227
  34. 2023DMV3D: Denoising Multi-View Diffusion using 3D Large Reconstruction Modelcited by 214
  35. 2021GeoNeRF: Generalizing NeRF with Geometry Priorscited by 196
  36. 2021Neural Rays for Occlusion-aware Image-based Renderingcited by 192
  37. 2024LVSM: A Large View Synthesis Model with Minimal 3D Inductive Biascited by 189
  38. 2020GRF: Learning a General Radiance Field for 3D Representation and Renderingcited by 183

50 most cited of 80 All 80 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.