Geometry-Aware Representation Denoising for Robust Multi-view 3D Reconstruction
Not on the map. Why?
Abstract (arXiv)
Multi-view 3D reconstruction has achieved remarkable progress with the advent of feed-forward 3D reconstruction models. However, these models are typically trained and evaluated under ideal, degradation-free imaging conditions, whereas real-world observations often contain degradations that differ significantly from such settings. Improving robustness for multi-view 3D reconstruction under degraded conditions therefore remains an important challenge. We present Geometry-Aware Representation Denoising (GARD), a novel framework that performs diffusion-based multi-view restoration directly in the feature space of a feed-forward 3D reconstruction model. This design exploits the geometry-aware feature representations of the 3D reconstructor to effectively recover accurate scene geometry. Furthermore, by employing an additional RGB image decoder, the refined representations can also be used to restore high-quality RGB images, thereby enabling the simultaneous recovery of 3D scene geometry and high-quality imagery. Comprehensive experiments on the Depth Anything 3 (DA3) benchmark demonstrate the effectiveness of the proposed GARD framework.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 52 of its 72 references that are in the map. First posted on arXiv 25 May 2026.
Builds on
52 of 72 references.
References · 52
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,627
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,320
38 more
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 984
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
- 2016Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurringcited by 727
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
- 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 604
- 2017FFDNet: Toward a Fast and Flexible Solution for CNN based Image Denoisingcited by 510
- 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 506
- 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Modelscited by 393
- 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 319
- 2025Diffusion Transformers with Representation Autoencoderscited by 295
- 2023DiffBIR: Towards Blind Image Restoration with Generative Diffusion Priorcited by 257
- 2022VRT: A Video Restoration Transformercited by 220
- 2019Kimera: an Open-Source Library for Real-Time Metric-Semantic Localization and Mappingcited by 184
- 2024InstructIR: High-Quality Image Restoration Following Human Instructionscited by 140
- 2025DDT: Decoupled Diffusion Transformercited by 109
- 2023Hierarchical Integration Diffusion Model for Realistic Image Deblurringcited by 88
- 2024Complexity Experts are Task-Discriminative Learners for Any Image Restorationcited by 77
- 2024A Survey on All-in-One Image Restoration: Taxonomy, Evaluation and Future Trendscited by 60
- 2025DiT4SR: Taming Diffusion Transformer for Real-World Image Super-Resolutioncited by 53
- 2026Scaling Text-to-Image Diffusion Transformers with Representation Autoencoderscited by 53
- 2021Depth Estimation from Monocular Images and Sparse radar using Deep Ordinal Regression Networkcited by 33
- 2025Emergent Temporal Correspondences from Video Diffusion Transformerscited by 31
- 2024Cross-View Completion Models are Zero-shot Correspondence Estimatorscited by 30
- 2024FMA-Net: Flow-Guided Dynamic Filtering and Iterative Feature Refinement with Multi-Attention for Joint Video Super-Resolution and Deblurringcited by 28
- 2026Masked Depth Modeling for Spatial Perceptioncited by 28
- 2025Emergent Outlier View Rejection in Visual Geometry Grounded Transformerscited by 22
- 2026Repurposing Geometric Foundation Models for Multi-view Diffusioncited by 15
- 2022maplab 2.0 -- A Modular and Multi-Modal Mapping Frameworkcited by 14
- 2024Computational Tradeoffs in Image Synthesis: Diffusion, Masked-Token, and Next-Token Predictioncited by 13
- 2026Learning on the Manifold: Unlocking Standard Diffusion Transformers with Representation Encoderscited by 13
- 2020RGB cameras failures and their effects in autonomous driving applicationscited by 12
- 2023Domain Generalization Using Large Pretrained Models with Mixture-of-Adapterscited by 11
- 2025CAMEO: Correspondence-Attention Alignment for Multi-View Diffusion Modelscited by 10
- 2025Text-Aware Image Restoration with Diffusion Modelscited by 6
- 2024Boosting Visual Recognition in Real-world Degradations via Unsupervised Feature Enhancement Module with Deep Channel Priorcited by 5
- 2025SIR-DIFF: Sparse Image Sets Restoration with Multi-View Diffusion Modelcited by 5
50 most cited of 52 All 52 (JSON)
Built on by
Not cited yet.