Amodal Depth Anything: Amodal Depth Estimation in the Wild
Not on the map. Why?
Abstract (arXiv)
Amodal depth estimation aims to predict the depth of occluded (invisible) parts of objects in a scene. This task addresses the question of whether models can effectively perceive the geometry of occluded regions based on visible cues. Prior methods primarily rely on synthetic datasets and focus on metric depth estimation, limiting their generalization to real-world settings due to domain shifts and scalability challenges. In this paper, we propose a novel formulation of amodal depth estimation in the wild, focusing on relative depth prediction to improve model generalization across diverse natural images. We introduce a new large-scale dataset, Amodal Depth In the Wild (ADIW), created using a scalable pipeline that leverages segmentation datasets and compositing techniques. Depth maps are generated using large pre-trained depth models, and a scale-and-shift alignment strategy is employed to refine and blend depth predictions, ensuring consistency in ground-truth annotations. To tackle the amodal depth task, we present two complementary frameworks: Amodal-DAV2, a deterministic model based on Depth Anything V2, and Amodal-DepthFM, a generative model that integrates conditional flow matching principles. Our proposed frameworks effectively leverage the capabilities of large pre-trained models with minimal modifications to achieve high-quality amodal depth predictions. Experiments validate our design choices, demonstrating the flexibility of our models in generating diverse, plausible depth structures for occluded regions. Our method achieves a 69.5% improvement in accuracy over the previous SoTA on the ADIW dataset.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 47 of its 52 references that are in the map. First posted on arXiv 3 Dec 2024.
Builds on
47 of 52 references.
References · 47
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023Segment Anythingcited by 8,234
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2017Neural Discrete Representation Learningcited by 4,712
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
- 2024Depth Anything V2cited by 1,422
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
35 more
- 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 723
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 657
- 2020AdaBins: Depth Estimation using Adaptive Binscited by 601
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 404
- 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 382
- 2023Unleashing Text-to-Image Diffusion Models for Visual Perceptioncited by 269
- 20203D Photography using Context-aware Layered Depth Inpaintingcited by 206
- 2023MiDaS v3.1 -- A Model Zoo for Robust Monocular Relative Depth Estimationcited by 174
- 2022BinsFormer: Revisiting Adaptive Bins for Monocular Depth Estimationcited by 168
- 2023Alpha-CLIP: A CLIP Model Focusing on Wherever You Wantcited by 151
- 2022DepthFormer: Exploiting Long-Range Correlation and Local Information for Accurate Monocular Depth Estimationcited by 118
- 2021Deep Occlusion-Aware Instance Segmentation with Overlapping BiLayerscited by 104
- 2015Semantic Amodal Segmentationcited by 103
- 2020Self-Supervised Scene De-occlusioncited by 96
- 2020ViP-DeepLab: Learning Visual Perception with Depth-aware Video Panoptic Segmentationcited by 96
- 2022LocalBins: Improving Depth Estimation by Learning Local Distributionscited by 94
- 2023CompletionFormer: Depth Completion with Convolutions and Vision Transformerscited by 93
- 2024DepthFM: Fast Monocular Depth Estimation with Flow Matchingcited by 76
- 2024pix2gestalt: Amodal Segmentation by Synthesizing Wholescited by 70
- 2017SeGAN: Segmenting and Generating the Invisiblecited by 60
- 2021360MonoDepth: High-Resolution 360deg Monocular Depth Estimationcited by 60
- 2024Bilateral Propagation Network for Depth Completioncited by 60
- 2023LRRU: Long-short Range Recurrent Updating Networks for Depth Completioncited by 49
- 2021SLIDE: Single Image 3D Photography with Soft Layering and Depth-aware Inpaintingcited by 48
- 2023Amodal Ground Truth and Completion in the Wildcited by 45
- 2024Tri-Perspective View Decomposition for Geometry-Aware Depth Completioncited by 42
- 2023PatchFusion: An End-to-End Tile-Based Framework for High-Resolution Monocular Metric Depth Estimationcited by 41
- 2019Monocular Depth Estimation: A Surveycited by 38
- 2021Single Image Depth Estimation: An Overviewcited by 35
- 2024Invisible Stitch: Generating Smooth 3D Scenes with Depth Inpaintingcited by 24
- 2015Amodal Completion and Size Constancy in Natural Scenescited by 21
- 2022Image Amodal Completion: A Surveycited by 18
- 2023AmodalSynthDrive: A Synthetic Amodal Perception Dataset for Autonomous Drivingcited by 14
- 2023Humans as Light Bulbs: 3D Human Reconstruction from Thermal Reflectioncited by 10
- 2024GeoBench: Benchmarking and Analyzing Monocular Geometry Estimation Modelscited by 5
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2025LaRI: Layered Ray Intersections for Single-view 3D Geometric Reasoningcited by 8
- 2026SeeThrough3D: Occlusion Aware 3D Control in Text-to-Image Generationcited by 4
- 2026EGM: Efficient Visual Grounding Language Modelscited by 3
- 2026AmodalSVG: Amodal Image Vectorization via Semantic Layer Peelingcited by 3
- 2026Perception Beyond the Visible: Incompleteness-Aware Scene Understanding for Robot Autonomycited by 0
- 2026Perception Beyond the Visible: Incompleteness-Aware Scene Understanding for Robot Autonomy13 Oct 2026
- 2026AmodalSVG: Amodal Image Vectorization via Semantic Layer Peeling13 Apr 2026
- 2026SeeThrough3D: Occlusion Aware 3D Control in Text-to-Image Generation26 Feb 2026
- 2026EGM: Efficient Visual Grounding Language Models20 Jan 2026
- 2025LaRI: Layered Ray Intersections for Single-view 3D Geometric Reasoning25 Apr 2025
Similar, not cited
Close in wording, no citation either way
- 2024SharpDepth: Sharpening Metric Depth Predictions Using Diffusion Distillation
- 2024Using Diffusion Priors for Video Amodal Segmentation
- 2025SynergyAmodal: Deocclude Anything with Text Control
- 2023Coarse-to-Fine Amodal Segmentation with Shape Prior
- 2025Depth Anything 3: Recovering the Visual Space from Any Views
- 2025Unveiling the Invisible: Reasoning Complex Occlusions Amodally with AURA
- 2025Zero-shot Depth Completion via Test-time Alignment with Affine-invariant Depth Prior
- 2026MetricAnything: Scaling Metric Depth Pretraining with Noisy Heterogeneous Sources