mlsanityData to 14 Oct 2026

Amodal Depth Anything: Amodal Depth Estimation in the Wild

arXiv 2412.02336 ↗First posted 3 Dec 2024cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

Amodal depth estimation aims to predict the depth of occluded (invisible) parts of objects in a scene. This task addresses the question of whether models can effectively perceive the geometry of occluded regions based on visible cues. Prior methods primarily rely on synthetic datasets and focus on metric depth estimation, limiting their generalization to real-world settings due to domain shifts and scalability challenges. In this paper, we propose a novel formulation of amodal depth estimation in the wild, focusing on relative depth prediction to improve model generalization across diverse natural images. We introduce a new large-scale dataset, Amodal Depth In the Wild (ADIW), created using a scalable pipeline that leverages segmentation datasets and compositing techniques. Depth maps are generated using large pre-trained depth models, and a scale-and-shift alignment strategy is employed to refine and blend depth predictions, ensuring consistency in ground-truth annotations. To tackle the amodal depth task, we present two complementary frameworks: Amodal-DAV2, a deterministic model based on Depth Anything V2, and Amodal-DepthFM, a generative model that integrates conditional flow matching principles. Our proposed frameworks effectively leverage the capabilities of large pre-trained models with minimal modifications to achieve high-quality amodal depth predictions. Experiments validate our design choices, demonstrating the flexibility of our models in generating diverse, plausible depth structures for occluded regions. Our method achieves a 69.5% improvement in accuracy over the previous SoTA on the ADIW dataset.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 47 of its 52 references that are in the map. First posted on arXiv 3 Dec 2024.

Builds on

47 of 52 references.

References · 47

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2023Segment Anythingcited by 8,234
  4. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  5. 2017Neural Discrete Representation Learningcited by 4,712
  6. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  7. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  8. 2021Vision Transformers for Dense Predictioncited by 1,803
  9. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
  10. 2024Depth Anything V2cited by 1,422
  11. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
  12. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
35 more
  1. 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 723
  2. 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 657
  3. 2020AdaBins: Depth Estimation using Adaptive Binscited by 601
  4. 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 404
  5. 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 382
  6. 2023Unleashing Text-to-Image Diffusion Models for Visual Perceptioncited by 269
  7. 20203D Photography using Context-aware Layered Depth Inpaintingcited by 206
  8. 2023MiDaS v3.1 -- A Model Zoo for Robust Monocular Relative Depth Estimationcited by 174
  9. 2022BinsFormer: Revisiting Adaptive Bins for Monocular Depth Estimationcited by 168
  10. 2023Alpha-CLIP: A CLIP Model Focusing on Wherever You Wantcited by 151
  11. 2022DepthFormer: Exploiting Long-Range Correlation and Local Information for Accurate Monocular Depth Estimationcited by 118
  12. 2021Deep Occlusion-Aware Instance Segmentation with Overlapping BiLayerscited by 104
  13. 2015Semantic Amodal Segmentationcited by 103
  14. 2020Self-Supervised Scene De-occlusioncited by 96
  15. 2020ViP-DeepLab: Learning Visual Perception with Depth-aware Video Panoptic Segmentationcited by 96
  16. 2022LocalBins: Improving Depth Estimation by Learning Local Distributionscited by 94
  17. 2023CompletionFormer: Depth Completion with Convolutions and Vision Transformerscited by 93
  18. 2024DepthFM: Fast Monocular Depth Estimation with Flow Matchingcited by 76
  19. 2024pix2gestalt: Amodal Segmentation by Synthesizing Wholescited by 70
  20. 2017SeGAN: Segmenting and Generating the Invisiblecited by 60
  21. 2021360MonoDepth: High-Resolution 360deg Monocular Depth Estimationcited by 60
  22. 2024Bilateral Propagation Network for Depth Completioncited by 60
  23. 2023LRRU: Long-short Range Recurrent Updating Networks for Depth Completioncited by 49
  24. 2021SLIDE: Single Image 3D Photography with Soft Layering and Depth-aware Inpaintingcited by 48
  25. 2023Amodal Ground Truth and Completion in the Wildcited by 45
  26. 2024Tri-Perspective View Decomposition for Geometry-Aware Depth Completioncited by 42
  27. 2023PatchFusion: An End-to-End Tile-Based Framework for High-Resolution Monocular Metric Depth Estimationcited by 41
  28. 2019Monocular Depth Estimation: A Surveycited by 38
  29. 2021Single Image Depth Estimation: An Overviewcited by 35
  30. 2024Invisible Stitch: Generating Smooth 3D Scenes with Depth Inpaintingcited by 24
  31. 2015Amodal Completion and Size Constancy in Natural Scenescited by 21
  32. 2022Image Amodal Completion: A Surveycited by 18
  33. 2023AmodalSynthDrive: A Synthetic Amodal Perception Dataset for Autonomous Drivingcited by 14
  34. 2023Humans as Light Bulbs: 3D Human Reconstruction from Thermal Reflectioncited by 10
  35. 2024GeoBench: Benchmarking and Analyzing Monocular Geometry Estimation Modelscited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 4.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024SharpDepth: Sharpening Metric Depth Predictions Using Diffusion Distillation
  2. 2024Using Diffusion Priors for Video Amodal Segmentation
  3. 2025SynergyAmodal: Deocclude Anything with Text Control
  4. 2023Coarse-to-Fine Amodal Segmentation with Shape Prior
  5. 2025Depth Anything 3: Recovering the Visual Space from Any Views
  6. 2025Unveiling the Invisible: Reasoning Complex Occlusions Amodally with AURA
  7. 2025Zero-shot Depth Completion via Test-time Alignment with Affine-invariant Depth Prior
  8. 2026MetricAnything: Scaling Metric Depth Pretraining with Noisy Heterogeneous Sources