mlsanityData to 7 Oct 2026

SPACE-CLIP: Spatial Perception via Adaptive CLIP Embeddings for Monocular Depth Estimation

arXiv 2601.17657 ↗First posted 25 Jan 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Robotic and autonomous systems need dense spatial cues, yet adding a dedicated depth estimator can duplicate visual processing already performed by a multimodal model. CLIP-based depth methods offer an alternative, but commonly rely on text-derived conditioning or backbone adaptation. We present SPACE-CLIP, a decoder-only framework for supervised monocular depth estimation with a frozen CLIP vision backbone and no text encoder at inference. A FiLM-conditioned semantic pathway combines global image context with multilevel patch features, while a structural pathway supplies separately processed spatial features to a hierarchical fusion decoder. Indoor and outdoor evaluations demonstrate depth reconstruction with this architecture, and controlled component comparisons support the contribution of the structural pathway. Layer-selection experiments and frequency interventions further characterize the structural pathway's contribution to depth reconstruction. A shared-backbone microbenchmark further illustrates the reduction in duplicated computation. SPACE-CLIP provides a modular approach to adding dense depth prediction to compatible visual perception stacks. Code is available at https://github.com/taewan2002/SPACE-CLIP.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 29 of its 56 references that are in the map. First posted on arXiv 25 Jan 2026.

Builds on

29 of 56 references.

References · 29

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  4. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  5. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  6. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
  7. 2013Visualizing and Understanding Convolutional Networkscited by 2,278
  8. 2021Vision Transformers for Dense Predictioncited by 1,789
  9. 2019Similarity of Neural Network Representations Revisitedcited by 1,695
  10. 2024Depth Anything V2cited by 1,385
  11. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
  12. 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 721
17 more
  1. 2021Do Vision Transformers See Like Convolutional Neural Networks?cited by 671
  2. 2020AdaBins: Depth Estimation using Adaptive Binscited by 596
  3. 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 389
  4. 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 375
  5. 2022How Do Vision Transformers Work?cited by 305
  6. 2022NeW CRFs: Neural Window Fully-connected CRFs for Monocular Depth Estimationcited by 151
  7. 2022DepthFormer: Exploiting Long-Range Correlation and Local Information for Accurate Monocular Depth Estimationcited by 116
  8. 2022Can Language Understand Depth?cited by 66
  9. 2015Loss Functions for Neural Networks for Image Processingcited by 41
  10. 2023Learning to Adapt CLIP for Few-Shot Monocular Depth Estimationcited by 19
  11. 2025Depth Anything at Any Conditioncited by 11
  12. 2020Monocular Depth Estimation Using Multi Scale Neural Network And Feature Fusioncited by 7
  13. 2024CLIP Can Understand Depthcited by 6
  14. 2020Real-Time Deep Learning Approach to Visual Servo Control and Grasp Detection for Autonomous Robotic Manipulationcited by 4
  15. 2024MambaDepth: Enhancing Long-range Dependency for Self-Supervised Fine-Structured Monocular Depth Estimationcited by 4
  16. 2025RetoVLA: Reusing Register Tokens for Spatial Reasoning in Vision-Language-Action Modelscited by 4
  17. 2018Self-Supervised Monocular Image Depth Learning and Confidence Estimationcited by 3

Built on by

Not cited yet.