SPACE-CLIP: Spatial Perception via Adaptive CLIP Embeddings for Monocular Depth Estimation
Not on the map. Why?
Abstract (arXiv)
Robotic and autonomous systems need dense spatial cues, yet adding a dedicated depth estimator can duplicate visual processing already performed by a multimodal model. CLIP-based depth methods offer an alternative, but commonly rely on text-derived conditioning or backbone adaptation. We present SPACE-CLIP, a decoder-only framework for supervised monocular depth estimation with a frozen CLIP vision backbone and no text encoder at inference. A FiLM-conditioned semantic pathway combines global image context with multilevel patch features, while a structural pathway supplies separately processed spatial features to a hierarchical fusion decoder. Indoor and outdoor evaluations demonstrate depth reconstruction with this architecture, and controlled component comparisons support the contribution of the structural pathway. Layer-selection experiments and frequency interventions further characterize the structural pathway's contribution to depth reconstruction. A shared-backbone microbenchmark further illustrates the reduction in duplicated computation. SPACE-CLIP provides a modular approach to adding dense depth prediction to compatible visual perception stacks. Code is available at https://github.com/taewan2002/SPACE-CLIP.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 29 of its 56 references that are in the map. First posted on arXiv 25 Jan 2026.
Builds on
29 of 56 references.
References · 29
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
- 2013Visualizing and Understanding Convolutional Networkscited by 2,278
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2019Similarity of Neural Network Representations Revisitedcited by 1,695
- 2024Depth Anything V2cited by 1,385
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 721
17 more
- 2021Do Vision Transformers See Like Convolutional Neural Networks?cited by 671
- 2020AdaBins: Depth Estimation using Adaptive Binscited by 596
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 389
- 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 375
- 2022How Do Vision Transformers Work?cited by 305
- 2022NeW CRFs: Neural Window Fully-connected CRFs for Monocular Depth Estimationcited by 151
- 2022DepthFormer: Exploiting Long-Range Correlation and Local Information for Accurate Monocular Depth Estimationcited by 116
- 2022Can Language Understand Depth?cited by 66
- 2015Loss Functions for Neural Networks for Image Processingcited by 41
- 2023Learning to Adapt CLIP for Few-Shot Monocular Depth Estimationcited by 19
- 2025Depth Anything at Any Conditioncited by 11
- 2020Monocular Depth Estimation Using Multi Scale Neural Network And Feature Fusioncited by 7
- 2024CLIP Can Understand Depthcited by 6
- 2020Real-Time Deep Learning Approach to Visual Servo Control and Grasp Detection for Autonomous Robotic Manipulationcited by 4
- 2024MambaDepth: Enhancing Long-range Dependency for Self-Supervised Fine-Structured Monocular Depth Estimationcited by 4
- 2025RetoVLA: Reusing Register Tokens for Spatial Reasoning in Vision-Language-Action Modelscited by 4
- 2018Self-Supervised Monocular Image Depth Learning and Confidence Estimationcited by 3
Built on by
Not cited yet.