mlsanityData to 14 Oct 2026

RePer-360: Releasing Perspective Priors for 360^circ Depth Estimation via Self-Modulation

arXiv 2603.05999 ↗First posted 6 Mar 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent depth foundation models trained on perspective imagery achieve strong performance, yet generalize poorly to 360^circ images due to the substantial geometric discrepancy between perspective and panoramic domains. Moreover, fully fine-tuning these models typically requires large amounts of panoramic data. To address this issue, we propose RePer-360, a distortion-aware self-modulation framework for monocular panoramic depth estimation that adapts depth foundation models while preserving powerful pretrained perspective priors. Specifically, we design a lightweight geometry-aligned guidance module to derive a modulation signal from two complementary projections (i.e., ERP and CP) and use it to guide the model toward the panoramic domain without overwriting its pretrained perspective knowledge. We further introduce a Self-Conditioned AdaLN-Zero mechanism that produces pixel-wise scaling factors to reduce the feature distribution gap between the perspective and panoramic domains. In addition, a cubemap-domain consistency loss further improves training stability and cross-projection alignment. By shifting the focus from complementary-projection fusion to panoramic domain adaptation under preserved pretrained perspective priors, RePer-360 surpasses standard fine-tuning methods while using only 1% of the training data. Under the same in-domain training setting, it further achieves an approximately 20% improvement in RMSE. The code is available at https://github.com/munimo/RePer360.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 36 of its 44 references that are in the map. First posted on arXiv 6 Mar 2026.

Builds on

36 of 44 references.

References · 36

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  4. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  5. 2022Scalable Diffusion Models with Transformerscited by 6,054
  6. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  7. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
  8. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  9. 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,332
  10. 2024Depth Anything V2cited by 1,422
  11. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
  12. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
24 more
  1. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
  2. 2017Joint 2D-3D-Semantic Data for Indoor Scene Understandingcited by 406
  3. 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 365
  4. 2019Structured3D: A Large Photo-realistic Dataset for Structured 3D Modelingcited by 286
  5. 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 261
  6. 2022PanoFormer: Panorama Transformer for Indoor 360 Depth Estimationcited by 95
  7. 2021UniFuse: Unidirectional Fusion for 360circ Panorama Depth Estimationcited by 92
  8. 2022Bending Reality: Distortion-aware Transformers for Adapting to Panoramic Semantic Segmentationcited by 72
  9. 2022OmniFusion: 360 Monocular Depth Estimation via Geometry-Aware Fusioncited by 61
  10. 2023Both Style and Distortion Matter: Dual-Path Unsupervised Domain Adaptation for Panoramic Semantic Segmentationcited by 47
  11. 2023EGformer: Equirectangular Geometry-biased Transformer for 360 Depth Estimationcited by 43
  12. 2023Look at the Neighbor: Distortion-aware Unsupervised Domain Adaptation for Panoramic Semantic Segmentationcited by 38
  13. 2024Depth Anywhere: Enhancing 360 Monocular Depth Estimation via Perspective Distillation and Unlabeled Data Augmentationcited by 38
  14. 2023HRDFuse: Monocular 360degDepth Estimation by Collaboratively Learning Holistic-with-Regional Depth Distributionscited by 37
  15. 2022BiFuse++: Self-supervised and Efficient Bi-projection Fusion for 360 Depth Estimationcited by 35
  16. 2024360+x: A Panoptic Multi-modal Scene Understanding Datasetcited by 35
  17. 2021SphereSR: 360deg Image Super-Resolution with Arbitrary Projection via Continuous Spherical Image Representationcited by 33
  18. 2024Elite360D: Towards Efficient 360 Depth Estimation via Semantic- and Distance-Aware Bi-Projection Fusioncited by 31
  19. 2025From Editor to Dense Geometry Estimatorcited by 24
  20. 2024PanDA: Towards Panoramic Depth Anything with Unlabeled Panoramas and Mobius Spatial Augmentationcited by 22
  21. 2025Jasmine: Harnessing Diffusion Prior for Self-supervised Depth Estimationcited by 21
  22. 2024Digging into contrastive learning for robust depth estimation with diffusion modelscited by 19
  23. 2024SGFormer: Spherical Geometry Transformer for 360 Depth Estimationcited by 9
  24. 2024Revisiting 360 Depth Estimation with PanoGabor: A New Fusion Perspectivecited by 5

Built on by

Not cited yet.