mlsanityData to 14 Oct 2026

EmbPASS: Towards Cross-Embodiment Open Panoramic Segmentation

arXiv 2610.03248 ↗First posted 2 Oct 2026cs.CV cs.ROcited by 0

Not on the map. Why?

Abstract (arXiv)

Panoramic images provide a complete 360-degree field of view, enabling comprehensive scene understanding for embodied perception. However, heterogeneous embodied platforms exhibit substantial differences in observation viewpoints and spatial layouts, giving rise to cross-embodiment observation shifts that pose additional challenges to consistent and reliable panoramic perception, while systematic studies of this problem remain limited. To bridge this gap, we introduce a new task, termed Cross-Embodiment Open Panoramic Segmentation. Meanwhile, we establish EmbPASS, a multi-platform panoramic semantic segmentation benchmark spanning Vehicle, Drone, Wearable, and Quadruped platforms under a unified semantic taxonomy, providing a testbed for systematically studying cross-embodiment panoramic perception. We further propose EPONet, an open-vocabulary panoramic semantic segmentation network that integrates Relation-Aware Metric Adapter (RAMA) and Content-Adaptive Semantic Transfer (CAST) to enhance spatial modeling and semantic transfer under heterogeneous embodied observations. Extensive experiments show that EPONet achieves the best platform-balanced performance on EmbPASS with 35.82% mIoU, outperforming the strongest baseline by 1.10%, while remaining competitive on existing panoramic segmentation benchmarks. The source code and EmbPASS benchmark will be made publicly available at https://github.com/guopj1/EmbPASS.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 44 of its 50 references that are in the map. First posted on arXiv 2 Oct 2026.

Builds on

44 of 50 references.

References · 44

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
  3. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
  4. 2016COCO-Stuff: Thing and Stuff Classes in Contextcited by 864
  5. 2018Deformable ConvNets v2: More Deformable, Better Resultscited by 670
  6. 2022Open-Vocabulary Semantic Segmentation with Mask-adapted CLIPcited by 565
  7. 2022InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutionscited by 482
  8. 2021Scaling Open-Vocabulary Image Segmentation with Image-Level Labelscited by 473
  9. 2017Joint 2D-3D-Semantic Data for Indoor Scene Understandingcited by 406
  10. 2022Visual Language Maps for Robot Navigationcited by 365
  11. 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 365
  12. 2023Side Adapter Network for Open-Vocabulary Semantic Segmentationcited by 300
32 more
  1. 2023CAT-Seg: Cost Aggregation for Open-Vocabulary Semantic Segmentationcited by 219
  2. 2023Convolutions Die Hard: Open-Vocabulary Segmentation with Single Frozen Convolutional CLIPcited by 201
  3. 2023SED: A Simple Encoder-Decoder for Open-Vocabulary Semantic Segmentationcited by 97
  4. 2019Spherical CNNs on Unstructured Gridscited by 79
  5. 2022Bending Reality: Distortion-aware Transformers for Adapting to Panoramic Semantic Segmentationcited by 72
  6. 2021Capturing Omni-Range Context for Omnidirectional Segmentationcited by 50
  7. 2024Efficient Deformable ConvNets: Rethinking Dynamic and Sparse Operator for Vision Applicationscited by 50
  8. 2023Both Style and Distortion Matter: Dual-Path Unsupervised Domain Adaptation for Panoramic Semantic Segmentationcited by 47
  9. 2022Review on Panoramic Imaging and Its Applications in Scene Understandingcited by 43
  10. 2023Look at the Neighbor: Distortion-aware Unsupervised Domain Adaptation for Panoramic Semantic Segmentationcited by 38
  11. 2021DensePASS: Dense Panoramic Semantic Segmentation via Unsupervised Domain Adaptation with Attention-Augmented Context Exchangecited by 36
  12. 2024GoodSAM: Bridging Domain and Capacity Gaps via Segment Anything Model for Distortion-aware Panoramic Semantic Segmentationcited by 28
  13. 2025OmniSAM: Omnidirectional Segment Anything Model for UDA in Panoramic Semantic Segmentationcited by 28
  14. 2023SGAT4PASS: Spherical Geometry-Aware Transformer for PAnoramic Semantic Segmentationcited by 26
  15. 2022FADE: Fusing the Assets of Decoder and Encoder for Task-Agnostic Upsamplingcited by 25
  16. 2025A Survey of Representation Learning, Optimization Strategies, and Applications for Omnidirectional Visioncited by 24
  17. 2024Mask-Adapter: The Devil is in the Masks for Open-Vocabulary Segmentationcited by 20
  18. 2025Perspective-Invariant 3D Object Detectioncited by 18
  19. 20253EED: Ground Everything Everywhere in 3Dcited by 12
  20. 2025EventFly: Event Camera Perception from Ground to the Skycited by 10
  21. 2024Multi-source Domain Adaptation for Panoramic Semantic Segmentationcited by 8
  22. 2026Panoramic Multimodal Semantic Occupancy Prediction for Quadruped Robotscited by 5
  23. 2026Open-Vocabulary Domain Generalization in Urban-Scene Segmentationcited by 4
  24. 2023CROVIA: Seeing Drone Scenes from Car Perspective via Cross-View Adaptationcited by 3
  25. 2024Metric Convolutions: A Unifying Theory to Adaptive Image Convolutionscited by 3
  26. 2026CoIn3D: Revisiting Configuration-Invariant Multi-Camera 3D Object Detectioncited by 3
  27. 2025Panoramic Out-of-Distribution Segmentationcited by 2
  28. 2026REL-SF4PASS: Panoramic Semantic Segmentation with REL Depth Representation and Spherical Fusioncited by 2
  29. 2026What if? Emulative Simulation with World Models for Situated Reasoningcited by 2
  30. 2026Seeing Beyond: Extrapolative Domain Adaptive Panoramic Segmentationcited by 1
  31. 2026Denoise and Align: Towards Source-Free UDA for Robust Panoramic Semantic Segmentationcited by 1
  32. 2026Spheriverse: 3D Scene Understanding from Spherical Observations in the Wildcited by 1

Built on by

Not cited yet.