EmbPASS: Towards Cross-Embodiment Open Panoramic Segmentation
Not on the map. Why?
Abstract (arXiv)
Panoramic images provide a complete 360-degree field of view, enabling comprehensive scene understanding for embodied perception. However, heterogeneous embodied platforms exhibit substantial differences in observation viewpoints and spatial layouts, giving rise to cross-embodiment observation shifts that pose additional challenges to consistent and reliable panoramic perception, while systematic studies of this problem remain limited. To bridge this gap, we introduce a new task, termed Cross-Embodiment Open Panoramic Segmentation. Meanwhile, we establish EmbPASS, a multi-platform panoramic semantic segmentation benchmark spanning Vehicle, Drone, Wearable, and Quadruped platforms under a unified semantic taxonomy, providing a testbed for systematically studying cross-embodiment panoramic perception. We further propose EPONet, an open-vocabulary panoramic semantic segmentation network that integrates Relation-Aware Metric Adapter (RAMA) and Content-Adaptive Semantic Transfer (CAST) to enhance spatial modeling and semantic transfer under heterogeneous embodied observations. Extensive experiments show that EPONet achieves the best platform-balanced performance on EmbPASS with 35.82% mIoU, outperforming the strongest baseline by 1.10%, while remaining competitive on existing panoramic segmentation benchmarks. The source code and EmbPASS benchmark will be made publicly available at https://github.com/guopj1/EmbPASS.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 44 of its 50 references that are in the map. First posted on arXiv 2 Oct 2026.
Builds on
44 of 50 references.
References · 44
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 2016COCO-Stuff: Thing and Stuff Classes in Contextcited by 864
- 2018Deformable ConvNets v2: More Deformable, Better Resultscited by 670
- 2022Open-Vocabulary Semantic Segmentation with Mask-adapted CLIPcited by 565
- 2022InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutionscited by 482
- 2021Scaling Open-Vocabulary Image Segmentation with Image-Level Labelscited by 473
- 2017Joint 2D-3D-Semantic Data for Indoor Scene Understandingcited by 406
- 2022Visual Language Maps for Robot Navigationcited by 365
- 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 365
- 2023Side Adapter Network for Open-Vocabulary Semantic Segmentationcited by 300
32 more
- 2023CAT-Seg: Cost Aggregation for Open-Vocabulary Semantic Segmentationcited by 219
- 2023Convolutions Die Hard: Open-Vocabulary Segmentation with Single Frozen Convolutional CLIPcited by 201
- 2023SED: A Simple Encoder-Decoder for Open-Vocabulary Semantic Segmentationcited by 97
- 2019Spherical CNNs on Unstructured Gridscited by 79
- 2022Bending Reality: Distortion-aware Transformers for Adapting to Panoramic Semantic Segmentationcited by 72
- 2021Capturing Omni-Range Context for Omnidirectional Segmentationcited by 50
- 2024Efficient Deformable ConvNets: Rethinking Dynamic and Sparse Operator for Vision Applicationscited by 50
- 2023Both Style and Distortion Matter: Dual-Path Unsupervised Domain Adaptation for Panoramic Semantic Segmentationcited by 47
- 2022Review on Panoramic Imaging and Its Applications in Scene Understandingcited by 43
- 2023Look at the Neighbor: Distortion-aware Unsupervised Domain Adaptation for Panoramic Semantic Segmentationcited by 38
- 2021DensePASS: Dense Panoramic Semantic Segmentation via Unsupervised Domain Adaptation with Attention-Augmented Context Exchangecited by 36
- 2024GoodSAM: Bridging Domain and Capacity Gaps via Segment Anything Model for Distortion-aware Panoramic Semantic Segmentationcited by 28
- 2025OmniSAM: Omnidirectional Segment Anything Model for UDA in Panoramic Semantic Segmentationcited by 28
- 2023SGAT4PASS: Spherical Geometry-Aware Transformer for PAnoramic Semantic Segmentationcited by 26
- 2022FADE: Fusing the Assets of Decoder and Encoder for Task-Agnostic Upsamplingcited by 25
- 2025A Survey of Representation Learning, Optimization Strategies, and Applications for Omnidirectional Visioncited by 24
- 2024Mask-Adapter: The Devil is in the Masks for Open-Vocabulary Segmentationcited by 20
- 2025Perspective-Invariant 3D Object Detectioncited by 18
- 20253EED: Ground Everything Everywhere in 3Dcited by 12
- 2025EventFly: Event Camera Perception from Ground to the Skycited by 10
- 2024Multi-source Domain Adaptation for Panoramic Semantic Segmentationcited by 8
- 2026Panoramic Multimodal Semantic Occupancy Prediction for Quadruped Robotscited by 5
- 2026Open-Vocabulary Domain Generalization in Urban-Scene Segmentationcited by 4
- 2023CROVIA: Seeing Drone Scenes from Car Perspective via Cross-View Adaptationcited by 3
- 2024Metric Convolutions: A Unifying Theory to Adaptive Image Convolutionscited by 3
- 2026CoIn3D: Revisiting Configuration-Invariant Multi-Camera 3D Object Detectioncited by 3
- 2025Panoramic Out-of-Distribution Segmentationcited by 2
- 2026REL-SF4PASS: Panoramic Semantic Segmentation with REL Depth Representation and Spherical Fusioncited by 2
- 2026What if? Emulative Simulation with World Models for Situated Reasoningcited by 2
- 2026Seeing Beyond: Extrapolative Domain Adaptive Panoramic Segmentationcited by 1
- 2026Denoise and Align: Towards Source-Free UDA for Robust Panoramic Semantic Segmentationcited by 1
- 2026Spheriverse: 3D Scene Understanding from Spherical Observations in the Wildcited by 1
Built on by
Not cited yet.