mlsanityData to 14 Oct 2026

Cross-View Multi-Modal Segmentation @ Ego-Exo4D Challenges 2025

arXiv 2506.05856 ↗First posted 6 Jun 2025cs.CV cs.AIcited by 5

Not on the map. Why?

Abstract (arXiv)

In this report, we present a cross-view multi-modal object segmentation approach for the object correspondence task in the Ego-Exo4D Correspondence Challenges 2025. Given object queries from one perspective (e.g., ego view), the goal is to predict the corresponding object masks in another perspective (e.g., exo view). To tackle this task, we propose a multimodal condition fusion module that enhances object localization by leveraging both visual masks and textual descriptions as segmentation conditions. Furthermore, to address the visual domain gap between ego and exo views, we introduce a cross-view object alignment module that enforces object-level consistency across perspectives, thereby improving the model's robustness to viewpoint changes. Our proposed method ranked second on the leaderboard of the large-scale Ego-Exo4D object correspondence benchmark. Code will be made available at https://github.com/lovelyqian/ObjectRelator.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 19 of its 20 references that are in the map. First posted on arXiv 6 Jun 2025.

Builds on

19 of 20 references.

References · 19

  1. 2023Segment Anythingcited by 8,234
  2. 2017Mask R-CNNcited by 7,277
  3. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
  4. 2023LISA: Reasoning Segmentation via Large Language Modelcited by 776
  5. 2023Segment Everything Everywhere All at Oncecited by 548
  6. 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 490
  7. 2023GLaMM: Pixel Grounding Large Multimodal Modelcited by 455
  8. 2023PixelLM: Pixel Reasoning with Large Multimodal Modelcited by 222
  9. 2023Universal Instance Perception as Object Discovery and Retrievalcited by 192
  10. 2024PSALM: Pixelwise SegmentAtion with Large Multi-Modal Modelcited by 101
  11. 2024OMG-Seg: Is One Model Good Enough For All Segmentation?cited by 75
  12. 2024CAFuser: Condition-Aware Multimodal Fusion for Robust Semantic Perception of Driving Scenescited by 33
7 more
  1. 2024Learning Modality-agnostic Representation for Semantic Segmentation from Any Modalitiescited by 31
  2. 2024ObjectRelator: Enabling Cross-View Object Relation Understanding Across Ego-Centric and Exo-Centric Perspectivescited by 29
  3. 2023Distilling Efficient Vision Transformers from CNNs for Semantic Segmentationcited by 18
  4. 2023Object Segmentation by Mining Cross-Modal Semanticscited by 12
  5. 2023Temporal-aware Hierarchical Mask Classification for Video Semantic Segmentationcited by 7
  6. 2024X-Prompt: Multi-modal Visual Prompt for Video Object Segmentationcited by 7
  7. 2025CamSAM2: Segment Anything Accurately in Camouflaged Videoscited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 2.

5 papers.