Cross-View Multi-Modal Segmentation @ Ego-Exo4D Challenges 2025
Not on the map. Why?
Abstract (arXiv)
In this report, we present a cross-view multi-modal object segmentation approach for the object correspondence task in the Ego-Exo4D Correspondence Challenges 2025. Given object queries from one perspective (e.g., ego view), the goal is to predict the corresponding object masks in another perspective (e.g., exo view). To tackle this task, we propose a multimodal condition fusion module that enhances object localization by leveraging both visual masks and textual descriptions as segmentation conditions. Furthermore, to address the visual domain gap between ego and exo views, we introduce a cross-view object alignment module that enforces object-level consistency across perspectives, thereby improving the model's robustness to viewpoint changes. Our proposed method ranked second on the leaderboard of the large-scale Ego-Exo4D object correspondence benchmark. Code will be made available at https://github.com/lovelyqian/ObjectRelator.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 19 of its 20 references that are in the map. First posted on arXiv 6 Jun 2025.
Builds on
19 of 20 references.
References · 19
- 2023Segment Anythingcited by 8,234
- 2017Mask R-CNNcited by 7,277
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
- 2023LISA: Reasoning Segmentation via Large Language Modelcited by 776
- 2023Segment Everything Everywhere All at Oncecited by 548
- 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 490
- 2023GLaMM: Pixel Grounding Large Multimodal Modelcited by 455
- 2023PixelLM: Pixel Reasoning with Large Multimodal Modelcited by 222
- 2023Universal Instance Perception as Object Discovery and Retrievalcited by 192
- 2024PSALM: Pixelwise SegmentAtion with Large Multi-Modal Modelcited by 101
- 2024OMG-Seg: Is One Model Good Enough For All Segmentation?cited by 75
- 2024CAFuser: Condition-Aware Multimodal Fusion for Robust Semantic Perception of Driving Scenescited by 33
7 more
- 2024Learning Modality-agnostic Representation for Semantic Segmentation from Any Modalitiescited by 31
- 2024ObjectRelator: Enabling Cross-View Object Relation Understanding Across Ego-Centric and Exo-Centric Perspectivescited by 29
- 2023Distilling Efficient Vision Transformers from CNNs for Semantic Segmentationcited by 18
- 2023Object Segmentation by Mining Cross-Modal Semanticscited by 12
- 2023Temporal-aware Hierarchical Mask Classification for Video Semantic Segmentationcited by 7
- 2024X-Prompt: Multi-modal Visual Prompt for Video Object Segmentationcited by 7
- 2025CamSAM2: Segment Anything Accurately in Camouflaged Videoscited by 7
Built on by
Citing papers per year: 2025: 3; 2026: 2.
5 papers.
- 2025EgoCross: Benchmarking Multimodal Large Language Models for Cross-Domain Egocentric Video Question Answeringcited by 21
- 2025Exo2EgoSyn: Unlocking Foundation Video Generation Models for Exocentric-to-Egocentric Video Synthesiscited by 15
- 2025V2-SAM: Marrying SAM2 with Multi-Prompt Experts for Cross-View Object Correspondencecited by 14
- 2026EgoSound: Benchmarking Sound Understanding in Egocentric Videoscited by 11
- 2026From Synchrony to Sequence: Exo-to-Ego Generation via Interpolationcited by 1
- 2026From Synchrony to Sequence: Exo-to-Ego Generation via Interpolation15 Apr 2026
- 2026EgoSound: Benchmarking Sound Understanding in Egocentric Videos15 Feb 2026
- 2025V2-SAM: Marrying SAM2 with Multi-Prompt Experts for Cross-View Object Correspondence25 Nov 2025
- 2025Exo2EgoSyn: Unlocking Foundation Video Generation Models for Exocentric-to-Egocentric Video Synthesis25 Nov 2025
- 2025EgoCross: Benchmarking Multimodal Large Language Models for Cross-Domain Egocentric Video Question Answering14 Aug 2025