Bridging Perspectives: A Survey on Cross-view Collaborative Intelligence with Egocentric-Exocentric Vision
Not on the map. Why?
Abstract (arXiv)
Perceiving the world from both egocentric (first-person) and exocentric (third-person) perspectives is fundamental to human cognition, enabling rich and complementary understanding of dynamic environments. In recent years, allowing the machines to leverage the synergistic potential of these dual perspectives has emerged as a compelling research direction in video understanding. In this survey, we provide a comprehensive review of video understanding from both exocentric and egocentric viewpoints. We begin by highlighting the practical applications of integrating egocentric and exocentric techniques, envisioning their potential collaboration across domains. We then identify key research tasks to realize these applications. Next, we systematically organize and review recent advancements into three main research directions: (1) leveraging egocentric data to enhance exocentric understanding, (2) utilizing exocentric data to improve egocentric analysis, and (3) joint learning frameworks that unify both perspectives. For each direction, we analyze a diverse set of tasks and relevant works. Additionally, we discuss benchmark datasets that support research in both perspectives, evaluating their scope, diversity, and applicability. Finally, we discuss limitations in current works and propose promising future research directions. By synthesizing insights from both perspectives, our goal is to inspire advancements in video understanding and artificial intelligence, bringing machines closer to perceiving the world in a human-like manner. A GitHub repo of related works can be found at https://github.com/ayiyayi/Awesome-Egocentric-and-Exocentric-Vision.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 168 of its 280 references that are in the map. First posted on arXiv 6 Jun 2025.
Builds on
168 of 280 references.
References · 168
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2023Visual Instruction Tuningcited by 7,869
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2015Learning Deep Features for Discriminative Localizationcited by 2,436
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
38 more
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
- 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,620
- 2021ViViT: A Video Vision Transformercited by 1,620
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,584
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
- 2014Two-Stream Convolutional Networks for Action Recognition in Videoscited by 1,068
- 2019HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clipscited by 950
- 2021Multiscale Vision Transformerscited by 897
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
- 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 590
- 2016Hollywood in Homes: Crowdsourcing Data Collection for Activity Understandingcited by 537
- 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 497
- 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 490
- 2017AVA: A Video Dataset of Spatio-temporally Localized Atomic Visual Actionscited by 449
- 2022ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulationcited by 312
- 2022Assembly101: A Large-Scale Multi-View Video Dataset for Understanding Procedural Activitiescited by 287
- 2023DragNUWA: Fine-grained Control in Video Generation by Integrating Text, Image, and Trajectorycited by 264
- 2021H2O: Two Hands Manipulating Objects for First Person Interaction Recognitioncited by 254
- 2022Egocentric Video-Language Pretrainingcited by 232
- 2020The EPIC-KITCHENS Dataset: Collection, Challenges and Baselinescited by 225
- 2022Tensor4D : Efficient Neural 4D Decomposition for High-fidelity Dynamic Reconstruction and Renderingcited by 217
- 2023NerfDiff: Single-image View Synthesis with NeRF-guided Distillation from 3D-aware Diffusioncited by 180
- 2023RoboAgent: Generalization and Efficiency in Robot Manipulation via Semantic Augmentations and Action Chunkingcited by 169
- 2020Beyond Static Features for Temporally Consistent 3D Human Pose and Shape from a Videocited by 163
- 2022Rethinking Visual Geo-localization for Large-Scale Applicationscited by 163
- 2023MixVPR: Feature Mixing for Visual Place Recognitioncited by 161
- 2022NeRDi: Single-View NeRF Synthesis with Language-Guided Diffusion as General Image Priorscited by 156
- 2024Video-RAG: Visually-aligned Retrieval-Augmented Long Video Comprehensioncited by 138
- 2021SPEC: Seeing People in the Wild with an Estimated Cameracited by 135
- 2024ALOHA Unleashed: A Simple Recipe for Robot Dexteritycited by 134
- 2023EgoVLPv2: Egocentric Video-Language Pre-training with Fusion in the Backbonecited by 130
- 2024LITA: Language Instructed Temporal-Localization Assistantcited by 125
- 2023VideoLLM: Modeling Video Sequence with Large Language Modelscited by 116
- 2024Nymeria: A Massive Collection of Multimodal Egocentric Daily Motion in the Wildcited by 114
50 most cited of 168 All 168 (JSON)
Built on by
Citing papers per year: 2025: 2; 2026: 6.
8 papers.
- 2025EgoThinker: Unveiling Egocentric Reasoning with Spatio-Temporal CoTcited by 16
- 2026Physion-Eval: Evaluating Physical Realism in Generated Video via Human Reasoningcited by 14
- 2025PhysBrain: Human Egocentric Data as a Bridge from Vision Language Models to Physical Intelligencecited by 11
- 2026VGGT-Segmentor: Geometry-Enhanced Cross-View Segmentationcited by 3
- 2026The Semantic Lifecycle in Embodied AI: Acquisition, Representation and Storage via Foundation Modelscited by 2
- 2026Decoding Pedestrian Crossing Intention from Egocentric Vision via Vision Language Modelscited by 1
- 2026ReViV: Reconstructing the Viewer and the View in 4D from Monocular Egocentric Videocited by 1
- 2026CrossView: Can Vision-Language Models Reason Across Cameras?cited by 1
- 2026CrossView: Can Vision-Language Models Reason Across Cameras?16 Aug 2026
- 2026ReViV: Reconstructing the Viewer and the View in 4D from Monocular Egocentric Video20 Jul 2026
- 2026Decoding Pedestrian Crossing Intention from Egocentric Vision via Vision Language Models8 Jun 2026
- 2026VGGT-Segmentor: Geometry-Enhanced Cross-View Segmentation15 Apr 2026
- 2026Physion-Eval: Evaluating Physical Realism in Generated Video via Human Reasoning20 Mar 2026
- 2026The Semantic Lifecycle in Embodied AI: Acquisition, Representation and Storage via Foundation Models12 Jan 2026
- 2025PhysBrain: Human Egocentric Data as a Bridge from Vision Language Models to Physical Intelligence18 Dec 2025
- 2025EgoThinker: Unveiling Egocentric Reasoning with Spatio-Temporal CoT27 Oct 2025