mlsanityData to 14 Oct 2026

Bridging Perspectives: A Survey on Cross-view Collaborative Intelligence with Egocentric-Exocentric Vision

arXiv 2506.06253 ↗First posted 6 Jun 2025cs.CVcited by 8

Not on the map. Why?

Abstract (arXiv)

Perceiving the world from both egocentric (first-person) and exocentric (third-person) perspectives is fundamental to human cognition, enabling rich and complementary understanding of dynamic environments. In recent years, allowing the machines to leverage the synergistic potential of these dual perspectives has emerged as a compelling research direction in video understanding. In this survey, we provide a comprehensive review of video understanding from both exocentric and egocentric viewpoints. We begin by highlighting the practical applications of integrating egocentric and exocentric techniques, envisioning their potential collaboration across domains. We then identify key research tasks to realize these applications. Next, we systematically organize and review recent advancements into three main research directions: (1) leveraging egocentric data to enhance exocentric understanding, (2) utilizing exocentric data to improve egocentric analysis, and (3) joint learning frameworks that unify both perspectives. For each direction, we analyze a diverse set of tasks and relevant works. Additionally, we discuss benchmark datasets that support research in both perspectives, evaluating their scope, diversity, and applicability. Finally, we discuss limitations in current works and propose promising future research directions. By synthesizing insights from both perspectives, our goal is to inspire advancements in video understanding and artificial intelligence, bringing machines closer to perceiving the world in a human-like manner. A GitHub repo of related works can be found at https://github.com/ayiyayi/Awesome-Egocentric-and-Exocentric-Vision.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 168 of its 280 references that are in the map. First posted on arXiv 6 Jun 2025.

Builds on

168 of 280 references.

References · 168

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
  3. 2023Visual Instruction Tuningcited by 7,869
  4. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
  5. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
  6. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
  7. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  8. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  9. 2015Learning Deep Features for Discriminative Localizationcited by 2,436
  10. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  11. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
  12. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
38 more
  1. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
  2. 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,620
  3. 2021ViViT: A Video Vision Transformercited by 1,620
  4. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,584
  5. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
  6. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
  7. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
  8. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
  9. 2014Two-Stream Convolutional Networks for Action Recognition in Videoscited by 1,068
  10. 2019HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clipscited by 950
  11. 2021Multiscale Vision Transformerscited by 897
  12. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
  13. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
  14. 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 590
  15. 2016Hollywood in Homes: Crowdsourcing Data Collection for Activity Understandingcited by 537
  16. 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 497
  17. 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 490
  18. 2017AVA: A Video Dataset of Spatio-temporally Localized Atomic Visual Actionscited by 449
  19. 2022ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulationcited by 312
  20. 2022Assembly101: A Large-Scale Multi-View Video Dataset for Understanding Procedural Activitiescited by 287
  21. 2023DragNUWA: Fine-grained Control in Video Generation by Integrating Text, Image, and Trajectorycited by 264
  22. 2021H2O: Two Hands Manipulating Objects for First Person Interaction Recognitioncited by 254
  23. 2022Egocentric Video-Language Pretrainingcited by 232
  24. 2020The EPIC-KITCHENS Dataset: Collection, Challenges and Baselinescited by 225
  25. 2022Tensor4D : Efficient Neural 4D Decomposition for High-fidelity Dynamic Reconstruction and Renderingcited by 217
  26. 2023NerfDiff: Single-image View Synthesis with NeRF-guided Distillation from 3D-aware Diffusioncited by 180
  27. 2023RoboAgent: Generalization and Efficiency in Robot Manipulation via Semantic Augmentations and Action Chunkingcited by 169
  28. 2020Beyond Static Features for Temporally Consistent 3D Human Pose and Shape from a Videocited by 163
  29. 2022Rethinking Visual Geo-localization for Large-Scale Applicationscited by 163
  30. 2023MixVPR: Feature Mixing for Visual Place Recognitioncited by 161
  31. 2022NeRDi: Single-View NeRF Synthesis with Language-Guided Diffusion as General Image Priorscited by 156
  32. 2024Video-RAG: Visually-aligned Retrieval-Augmented Long Video Comprehensioncited by 138
  33. 2021SPEC: Seeing People in the Wild with an Estimated Cameracited by 135
  34. 2024ALOHA Unleashed: A Simple Recipe for Robot Dexteritycited by 134
  35. 2023EgoVLPv2: Egocentric Video-Language Pre-training with Fusion in the Backbonecited by 130
  36. 2024LITA: Language Instructed Temporal-Localization Assistantcited by 125
  37. 2023VideoLLM: Modeling Video Sequence with Large Language Modelscited by 116
  38. 2024Nymeria: A Massive Collection of Multimodal Egocentric Daily Motion in the Wildcited by 114

50 most cited of 168 All 168 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 6.

8 papers.