mlsanityData to 14 Oct 2026

Four Eyes Are Better Than Two: Harnessing the Collaborative Potential of Large Models via Differentiated Thinking and Complementary Ensembles

arXiv 2505.16784 ↗First posted 22 May 2025cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

In this paper, we present the runner-up solution for the Ego4D EgoSchema Challenge at CVPR 2025 (Confirmed on May 20, 2025). Inspired by the success of large models, we evaluate and leverage leading accessible multimodal large models and adapt them to video understanding tasks via few-shot learning and model ensemble strategies. Specifically, diversified prompt styles and process paradigms are systematically explored and evaluated to effectively guide the attention of large models, fully unleashing their powerful generalization and adaptability abilities. Experimental results demonstrate that, with our carefully designed approach, directly utilizing an individual multimodal model already outperforms the previous state-of-the-art (SOTA) method which includes several additional processes. Besides, an additional stage is further introduced that facilitates the cooperation and ensemble of periodic results, which achieves impressive performance improvements. We hope this work serves as a valuable reference for the practical application of large models and inspires future research in the field. Our Code is available at https://github.com/XiongjunGuan/EgoSchema-CVPR25.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 16 of its 16 references that are in the map. First posted on arXiv 22 May 2025.

Builds on

16 of 16 references.

References · 16

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  3. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
  4. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
  5. 2023mPLUG-Owl: Modularization Empowers Large Language Models with Multimodalitycited by 1,040
  6. 2023EgoSchema: A Diagnostic Benchmark for Very Long-form Video Language Understandingcited by 680
  7. 2024VideoAgent: Long-form Video Understanding with Large Language Model as Agentcited by 332
  8. 2024InternVideo2: Scaling Foundation Models for Multimodal Video Understandingcited by 317
  9. 2022Learning Video Representations from Large Language Modelscited by 205
  10. 2023A Simple LLM Framework for Long-Range Video Question-Answeringcited by 178
  11. 2024Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction Tuningcited by 121
  12. 2023LifelongMemory: Leveraging LLMs for Answering Queries in Long-form Egocentric Videoscited by 51
4 more
  1. 2024Memory Consolidation Enables Long-Context Video Understandingcited by 45
  2. 2023Zero-Shot Video Question Answering with Procedural Programscited by 37
  3. 2023A Simple Recipe for Contrastively Pre-training Video-First Encoders Beyond 16 Framescited by 34
  4. 2024HCQA @ Ego4D EgoSchema Challenge 2024cited by 9

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.