mlsanityData to 14 Oct 2026

ObjectNLQ @ Ego4D Episodic Memory Challenge 2024

arXiv 2406.15778 ↗First posted 22 Jun 2024cs.CV cs.AIcited by 10

Not on the map. Why?

Abstract (arXiv)

In this report, we present our approach for the Natural Language Query track and Goal Step track of the Ego4D Episodic Memory Benchmark at CVPR 2024. Both challenges require the localization of actions within long video sequences using textual queries. To enhance localization accuracy, our method not only processes the temporal information of videos but also identifies fine-grained objects spatially within the frames. To this end, we introduce a novel approach, termed ObjectNLQ, which incorporates an object branch to augment the video representation with detailed object information, thereby improving grounding efficiency. ObjectNLQ achieves a mean R@1 of 23.15, ranking 2nd in the Natural Language Queries Challenge, and gains 33.00 in terms of the metric R@1, IoU=0.3, ranking 3rd in the Goal Step Challenge. Our code will be released at https://github.com/Yisen-Feng/ObjectNLQ.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 14 of its 20 references that are in the map. First posted on arXiv 22 Jun 2024.

Builds on

14 of 20 references.

References · 14

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
  3. 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,217
  4. 2022ActionFormer: Localizing Moments of Actions with Transformerscited by 311
  5. 2022DETRs with Collaborative Hybrid Assignments Trainingcited by 274
  6. 2020Span-based Localizing Network for Natural Language Video Localizationcited by 235
  7. 2022InternVideo-Ego4D: A Pack of Champion Solutions to Ego4D Challengescited by 48
  8. 2023NaQ: Leveraging Narrations as Queries to Supervise Episodic Memorycited by 46
  9. 2022CONE: An Efficient COarse-to-fiNE Alignment Framework for Long Video Temporal Groundingcited by 27
  10. 2023GroundNLQ @ Ego4D Natural Language Queries Challenge 2023cited by 20
  11. 2022ReLER@ZJU-Alibaba Submission to the Ego4D Natural Language Queries Challenge 2022cited by 19
  12. 2023Action Sensitivity Learning for the Ego4D Episodic Memory Challenge 2023cited by 7
2 more
  1. 2022Egocentric Video-Language Pretraining @ Ego4D Challenge 2022cited by 6
  2. 2022A Simple Transformer-Based Model for Ego4D Natural Language Queries Challengecited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 6; 2026: 3.

10 papers.

  1. 2025Spatial Understanding from Videos: Structured Prompts Meet Simulation Datacited by 28
  2. 2025Exo2Ego: Exocentric Knowledge Guided MLLM for Egocentric Video Understandingcited by 25
  3. 2024Online Episodic Memory Visual Query Localization with Egocentric Streaming Object Memorycited by 11
  4. 2025Technical Report for Ego4D Long-Term Action Anticipation Challenge 2025cited by 9
  5. 2025HCQA-1.5 @ Ego4D EgoSchema Challenge 2025cited by 6
  6. 2025OSGNet @ Ego4D Episodic Memory Challenge 2025cited by 6
  7. 2026MARS: Technical Report for the CASTLE Challenge at EgoVis 2026cited by 1
  8. 2025GazeNLQ @ Ego4D Natural Language Queries Challenge 2025cited by 0
  9. 2026OSGNet with MLLM Reranking @ Ego4D Episodic Memory Challenge 2026cited by 0
  10. 2026Hand Trajectory Fusion for Egocentric Natural Language Query Groundingcited by 0