mlsanityData to 7 Oct 2026

GroundNLQ @ Ego4D Natural Language Queries Challenge 2023

arXiv 2306.15255 ↗First posted 27 Jun 2023cs.CV cs.CLcited by 20

Not on the map. Why?

Abstract (arXiv)

In this report, we present our champion solution for Ego4D Natural Language Queries (NLQ) Challenge in CVPR 2023. Essentially, to accurately ground in a video, an effective egocentric feature extractor and a powerful grounding model are required. Motivated by this, we leverage a two-stage pre-training strategy to train egocentric feature extractors and the grounding model on video narrations, and further fine-tune the model on annotated data. In addition, we introduce a novel grounding model GroundNLQ, which employs a multi-modal multi-scale grounding module for effective video and text fusion and various temporal intervals, especially for long videos. On the blind test set, GroundNLQ achieves 25.67 and 18.18 for R1@IoU=0.3 and R1@IoU=0.5, respectively, and surpasses all other teams by a noticeable margin. Our code will be released aturlhttps://github.com/houzhijian/GroundNLQ.

Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 14 of its 14 references that are in the map. First posted on arXiv 27 Jun 2023.

Builds on

14 of 14 references.

References · 14

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  4. 2020Longformer: The Long-Document Transformercited by 3,362
  5. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
  6. 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,305
  7. 2022ActionFormer: Localizing Moments of Actions with Transformerscited by 308
  8. 2020Span-based Localizing Network for Natural Language Video Localizationcited by 234
  9. 2022InternVideo-Ego4D: A Pack of Champion Solutions to Ego4D Challengescited by 48
  10. 2023NaQ: Leveraging Narrations as Queries to Supervise Episodic Memorycited by 46
  11. 2022ReLER@ZJU-Alibaba Submission to the Ego4D Natural Language Queries Challenge 2022cited by 19
  12. 2022Egocentric Video-Language Pretraining @ Ego4D Challenge 2022cited by 6
2 more
  1. 2022A Simple Transformer-Based Model for Ego4D Natural Language Queries Challengecited by 6
  2. 2022An Efficient COarse-to-fiNE Alignment Framework @ Ego4D Natural Language Queries Challenge 2022cited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 2; 2024: 8; 2025: 4; 2026: 6.

20 papers.

Sort:

By area:

  1. 2024VideoAgent: A Memory-augmented Multimodal Agent for Video Understandingcited by 224
  2. 2023Grounded Question-Answering in Long Egocentric Videoscited by 62
  3. 2023LifelongMemory: Leveraging LLMs for Answering Queries in Long-form Egocentric Videoscited by 51
  4. 2024EgoVideo: Exploring Egocentric Foundation Model and Downstream Adaptationcited by 44
  5. 2025Rethinking Memory in LLM based Agents: Representations, Operations, and Emerging Topicscited by 36
  6. 2025Object-Shot Enhanced Grounding Network for Egocentric Videocited by 11
  7. 2024Evaluating Zero-Shot GPT-4V Performance on 3D Visual Question Answering Benchmarkscited by 10
  8. 2024ObjectNLQ @ Ego4D Episodic Memory Challenge 2024cited by 10
  9. 2024OmniQuery: Contextually Augmenting Captured Multimodal Memory to Enable Personal Question Answeringcited by 10
  10. 2024ViLCo-Bench: VIdeo Language COntinual learning Benchmarkcited by 9
  11. 2025OSGNet @ Ego4D Episodic Memory Challenge 2025cited by 6
  12. 2024CARLOR @ Ego4D Step Grounding Challenge: Bayesian temporal-order priors for test time refinementcited by 3
8 more
  1. 2024Streaming Detection of Queried Event Startcited by 3
  2. 2026EgoProx: Evaluating MLLMs on Egocentric 3D Proximity Reasoning Across a Cognitive Hierarchycited by 2
  3. 2025GazeNLQ @ Ego4D Natural Language Queries Challenge 2025cited by 0
  4. 2026Incentivizing Temporal-Awareness in Egocentric Video Understanding Modelscited by 0
  5. 2026Interactive Episodic Memory with User Feedbackcited by 0
  6. 2026OSGNet with MLLM Reranking @ Ego4D Episodic Memory Challenge 2026cited by 0
  7. 2026Hand Trajectory Fusion for Egocentric Natural Language Query Groundingcited by 0
  8. 2026Linguistic Trajectory Encoding for Efficient Long-Horizon Spatial Memory in Embodied Agentscited by 0