mlsanityData to 7 Oct 2026

A Simple Transformer-Based Model for Ego4D Natural Language Queries Challenge

arXiv 2211.08704 ↗First posted 16 Nov 2022cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

This report describes Badgers@UW-Madison, our submission to the Ego4D Natural Language Queries (NLQ) Challenge. Our solution inherits the point-based event representation from our prior work on temporal action localization, and develops a Transformer-based model for video grounding. Further, our solution integrates several strong video features including SlowFast, Omnivore and EgoVLP. Without bells and whistles, our submission based on a single model achieves 12.64% Mean R@1 and is ranked 2nd on the public leaderboard. Meanwhile, our method garners 28.45% (18.03%) R@5 at tIoU=0.3 (0.5), surpassing the top-ranked solution by up to 5.5 absolute percentage points.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 11 of its 12 references that are in the map. First posted on arXiv 16 Nov 2022.

Builds on

11 of 12 references.

References · 11

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2018SlowFast Networks for Video Recognitioncited by 1,862
  4. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
  5. 2017Soft-NMS -- Improving Object Detection With One Line of Codecited by 380
  6. 2022ActionFormer: Localizing Moments of Actions with Transformerscited by 308
  7. 2022Egocentric Video-Language Pretrainingcited by 231
  8. 2022Omnivore: A Single Model for Many Visual Modalitiescited by 214
  9. 2021AdaAttN: Revisit Attention Mechanism in Arbitrary Neural Style Transfercited by 178
  10. 2021A Survey on Temporal Sentence Grounding in Videoscited by 29
  11. 2022ReLER@ZJU-Alibaba Submission to the Ego4D Natural Language Queries Challenge 2022cited by 19

Built on by

Cited by year

Citing papers per year: 2023: 4; 2024: 1; 2025: 1.

6 papers.

  1. 2023NaQ: Leveraging Narrations as Queries to Supervise Episodic Memorycited by 46
  2. 2023GroundNLQ @ Ego4D Natural Language Queries Challenge 2023cited by 20
  3. 2023SpotEM: Efficient Video Search for Episodic Memorycited by 17
  4. 2024ObjectNLQ @ Ego4D Episodic Memory Challenge 2024cited by 10
  5. 2023Action Sensitivity Learning for the Ego4D Episodic Memory Challenge 2023cited by 7
  6. 2025Building Egocentric Procedural AI Assistant: Methods, Benchmarks, and Challengescited by 5