mlsanityData to 7 Oct 2026

Action Sensitivity Learning for the Ego4D Episodic Memory Challenge 2023

arXiv 2306.09172 ↗First posted 15 Jun 2023cs.CVcited by 7

Not on the map. Why?

Abstract (arXiv)

This report presents ReLER submission to two tracks in the Ego4D Episodic Memory Benchmark in CVPR 2023, including Natural Language Queries and Moment Queries. This solution inherits from our proposed Action Sensitivity Learning framework (ASL) to better capture discrepant information of frames. Further, we incorporate a series of stronger video features and fusion strategies. Our method achieves an average mAP of 29.34, ranking 1st in Moment Queries Challenge, and garners 19.79 mean R1, ranking 2nd in Natural Language Queries Challenge. Our code will be released.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 22 of its 26 references that are in the map. First posted on arXiv 15 Jun 2023.

Builds on

22 of 26 references.

References · 22

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
  3. 2018SlowFast Networks for Video Recognitioncited by 1,862
  4. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
  5. 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,305
  6. 2017Focal Loss for Dense Object Detectioncited by 749
  7. 2019Distance-IoU Loss: Faster and Better Learning for Bounding Box Regressioncited by 454
  8. 2017Soft-NMS -- Improving Object Detection With One Line of Codecited by 380
  9. 2019BMN: Boundary-Matching Network for Temporal Action Proposal Generationcited by 327
  10. 2022ActionFormer: Localizing Moments of Actions with Transformerscited by 308
  11. 2019Learning 2D Temporal Adjacent Networks for Moment Localization with Natural Languagecited by 283
  12. 2019G-TAD: Sub-Graph Localization for Temporal Action Detectioncited by 248
10 more
  1. 2020Span-based Localizing Network for Natural Language Video Localizationcited by 234
  2. 2022Egocentric Video-Language Pretrainingcited by 231
  3. 2022Omnivore: A Single Model for Many Visual Modalitiescited by 214
  4. 2021Learning Salient Boundary Feature for Anchor-free Temporal Action Localizationcited by 156
  5. 2022CenterCLIP: Token Clustering for Efficient Text-Video Retrievalcited by 86
  6. 2022InternVideo-Ego4D: A Pack of Champion Solutions to Ego4D Challengescited by 48
  7. 2023NaQ: Leveraging Narrations as Queries to Supervise Episodic Memorycited by 46
  8. 2023Action Sensitivity Learning for Temporal Action Localizationcited by 28
  9. 2022ReLER@ZJU-Alibaba Submission to the Ego4D Natural Language Queries Challenge 2022cited by 19
  10. 2022A Simple Transformer-Based Model for Ego4D Natural Language Queries Challengecited by 6

Built on by

Cited by year

Citing papers per year: 2023: 2; 2024: 3; 2025: 2.

7 papers.

  1. 2023LifelongMemory: Leveraging LLMs for Answering Queries in Long-form Egocentric Videoscited by 51
  2. 2024EgoVideo: Exploring Egocentric Foundation Model and Downstream Adaptationcited by 44
  3. 2024EgoChoir: Capturing 3D Human-Object Interaction Regions from Egocentric Viewscited by 26
  4. 2023Text-Conditioned Resampler For Long Form Video Understandingcited by 24
  5. 2025Object-Shot Enhanced Grounding Network for Egocentric Videocited by 11
  6. 2024ObjectNLQ @ Ego4D Episodic Memory Challenge 2024cited by 10
  7. 2025Hier-EgoPack: Hierarchical Egocentric Video Understanding with Diverse Task Perspectivescited by 5