mlsanityData to 14 Oct 2026

Exploiting Feature Diversity for Make-up Temporal Video Grounding

arXiv 2208.06179 ↗First posted 12 Aug 2022cs.CV cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

This technical report presents the 3rd winning solution for MTVG, a new task introduced in the 4-th Person in Context (PIC) Challenge at ACM MM 2022. MTVG aims at localizing the temporal boundary of the step in an untrimmed video based on a textual description. The biggest challenge of this task is the fi ne-grained video-text semantics of make-up steps. However, current methods mainly extract video features using action-based pre-trained models. As actions are more coarse-grained than make-up steps, action-based features are not sufficient to provide fi ne-grained cues. To address this issue,we propose to achieve fi ne-grained representation via exploiting feature diversities. Specifically, we proposed a series of methods from feature extraction, network optimization, to model ensemble. As a result, we achieved 3rd place in the MTVG competition.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 17 of its 19 references that are in the map. First posted on arXiv 12 Aug 2022.

Builds on

17 of 19 references.

References · 17

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  4. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
  5. 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,375
  6. 2021ViViT: A Video Vision Transformercited by 1,620
  7. 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,616
  8. 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,322
  9. 2017The "something something" video database for learning and evaluating visual common sensecited by 1,103
  10. 2021Video Swin Transformercited by 1,091
  11. 2021Multiscale Vision Transformerscited by 897
  12. 2019Learning 2D Temporal Adjacent Networks for Moment Localization with Natural Languagecited by 285
5 more
  1. 2021Context-aware Biaffine Localizing Network for Temporal Sentence Groundingcited by 107
  2. 2021Negative Sample Matters: A Renaissance of Metric Learning for Temporal Groundingcited by 90
  3. 2021End-to-end Multi-modal Video Temporal Groundingcited by 47
  4. 2020Multi-Scale 2D Temporal Adjacent Networks for Moment Localization with Natural Languagecited by 29
  5. 2021Natural Language Video Localization with Learnable Moment Proposalscited by 27

Built on by

Cited by year

Citing papers per year: 2023: 1.

1 paper.