mlsanityData to 7 Oct 2026

ZJU ReLER Submission for EPIC-KITCHEN Challenge 2023: TREK-150 Single Object Tracking

arXiv 2307.02508 ↗First posted 5 Jul 2023cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

The Associating Objects with Transformers (AOT) framework has exhibited exceptional performance in a wide range of complex scenarios for video object tracking and segmentation. In this study, we convert the bounding boxes to masks in reference frames with the help of the Segment Anything Model (SAM) and Alpha-Refine, and then propagate the masks to the current frame, transforming the task from Video Object Tracking (VOT) to video object segmentation (VOS). Furthermore, we introduce MSDeAOT, a variant of the AOT series that incorporates transformers at multiple feature scales. MSDeAOT efficiently propagates object masks from previous frames to the current frame using two feature scales of 16 and 8. As a testament to the effectiveness of our design, we achieved the 1st place in the EPIC-KITCHENS TREK-150 Object Tracking Challenge.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 25 of its 32 references that are in the map. First posted on arXiv 5 Jul 2023.

Builds on

25 of 32 references.

References · 25

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  3. 2023Segment Anythingcited by 8,158
  4. 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 942
  5. 2018GOT-10k: A Large High-Diversity Benchmark for Generic Object Tracking in the Wildcited by 471
  6. 2018LaSOT: A High-quality Benchmark for Large-scale Single Object Trackingcited by 424
  7. 2018YouTube-VOS: A Large-Scale Video Object Segmentation Benchmarkcited by 381
  8. 2022MixFormer: End-to-End Tracking with Iterative Mixed Attentioncited by 278
  9. 2023MOSE: A New Dataset for Video Object Segmentation in Complex Scenescited by 232
  10. 2021Associating Objects with Transformers for Video Object Segmentationcited by 225
  11. 2023Segment and Track Anythingcited by 193
  12. 2022Decoupling Features in Hierarchical Propagation for Video Object Segmentationcited by 146
13 more
  1. 2020Collaborative Video Object Segmentation by Foreground-Background Integrationcited by 142
  2. 2022EPIC-KITCHENS VISOR Benchmark: VIdeo Segmentations and Object Relationscited by 139
  3. 2021A Survey on Deep Learning Technique for Video Segmentationcited by 132
  4. 2021SwinTrack: A Simple and Strong Baseline for Transformer Trackingcited by 126
  5. 2020Alpha-Refine: Boosting Tracking Performance by Precise Bounding Box Estimationcited by 81
  6. 2020Collaborative Video Object Segmentation by Multi-Scale Foreground-Background Integrationcited by 81
  7. 2022Robust Visual Tracking by Segmentationcited by 38
  8. 2023EgoTracks: A Long-term Egocentric Visual Object Tracking Datasetcited by 27
  9. 2022Locality-Aware Inter-and Intra-Video Reconstruction for Self-Supervised Correspondence Learningcited by 26
  10. 2022Visual Object Tracking in First Person Visioncited by 25
  11. 2021Is First Person Vision Challenging for Object Tracking?cited by 21
  12. 2023Unified Sequence-to-Sequence Learning for Single- and Multi-Modal Visual Object Trackingcited by 20
  13. 2023Unified Mask Embedding and Correspondence Learning for Self-Supervised Video Segmentationcited by 16

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.

  1. 2024Segment Anything for Videos: A Systematic Surveycited by 5