mlsanityData to 7 Oct 2026

Tracking Instances as Queries

arXiv 2106.11963 ↗First posted 22 Jun 2021cs.CV cs.AI cs.MMcited by 7

Not on the map. Why?

Abstract (arXiv)

Recently, query based deep networks catch lots of attention owing to their end-to-end pipeline and competitive results on several fundamental computer vision tasks, such as object detection, semantic segmentation, and instance segmentation. However, how to establish a query based video instance segmentation (VIS) framework with elegant architecture and strong performance remains to be settled. In this paper, we present QueryTrack (i.e., tracking instances as queries), a unified query based VIS framework fully leveraging the intrinsic one-to-one correspondence between instances and queries in QueryInst. The proposed method obtains 52.7 / 52.3 AP on YouTube-VIS-2019 / 2021 datasets, which wins the 2-nd place in the YouTube-VIS Challenge at CVPR 2021 with a single online end-to-end model, single scale testing & modest amount of training data. We also provide QueryTrack-ResNet-50 baseline results on YouTube-VIS-2021 val set as references for the VIS community.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 23 of its 24 references that are in the map. First posted on arXiv 22 Jun 2021.

Builds on

23 of 24 references.

References · 23

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  3. 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,540
  4. 2020Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformerscited by 1,368
  5. 2018The Open Images Dataset V4: Unified image classification, object detection, and visual relationship detection at scalecited by 542
  6. 2020Sparse R-CNN: End-to-End Object Detection with Learnable Proposalscited by 494
  7. 2020FairMOT: On the Fairness of Detection and Re-Identification in Multiple Object Trackingcited by 489
  8. 2020End-to-End Video Instance Segmentation with Transformerscited by 443
  9. 2019Video Instance Segmentationcited by 391
  10. 2020Quasi-Dense Similarity Learning for Multiple Object Trackingcited by 220
  11. 2021You Only Look at One Sequence: Rethinking Transformer in Vision through Object Detectioncited by 170
  12. 2019Classifying, Segmenting, and Tracking Object Instances in Video with Mask Propagationcited by 125
11 more
  1. 2020STEm-Seg: Spatio-temporal Embeddings for Instance Segmentation in Videoscited by 121
  2. 2020SipMask: Spatial Information Preservation for Fast Image and Video Instance Segmentationcited by 108
  3. 2021Video Instance Segmentation using Inter-Frame Communication Transformerscited by 105
  4. 2021Crossover Learning for Fast Online Video Instance Segmentationcited by 83
  5. 2021Video Instance Segmentation with a Propose-Reduce Paradigmcited by 74
  6. 2020Fast Video Object Segmentation using the Global Context Modulecited by 65
  7. 2020CompFeat: Comprehensive Feature Aggregation for Video Instance Segmentationcited by 53
  8. 2021MSG-Transformer: Exchanging Local Spatial Information by Manipulating Messenger Tokenscited by 46
  9. 2020Dual Semantic Fusion Network for Video Object Detectioncited by 12
  10. 20211st Place Solution for YouTubeVOS Challenge 2021:Video Instance Segmentationcited by 6
  11. 2021MSN: Efficient Online Mask Selection Network for Video Instance Segmentationcited by 6

Built on by

Cited by year

Citing papers per year: 2022: 4; 2023: 1; 2024: 2.

7 papers.

  1. 2022MinVIS: A Minimal Video Instance Segmentation Framework without Video-based Trainingcited by 94
  2. 2022Temporally Efficient Vision Transformer for Video Instance Segmentationcited by 55
  3. 2022Look Before You Match: Instance Understanding Matters in Video Object Segmentationcited by 33
  4. 2023GRAtt-VIS: Gated Residual Attention for Auto Rectifying Video Instance Segmentationcited by 9
  5. 2022Instance As Identity: A Generic Online Paradigm for Video Instance Segmentationcited by 8
  6. 2024What is Point Supervision Worth in Video Instance Segmentation?cited by 5
  7. 2024UVIS: Unsupervised Video Instance Segmentationcited by 5