GateMOT: Q-Gated Attention for Dense Object Tracking
Not on the map. Why?
Abstract (arXiv)
While large models demonstrate the strong representational power of vanilla attention, this core mechanism cannot be directly applied to Dense Object Tracking: its quadratic all-to-all interactions are computationally prohibitive for dense motion estimation on high-resolution features. This mismatch prevents Dense Object Tracking from fully leveraging attention-based modeling in crowded and occlusion-heavy scenes. To address this challenge, we introduce GateMOT, an online tracking framework centered on Q-Gated Attention (Q-Attention), an efficient and spatially aware attention variant. Our key idea is to repurpose the Query from a similarity-conditioning term into a learnable gating unit. This Gating-Query (Gating-Q) produces a probabilistic gate that modulates Key features in an element-wise manner, enabling explicit relevance selection instead of costly global aggregation. Built on this mechanism, parallel Q-Attention heads transform one shared feature map into task-specific yet consistent representations for detection, motion, and re-identification, yielding a tightly coupled multi-task decoder with linear-complexity gating operations. GateMOT achieves state-of-the-art HOTA of 48.4, MOTA of 67.8, and IDF1 of 64.5 on BEE24, and demonstrates strong performance on additional Dense Object Tracking benchmarks. These results show that Q-Attention is a simple, effective, and transferable building block for attention-based tracking in dense tracking scenarios.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 80 of its 93 references that are in the map. First posted on arXiv 29 Apr 2026.
Builds on
80 of 93 references.
References · 80
- 2017Attention Is All You Needcited by 60,106
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,043
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,625
- 2020End-to-End Object Detection with Transformerscited by 7,396
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,637
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,417
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,570
- 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 1,994
- 2020Rethinking Attention with Performerscited by 1,594
- 2020Linformer: Self-Attention with Linear Complexitycited by 1,469
- 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,362
- 2021YOLOX: Exceeding YOLO Series in 2021cited by 1,069
38 more
- 2017Simple Online and Realtime Tracking with a Deep Association Metriccited by 908
- 2016Simple Online and Realtime Trackingcited by 864
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 816
- 2020HOTA: A Higher Order Metric for Evaluating Multi-Object Trackingcited by 549
- 2021TrackFormer: Multi-Object Tracking with Transformerscited by 516
- 2020FairMOT: On the Fairness of Detection and Re-Identification in Multiple Object Trackingcited by 489
- 2020Tracking Objects as Pointscited by 483
- 2017Deep Layer Aggregationcited by 436
- 2019Tracking without bells and whistlescited by 382
- 2021MOTR: End-to-End Multiple-Object Tracking with Transformercited by 380
- 2020TransTrack: Multiple Object Tracking with Transformercited by 370
- 2020MOT20: A benchmark for multi object tracking in crowded scenescited by 355
- 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 346
- 2022BoT-SORT: Robust Associations Multi-Pedestrian Trackingcited by 317
- 2021Track to Detect and Segment: An Online Multi-Object Trackercited by 156
- 2022MOTRv2: Bootstrapping End-to-End Multi-Object Tracking by Pretrained Object Detectorscited by 148
- 2020MOTChallenge: A Benchmark for Single-Camera Multiple Target Trackingcited by 135
- 2017Detect to Track and Track to Detectcited by 131
- 2023SportsMOT: A Large Multi-Object Tracking Dataset in Multiple Sports Scenescited by 130
- 2021Learning to Track with Object Permanencecited by 118
- 2020Chained-Tracker: Chaining Paired Attentive Regression Results for End-to-End Joint Multiple-Object Detection and Trackingcited by 115
- 2022MeMOT: Multi-Object Tracking with Memorycited by 113
- 2022Global Tracking Transformerscited by 110
- 2021SimpleTrack: Understanding and Rethinking 3D Multi-object Trackingcited by 102
- 2021TransMOT: Spatial-Temporal Graph Transformer for Multiple Object Trackingcited by 93
- 2023MeMOTR: Long-Term Memory-Augmented Transformer for Multi-Object Trackingcited by 86
- 2022Transformer Tracking with Cyclic Shifting Window Attentioncited by 75
- 2021SMURF: Self-Teaching Multi-Frame Unsupervised RAFT with Full-Image Warpingcited by 74
- 2023Hybrid-SORT: Weak Cues Matter for Online Multi-Object Trackingcited by 66
- 2023MotionTrack: Learning Robust Short-term and Long-term Motions for Multi-Object Trackingcited by 64
- 2020AB3DMOT: A Baseline for 3D Multi-Object Tracking and New Evaluation Metricscited by 63
- 2021Do Different Tracking Tasks Require Different Appearance Models?cited by 62
- 2024DiffMOT: A Real-time Diffusion-based Multiple Object Tracker with Non-linear Predictioncited by 59
- 2024Multiple Object Tracking as ID Predictioncited by 59
- 2021Exploring Simple 3D Multi-Object Tracking for Autonomous Drivingcited by 56
- 2023Compact Transformer Tracker with Correlative Masked Modelingcited by 50
- 2022SIoU Loss: More Powerful Learning for Bounding Box Regressioncited by 49
- 2023SparseTrack: Multi-Object Tracking by Performing Scene Decomposition based on Pseudo-Depthcited by 48
50 most cited of 80 All 80 (JSON)
Built on by
Not cited yet.