TransTrack: Multiple Object Tracking with Transformer
Not on the map. Why?
Abstract (arXiv)
In this work, we propose TransTrack, a simple but efficient scheme to solve the multiple object tracking problems. TransTrack leverages the transformer architecture, which is an attention-based query-key mechanism. It applies object features from the previous frame as a query of the current frame and introduces a set of learned object queries to enable detecting new-coming objects. It builds up a novel joint-detection-and-tracking paradigm by accomplishing object detection and object association in a single shot, simplifying complicated multi-step settings in tracking-by-detection methods. On MOT17 and MOT20 benchmark, TransTrack achieves 74.5% and 64.5% MOTA, respectively, competitive to the state-of-the-art methods. We expect TransTrack to provide a novel perspective for multiple object tracking. The code is available at: urlhttps://github.com/PeizeSun/TransTrack.
Key facts. Cited by 371 papers in the map (data through 14 Oct 2026). First posted on arXiv 31 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 41; 2022: 86; 2023: 83; 2024: 85; 2025: 46; 2026: 30.
371 papers.
Sort:
By area:
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
- 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,962
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 864
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 823
- 2021TransReID: Transformer-based Object Re-Identificationcited by 435
- 2021MOTR: End-to-End Multiple-Object Tracking with Transformercited by 381
- 2021Learning Spatio-Temporal Transformer for Visual Trackingcited by 350
- 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 346
- 2022BoT-SORT: Robust Associations Multi-Pedestrian Trackingcited by 320
- 2023Perception Test: A Diagnostic Benchmark for Multimodal Video Modelscited by 314
- 2022MAXIM: Multi-Axis MLP for Image Processingcited by 302
- 2024SparseDrive: End-to-End Autonomous Driving via Sparse Scene Representationcited by 241
38 more
- 2021DanceTrack: Multi-Object Tracking in Uniform Appearance and Diverse Motioncited by 217
- 2022StrongSORT: Make DeepSORT Great Againcited by 213
- 2022Language as Queries for Referring Video Object Segmentationcited by 182
- 2021Visual Saliency Transformercited by 175
- 2022BinsFormer: Revisiting Adaptive Bins for Monocular Depth Estimationcited by 168
- 2021Instances as Queriescited by 158
- 2021Track to Detect and Segment: An Online Multi-Object Trackercited by 156
- 2022DETRs with Hybrid Matchingcited by 150
- 2022MOTRv2: Bootstrapping End-to-End Multi-Object Tracking by Pretrained Object Detectorscited by 148
- 2022AiATrack: Attention in Attention for Transformer Visual Trackingcited by 137
- 2021TransFG: A Transformer Architecture for Fine-grained Recognitioncited by 132
- 2023Deep OC-SORT: Multi-Pedestrian Tracking by Adaptive Re-Identificationcited by 132
- 2023SportsMOT: A Large Multi-Object Tracking Dataset in Multiple Sports Scenescited by 131
- 2023Transformer-Based Visual Segmentation: A Surveycited by 124
- 2022MeMOT: Multi-Object Tracking with Memorycited by 114
- 2022Global Tracking Transformerscited by 110
- 2022AvatarPoser: Articulated Full-Body Pose Tracking from Sparse Motion Sensingcited by 110
- 2021SeqFormer: Sequential Transformer for Video Instance Segmentationcited by 98
- 2022In Defense of Online Models for Video Instance Segmentationcited by 97
- 2021TransMOT: Spatial-Temporal Graph Transformer for Multiple Object Trackingcited by 93
- 2022Towards Grand Unification of Object Trackingcited by 93
- 2023Referring Multi-Object Trackingcited by 93
- 2023ReasonNet: End-to-End Driving with Temporal and Global Reasoningcited by 93
- 2022MUTR3D: A Multi-camera Tracking Framework via 3D-to-2D Queriescited by 91
- 2023MeMOTR: Long-Term Memory-Augmented Transformer for Multi-Object Trackingcited by 88
- 2023DiffFit: Unlocking Transferability of Large Diffusion Models via Simple Parameter-Efficient Fine-Tuningcited by 84
- 2022Video K-Net: A Simple, Strong, and Unified Baseline for Video Segmentationcited by 79
- 2022TransVOD: End-to-End Video Object Detection with Spatial-Temporal Transformerscited by 78
- 2021CATs: Cost Aggregation Transformers for Visual Correspondencecited by 77
- 2024Autoregressive Queries for Adaptive Tracking with Spatio-TemporalTransformerscited by 76
- 2022Boosting Crowd Counting via Multifaceted Attentioncited by 73
- 2023Sparse4D v3: Advancing End-to-End 3D Detection and Trackingcited by 70
- 2024MapTracker: Tracking with Strided Memory Fusion for Consistent Vector HD Mappingcited by 68
- 2023Hybrid-SORT: Weak Cues Matter for Online Multi-Object Trackingcited by 67
- 2022Hard to Track Objects with Irregular Motions and Similar Appearances? Make It Easier by Buffering the Matching Spacecited by 66
- 2022QDTrack: Quasi-Dense Similarity Learning for Appearance-Only Multiple Object Trackingcited by 61
- 2024Multiple Object Tracking as ID Predictioncited by 60
- 2024DiffMOT: A Real-time Diffusion-based Multiple Object Tracker with Non-linear Predictioncited by 59
50 most cited of 371 All 371 (JSON)
- 2026MOTIP2: Spatial Priors for End-to-End Multi-Object Tracking7 Oct 2026
- 2026UGO: Unified Architecture for General Multi-Object Tracking by Segmentation29 Sep 2026
- 2026VastMAT: A Large-Scale Multi-Category Benchmark for Multi-Animal Tracking28 Sep 2026
- 2026LiAM-SAM: Lifecycle-Aware Memory for Robust SAM2-Based MOT23 Sep 2026
- 2026EECTracker: Swarm Motion Prior-Guided Feature Compensation for Airborne Optical UAV Swarm Tracking14 Sep 2026
- 2026Beyond the Image Plane: World-Grounded Queries for Multi-Object Tracking1 Sep 2026
- 2026CD-RMOT-Bench: Benchmarking the Cross-Domain Referring Multi-Object Tracking28 Jul 2026
- 2026The generator is the tracker: Multi-object tracking by painting persistent identity colours19 Jul 2026
- 2026HieDG: A Hierarchical Discrete Geometry-Guided Framework for Multi-Animal Tracking1 Jul 2026
- 2026PS-MOT: Cultivating Instance Awareness from Point Seeds for Multi-Object Tracking29 Jun 2026
- 2026FEMOT: Multi-Object Tracking using Frame and Event Cameras12 Jun 2026
- 2026CalibFree: Self-Supervised View Feature Separation for Calibration-Free Multi-Camera Multi-Object Tracking10 May 2026
38 more
- 2026Time-series Meets Complex Motion Modeling: Robust and Computational-effective Motion Predictor for Multi-object Tracking1 May 2026
- 2026GateMOT: Q-Gated Attention for Dense Object Tracking29 Apr 2026
- 2026Training-Free Semantic Multi-Object Tracking with Vision-Language Models15 Apr 2026
- 2026Radar-Informed 3D Multi-Object Tracking under Adverse Conditions15 Apr 2026
- 2026Hypergraph-State Collaborative Reasoning for Multi-Object Tracking14 Apr 2026
- 2026LEO: Graph Attention Network based Hybrid Multi Sensor Extended Object Fusion and Tracking for Autonomous Driving Applications2 Apr 2026
- 2026Out of Sight, Out of Track: Adversarial Attacks on Propagation-based Multi-Object Trackers via Query State Manipulation1 Apr 2026
- 2026COVTrack++: Learning Open-Vocabulary Multi-Object Tracking from Continuous Videos via a Synergistic Paradigm25 Mar 2026
- 2026Dual-level Adaptation for Multi-Object Tracking: Building Test-Time Calibration from Experience and Intuition23 Mar 2026
- 2026VSD-MOT: End-to-End Multi-Object Tracking in Low-Quality Video Scenes Guided by Visual Semantic Distillation21 Mar 2026
- 2026Sparse3DTrack: Monocular 3D Object Tracking Using Sparse Supervision18 Mar 2026
- 2026Occlusion-Aware SORT: Observing Occlusion for Robust Multi-Object Tracking6 Mar 2026
- 2026PredMapNet: Future and Historical Reasoning for Consistent Online HD Vectorized Map Construction18 Feb 2026
- 2026Detecting Object Tracking Failure via Sequential Hypothesis Testing13 Feb 2026
- 2026UniTrack: Differentiable Graph Representation Learning for Multi-Object Tracking4 Feb 2026
- 2026Generative Semantic Multi-Object Tracking: A Large-Scale Benchmark and an MLLM-Driven Reasoning Framework10 Jan 2026
- 2026AR-MOT: Autoregressive Multi-object Tracking5 Jan 2026
- 2026Crowded Video Individual Counting Informed by Social Grouping and Spatial-Temporal Displacement Priors3 Jan 2026
- 2025CropTrack: A Tracking with Re-Identification Framework for Precision Agriculture31 Dec 2025
- 2025ST-DETrack: Identity-Preserving Branch Tracking in Entangled Plant Canopies via Dual Spatiotemporal Evidence17 Dec 2025
- 2025From Detection to Association: Learning Discriminative Object Embeddings for Multi-Object Tracking2 Dec 2025
- 2025DM3T: Harmonizing Modalities via Diffusion for Multi-Object Tracking28 Nov 2025
- 2025AerialMind: Towards Referring Multi-Object Tracking in UAV Scenarios26 Nov 2025
- 2025SelfMOTR: Revisiting MOTR with Self-Generating Detection Priors25 Nov 2025
- 2025A Tri-Modal Dataset and a Baseline System for Tracking Unmanned Aerial Vehicles23 Nov 2025
- 2025Motion-Aware Vision-Reference Alignment for Referring Multi-Object Tracking21 Nov 2025
- 2025OmniPT: Unleashing the Potential of Large Vision Language Models for Pedestrian Tracking and Understanding21 Nov 2025
- 2025SOTFormer: A Minimal Transformer for Unified Object Tracking and Trajectory Prediction14 Nov 2025
- 2025OmniTrack++: Omnidirectional Multi-Object Tracking by Learning Large-FoV Trajectory Feedback1 Nov 2025
- 2025Multi-Camera Worker Tracking in Logistics Warehouse Considering Wide-Angle Distortion22 Oct 2025
- 2025Fast Self-Supervised depth and mask aware Association for Multi-Object Tracking10 Oct 2025
- 2025From Camera-Based Sensing to Reasoning: A Comprehensive Review Toward Proactive Vulnerable Road User Safety30 Sep 2025
- 2025Motion-Aware Transformer for Multi-Object Tracking26 Sep 2025
- 2025Lattice Boltzmann Model for Learning Real-World Pixel Dynamicity20 Sep 2025
- 2025VSE-MOT: Multi-Object Tracking in Low-Quality Video Scenes Guided by Visual Semantic Enhancement17 Sep 2025
- 2025To New Beginnings: A Survey of Unified Perception in Autonomous Vehicle Software28 Aug 2025
- 2025SMTrack: End-to-End Trained Spiking Neural Networks for Multi-Object Tracking in RGB Videos20 Aug 2025
- 2025FastTracker: Real-Time and Accurate Visual Tracking20 Aug 2025
50 newest of 371 All 371 (JSON)
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 864
- 2023DiffFit: Unlocking Transferability of Large Diffusion Models via Simple Parameter-Efficient Fine-Tuningcited by 84
- 2023DiffusionTrack: Diffusion Model For Multi-Object Trackingcited by 40
- 2024FLUX that Plays Musiccited by 18
- 2024LDTrack: Dynamic People Tracking by Service Robots using Diffusion Modelscited by 3
- 2024ConsistencyTrack: A Robust Multi-Object Tracker with a Generation Strategy of Consistency Modelcited by 0
- 2024FLUX that Plays Music1 Sep 2024
- 2024ConsistencyTrack: A Robust Multi-Object Tracker with a Generation Strategy of Consistency Model28 Aug 2024
- 2024LDTrack: Dynamic People Tracking by Service Robots using Diffusion Models13 Feb 2024
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesis30 Sep 2023
- 2023DiffusionTrack: Diffusion Model For Multi-Object Tracking19 Aug 2023
- 2023DiffFit: Unlocking Transferability of Large Diffusion Models via Simple Parameter-Efficient Fine-Tuning13 Apr 2023
- 2024SparseDrive: End-to-End Autonomous Driving via Sparse Scene Representationcited by 241
- 2023ReasonNet: End-to-End Driving with Temporal and Global Reasoningcited by 93
- 2024SparseAD: Sparse Query-Centric Paradigm for Efficient End-to-End Autonomous Drivingcited by 47
- 2024EchoTrack: Auditory Referring Multi-Object Tracking for Autonomous Drivingcited by 19
- 2024SparseDrive: End-to-End Autonomous Driving via Sparse Scene Representation30 May 2024
- 2024SparseAD: Sparse Query-Centric Paradigm for Efficient End-to-End Autonomous Driving10 Apr 2024
- 2024EchoTrack: Auditory Referring Multi-Object Tracking for Autonomous Driving28 Feb 2024
- 2023ReasonNet: End-to-End Driving with Temporal and Global Reasoning17 May 2023
- 2025OmniPT: Unleashing the Potential of Large Vision Language Models for Pedestrian Tracking and Understandingcited by 1
- 2025EffOWT: Transfer Visual Language Models to Open-World Tracking Efficiently and Effectivelycited by 0
- 2025VSE-MOT: Multi-Object Tracking in Low-Quality Video Scenes Guided by Visual Semantic Enhancementcited by 0
- 2026Training-Free Semantic Multi-Object Tracking with Vision-Language Modelscited by 0
- 2026Training-Free Semantic Multi-Object Tracking with Vision-Language Models15 Apr 2026
- 2025OmniPT: Unleashing the Potential of Large Vision Language Models for Pedestrian Tracking and Understanding21 Nov 2025
- 2025VSE-MOT: Multi-Object Tracking in Low-Quality Video Scenes Guided by Visual Semantic Enhancement17 Sep 2025
- 2025EffOWT: Transfer Visual Language Models to Open-World Tracking Efficiently and Effectively7 Apr 2025
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
- 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,962
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 823
- 2021TransReID: Transformer-based Object Re-Identificationcited by 435
- 2021MOTR: End-to-End Multiple-Object Tracking with Transformercited by 381
- 2021Learning Spatio-Temporal Transformer for Visual Trackingcited by 350
- 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 346
- 2022BoT-SORT: Robust Associations Multi-Pedestrian Trackingcited by 320
- 2022MAXIM: Multi-Axis MLP for Image Processingcited by 302
- 2021DanceTrack: Multi-Object Tracking in Uniform Appearance and Diverse Motioncited by 217
- 2022StrongSORT: Make DeepSORT Great Againcited by 213
- 2022Language as Queries for Referring Video Object Segmentationcited by 182
12 most cited of 351 All 351 (JSON)
- 2026MOTIP2: Spatial Priors for End-to-End Multi-Object Tracking7 Oct 2026
- 2026UGO: Unified Architecture for General Multi-Object Tracking by Segmentation29 Sep 2026
- 2026VastMAT: A Large-Scale Multi-Category Benchmark for Multi-Animal Tracking28 Sep 2026
- 2026LiAM-SAM: Lifecycle-Aware Memory for Robust SAM2-Based MOT23 Sep 2026
- 2026EECTracker: Swarm Motion Prior-Guided Feature Compensation for Airborne Optical UAV Swarm Tracking14 Sep 2026
- 2026Beyond the Image Plane: World-Grounded Queries for Multi-Object Tracking1 Sep 2026
- 2026CD-RMOT-Bench: Benchmarking the Cross-Domain Referring Multi-Object Tracking28 Jul 2026
- 2026The generator is the tracker: Multi-object tracking by painting persistent identity colours19 Jul 2026
- 2026HieDG: A Hierarchical Discrete Geometry-Guided Framework for Multi-Animal Tracking1 Jul 2026
- 2026PS-MOT: Cultivating Instance Awareness from Point Seeds for Multi-Object Tracking29 Jun 2026
- 2026FEMOT: Multi-Object Tracking using Frame and Event Cameras12 Jun 2026
- 2026CalibFree: Self-Supervised View Feature Separation for Calibration-Free Multi-Camera Multi-Object Tracking10 May 2026
12 newest of 351 All 351 (JSON)