MeMOTR: Long-Term Memory-Augmented Transformer for Multi-Object Tracking
Not on the map. Why?
Abstract (arXiv)
As a video task, Multiple Object Tracking (MOT) is expected to capture temporal information of targets effectively. Unfortunately, most existing methods only explicitly exploit the object features between adjacent frames, while lacking the capacity to model long-term temporal information. In this paper, we propose MeMOTR, a long-term memory-augmented Transformer for multi-object tracking. Our method is able to make the same object's track embedding more stable and distinguishable by leveraging long-term memory injection with a customized memory-attention layer. This significantly improves the target association ability of our model. Experimental results on DanceTrack show that MeMOTR impressively surpasses the state-of-the-art method by 7.9% and 13.0% on HOTA and AssA metrics, respectively. Furthermore, our model also outperforms other Transformer-based methods on association performance on MOT17 and generalizes well on BDD100K. Code is available at https://github.com/MCG-NJU/MeMOTR.
Key facts. Cited by 88 papers in the map (data through 14 Oct 2026). Builds on 43 of its 50 references that are in the map. First posted on arXiv 28 Jul 2023.
Builds on
43 of 50 references.
References · 43
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
- 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,288
- 2021YOLOX: Exceeding YOLO Series in 2021cited by 1,071
- 2017Simple Online and Realtime Tracking with a Deep Association Metriccited by 910
- 2016Simple Online and Realtime Trackingcited by 868
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 823
- 2016Performance Measures and a Data Set for Multi-Target, Multi-Camera Trackingcited by 692
31 more
- 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 690
- 2022DAB-DETR: Dynamic Anchor Boxes are Better Queries for DETRcited by 573
- 2020HOTA: A Higher Order Metric for Evaluating Multi-Object Trackingcited by 552
- 2016MOT16: A Benchmark for Multi-Object Trackingcited by 532
- 2021TrackFormer: Multi-Object Tracking with Transformerscited by 518
- 2020FairMOT: On the Fairness of Detection and Re-Identification in Multiple Object Trackingcited by 490
- 2020Tracking Objects as Pointscited by 483
- 2019Tracking without bells and whistlescited by 382
- 2021MOTR: End-to-End Multiple-Object Tracking with Transformercited by 381
- 2020TransTrack: Multiple Object Tracking with Transformercited by 371
- 2020MOT20: A benchmark for multi object tracking in crowded scenescited by 357
- 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 346
- 2019Towards Real-Time Multi-Object Trackingcited by 311
- 2018CrowdHuman: A Benchmark for Detecting Human in a Crowdcited by 284
- 2020Quasi-Dense Similarity Learning for Multiple Object Trackingcited by 220
- 2021DanceTrack: Multi-Object Tracking in Uniform Appearance and Diverse Motioncited by 217
- 2021Track to Detect and Segment: An Online Multi-Object Trackercited by 156
- 2018SoccerNet: A Scalable Dataset for Action Spotting in Soccer Videoscited by 150
- 2022MOTRv2: Bootstrapping End-to-End Multi-Object Tracking by Pretrained Object Detectorscited by 148
- 2023SportsMOT: A Large Multi-Object Tracking Dataset in Multiple Sports Scenescited by 131
- 2022MeMOT: Multi-Object Tracking with Memorycited by 114
- 2022Global Tracking Transformerscited by 110
- 2022Towards Grand Unification of Object Trackingcited by 93
- 2018Features for Multi-Target Multi-Camera Tracking and Re-Identificationcited by 88
- 2021MOTSynth: How Can Synthetic Data Help Pedestrian Detection and Tracking?cited by 69
- 2022Hard to Track Objects with Irregular Motions and Similar Appearances? Make It Easier by Buffering the Matching Spacecited by 66
- 2022Tracking Every Thing in the Wildcited by 44
- 2022Quo Vadis: Is Trajectory Forecasting the Key Towards Long-Term Multi-Object Tracking?cited by 29
- 2022End-to-end Tracking with a Multi-query Transformercited by 5
- 2022Tracking by Associating Clipscited by 5
- 2022Multiple Object Tracking Challenge Technical Report for Team MT_IoTcited by 3
Built on by
Citing papers per year: 2023: 2; 2024: 28; 2025: 29; 2026: 29.
88 papers.
Sort:
By area:
- 2024MapTracker: Tracking with Strided Memory Fusion for Consistent Vector HD Mappingcited by 68
- 2024Multiple Object Tracking as ID Predictioncited by 60
- 2024Bootstrapping Referring Multi-Object Trackingcited by 22
- 2024Samba: Synchronized Set-of-Sequences Modeling for Multiple Object Trackingcited by 21
- 2024EchoTrack: Auditory Referring Multi-Object Tracking for Autonomous Drivingcited by 19
- 2024MapExpert: Online HD Map Construction with Simple and Efficient Sparse Map Element Expertcited by 17
- 2025SAM2MOT: A Novel Paradigm of Multi-Object Tracking by Segmentationcited by 17
- 2024Self-Supervised Multi-Object Tracking with Path Consistencycited by 16
- 2024Multi-Object Tracking in the Darkcited by 14
- 2025Omnidirectional Multi-Object Trackingcited by 13
- 2025CoMotion: Concurrent Multi-person 3D Motioncited by 13
- 2024Beyond MOT: Semantic Multi-Object Trackingcited by 12
38 more
- 2025OVTR: End-to-End Open-Vocabulary Multiple Object Tracking with Transformercited by 11
- 2024DeconfuseTrack:Dealing with Confusion for Multi-Object Trackingcited by 9
- 2024ETTrack: Enhanced Temporal Motion Predictor for Multi-Object Trackingcited by 9
- 2024LaMOT: Language-Guided Multi-Object Trackingcited by 9
- 2025Memory-Augmented Transformers: A Systematic Review from Neuroscience Principles to Enhanced Model Architecturescited by 9
- 2024ColorMNet: A Memory-based Deep Spatial-Temporal Feature Propagation Network for Video Colorizationcited by 8
- 2023AttMOT: Improving Multiple-Object Tracking by Introducing Auxiliary Pedestrian Attributescited by 6
- 2024TrackSSM: A General Motion Predictor by State-Space Modelcited by 6
- 2025No Train Yet Gain: Towards Generic Multi-Object Tracking in Sports and Beyondcited by 6
- 2025Calibrated Decomposition of Aleatoric and Epistemic Uncertainty in Deep Features for Inference-Time Adaptationcited by 6
- 2024Associate Everything Detected: Facilitating Tracking-by-Detection to the Unknowncited by 5
- 2024Is Multiple Object Tracking a Matter of Specialization?cited by 5
- 2025MEX: Memory-efficient Approach to Referring Multi-Object Trackingcited by 4
- 2025CAMELTrack: Context-Aware Multi-cue ExpLoitation for Online Multi-Object Trackingcited by 4
- 2025Deep Learning-Based Multi-Object Tracking: A Comprehensive Survey from Foundations to State-of-the-Artcited by 4
- 2025Latest Object Memory Management for Temporally Consistent Video Instance Segmentationcited by 4
- 2025OmniTrack++: Omnidirectional Multi-Object Tracking by Learning Large-FoV Trajectory Feedbackcited by 4
- 2024On the Equivalency, Substitutability, and Flexibility of Synthetic Datacited by 3
- 2025NOOUGAT: Towards Unified Online and Offline Multi-Object Trackingcited by 3
- 2025Motion-Aware Vision-Reference Alignment for Referring Multi-Object Trackingcited by 3
- 2026TRIAGE: Type-Routed Interventions via Aleatoric-Epistemic Gated Estimation in Robotic Manipulation and Adaptive Perception -- Don't Treat All Uncertainty the Samecited by 3
- 2023DecoderTracker: Decoder-Only Method for Multiple-Object Trackingcited by 2
- 2024Is a Pure Transformer Effective for Separated and Online Multi-Object Tracking?cited by 2
- 2025History-Aware Transformation of ReID Features for Multiple Object Trackingcited by 2
- 2025SportMamba: Adaptive Non-Linear Multi-Object Tracking with State Space Models for Team Sportscited by 2
- 2025CrowdTrack: A Benchmark for Difficult Multiple Pedestrian Tracking in Real Scenarioscited by 2
- 2025A Tri-Modal Dataset and a Baseline System for Tracking Unmanned Aerial Vehiclescited by 2
- 2026AR-MOT: Autoregressive Multi-object Trackingcited by 2
- 2026Dual-level Adaptation for Multi-Object Tracking: Building Test-Time Calibration from Experience and Intuitioncited by 2
- 2026Hypergraph-State Collaborative Reasoning for Multi-Object Trackingcited by 2
- 2024AM-SORT: Adaptable Motion Predictor with Historical Trajectory Embedding for Multi-Object Trackingcited by 1
- 2024One Homography is All You Need: IMM-based Joint Homography and Multiple Object State Estimationcited by 1
- 2024Temporally Propagated Masks and Bounding Boxes: Combining the Best of Both Worlds for Multi-Object Trackingcited by 1
- 2024DINTR: Tracking via Diffusion-based Interpolationcited by 1
- 2024IP-MOT: Instance Prompt Learning for Cross-Domain Multi-Object Trackingcited by 1
- 2024Learning a Neural Association Network for Self-supervised Multi-Object Trackingcited by 1
- 2024FastTrackTr:Towards Fast Multi-Object Tracking with Transformerscited by 1
- 2025Attention to Trajectory: Trajectory-Aware Open-Vocabulary Trackingcited by 1
50 most cited of 88 All 88 (JSON)
- 2026SceneForesee: Learning Scene Evolution for Spatiotemporal Reasoning10 Oct 2026
- 2026MemReg: Streaming Outdoor LiDAR Point Cloud Registration with Hybrid Memory Buffers8 Oct 2026
- 2026ReWorld-Track: A Recursive Event World Model for Language-Guided Multi-Camera Tracking29 Sep 2026
- 2026LiAM-SAM: Lifecycle-Aware Memory for Robust SAM2-Based MOT23 Sep 2026
- 2026Beyond the Survey: A Systematic Empirical Study of Detection and Association in Visual MOT14 Sep 2026
- 2026Beyond the Image Plane: World-Grounded Queries for Multi-Object Tracking1 Sep 2026
- 2026Probing Association Instability with Track-State Perturbations for Clip-Level Active Learning in Query-Propagation Multi-Object Tracking18 Aug 2026
- 2026Training-Free Long-Term Multi-Object Tracking for Sports Video Analytics16 Aug 2026
- 2026The generator is the tracker: Multi-object tracking by painting persistent identity colours19 Jul 2026
- 2026REMIND: RE-Identification with Memory for INDoor Navigation10 Jul 2026
- 2026HieDG: A Hierarchical Discrete Geometry-Guided Framework for Multi-Animal Tracking1 Jul 2026
- 2026MVDGC: Joint 3D and 2D Multi-view Pedestrian Detection via Dual Geometric Constraints30 Jun 2026
38 more
- 2026PS-MOT: Cultivating Instance Awareness from Point Seeds for Multi-Object Tracking29 Jun 2026
- 2026Polycepta: Object-Centric Appearance Estimation for Multi-Object Tracking22 Jun 2026
- 2026FEMOT: Multi-Object Tracking using Frame and Event Cameras12 Jun 2026
- 2026Selective Mask Propagation for Multi-Object Tracking11 Jun 2026
- 2026IMPose: Interactive Multi-person Pose Estimation with Dynamic Correction Propagation3 Jun 2026
- 2026Clip-level Uncertainty and Temporal-aware Active Learning for End-to-End Multi-Object Tracking11 May 2026
- 2026GateMOT: Q-Gated Attention for Dense Object Tracking29 Apr 2026
- 2026Motion-Driven Multi-Object Tracking of Model Organisms in Space Science Experiments29 Apr 2026
- 2026Hypergraph-State Collaborative Reasoning for Multi-Object Tracking14 Apr 2026
- 2026Dual-level Adaptation for Multi-Object Tracking: Building Test-Time Calibration from Experience and Intuition23 Mar 2026
- 2026VSD-MOT: End-to-End Multi-Object Tracking in Low-Quality Video Scenes Guided by Visual Semantic Distillation21 Mar 2026
- 2026TRIAGE: Type-Routed Interventions via Aleatoric-Epistemic Gated Estimation in Robotic Manipulation and Adaptive Perception -- Don't Treat All Uncertainty the Same9 Mar 2026
- 2026Occlusion-Aware SORT: Observing Occlusion for Robust Multi-Object Tracking6 Mar 2026
- 2026AMV-L: Lifecycle-Managed Agent Memory for Tail-Latency Control in Long-Running LLM Systems22 Feb 2026
- 2026PredMapNet: Future and Historical Reasoning for Consistent Online HD Vectorized Map Construction18 Feb 2026
- 2026Wavelet-Domain Masked Image Modeling for Color-Consistent HDR Video Reconstruction7 Feb 2026
- 2026AR-MOT: Autoregressive Multi-object Tracking5 Jan 2026
- 2025Learning Association via Track-Detection Matching for Multi-Object Tracking26 Dec 2025
- 2025From Detection to Association: Learning Discriminative Object Embeddings for Multi-Object Tracking2 Dec 2025
- 2025SelfMOTR: Revisiting MOTR with Self-Generating Detection Priors25 Nov 2025
- 2025A Tri-Modal Dataset and a Baseline System for Tracking Unmanned Aerial Vehicles23 Nov 2025
- 2025Motion-Aware Vision-Reference Alignment for Referring Multi-Object Tracking21 Nov 2025
- 2025Calibrated Decomposition of Aleatoric and Epistemic Uncertainty in Deep Features for Inference-Time Adaptation15 Nov 2025
- 2025OmniTrack++: Omnidirectional Multi-Object Tracking by Learning Large-FoV Trajectory Feedback1 Nov 2025
- 2025MMOT: The First Challenging Benchmark for Drone-based Multispectral Multi-Object Tracking14 Oct 2025
- 2025Fast Self-Supervised depth and mask aware Association for Multi-Object Tracking10 Oct 2025
- 2025Motion-Aware Transformer for Multi-Object Tracking26 Sep 2025
- 2025VSE-MOT: Multi-Object Tracking in Low-Quality Video Scenes Guided by Visual Semantic Enhancement17 Sep 2025
- 2025Smoothed Online Optimization for Target Tracking: Robust and Learning-Augmented Algorithms7 Sep 2025
- 2025NOOUGAT: Towards Unified Online and Offline Multi-Object Tracking2 Sep 2025
- 2025To New Beginnings: A Survey of Unified Perception in Autonomous Vehicle Software28 Aug 2025
- 2025Memory-Augmented Transformers: A Systematic Review from Neuroscience Principles to Enhanced Model Architectures14 Aug 2025
- 2025Latest Object Memory Management for Temporally Consistent Video Instance Segmentation26 Jul 2025
- 2025CrowdTrack: A Benchmark for Difficult Multiple Pedestrian Tracking in Real Scenarios3 Jul 2025
- 2025Deep Learning-Based Multi-Object Tracking: A Comprehensive Survey from Foundations to State-of-the-Art16 Jun 2025
- 2025SportMamba: Adaptive Non-Linear Multi-Object Tracking with State Space Models for Team Sports3 Jun 2025
- 2025No Train Yet Gain: Towards Generic Multi-Object Tracking in Sports and Beyond2 Jun 2025
- 2025Depth-Aware Scoring and Hierarchical Alignment for Multiple Object Tracking1 Jun 2025
50 newest of 88 All 88 (JSON)
- 2024DINTR: Tracking via Diffusion-based Interpolationcited by 1
- 2024DINTR: Tracking via Diffusion-based Interpolation14 Oct 2024
- 2024MapTracker: Tracking with Strided Memory Fusion for Consistent Vector HD Mappingcited by 68
- 2024Multiple Object Tracking as ID Predictioncited by 60
- 2024Bootstrapping Referring Multi-Object Trackingcited by 22
- 2024Samba: Synchronized Set-of-Sequences Modeling for Multiple Object Trackingcited by 21
- 2024MapExpert: Online HD Map Construction with Simple and Efficient Sparse Map Element Expertcited by 17
- 2025SAM2MOT: A Novel Paradigm of Multi-Object Tracking by Segmentationcited by 17
- 2024Self-Supervised Multi-Object Tracking with Path Consistencycited by 16
- 2024Multi-Object Tracking in the Darkcited by 14
- 2025Omnidirectional Multi-Object Trackingcited by 13
- 2025CoMotion: Concurrent Multi-person 3D Motioncited by 13
- 2024Beyond MOT: Semantic Multi-Object Trackingcited by 12
- 2025OVTR: End-to-End Open-Vocabulary Multiple Object Tracking with Transformercited by 11
12 most cited of 80 All 80 (JSON)
- 2026MemReg: Streaming Outdoor LiDAR Point Cloud Registration with Hybrid Memory Buffers8 Oct 2026
- 2026LiAM-SAM: Lifecycle-Aware Memory for Robust SAM2-Based MOT23 Sep 2026
- 2026Beyond the Survey: A Systematic Empirical Study of Detection and Association in Visual MOT14 Sep 2026
- 2026Beyond the Image Plane: World-Grounded Queries for Multi-Object Tracking1 Sep 2026
- 2026Probing Association Instability with Track-State Perturbations for Clip-Level Active Learning in Query-Propagation Multi-Object Tracking18 Aug 2026
- 2026Training-Free Long-Term Multi-Object Tracking for Sports Video Analytics16 Aug 2026
- 2026The generator is the tracker: Multi-object tracking by painting persistent identity colours19 Jul 2026
- 2026REMIND: RE-Identification with Memory for INDoor Navigation10 Jul 2026
- 2026HieDG: A Hierarchical Discrete Geometry-Guided Framework for Multi-Animal Tracking1 Jul 2026
- 2026MVDGC: Joint 3D and 2D Multi-view Pedestrian Detection via Dual Geometric Constraints30 Jun 2026
- 2026PS-MOT: Cultivating Instance Awareness from Point Seeds for Multi-Object Tracking29 Jun 2026
- 2026Polycepta: Object-Centric Appearance Estimation for Multi-Object Tracking22 Jun 2026
12 newest of 80 All 80 (JSON)