mlsanityData to 7 Oct 2026

MeMOT: Multi-Object Tracking with Memory

arXiv 2203.16761 ↗First posted 31 Mar 2022cs.CVcited by 113

Not on the map. Why?

Abstract (arXiv)

We propose an online tracking algorithm that performs the object detection and data association under a common framework, capable of linking objects after a long time span. This is realized by preserving a large spatio-temporal memory to store the identity embeddings of the tracked objects, and by adaptively referencing and aggregating useful information from the memory as needed. Our model, called MeMOT, consists of three main modules that are all Transformer-based: 1) Hypothesis Generation that produce object proposals in the current video frame; 2) Memory Encoding that extracts the core information from the memory for each tracked object; and 3) Memory Decoding that solves the object detection and data association tasks simultaneously for multi-object tracking. When evaluated on widely adopted MOT benchmark datasets, MeMOT observes very competitive performance.

Key facts. Cited by 113 papers in the map (data through 7 Oct 2026). Builds on 55 of its 73 references that are in the map. First posted on arXiv 31 Mar 2022.

Builds on

55 of 73 references.

References · 55

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  5. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  6. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  7. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  8. 2020End-to-End Object Detection with Transformerscited by 7,384
  9. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
  10. 2015SSD: Single Shot MultiBox Detectorcited by 3,125
  11. 2021ViViT: A Video Vision Transformercited by 1,610
  12. 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,609
38 more
  1. 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,361
  2. 2019Objects as Pointscited by 1,172
  3. 2021Video Swin Transformercited by 1,090
  4. 2021YOLOX: Exceeding YOLO Series in 2021cited by 1,064
  5. 2017Simple Online and Realtime Tracking with a Deep Association Metriccited by 908
  6. 2014Neural Turing Machinescited by 630
  7. 2020HOTA: A Higher Order Metric for Evaluating Multi-Object Trackingcited by 546
  8. 2016MOT16: A Benchmark for Multi-Object Trackingcited by 531
  9. 2021TrackFormer: Multi-Object Tracking with Transformerscited by 515
  10. 2020FairMOT: On the Fairness of Detection and Re-Identification in Multiple Object Trackingcited by 489
  11. 2020Tracking Objects as Pointscited by 483
  12. 2019Video Object Segmentation using Space-Time Memory Networkscited by 436
  13. 2019Tracking without bells and whistlescited by 382
  14. 2021MOTR: End-to-End Multiple-Object Tracking with Transformercited by 379
  15. 2020TransTrack: Multiple Object Tracking with Transformercited by 370
  16. 2020MOT20: A benchmark for multi object tracking in crowded scenescited by 355
  17. 2014Memory Networkscited by 354
  18. 2019Towards Real-Time Multi-Object Trackingcited by 311
  19. 2018CrowdHuman: A Benchmark for Detecting Human in a Crowdcited by 283
  20. 2018Long-Term Feature Banks for Detailed Video Understandingcited by 239
  21. 2019Learning a Neural Solver for Multiple Object Trackingcited by 198
  22. 2021Track to Detect and Segment: An Online Multi-Object Trackercited by 156
  23. 2017Detect to Track and Track to Detectcited by 131
  24. 2020Video Object Segmentation with Episodic Graph Memory Networkscited by 118
  25. 2021Learning to Track with Object Permanencecited by 117
  26. 2015Ask Me Anything: Dynamic Memory Networks for Natural Language Processingcited by 116
  27. 2020Chained-Tracker: Chaining Paired Attentive Regression Results for End-to-End Joint Multiple-Object Detection and Trackingcited by 115
  28. 2021TransMOT: Spatial-Temporal Graph Transformer for Multiple Object Trackingcited by 93
  29. 2021STMTrack: Template-free Visual Tracking with Space-time Memory Networkscited by 91
  30. 2021An Image is Worth 16x16 Words, What is a Video Worth?cited by 87
  31. 2021Long Short-Term Transformer for Online Action Detectioncited by 87
  32. 2020TubeTK: Adopting Tubes to Track Multi-Object in a One-Step Training Modelcited by 70
  33. 2021Multiple Object Tracking with Correlation Learningcited by 67
  34. 2019FAMNet: Joint Learning of Feature, Affinity and Multi-dimensional Assignment for Online Multiple Object Trackingcited by 65
  35. 2016Dynamic Memory Networks for Visual and Textual Question Answeringcited by 62
  36. 2018Learning Dynamic Memory Networks for Object Trackingcited by 58
  37. 2019Global-to-local Memory Pointer Networks for Task-Oriented Dialoguecited by 47
  38. 2013Scalable Object Detection using Deep Neural Networkscited by 30

50 most cited of 55 All 55 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 10; 2023: 28; 2024: 38; 2025: 23; 2026: 14.

113 papers.

Sort:

By area:

  1. 2023MovieChat: From Dense Token to Sparse Memory for Long Video Understandingcited by 536
  2. 2023Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object Detectioncited by 313
  3. 2022MOTRv2: Bootstrapping End-to-End Multi-Object Tracking by Pretrained Object Detectorscited by 148
  4. 2023MeMOTR: Long-Term Memory-Augmented Transformer for Multi-Object Trackingcited by 86
  5. 2024MovieChat+: Question-aware Sparse Memory for Long Video Question Answeringcited by 73
  6. 2024MapTracker: Tracking with Strided Memory Fusion for Consistent Vector HD Mappingcited by 67
  7. 2023MotionTrack: Learning Robust Short-term and Long-term Motions for Multi-Object Trackingcited by 64
  8. 2022Unifying Short and Long-Term Tracking with Graph Hierarchiescited by 62
  9. 2024Multiple Object Tracking as ID Predictioncited by 58
  10. 2022A Generalized Framework for Video Instance Segmentationcited by 52
  11. 2022Simple Cues Lead to a Strong Multi-Object Trackercited by 44
  12. 2025StreamMind: Unlocking Full Frame Rate Streaming Video Dialogue through Event-Gated Cognitioncited by 44
38 more
  1. 2023MOTRv3: Release-Fetch Supervision for End-to-End Multi-Object Trackingcited by 42
  2. 2023DiffusionTrack: Diffusion Model For Multi-Object Trackingcited by 40
  3. 2023Video-kMaX: A Simple Unified Approach for Online and Near-Online Video Panoptic Segmentationcited by 24
  4. 2023MAMo: Leveraging Memory and Attention for Monocular Video Depth Estimationcited by 24
  5. 2023TOPIC: A Parallel Association Paradigm for Multi-Object Tracking under Complex Motions and Diverse Scenescited by 21
  6. 2024Bootstrapping Referring Multi-Object Trackingcited by 21
  7. 2023Bridging the Gap Between End-to-end and Non-End-to-end Multi-Object Trackingcited by 20
  8. 2024Samba: Synchronized Set-of-Sequences Modeling for Multiple Object Trackingcited by 20
  9. 2023MotionTrack: End-to-End Transformer-based Multi-Object Tracing with LiDAR-Camera Fusioncited by 19
  10. 2024EchoTrack: Auditory Referring Multi-Object Tracking for Autonomous Drivingcited by 18
  11. 2025SAM2MOT: A Novel Paradigm of Multi-Object Tracking by Segmentationcited by 17
  12. 2024Self-Supervised Multi-Object Tracking with Path Consistencycited by 16
  13. 2024MapExpert: Online HD Map Construction with Simple and Efficient Sparse Map Element Expertcited by 16
  14. 2023Object-Centric Multiple Object Trackingcited by 15
  15. 2022In Pursuit of Many: A Review of Modern Multiple Object Tracking Systemscited by 12
  16. 2023DeNoising-MOT: Towards Multiple Object Tracking with Severe Occlusionscited by 12
  17. 2023Streaming Video Modelcited by 10
  18. 2023Collaborative Tracking Learning for Frame-Rate-Insensitive Multi-Object Trackingcited by 10
  19. 2024DeconfuseTrack:Dealing with Confusion for Multi-Object Trackingcited by 9
  20. 2024RobMOT: Robust 3D Multi-Object Tracking by Observational Noise and State Estimation Drift Mitigation on LiDAR PointCloudcited by 9
  21. 2022Recent Advances in Embedding Methods for Multi-Object Tracking: A Surveycited by 8
  22. 2022Track Targets by Dense Spatio-Temporal Position Encodingcited by 8
  23. 2023Modeling Continuous Motion for 3D Point Cloud Object Trackingcited by 8
  24. 2024MCTR: Multi Camera Tracking Transformercited by 8
  25. 2023Self-Supervised Multi-Object Tracking For Autonomous Driving From Consistency Across Timescalescited by 7
  26. 2023Z-GMOT: Zero-shot Generic Multiple Object Trackingcited by 7
  27. 2023Multi-Scene Generalized Trajectory Global Graph Solver with Composite Nodes for Multiple Object Trackingcited by 7
  28. 2023TAO-Amodal: A Benchmark for Tracking Any Object Amodallycited by 7
  29. 2024SPAMming Labels: Efficient Annotations for the Trackers of Tomorrowcited by 7
  30. 2023Contrastive Learning for Multi-Object Tracking with Transformerscited by 6
  31. 2024Temporal-Enhanced Multimodal Transformer for Referring Multi-Object Tracking and Segmentationcited by 6
  32. 2025PD-SORT: Occlusion-Robust Multi-Object Tracking Using Pseudo-Depth Cuescited by 6
  33. 2025Calibrated Decomposition of Aleatoric and Epistemic Uncertainty in Deep Features for Inference-Time Adaptationcited by 6
  34. 2022End-to-end Tracking with a Multi-query Transformercited by 5
  35. 2023Out of Sight, Still in Mind: Reasoning and Planning about Unobserved Objects with Video Tracking Enabled Memory Modelscited by 5
  36. 2023Single-Shot and Multi-Shot Feature Learning for Multi-Object Trackingcited by 5
  37. 2024Associate Everything Detected: Facilitating Tracking-by-Detection to the Unknowncited by 5
  38. 2024DepthMOT: Depth Cues Lead to a Strong Multi-Object Trackercited by 4

50 most cited of 113 All 113 (JSON)