Learning a Neural Solver for Multiple Object Tracking
Not on the map. Why?
Abstract (arXiv)
Graphs offer a natural way to formulate Multiple Object Tracking (MOT) within the tracking-by-detection paradigm. However, they also introduce a major challenge for learning methods, as defining a model that can operate on such textitstructured domain is not trivial. As a consequence, most learning-based work has been devoted to learning better features for MOT, and then using these with well-established optimization frameworks. In this work, we exploit the classical network flow formulation of MOT to define a fully differentiable framework based on Message Passing Networks (MPNs). By operating directly on the graph domain, our method can reason globally over an entire set of detections and predict final solutions. Hence, we show that learning in MOT does not need to be restricted to feature extraction, but it can also be applied to the data association step. We show a significant improvement in both MOTA and IDF1 on three publicly available benchmarks. Our code is available at https://bit.ly/motsolv .
Key facts. Cited by 198 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Dec 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 48; 2022: 57; 2023: 31; 2024: 42; 2025: 14; 2026: 6.
198 papers.
Sort:
By area:
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 812
- 2021TrackFormer: Multi-Object Tracking with Transformerscited by 515
- 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 345
- 2022Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detectioncited by 313
- 2022StrongSORT: Make DeepSORT Great Againcited by 213
- 2021Track to Detect and Segment: An Online Multi-Object Trackercited by 156
- 2021Learning Target Candidate Association to Keep Track of What Not to Trackcited by 131
- 2021Learning to Track with Object Permanencecited by 117
- 2022MeMOT: Multi-Object Tracking with Memorycited by 113
- 2022Global Tracking Transformerscited by 110
- 2021SimpleTrack: Understanding and Rethinking 3D Multi-object Trackingcited by 102
- 2022VITA: Video Instance Segmentation via Object Token Associationcited by 94
38 more
- 2021TransMOT: Spatial-Temporal Graph Transformer for Multiple Object Trackingcited by 93
- 2022Towards Grand Unification of Object Trackingcited by 93
- 2022MUTR3D: A Multi-camera Tracking Framework via 3D-to-2D Queriescited by 90
- 2021EagerMOT: 3D Multi-Object Tracking via Sensor Fusioncited by 83
- 2021MOTSynth: How Can Synthetic Data Help Pedestrian Detection and Tracking?cited by 68
- 2021Multiple Object Tracking with Correlation Learningcited by 67
- 2023Hybrid-SORT: Weak Cues Matter for Online Multi-Object Trackingcited by 66
- 20214D Panoptic LiDAR Segmentationcited by 64
- 2023MotionTrack: Learning Robust Short-term and Long-term Motions for Multi-Object Trackingcited by 64
- 2021SiamMOT: Siamese Multi-Object Trackingcited by 62
- 2022Unifying Short and Long-Term Tracking with Graph Hierarchiescited by 62
- 2021The Dawn of Quantum Natural Language Processingcited by 60
- 2022A Survey on Graph Neural Networks and Graph Transformers in Computer Vision: A Task-Oriented Perspectivecited by 56
- 2023OVTrack: Open-Vocabulary Multiple Object Trackingcited by 53
- 2021Opening up Open-World Trackingcited by 50
- 2023SparseTrack: Multi-Object Tracking by Performing Scene Decomposition based on Pseudo-Depthcited by 48
- 2021Learnable Graph Matching: Incorporating Graph Partitioning with Deep Feature Learning for Multiple Object Trackingcited by 47
- 2022GIAOTracker: A comprehensive framework for MCMOT with global information and optimizing strategies in VisDrone 2021cited by 46
- 2023Towards Open-Vocabulary Video Instance Segmentationcited by 45
- 2022Simple Cues Lead to a Strong Multi-Object Trackercited by 44
- 2022Tracking Every Thing in the Wildcited by 44
- 2021Learning a Proposal Classifier for Multiple Object Trackingcited by 42
- 2021TransCenter: Transformers with Dense Representations for Multiple-Object Trackingcited by 42
- 2023DiffusionTrack: Diffusion Model For Multi-Object Trackingcited by 40
- 2021Learnable Online Graph Representations for 3D Multi-Object Trackingcited by 38
- 2024Neural Markov Random Field for Stereo Matchingcited by 38
- 2022AnimalTrack: A Benchmark for Multi-Animal Tracking in the Wildcited by 37
- 20224D-StOP: Panoptic Segmentation of 4D LiDAR using Spatio-temporal Object Proposal Generation and Aggregationcited by 35
- 2021Learning Intra-Batch Connections for Deep Metric Learningcited by 34
- 2021LMGP: Lifted Multicut Meets Geometry Projections for Multi-Camera Multi-Object Trackingcited by 34
- 2024ADA-Track++: End-to-End Multi-Camera 3D Multi-Object Tracking with Alternating Detection and Associationcited by 33
- 2022Time3D: End-to-End Joint Monocular 3D Object Detection and Tracking for Autonomous Drivingcited by 30
- 2022PolarMOT: How Far Can Geometric Relations Take Us in 3D Multi-Object Tracking?cited by 29
- 2022Quo Vadis: Is Trajectory Forecasting the Key Towards Long-Term Multi-Object Tracking?cited by 28
- 20223D Multi-Object Tracking Using Graph Neural Networks with Cross-Edge Modality Attentioncited by 27
- 2022Deep Interactive Motion Prediction and Planning: Playing Games with Motion Prediction Modelscited by 27
- 2021Track without Appearance: Learn Box and Tracklet Embedding with Local and Global Motion Patterns for Vehicle Trackingcited by 26
- 2021One More Check: Making "Fake Background" Be Tracked Againcited by 25
50 most cited of 198 All 198 (JSON)
- 2026UGO: Unified Architecture for General Multi-Object Tracking by Segmentation29 Sep 2026
- 2026ReWorld-Track: A Recursive Event World Model for Language-Guided Multi-Camera Tracking29 Sep 2026
- 2026Beyond the Image Plane: World-Grounded Queries for Multi-Object Tracking1 Sep 2026
- 2026Higher-Order Cell Tracking Transformer13 Jul 2026
- 2026HDST-GNN: Heterogeneous Dynamic Spatiotemporal Graph Neural Networks for Multi-Object Tracking in UAV Aerial Imagery4 Jun 2026
- 2026UniTrack: Differentiable Graph Representation Learning for Multi-Object Tracking4 Feb 2026
- 2025Learning Association via Track-Detection Matching for Multi-Object Tracking26 Dec 2025
- 2025Fast Self-Supervised depth and mask aware Association for Multi-Object Tracking10 Oct 2025
- 2025NOOUGAT: Towards Unified Online and Offline Multi-Object Tracking2 Sep 2025
- 2025MVTrajecter: Multi-View Pedestrian Tracking with Trajectory Motion Cost and Trajectory Appearance Cost1 Sep 2025
- 2025Delving into Dynamic Scene Cue-Consistency for Robust 3D Multi-Object Tracking15 Aug 2025
- 2025One Graph to Track Them All: Dynamic GNNs for Single- and Multi-View Tracking11 Jul 2025
38 more
- 2025Bayesian Multiobject Tracking With Neural-Enhanced Motion and Measurement Models22 Jun 2025
- 2025Deep Learning-Based Multi-Object Tracking: A Comprehensive Survey from Foundations to State-of-the-Art16 Jun 2025
- 2025SAM2Auto: Auto Annotation Using FLASH9 Jun 2025
- 2025Depth-Aware Scoring and Hierarchical Alignment for Multiple Object Tracking1 Jun 2025
- 2025CAMELTrack: Context-Aware Multi-cue ExpLoitation for Online Multi-Object Tracking2 May 2025
- 2025S3MOT: Monocular 3D Object Tracking with Selective State Space Model25 Apr 2025
- 2025Towards long-term player tracking with graph hierarchies and domain-specific features28 Feb 2025
- 2025CrossFuse: Learning Infrared and Visible Image Fusion by Cross-Sensor Top-K Vision Alignment and Beyond20 Feb 2025
- 2024Interacted Object Grounding in Spatio-Temporal Human-Object Interactions27 Dec 2024
- 2024Tell Me What to Track: Infusing Robust Language Guidance for Enhanced Referring Multi-Object Tracking17 Dec 2024
- 2024Heterogeneous Graph Transformer for Multiple Tiny Object Tracking in RGB-T Videos14 Dec 2024
- 2024ViCaS: A Dataset for Combining Holistic and Pixel-level Video Understanding using Captions with Grounded Segmentation12 Dec 2024
- 2024TGOSPA Metric Parameters Selection and Evaluation for Visual Multi-object Tracking11 Dec 2024
- 2024MCBLT: Multi-Camera Multi-Object 3D Tracking in Long Videos1 Dec 2024
- 2024MOT FCG++: Enhanced Representation of Spatio-temporal Motion and Appearance Features15 Nov 2024
- 2024PKF: Probabilistic Data Association Kalman Filter for Multi-Object Tracking10 Nov 2024
- 2024OVT-B: A New Large-Scale Benchmark for Open-Vocabulary Multi-Object Tracking23 Oct 2024
- 2024DINTR: Tracking via Diffusion-based Interpolation14 Oct 2024
- 2024Enhanced Kalman with Adaptive Appearance Motion SORT for Grounded Generic Multiple Object Tracking11 Oct 2024
- 2024A New Architecture for Neural Enhanced Multiobject Tracking8 Oct 2024
- 2024Spatial-Temporal Multi-Cuts for Online Multiple-Camera Vehicle Tracking3 Oct 2024
- 2024Cross-Camera Data Association via GNN for Supervised Graph Clustering1 Oct 2024
- 2024CAMOT: Camera Angle-aware Multi-Object Tracking26 Sep 2024
- 2024SLAck: Semantic, Location, and Appearance Aware Open-Vocabulary Tracking17 Sep 2024
- 2024When to Extract ReID Features: A Selective Approach for Improved Multiple Object Tracking10 Sep 2024
- 2024TP-GMOT: Tracking Generic Multiple Object by Textual Prompt with Motion-Appearance Cost (MAC) SORT4 Sep 2024
- 2024MMDRFuse: Distilled Mini-Model with Dynamic Refresh for Multi-Modality Image Fusion28 Aug 2024
- 2024MambaTrack: A Simple Baseline for Multiple Object Tracking with State Space Model17 Aug 2024
- 2024RTAT: A Robust Two-stage Association Tracker for Multi-Object Tracking14 Aug 2024
- 2024CORT: Class-Oriented Real-time Tracking for Embedded Systems20 Jul 2024
- 2024Temporal Correlation Meets Embedding: Towards a 2nd Generation of JDE-based Real-Time Multi-Object Tracking19 Jul 2024
- 2024Edge Graph Intelligence: Reciprocally Empowering Edge Networks with Graph Intelligence7 Jul 2024
- 2024SSP-GNN: Learning to Track via Bilevel Optimization5 Jul 2024
- 2024FeatureSORT: Essential Features for Effective Tracking5 Jul 2024
- 2024Multi-Granularity Language-Guided Training for Multi-Object Tracking7 Jun 2024
- 2024Is a Pure Transformer Effective for Separated and Online Multi-Object Tracking?23 May 2024
- 2024Multi Player Tracking in Ice Hockey with Homographic Projections22 May 2024
- 2024ADA-Track++: End-to-End Multi-Camera 3D Multi-Object Tracking with Alternating Detection and Association14 May 2024
50 newest of 198 All 198 (JSON)
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 812
- 2021TrackFormer: Multi-Object Tracking with Transformerscited by 515
- 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 345
- 2022Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detectioncited by 313
- 2022StrongSORT: Make DeepSORT Great Againcited by 213
- 2021Track to Detect and Segment: An Online Multi-Object Trackercited by 156
- 2021Learning Target Candidate Association to Keep Track of What Not to Trackcited by 131
- 2021Learning to Track with Object Permanencecited by 117
- 2022MeMOT: Multi-Object Tracking with Memorycited by 113
- 2022Global Tracking Transformerscited by 110
- 2021SimpleTrack: Understanding and Rethinking 3D Multi-object Trackingcited by 102
- 2022VITA: Video Instance Segmentation via Object Token Associationcited by 94
12 most cited of 189 All 189 (JSON)
- 2026UGO: Unified Architecture for General Multi-Object Tracking by Segmentation29 Sep 2026
- 2026Beyond the Image Plane: World-Grounded Queries for Multi-Object Tracking1 Sep 2026
- 2026Higher-Order Cell Tracking Transformer13 Jul 2026
- 2026HDST-GNN: Heterogeneous Dynamic Spatiotemporal Graph Neural Networks for Multi-Object Tracking in UAV Aerial Imagery4 Jun 2026
- 2026UniTrack: Differentiable Graph Representation Learning for Multi-Object Tracking4 Feb 2026
- 2025Learning Association via Track-Detection Matching for Multi-Object Tracking26 Dec 2025
- 2025Fast Self-Supervised depth and mask aware Association for Multi-Object Tracking10 Oct 2025
- 2025NOOUGAT: Towards Unified Online and Offline Multi-Object Tracking2 Sep 2025
- 2025MVTrajecter: Multi-View Pedestrian Tracking with Trajectory Motion Cost and Trajectory Appearance Cost1 Sep 2025
- 2025Delving into Dynamic Scene Cue-Consistency for Robust 3D Multi-Object Tracking15 Aug 2025
- 2025One Graph to Track Them All: Dynamic GNNs for Single- and Multi-View Tracking11 Jul 2025
- 2025Bayesian Multiobject Tracking With Neural-Enhanced Motion and Measurement Models22 Jun 2025
12 newest of 189 All 189 (JSON)