mlsanityData to 7 Oct 2026

Hypergraph-State Collaborative Reasoning for Multi-Object Tracking

arXiv 2604.12665 ↗First posted 14 Apr 2026cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Motion reasoning serves as the cornerstone of multi-object tracking (MOT), as it enables consistent association of targets across frames. However, existing motion estimation approaches face two major limitations: (1) instability caused by noisy or probabilistic predictions, and (2) vulnerability under occlusion, where trajectories often fragment once visual cues disappear. To overcome these issues, we propose a collaborative reasoning framework that enhances motion estimation through joint inference among multiple correlated objects. By allowing objects with similar motion states to mutually constrain and refine each other, our framework stabilizes noisy trajectories and infers plausible motion continuity even when target is occluded. To realize this concept, we design HyperSSM, an architecture that integrates Hypergraph computation and a State Space Model (SSM) for unified spatial-temporal reasoning. The Hypergraph module captures spatial motion correlations through dynamic hyperedges, while the SSM enforces temporal smoothness via structured state transitions. This synergistic design enables simultaneous optimization of spatial consensus and temporal coherence, resulting in robust and stable motion estimation. Extensive experiments on four mainstream and diverse benchmarks(MOT17, MOT20, DanceTrack, and SportsMOT) covering various motion patterns and scene complexities, demonstrate that our approach achieves state-of-the-art performance across a wide range of tracking scenarios.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 59 of its 71 references that are in the map. First posted on arXiv 14 Apr 2026.

Builds on

59 of 71 references.

References · 59

  1. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  2. 2020End-to-End Object Detection with Transformerscited by 7,384
  3. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  4. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
  5. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
  6. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
  7. 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,361
  8. 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,283
  9. 2021YOLOX: Exceeding YOLO Series in 2021cited by 1,064
  10. 2017Simple Online and Realtime Tracking with a Deep Association Metriccited by 908
  11. 2016Simple Online and Realtime Trackingcited by 862
  12. 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 812
38 more
  1. 2016MOT16: A Benchmark for Multi-Object Trackingcited by 531
  2. 2021TrackFormer: Multi-Object Tracking with Transformerscited by 515
  3. 2018Hypergraph Neural Networkscited by 482
  4. 2022On the Parameterization and Initialization of Diagonal State Space Modelscited by 418
  5. 2021MOTR: End-to-End Multiple-Object Tracking with Transformercited by 379
  6. 2020TransTrack: Multiple Object Tracking with Transformercited by 370
  7. 2020MOT20: A benchmark for multi object tracking in crowded scenescited by 355
  8. 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 345
  9. 2022BoT-SORT: Robust Associations Multi-Pedestrian Trackingcited by 313
  10. 2021DanceTrack: Multi-Object Tracking in Uniform Appearance and Diverse Motioncited by 213
  11. 2022StrongSORT: Make DeepSORT Great Againcited by 213
  12. 2022MOTRv2: Bootstrapping End-to-End Multi-Object Tracking by Pretrained Object Detectorscited by 148
  13. 2023SportsMOT: A Large Multi-Object Tracking Dataset in Multiple Sports Scenescited by 130
  14. 2024ODTrack: Online Dense Temporal Token Learning for Visual Trackingcited by 129
  15. 2022MeMOT: Multi-Object Tracking with Memorycited by 113
  16. 2023MeMOTR: Long-Term Memory-Augmented Transformer for Multi-Object Trackingcited by 86
  17. 2022Transformer Tracking with Cyclic Shifting Window Attentioncited by 75
  18. 2023Hybrid-SORT: Weak Cues Matter for Online Multi-Object Trackingcited by 66
  19. 2022Unifying Short and Long-Term Tracking with Graph Hierarchiescited by 62
  20. 2023Towards Unified Token Learning for Vision-Language Trackingcited by 62
  21. 2024DiffMOT: A Real-time Diffusion-based Multiple Object Tracker with Non-linear Predictioncited by 59
  22. 2024Multiple Object Tracking as ID Predictioncited by 58
  23. 2024Exploiting Multimodal Spatial-temporal Patterns for Video Object Trackingcited by 55
  24. 2023Compact Transformer Tracker with Correlative Masked Modelingcited by 50
  25. 2023SparseTrack: Multi-Object Tracking by Performing Scene Decomposition based on Pseudo-Depthcited by 48
  26. 2021Learnable Graph Matching: Incorporating Graph Partitioning with Deep Feature Learning for Multiple Object Trackingcited by 47
  27. 2021TransCenter: Transformers with Dense Representations for Multiple-Object Trackingcited by 42
  28. 2023MOTRv3: Release-Fetch Supervision for End-to-End Multi-Object Trackingcited by 42
  29. 2023DiffusionTrack: Diffusion Model For Multi-Object Trackingcited by 40
  30. 2024Coupled Mamba: Enhanced Multi-modal Fusion with Coupled State Space Modelcited by 30
  31. 2025Towards Universal Modal Tracking with Online Dense Temporal Token Learningcited by 30
  32. 2024Hyper-YOLO: When Visual Object Detection Meets Hypergraph Computationcited by 29
  33. 2025Exploring Decoupled Spatio-Temporal Consistency Learning and Self-Prompting Evolution for Self-Supervised Trackingcited by 23
  34. 2021TrackMPNN: A Message Passing Graph Neural Architecture for Multi-Object Trackingcited by 21
  35. 2024Samba: Synchronized Set-of-Sequences Modeling for Multiple Object Trackingcited by 20
  36. 2020Tracking-by-Counting: Using Network Flows on Crowd Density Maps for Tracking Multiple Targetscited by 18
  37. 2024MambaTrack: A Simple Baseline for Multiple Object Tracking with State Space Modelcited by 18
  38. 2024Autogenic Language Embedding for Coherent Point Trackingcited by 17

50 most cited of 59 All 59 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025ReaMOT: A Benchmark and Framework for Reasoning-based Multi-Object Tracking
  2. 2024HyperGLM: HyperGraph for Video Scene Graph Generation and Anticipation
  3. 2026DynTrace: Tracking Dynamic Object Evidence for 4D Spatio-Temporal Reasoning in MLLMs
  4. 2026HSTGFormer: Hyper Spatial-Temporal Graph Transformer for 3D Human Pose Estimation
  5. 2026QTrack: Query-Driven Reasoning for Multi-modal MOT
  6. 2026StateTrace: An Object-Centric Framework for Hidden-State Spatiotemporal Reasoning in Long Videos
  7. 2024ConsistencyTrack: A Robust Multi-Object Tracker with a Generation Strategy of Consistency Model
  8. 2026Motion-o: Trajectory-Grounded Video Reasoning