Hypergraph-State Collaborative Reasoning for Multi-Object Tracking
Not on the map. Why?
Abstract (arXiv)
Motion reasoning serves as the cornerstone of multi-object tracking (MOT), as it enables consistent association of targets across frames. However, existing motion estimation approaches face two major limitations: (1) instability caused by noisy or probabilistic predictions, and (2) vulnerability under occlusion, where trajectories often fragment once visual cues disappear. To overcome these issues, we propose a collaborative reasoning framework that enhances motion estimation through joint inference among multiple correlated objects. By allowing objects with similar motion states to mutually constrain and refine each other, our framework stabilizes noisy trajectories and infers plausible motion continuity even when target is occluded. To realize this concept, we design HyperSSM, an architecture that integrates Hypergraph computation and a State Space Model (SSM) for unified spatial-temporal reasoning. The Hypergraph module captures spatial motion correlations through dynamic hyperedges, while the SSM enforces temporal smoothness via structured state transitions. This synergistic design enables simultaneous optimization of spatial consensus and temporal coherence, resulting in robust and stable motion estimation. Extensive experiments on four mainstream and diverse benchmarks(MOT17, MOT20, DanceTrack, and SportsMOT) covering various motion patterns and scene complexities, demonstrate that our approach achieves state-of-the-art performance across a wide range of tracking scenarios.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 59 of its 71 references that are in the map. First posted on arXiv 14 Apr 2026.
Builds on
59 of 71 references.
References · 59
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
- 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,361
- 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,283
- 2021YOLOX: Exceeding YOLO Series in 2021cited by 1,064
- 2017Simple Online and Realtime Tracking with a Deep Association Metriccited by 908
- 2016Simple Online and Realtime Trackingcited by 862
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 812
38 more
- 2016MOT16: A Benchmark for Multi-Object Trackingcited by 531
- 2021TrackFormer: Multi-Object Tracking with Transformerscited by 515
- 2018Hypergraph Neural Networkscited by 482
- 2022On the Parameterization and Initialization of Diagonal State Space Modelscited by 418
- 2021MOTR: End-to-End Multiple-Object Tracking with Transformercited by 379
- 2020TransTrack: Multiple Object Tracking with Transformercited by 370
- 2020MOT20: A benchmark for multi object tracking in crowded scenescited by 355
- 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 345
- 2022BoT-SORT: Robust Associations Multi-Pedestrian Trackingcited by 313
- 2021DanceTrack: Multi-Object Tracking in Uniform Appearance and Diverse Motioncited by 213
- 2022StrongSORT: Make DeepSORT Great Againcited by 213
- 2022MOTRv2: Bootstrapping End-to-End Multi-Object Tracking by Pretrained Object Detectorscited by 148
- 2023SportsMOT: A Large Multi-Object Tracking Dataset in Multiple Sports Scenescited by 130
- 2024ODTrack: Online Dense Temporal Token Learning for Visual Trackingcited by 129
- 2022MeMOT: Multi-Object Tracking with Memorycited by 113
- 2023MeMOTR: Long-Term Memory-Augmented Transformer for Multi-Object Trackingcited by 86
- 2022Transformer Tracking with Cyclic Shifting Window Attentioncited by 75
- 2023Hybrid-SORT: Weak Cues Matter for Online Multi-Object Trackingcited by 66
- 2022Unifying Short and Long-Term Tracking with Graph Hierarchiescited by 62
- 2023Towards Unified Token Learning for Vision-Language Trackingcited by 62
- 2024DiffMOT: A Real-time Diffusion-based Multiple Object Tracker with Non-linear Predictioncited by 59
- 2024Multiple Object Tracking as ID Predictioncited by 58
- 2024Exploiting Multimodal Spatial-temporal Patterns for Video Object Trackingcited by 55
- 2023Compact Transformer Tracker with Correlative Masked Modelingcited by 50
- 2023SparseTrack: Multi-Object Tracking by Performing Scene Decomposition based on Pseudo-Depthcited by 48
- 2021Learnable Graph Matching: Incorporating Graph Partitioning with Deep Feature Learning for Multiple Object Trackingcited by 47
- 2021TransCenter: Transformers with Dense Representations for Multiple-Object Trackingcited by 42
- 2023MOTRv3: Release-Fetch Supervision for End-to-End Multi-Object Trackingcited by 42
- 2023DiffusionTrack: Diffusion Model For Multi-Object Trackingcited by 40
- 2024Coupled Mamba: Enhanced Multi-modal Fusion with Coupled State Space Modelcited by 30
- 2025Towards Universal Modal Tracking with Online Dense Temporal Token Learningcited by 30
- 2024Hyper-YOLO: When Visual Object Detection Meets Hypergraph Computationcited by 29
- 2025Exploring Decoupled Spatio-Temporal Consistency Learning and Self-Prompting Evolution for Self-Supervised Trackingcited by 23
- 2021TrackMPNN: A Message Passing Graph Neural Architecture for Multi-Object Trackingcited by 21
- 2024Samba: Synchronized Set-of-Sequences Modeling for Multiple Object Trackingcited by 20
- 2020Tracking-by-Counting: Using Network Flows on Crowd Density Maps for Tracking Multiple Targetscited by 18
- 2024MambaTrack: A Simple Baseline for Multiple Object Tracking with State Space Modelcited by 18
- 2024Autogenic Language Embedding for Coherent Point Trackingcited by 17
50 most cited of 59 All 59 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025ReaMOT: A Benchmark and Framework for Reasoning-based Multi-Object Tracking
- 2024HyperGLM: HyperGraph for Video Scene Graph Generation and Anticipation
- 2026DynTrace: Tracking Dynamic Object Evidence for 4D Spatio-Temporal Reasoning in MLLMs
- 2026HSTGFormer: Hyper Spatial-Temporal Graph Transformer for 3D Human Pose Estimation
- 2026QTrack: Query-Driven Reasoning for Multi-modal MOT
- 2026StateTrace: An Object-Centric Framework for Hidden-State Spatiotemporal Reasoning in Long Videos
- 2024ConsistencyTrack: A Robust Multi-Object Tracker with a Generation Strategy of Consistency Model
- 2026Motion-o: Trajectory-Grounded Video Reasoning