mlsanityData to 7 Oct 2026

OmniTrack++: Omnidirectional Multi-Object Tracking by Learning Large-FoV Trajectory Feedback

arXiv 2511.00510 ↗First posted 1 Nov 2025cs.CV cs.RO eess.IVcited by 2

Not on the map. Why?

Abstract (arXiv)

To address panoramic distortion, large search space, and identity ambiguity under a 360deg FoV, OmniTrack++ adopts a feedback-driven framework that progressively refines perception with trajectory cues. A DynamicSSM block first stabilizes panoramic features, implicitly alleviating geometric distortion. On top of normalized representations, FlexiTrack Instances use trajectory-informed feedback for flexible localization and reliable short-term association. To ensure long-term robustness, an ExpertTrack Memory consolidates appearance cues via a Mixture-of-Experts design, enabling recovery from fragmented tracks and reducing identity drift. Finally, a Tracklet Management module adaptively switches between end-to-end and tracking-by-detection modes according to scene dynamics, offering a balanced and scalable solution for panoramic MOT. To support rigorous evaluation, we establish the EmboTrack benchmark, a comprehensive dataset for panoramic MOT that includes QuadTrack, captured with a quadruped robot, and BipTrack, collected with a bipedal wheel-legged robot. Together, these datasets span wide-angle environments and diverse motion patterns, providing a challenging testbed for real-world panoramic perception. Extensive experiments on JRDB and EmboTrack demonstrate that OmniTrack++ achieves state-of-the-art performance, yielding substantial HOTA improvements of +3.94 on JRDB and +15.03 on QuadTrack over the original OmniTrack. These results highlight the effectiveness of trajectory-informed feedback, adaptive paradigm switching, and robust long-term memory in advancing panoramic multi-object tracking. Datasets and code will be made available at https://github.com/xifen523/OmniTrack.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 97 of its 139 references that are in the map. First posted on arXiv 1 Nov 2025.

Builds on

97 of 139 references.

References · 97

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  3. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
  4. 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,283
  5. 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,282
  6. 2022Planning-oriented Autonomous Drivingcited by 1,068
  7. 2017Simple Online and Realtime Tracking with a Deep Association Metriccited by 908
  8. 2016Simple Online and Realtime Trackingcited by 862
  9. 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Modelscited by 834
  10. 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 812
  11. 2016Performance Measures and a Data Set for Multi-Target, Multi-Camera Trackingcited by 685
  12. 2020HOTA: A Higher Order Metric for Evaluating Multi-Object Trackingcited by 546
38 more
  1. 2016MOT16: A Benchmark for Multi-Object Trackingcited by 531
  2. 2023DETRs Beat YOLOs on Real-time Object Detectioncited by 526
  3. 2021TrackFormer: Multi-Object Tracking with Transformerscited by 515
  4. 2021MOTR: End-to-End Multiple-Object Tracking with Transformercited by 379
  5. 2020TransTrack: Multiple Object Tracking with Transformercited by 370
  6. 2020MOT20: A benchmark for multi object tracking in crowded scenescited by 355
  7. 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 345
  8. 2022BoT-SORT: Robust Associations Multi-Pedestrian Trackingcited by 313
  9. 2021DanceTrack: Multi-Object Tracking in Uniform Appearance and Diverse Motioncited by 213
  10. 2022StrongSORT: Make DeepSORT Great Againcited by 213
  11. 2023Panacea: Panoramic and Controllable Video Generation for Autonomous Drivingcited by 165
  12. 2022MOTRv2: Bootstrapping End-to-End Multi-Object Tracking by Pretrained Object Detectorscited by 148
  13. 2023SportsMOT: A Large Multi-Object Tracking Dataset in Multiple Sports Scenescited by 130
  14. 2022PanoFormer: Panorama Transformer for Indoor 360 Depth Estimationcited by 94
  15. 2021UniFuse: Unidirectional Fusion for 360circ Panorama Depth Estimationcited by 91
  16. 2023MeMOTR: Long-Term Memory-Augmented Transformer for Multi-Object Trackingcited by 86
  17. 2024DreamScene360: Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splattingcited by 81
  18. 2023PanoGen: Text-Conditioned Panoramic Environment Generation for Vision-and-Language Navigationcited by 77
  19. 2023Hybrid-SORT: Weak Cues Matter for Online Multi-Object Trackingcited by 66
  20. 2023MotionTrack: Learning Robust Short-term and Long-term Motions for Multi-Object Trackingcited by 64
  21. 2024DiffMOT: A Real-time Diffusion-based Multiple Object Tracker with Non-linear Predictioncited by 59
  22. 2024Multiple Object Tracking as ID Predictioncited by 58
  23. 2022Waymo Open Dataset: Panoramic Video Panoptic Segmentationcited by 57
  24. 2024360DVD: Controllable Panorama Video Generation with 360-Degree Video Diffusion Modelcited by 56
  25. 2023OVTrack: Open-Vocabulary Multiple Object Trackingcited by 53
  26. 2022Behind Every Domain There is a Shift: Adapting Distortion-aware Vision Transformers for Panoramic Semantic Segmentationcited by 46
  27. 2023PERF: Panoramic Neural Radiance Field from a Single Panoramacited by 45
  28. 2023EGformer: Equirectangular Geometry-biased Transformer for 360 Depth Estimationcited by 42
  29. 2023UCMCTrack: Multi-Object Tracking with Uniform Camera Motion Compensationcited by 42
  30. 2021JRDB-Act: A Large-scale Dataset for Spatio-temporal Action, Social Group and Activity Detectioncited by 38
  31. 2024DiffPano: Scalable and Consistent Text to Panorama Generation with Spherical Epipolar-Aware Diffusioncited by 38
  32. 2022BiFuse++: Self-supervised and Efficient Bi-projection Fusion for 360 Depth Estimationcited by 35
  33. 2024360+x: A Panoptic Multi-modal Scene Understanding Datasetcited by 35
  34. 2024ADA-Track++: End-to-End Multi-Camera 3D Multi-Object Tracking with Alternating Detection and Associationcited by 33
  35. 2023iKUN: Speak to Trackers without Retrainingcited by 31
  36. 2024Elite360D: Towards Efficient 360 Depth Estimation via Semantic- and Distance-Aware Bi-Projection Fusioncited by 31
  37. 2023360Loc: A Dataset and Benchmark for Omnidirectional Visual Localization with Cross-device Queriescited by 28
  38. 2024360SFUDA++: Towards Source-free UDA for Panoramic Segmentation by Learning Reliable Category Prototypescited by 28

50 most cited of 97 All 97 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024RegTrack: Simplicity Beneath Complexity in Robust Multi-Modal 3D Multi-Object Tracking
  2. 2026OmniTrack: General Motion Tracking via Physics-Consistent Reference
  3. 2025GRASPTrack: Geometry-Reasoned Association via Segmentation and Projection for Multi-Object Tracking
  4. 2026OmniAct3D: Leveraging Foundation Geometry and Evidence-Grounded Reasoning for Panoramic 3D Detection
  5. 2026PanoWorld: Real-World Panoramic Generation
  6. 2026ReferTrack: Referring Then Tracking for Embodied Visual Tracking
  7. 2026Models as Tools: An Agentic Coordination Framework for Unified Multimodal Visual Tracking
  8. 2026QTrack: Query-Driven Reasoning for Multi-modal MOT