OmniTrack++: Omnidirectional Multi-Object Tracking by Learning Large-FoV Trajectory Feedback
Not on the map. Why?
Abstract (arXiv)
To address panoramic distortion, large search space, and identity ambiguity under a 360deg FoV, OmniTrack++ adopts a feedback-driven framework that progressively refines perception with trajectory cues. A DynamicSSM block first stabilizes panoramic features, implicitly alleviating geometric distortion. On top of normalized representations, FlexiTrack Instances use trajectory-informed feedback for flexible localization and reliable short-term association. To ensure long-term robustness, an ExpertTrack Memory consolidates appearance cues via a Mixture-of-Experts design, enabling recovery from fragmented tracks and reducing identity drift. Finally, a Tracklet Management module adaptively switches between end-to-end and tracking-by-detection modes according to scene dynamics, offering a balanced and scalable solution for panoramic MOT. To support rigorous evaluation, we establish the EmboTrack benchmark, a comprehensive dataset for panoramic MOT that includes QuadTrack, captured with a quadruped robot, and BipTrack, collected with a bipedal wheel-legged robot. Together, these datasets span wide-angle environments and diverse motion patterns, providing a challenging testbed for real-world panoramic perception. Extensive experiments on JRDB and EmboTrack demonstrate that OmniTrack++ achieves state-of-the-art performance, yielding substantial HOTA improvements of +3.94 on JRDB and +15.03 on QuadTrack over the original OmniTrack. These results highlight the effectiveness of trajectory-informed feedback, adaptive paradigm switching, and robust long-term memory in advancing panoramic multi-object tracking. Datasets and code will be made available at https://github.com/xifen523/OmniTrack.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 97 of its 139 references that are in the map. First posted on arXiv 1 Nov 2025.
Builds on
97 of 139 references.
References · 97
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
- 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,283
- 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,282
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2017Simple Online and Realtime Tracking with a Deep Association Metriccited by 908
- 2016Simple Online and Realtime Trackingcited by 862
- 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Modelscited by 834
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 812
- 2016Performance Measures and a Data Set for Multi-Target, Multi-Camera Trackingcited by 685
- 2020HOTA: A Higher Order Metric for Evaluating Multi-Object Trackingcited by 546
38 more
- 2016MOT16: A Benchmark for Multi-Object Trackingcited by 531
- 2023DETRs Beat YOLOs on Real-time Object Detectioncited by 526
- 2021TrackFormer: Multi-Object Tracking with Transformerscited by 515
- 2021MOTR: End-to-End Multiple-Object Tracking with Transformercited by 379
- 2020TransTrack: Multiple Object Tracking with Transformercited by 370
- 2020MOT20: A benchmark for multi object tracking in crowded scenescited by 355
- 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 345
- 2022BoT-SORT: Robust Associations Multi-Pedestrian Trackingcited by 313
- 2021DanceTrack: Multi-Object Tracking in Uniform Appearance and Diverse Motioncited by 213
- 2022StrongSORT: Make DeepSORT Great Againcited by 213
- 2023Panacea: Panoramic and Controllable Video Generation for Autonomous Drivingcited by 165
- 2022MOTRv2: Bootstrapping End-to-End Multi-Object Tracking by Pretrained Object Detectorscited by 148
- 2023SportsMOT: A Large Multi-Object Tracking Dataset in Multiple Sports Scenescited by 130
- 2022PanoFormer: Panorama Transformer for Indoor 360 Depth Estimationcited by 94
- 2021UniFuse: Unidirectional Fusion for 360circ Panorama Depth Estimationcited by 91
- 2023MeMOTR: Long-Term Memory-Augmented Transformer for Multi-Object Trackingcited by 86
- 2024DreamScene360: Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splattingcited by 81
- 2023PanoGen: Text-Conditioned Panoramic Environment Generation for Vision-and-Language Navigationcited by 77
- 2023Hybrid-SORT: Weak Cues Matter for Online Multi-Object Trackingcited by 66
- 2023MotionTrack: Learning Robust Short-term and Long-term Motions for Multi-Object Trackingcited by 64
- 2024DiffMOT: A Real-time Diffusion-based Multiple Object Tracker with Non-linear Predictioncited by 59
- 2024Multiple Object Tracking as ID Predictioncited by 58
- 2022Waymo Open Dataset: Panoramic Video Panoptic Segmentationcited by 57
- 2024360DVD: Controllable Panorama Video Generation with 360-Degree Video Diffusion Modelcited by 56
- 2023OVTrack: Open-Vocabulary Multiple Object Trackingcited by 53
- 2022Behind Every Domain There is a Shift: Adapting Distortion-aware Vision Transformers for Panoramic Semantic Segmentationcited by 46
- 2023PERF: Panoramic Neural Radiance Field from a Single Panoramacited by 45
- 2023EGformer: Equirectangular Geometry-biased Transformer for 360 Depth Estimationcited by 42
- 2023UCMCTrack: Multi-Object Tracking with Uniform Camera Motion Compensationcited by 42
- 2021JRDB-Act: A Large-scale Dataset for Spatio-temporal Action, Social Group and Activity Detectioncited by 38
- 2024DiffPano: Scalable and Consistent Text to Panorama Generation with Spherical Epipolar-Aware Diffusioncited by 38
- 2022BiFuse++: Self-supervised and Efficient Bi-projection Fusion for 360 Depth Estimationcited by 35
- 2024360+x: A Panoptic Multi-modal Scene Understanding Datasetcited by 35
- 2024ADA-Track++: End-to-End Multi-Camera 3D Multi-Object Tracking with Alternating Detection and Associationcited by 33
- 2023iKUN: Speak to Trackers without Retrainingcited by 31
- 2024Elite360D: Towards Efficient 360 Depth Estimation via Semantic- and Distance-Aware Bi-Projection Fusioncited by 31
- 2023360Loc: A Dataset and Benchmark for Omnidirectional Visual Localization with Cross-device Queriescited by 28
- 2024360SFUDA++: Towards Source-free UDA for Panoramic Segmentation by Learning Reliable Category Prototypescited by 28
50 most cited of 97 All 97 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2024RegTrack: Simplicity Beneath Complexity in Robust Multi-Modal 3D Multi-Object Tracking
- 2026OmniTrack: General Motion Tracking via Physics-Consistent Reference
- 2025GRASPTrack: Geometry-Reasoned Association via Segmentation and Projection for Multi-Object Tracking
- 2026OmniAct3D: Leveraging Foundation Geometry and Evidence-Grounded Reasoning for Panoramic 3D Detection
- 2026PanoWorld: Real-World Panoramic Generation
- 2026ReferTrack: Referring Then Tracking for Embodied Visual Tracking
- 2026Models as Tools: An Agentic Coordination Framework for Unified Multimodal Visual Tracking
- 2026QTrack: Query-Driven Reasoning for Multi-modal MOT