mlsanityData to 14 Oct 2026

Online Multi-Camera 3D Tracking via ID Prediction over Recurrent Sparse Queries

arXiv 2609.18363 ↗First posted 16 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Online multi camera 3D tracking must maintain scene global identities across synchronized views, yet query-based trackers carry these identities only implicitly in the instance bank, where they fragment upon query interruption. We present an online architecture that recovers association accuracy by predicting IDs explicitly over recurrent sparse queries. An outside-in Sparse4D detector fuses calibrated views into world frame 3D detections while propagating a sparse query bank, and a causal MOTIP ID decoder associates detections against a finite trajectory memory. We adapt MOTIP's relative-ID prediction and recycled slot runtime to globally fused 3D observations, and introduce metric spatial gating and proximity based newborn recovery. On the official 2026 AI City Challenge Track 1 test set, our method raises HOTA from 29.63 with native instance bank identities to 38.01, primarily through an AssA increase from 20.83 to 31.10, and ranks third on the public leaderboard. Full-sequence validation over all 9,000 frames of each scene shows that decoupled ID training improves HOTA over native identities, whereas continuing detector training alongside the detached ID objective produces scene-dependent gains and losses.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 31 references that are in the map. First posted on arXiv 16 Sep 2026.

Builds on

27 of 31 references.

References · 27

  1. 2020End-to-End Object Detection with Transformerscited by 7,414
  2. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
  3. 2017Simple Online and Realtime Tracking with a Deep Association Metriccited by 910
  4. 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 823
  5. 2020HOTA: A Higher Order Metric for Evaluating Multi-Object Trackingcited by 552
  6. 2021TrackFormer: Multi-Object Tracking with Transformerscited by 518
  7. 2021MOTR: End-to-End Multiple-Object Tracking with Transformercited by 381
  8. 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 346
  9. 2022Sparse4D: Multi-view 3D Object Detection with Sparse Spatial-Temporal Fusioncited by 162
  10. 2022MeMOT: Multi-Object Tracking with Memorycited by 114
  11. 2023Sparse4D v2: Recurrent Temporal Fusion with Sparse Modelcited by 93
  12. 2022MUTR3D: A Multi-camera Tracking Framework via 3D-to-2D Queriescited by 91
15 more
  1. 2020Multiview Detection with Feature Perspective Transformationcited by 71
  2. 2023Sparse4D v3: Advancing End-to-End 3D Detection and Trackingcited by 70
  3. 2024Multiple Object Tracking as ID Predictioncited by 60
  4. 2023Standing Between Past and Future: Spatio-Temporal Modeling for Multi-Camera 3D Multi-Object Trackingcited by 54
  5. 2021Multiview Detection with Shadow Transformer (and View-Coherent Data Augmentation)cited by 45
  6. 2021LMGP: Lifted Multicut Meets Geometry Projections for Multi-Camera Multi-Object Trackingcited by 34
  7. 2023EarlyBird: Early-Fusion for Multi-View Tracking in the Bird's Eye Viewcited by 33
  8. 2024ADA-Track++: End-to-End Multi-Camera 3D Multi-Object Tracking with Alternating Detection and Associationcited by 33
  9. 2024Lifting Multi-View Detection and Tracking to the Bird's Eye Viewcited by 25
  10. 2023ReST: A Reconfigurable Spatial-Temporal Graph Model for Multi-Camera Multi-Object Trackingcited by 24
  11. 2025The 9th AI City Challengecited by 12
  12. 2024MCBLT: Multi-Camera Multi-Object 3D Tracking in Long Videoscited by 9
  13. 2026The 10th AI City Challengecited by 8
  14. 2024GMT: Effective Global Framework for Multi-Camera Multi-Target Trackingcited by 2
  15. 2026A Unified 3D Object Perception Framework for Real-Time Outside-In Multi-Camera Systemscited by 2

Built on by

Not cited yet.