mlsanityData to 14 Oct 2026

ReWorld-Track: A Recursive Event World Model for Language-Guided Multi-Camera Tracking

arXiv 2609.36677 ↗First posted 29 Sep 2026cs.CVcited by 0

New in World models; no direction yet. World models

Abstract (arXiv)

Language-guided multi-camera tracking must preserve a target identity across unobserved gaps, where similar candidates and uncertain returns can make early associations unreliable. A wrong match can corrupt the history used to predict later observations and propagate identity errors across subsequent camera handoffs. We propose ReWorld-Track, a recursive event world model that carries association uncertainty into future predictions. Candidate matches and continued waiting define alternative target states, whose posterior probabilities are used to update a persistent recurrent belief. This representation preserves uncertainty about alternative trajectories through successive observations. This belief predicts the next camera, arrival time, and entry region, while appearance and language evidence guide association. By training across successive handoffs, the model learns to retain uncertainty that remains useful for later predictions and identity decisions. ReWorld-Track achieves HOTA scores of 65.19 on CityFlowV2 and 45.36 on MTMMC, with improved identity continuity across repeated handoffs. On MTMMC, its structured posterior update gains 0.50 HOTA points over a similarly sized generic updater and 0.94 points over fixed-moment soft association, raising next-camera accuracy from 86.03% to 87.41% and reducing median arrival-time error from 0.78 s to 0.71 s for subsequent target returns.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 52 of its 67 references that are in the map. First posted on arXiv 29 Sep 2026.

Builds on

52 of 67 references.

References · 52

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  3. 2017On Calibration of Modern Neural Networkscited by 4,960
  4. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  5. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  6. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
  7. 2018Learning Latent Dynamics for Planning from Pixelscited by 1,264
  8. 2017Simple Online and Realtime Tracking with a Deep Association Metriccited by 910
  9. 2016Simple Online and Realtime Trackingcited by 868
  10. 2017Selective Classification for Deep Neural Networkscited by 852
  11. 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 823
  12. 2018Recurrent World Models Facilitate Policy Evolutioncited by 785
38 more
  1. 2016Performance Measures and a Data Set for Multi-Target, Multi-Camera Trackingcited by 692
  2. 2020HOTA: A Higher Order Metric for Evaluating Multi-Object Trackingcited by 552
  3. 2021TrackFormer: Multi-Object Tracking with Transformerscited by 518
  4. 2022XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Modelcited by 439
  5. 2019Video Object Segmentation using Space-Time Memory Networkscited by 438
  6. 2019Bag of Tricks and A Strong Baseline for Deep Person Re-identificationcited by 430
  7. 2021MOTR: End-to-End Multiple-Object Tracking with Transformercited by 381
  8. 2019SelectiveNet: A Deep Neural Network with an Integrated Reject Optioncited by 350
  9. 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 346
  10. 2022BoT-SORT: Robust Associations Multi-Pedestrian Trackingcited by 320
  11. 2020Transformer Hawkes Processcited by 235
  12. 2020Quasi-Dense Similarity Learning for Multiple Object Trackingcited by 220
  13. 2022StrongSORT: Make DeepSORT Great Againcited by 213
  14. 2019Learning a Neural Solver for Multiple Object Trackingcited by 198
  15. 2023Putting the Object Back into Video Object Segmentationcited by 188
  16. 2016Structured Inference Networks for Nonlinear State Space Modelscited by 182
  17. 2022MOTRv2: Bootstrapping End-to-End Multi-Object Tracking by Pretrained Object Detectorscited by 148
  18. 2019CityFlow: A City-Scale Benchmark for Multi-Target Multi-Camera Vehicle Tracking and Re-Identificationcited by 119
  19. 2021Learning to Track with Object Permanencecited by 119
  20. 2017A Disentangled Recognition and Nonlinear Dynamics Model for Unsupervised Learningcited by 107
  21. 2023Referring Multi-Object Trackingcited by 93
  22. 2021STMTrack: Template-free Visual Tracking with Space-time Memory Networkscited by 91
  23. 2023MeMOTR: Long-Term Memory-Augmented Transformer for Multi-Object Trackingcited by 88
  24. 2022Unifying Short and Long-Term Tracking with Graph Hierarchiescited by 62
  25. 2024Multiple Object Tracking as ID Predictioncited by 60
  26. 2025World-in-World: World Models in a Closed-Loop Worldcited by 47
  27. 2023iKUN: Speak to Trackers without Retrainingcited by 32
  28. 2024Spatial Cognition from Egocentric Video: Out of Sight, Not Out of Mindcited by 28
  29. 2021CityFlow-NL: Tracking and Retrieval of Vehicles at City Scale by Natural Language Descriptionscited by 26
  30. 2024Samba: Synchronized Set-of-Sequences Modeling for Multiple Object Trackingcited by 21
  31. 2025Track-On: Transformer-based Online Point Tracking with Memorycited by 21
  32. 2024Cross-View Referring Multi-Object Trackingcited by 12
  33. 2025OVTR: End-to-End Open-Vocabulary Multiple Object Tracking with Transformercited by 11
  34. 2021Cross-Camera Feature Prediction for Intra-Camera Supervised Person Re-identification across Distant Scenescited by 9
  35. 2022Camera-Conditioned Stable Feature Generation for Isolated Camera Supervised Person Re-IDentificationcited by 8
  36. 2024MTMMC: A Large-Scale Real-World Multi-Modal Camera Tracking Benchmarkcited by 5
  37. 2021Multi-Camera Trajectory Forecasting with Trajectory Tensorscited by 4
  38. 2026ViewSAM: Learning View-aware Cross-modal Semantics for Weakly Supervised Cross-view Referring Multi-Object Trackingcited by 2

50 most cited of 52 All 52 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025ReaMOT: A Benchmark and Framework for Reasoning-based Multi-Object Tracking
  2. 2025VPTracker: Global Vision-Language Tracking via Visual Prompt
  3. 2026YesTrack: Referring Multi-Object Tracking via MLLM-based Yes/No Verification
  4. 2026Can Vision-Language Models Solve the Shell Game?
  5. 2026Dynamic Parsing and Updating Natural Language Specification using VLMs for Robust Vision-Language Tracking
  6. 2026NOVA: Next-step Open-Vocabulary Autoregression for 3D Multi-Object Tracking in Autonomous Driving
  7. 2026VLX-Go: Robust Embodied Tracking through Multi-Stage Learning and On-Policy Refinement
  8. 2025ReasoningTrack: Chain-of-Thought Reasoning for Long-term Vision-Language Tracking