ReWorld-Track: A Recursive Event World Model for Language-Guided Multi-Camera Tracking
New in World models; no direction yet. World models
Abstract (arXiv)
Language-guided multi-camera tracking must preserve a target identity across unobserved gaps, where similar candidates and uncertain returns can make early associations unreliable. A wrong match can corrupt the history used to predict later observations and propagate identity errors across subsequent camera handoffs. We propose ReWorld-Track, a recursive event world model that carries association uncertainty into future predictions. Candidate matches and continued waiting define alternative target states, whose posterior probabilities are used to update a persistent recurrent belief. This representation preserves uncertainty about alternative trajectories through successive observations. This belief predicts the next camera, arrival time, and entry region, while appearance and language evidence guide association. By training across successive handoffs, the model learns to retain uncertainty that remains useful for later predictions and identity decisions. ReWorld-Track achieves HOTA scores of 65.19 on CityFlowV2 and 45.36 on MTMMC, with improved identity continuity across repeated handoffs. On MTMMC, its structured posterior update gains 0.50 HOTA points over a similarly sized generic updater and 0.94 points over fixed-moment soft association, raising next-camera accuracy from 86.03% to 87.41% and reducing median arrival-time error from 0.78 s to 0.71 s for subsequent target returns.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 52 of its 67 references that are in the map. First posted on arXiv 29 Sep 2026.
Builds on
52 of 67 references.
References · 52
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
- 2018Learning Latent Dynamics for Planning from Pixelscited by 1,264
- 2017Simple Online and Realtime Tracking with a Deep Association Metriccited by 910
- 2016Simple Online and Realtime Trackingcited by 868
- 2017Selective Classification for Deep Neural Networkscited by 852
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 823
- 2018Recurrent World Models Facilitate Policy Evolutioncited by 785
38 more
- 2016Performance Measures and a Data Set for Multi-Target, Multi-Camera Trackingcited by 692
- 2020HOTA: A Higher Order Metric for Evaluating Multi-Object Trackingcited by 552
- 2021TrackFormer: Multi-Object Tracking with Transformerscited by 518
- 2022XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Modelcited by 439
- 2019Video Object Segmentation using Space-Time Memory Networkscited by 438
- 2019Bag of Tricks and A Strong Baseline for Deep Person Re-identificationcited by 430
- 2021MOTR: End-to-End Multiple-Object Tracking with Transformercited by 381
- 2019SelectiveNet: A Deep Neural Network with an Integrated Reject Optioncited by 350
- 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 346
- 2022BoT-SORT: Robust Associations Multi-Pedestrian Trackingcited by 320
- 2020Transformer Hawkes Processcited by 235
- 2020Quasi-Dense Similarity Learning for Multiple Object Trackingcited by 220
- 2022StrongSORT: Make DeepSORT Great Againcited by 213
- 2019Learning a Neural Solver for Multiple Object Trackingcited by 198
- 2023Putting the Object Back into Video Object Segmentationcited by 188
- 2016Structured Inference Networks for Nonlinear State Space Modelscited by 182
- 2022MOTRv2: Bootstrapping End-to-End Multi-Object Tracking by Pretrained Object Detectorscited by 148
- 2019CityFlow: A City-Scale Benchmark for Multi-Target Multi-Camera Vehicle Tracking and Re-Identificationcited by 119
- 2021Learning to Track with Object Permanencecited by 119
- 2017A Disentangled Recognition and Nonlinear Dynamics Model for Unsupervised Learningcited by 107
- 2023Referring Multi-Object Trackingcited by 93
- 2021STMTrack: Template-free Visual Tracking with Space-time Memory Networkscited by 91
- 2023MeMOTR: Long-Term Memory-Augmented Transformer for Multi-Object Trackingcited by 88
- 2022Unifying Short and Long-Term Tracking with Graph Hierarchiescited by 62
- 2024Multiple Object Tracking as ID Predictioncited by 60
- 2025World-in-World: World Models in a Closed-Loop Worldcited by 47
- 2023iKUN: Speak to Trackers without Retrainingcited by 32
- 2024Spatial Cognition from Egocentric Video: Out of Sight, Not Out of Mindcited by 28
- 2021CityFlow-NL: Tracking and Retrieval of Vehicles at City Scale by Natural Language Descriptionscited by 26
- 2024Samba: Synchronized Set-of-Sequences Modeling for Multiple Object Trackingcited by 21
- 2025Track-On: Transformer-based Online Point Tracking with Memorycited by 21
- 2024Cross-View Referring Multi-Object Trackingcited by 12
- 2025OVTR: End-to-End Open-Vocabulary Multiple Object Tracking with Transformercited by 11
- 2021Cross-Camera Feature Prediction for Intra-Camera Supervised Person Re-identification across Distant Scenescited by 9
- 2022Camera-Conditioned Stable Feature Generation for Isolated Camera Supervised Person Re-IDentificationcited by 8
- 2024MTMMC: A Large-Scale Real-World Multi-Modal Camera Tracking Benchmarkcited by 5
- 2021Multi-Camera Trajectory Forecasting with Trajectory Tensorscited by 4
- 2026ViewSAM: Learning View-aware Cross-modal Semantics for Weakly Supervised Cross-view Referring Multi-Object Trackingcited by 2
50 most cited of 52 All 52 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025ReaMOT: A Benchmark and Framework for Reasoning-based Multi-Object Tracking
- 2025VPTracker: Global Vision-Language Tracking via Visual Prompt
- 2026YesTrack: Referring Multi-Object Tracking via MLLM-based Yes/No Verification
- 2026Can Vision-Language Models Solve the Shell Game?
- 2026Dynamic Parsing and Updating Natural Language Specification using VLMs for Robust Vision-Language Tracking
- 2026NOVA: Next-step Open-Vocabulary Autoregression for 3D Multi-Object Tracking in Autonomous Driving
- 2026VLX-Go: Robust Embodied Tracking through Multi-Stage Learning and On-Policy Refinement
- 2025ReasoningTrack: Chain-of-Thought Reasoning for Long-term Vision-Language Tracking