SAMOFT: Robust Multi-Object Tracking via Region and Flow
Not on the map. Why?
Abstract (arXiv)
Multi-object tracking (MOT) is a fundamental task in computer vision that requires continuously tracking multiple targets while maintaining consistent identities across frames. However, most existing approaches primarily rely on instance-level object features for trajectory association, which often leads to degraded performance under challenging conditions such as object deformation, nonlinear motion, and occlusion. In this work, we propose SAMOFT, a robust tracker that leverages pixel-level cues to improve robustness under complex motion scenarios. Specifically, we introduce a Pixel Motion Matching (PMM) module that integrates the Segment Anything Model (SAM) with dense optical flow to refine Kalman filter-based motion prediction using instantaneous foreground pixel motion. To further enhance robustness under unreliable detections, we design a Centroid Distance Matching (CDM) module that performs flexible mask-based centroid matching for low-confidence or partially occluded observations. Moreover, a Distribution-Based Correction (DBC) module models long-tailed motion patterns in a training-free manner using historical optical flow statistics and dynamically corrects trajectory states online. We also incorporate a Cluster-Aware ReID (CA-ReID) strategy to improve the stability and discriminative power of trajectory appearance features. Extensive experiments on the DanceTrack and MOTChallenge benchmarks demonstrate that SAMOFT consistently improves baseline trackers and achieves competitive performance compared with recent state-of-the-art methods, validating the effectiveness of leveraging pixel-level cues for robust multi-object tracking.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 48 of its 70 references that are in the map. First posted on arXiv 10 May 2026.
Builds on
48 of 70 references.
References · 48
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2023Segment Anythingcited by 8,158
- 2021YOLOX: Exceeding YOLO Series in 2021cited by 1,064
- 2022YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectorscited by 978
- 2017Simple Online and Realtime Tracking with a Deep Association Metriccited by 908
- 2016Simple Online and Realtime Trackingcited by 862
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 812
- 2016Performance Measures and a Data Set for Multi-Target, Multi-Camera Trackingcited by 685
- 2020HOTA: A Higher Order Metric for Evaluating Multi-Object Trackingcited by 546
- 2016MOT16: A Benchmark for Multi-Object Trackingcited by 531
- 2023CoTracker: It is Better to Track Togethercited by 516
- 2021MOTR: End-to-End Multiple-Object Tracking with Transformercited by 379
36 more
- 2020MOT20: A benchmark for multi object tracking in crowded scenescited by 355
- 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 345
- 2022BoT-SORT: Robust Associations Multi-Pedestrian Trackingcited by 313
- 2019Towards Real-Time Multi-Object Trackingcited by 311
- 2021DanceTrack: Multi-Object Tracking in Uniform Appearance and Diverse Motioncited by 213
- 2022StrongSORT: Make DeepSORT Great Againcited by 213
- 2023Spring: A High-Resolution High-Detail Dataset and Benchmark for Scene Flow, Optical Flow and Stereocited by 170
- 2024SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flowcited by 169
- 2022MOTRv2: Bootstrapping End-to-End Multi-Object Tracking by Pretrained Object Detectorscited by 148
- 2023Deep OC-SORT: Multi-Pedestrian Tracking by Adaptive Re-Identificationcited by 130
- 2022Global Tracking Transformerscited by 110
- 2023Hybrid-SORT: Weak Cues Matter for Online Multi-Object Trackingcited by 66
- 2023MotionTrack: Learning Robust Short-term and Long-term Motions for Multi-Object Trackingcited by 64
- 2022Unifying Short and Long-Term Tracking with Graph Hierarchiescited by 62
- 2024DiffMOT: A Real-time Diffusion-based Multiple Object Tracker with Non-linear Predictioncited by 59
- 2024Multiple Object Tracking as ID Predictioncited by 58
- 2024Matching Anything by Segmenting Anythingcited by 49
- 2023SparseTrack: Multi-Object Tracking by Performing Scene Decomposition based on Pseudo-Depthcited by 48
- 2022Simple Cues Lead to a Strong Multi-Object Trackercited by 44
- 2023UCMCTrack: Multi-Object Tracking with Uniform Camera Motion Compensationcited by 42
- 2023DiffusionTrack: Diffusion Model For Multi-Object Trackingcited by 40
- 2023iKUN: Speak to Trackers without Retrainingcited by 31
- 2022SMILEtrack: SiMIlarity LEarning for Occlusion-Aware Multiple Object Trackingcited by 29
- 2022Quo Vadis: Is Trajectory Forecasting the Key Towards Long-Term Multi-Object Tracking?cited by 28
- 2023Focus On Details: Online Multi-object Tracking with Diverse Fine-grained Representationcited by 25
- 2024NetTrack: Tracking Highly Dynamic Objects with a Netcited by 22
- 2024Towards Generalizable Multi-Object Trackingcited by 22
- 2023TOPIC: A Parallel Association Paradigm for Multi-Object Tracking under Complex Motions and Diverse Scenescited by 21
- 2024Delving into the Trajectory Long-tail Distribution for Muti-object Trackingcited by 18
- 2025SAM2MOT: A Novel Paradigm of Multi-Object Tracking by Segmentationcited by 17
- 2023FOLT: Fast Multiple Object Tracking from UAV-captured Videos Based on Optical Flowcited by 15
- 2022Large Scale Real-World Multi-Person Trackingcited by 14
- 2024Visible-Thermal Multiple Object Tracking: Large-scale Video Dataset and Progressive Fusion Approachcited by 13
- 2025Omnidirectional Multi-Object Trackingcited by 12
- 2024DeconfuseTrack:Dealing with Confusion for Multi-Object Trackingcited by 9
- 2023Multi-Scene Generalized Trajectory Global Graph Solver with Composite Nodes for Multiple Object Trackingcited by 7
Built on by
Not cited yet.