mlsanityData to 7 Oct 2026

Segment Any Motion with Radar: Robust Multimodal Moving-Object Segmentation and Tracking

arXiv 2609.08346 ↗First posted 8 Sep 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Moving-object perception must decide which image regions correspond to real motion and keep every instance identified over time. Methods that read motion from appearance, optical flow, or estimated trajectories lose that evidence under poor illumination, adverse weather, reflections, and occlusion. Radar is a natural remedy because it measures radial velocity directly instead of inferring it from photometric correspondence. However, existing benchmarks do not jointly provide radar measurements, dense moving-instance masks, and temporally consistent identities for surveillance. We therefore introduce RGBTR-Motion, a synchronized and calibrated fixed-camera benchmark that pairs RGB, thermal, and radar streams with dense instance masks and temporally consistent identities across diverse surveillance scenes. We also develop SAM-Radar, an RGB, thermal, and radar-based segmentation and tracking framework built on SAM 3. SAM-Radar's radar-aware detector fuses calibrated RGBT features with radar returns that are grounded at their projected image locations, and motion supervision, implemented as foreground classification of those projected returns, teaches the detector to reject clutter without any text prompt. The tracker associates accepted radar returns with individual trajectories and uses them as physical evidence that a visually degraded target remains present. This allows it to bridge short periods of low visibility or occlusion and reconnect a reappearing target to its existing identity instead of starting a new track. SAM-Radar attains 0.7027 IoU and 0.8090 F1-50, and raises MOTA, HOTA, and IDF1 by 0.2977, 0.1603, and 0.2857 over the strongest competing values.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 30 references that are in the map. First posted on arXiv 8 Sep 2026.

Builds on

17 of 30 references.

References · 17

  1. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  2. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  3. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  4. 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,361
  5. 2025SAM 3: Segment Anything with Conceptscited by 835
  6. 2016Performance Measures and a Data Set for Multi-Target, Multi-Camera Trackingcited by 685
  7. 2020HOTA: A Higher Order Metric for Evaluating Multi-Object Trackingcited by 546
  8. 2019Video Instance Segmentationcited by 391
  9. 2019MOTS: Multi-Object Tracking and Segmentationcited by 222
  10. 2020CenterFusion: Center-based Radar and Camera Fusion for 3D Object Detectioncited by 159
  11. 2018RGB-T Object Tracking:Benchmark and Baselinecited by 121
  12. 2020RADIATE: A Radar Dataset for Automotive Perception in Bad Weathercited by 98
5 more
  1. 2021LasHeR: A Large-scale High-diversity Benchmark for RGBT Trackingcited by 94
  2. 2022CRAFT: Camera-Radar 3D Object Detection with Spatio-Contextual Fusion Transformercited by 66
  3. 2022Segmenting Moving Objects via an Object-Centric Layered Representationcited by 63
  4. 2024CAFuser: Condition-Aware Multimodal Fusion for Robust Semantic Perception of Driving Scenescited by 33
  5. 2023ASY-VRNet: Waterway Panoptic Driving Perception Model based on Asymmetric Fair Fusion of Vision and 4D mmWave Radarcited by 11

Built on by

Not cited yet.