mlsanityData to 14 Oct 2026

NanoMVG: USV-Centric Low-Power Multi-Task Visual Grounding based on Prompt-Guided Camera and 4D mmWave Radar

arXiv 2408.17207 ↗First posted 30 Aug 2024cs.CV cs.ROcited by 7

Not on the map. Why?

Abstract (arXiv)

Recently, visual grounding and multi-sensors setting have been incorporated into perception system for terrestrial autonomous driving systems and Unmanned Surface Vehicles (USVs), yet the high complexity of modern learning-based visual grounding model using multi-sensors prevents such model to be deployed on USVs in the real-life. To this end, we design a low-power multi-task model named NanoMVG for waterway embodied perception, guiding both camera and 4D millimeter-wave radar to locate specific object(s) through natural language. NanoMVG can perform both box-level and mask-level visual grounding tasks simultaneously. Compared to other visual grounding models, NanoMVG achieves highly competitive performance on the WaterVG dataset, particularly in harsh environments and boasts ultra-low power consumption for long endurance.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 41 of its 54 references that are in the map. First posted on arXiv 30 Aug 2024.

Builds on

41 of 54 references.

References · 41

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2019Objects as Pointscited by 1,175
  4. 2016Modeling Context in Referring Expressionscited by 1,063
  5. 2017Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentationscited by 620
  6. 2019ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networkscited by 575
  7. 2020MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devicescited by 482
  8. 2018MAttNet: Modular Attention Network for Referring Expression Comprehensioncited by 431
  9. 2021LAVT: Language-Aware Vision Transformer for Referring Image Segmentationcited by 348
  10. 2021TransVG: End-to-End Visual Grounding with Transformerscited by 271
  11. 2020Multi-task Collaborative Network for Joint Referring Expression Comprehension and Segmentationcited by 204
  12. 2019A Fast and Accurate One-Stage Approach to Visual Groundingcited by 195
29 more
  1. 2021Referring Transformer: A One-step Approach to Multi-task Visual Groundingcited by 143
  2. 2022SeqTR: A Simple yet Universal Network for Visual Groundingcited by 139
  3. 2019Dynamic Graph Attention for Referring Expression Comprehensioncited by 111
  4. 2022VLT: Vision-Language Transformer and Query Generation for Referring Segmentationcited by 111
  5. 2022MobileOne: An Improved One millisecond Mobile Backbonecited by 109
  6. 2018Neighbourhood Watch: Referring Expression Comprehension via Language-guided Graph Attention Networkscited by 102
  7. 2024MobileNetV4 -- Universal Models for the Mobile Ecosystemcited by 99
  8. 2019Learning to Compose and Reason with Language Tree Structures for Visual Groundingcited by 98
  9. 2020Enhancing Geometric Factors in Model Learning and Inference for Object Detection and Instance Segmentationcited by 98
  10. 2020Referring Expression Comprehension: A Survey of Methods and Datasetscited by 79
  11. 2021Multi-Modal 3D Object Detection in Autonomous Driving: a Surveycited by 63
  12. 2021SeaDronesSee: A Maritime Benchmark for Detecting Humans in Open Watercited by 61
  13. 2023LXL: LiDAR Excluded Lean 3D Object Detection with 4D Imaging Radar and Camera Fusioncited by 58
  14. 2018Real-Time Referring Expression Comprehension by Single-Stage Grounding Networkcited by 56
  15. 2023Contrastive Grouping with Transformer for Referring Image Segmentationcited by 54
  16. 2023SMURF: Spatial Multi-Representation Fusion for 3D Object Detection with 4D Imaging Radarcited by 49
  17. 2023WaterScenes: A Multi-Task 4D Radar-Camera Fusion Dataset and Benchmarks for Autonomous Driving on Water Surfacescited by 35
  18. 2018Stereo obstacle detection for unmanned surface vehicles by IMU-assisted semantic segmentationcited by 21
  19. 2021Are We Ready for Unmanned Surface Vehicles in Inland Waterways? The USVInland Multisensor Dataset and Benchmarkcited by 21
  20. 2023LaRS: A Diverse Panoptic Maritime Obstacle Detection Dataset and Benchmarkcited by 19
  21. 2024DPFT: Dual Perspective Fusion Transformer for Camera-Radar-based Object Detectioncited by 19
  22. 2023Achelous: A Fast Unified Water-surface Panoptic Perception Framework based on Fusion of Monocular Camera and 4D mmWave Radarcited by 16
  23. 2023Which Framework is Suitable for Online 3D Multi-Object Tracking for Autonomous Driving with Automotive 4D Imaging Radar?cited by 13
  24. 2024WaterVG: Waterway Visual Grounding based on Text-Guided Vision and mmWave Radarcited by 13
  25. 2022Survey of Deep Learning for Autonomous Surface Vehicles in the Marine Environmentcited by 11
  26. 2023ASY-VRNet: Waterway Panoptic Driving Perception Model based on Asymmetric Fair Fusion of Vision and 4D mmWave Radarcited by 11
  27. 2022A Survivor in the Era of Large-Scale Pretraining: An Empirical Study of One-Stage Referring Expression Comprehensioncited by 5
  28. 2023FemtoDet: An Object Detection Baseline for Energy Versus Performance Tradeoffscited by 5
  29. 2023Achelous++: Power-Oriented Water-Surface Panoptic Perception Framework on Edge Devices based on Vision-Radar Fusion and Pruning of Heterogeneous Modalitiescited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 5; 2026: 2.

7 papers.

  1. 2025Doracamom: Joint 3D Detection and Occupancy Prediction with Multi-view 4D Radars and Cameras for Omnidirectional Perceptioncited by 22
  2. 2025AerialMind: Towards Referring Multi-Object Tracking in UAV Scenarioscited by 4
  3. 2025MetaOcc: Spatio-Temporal Fusion of Surround-View 4D Radar and Camera for 3D Occupancy Prediction with Dual Training Strategiescited by 3
  4. 2025RadarNeXt: Real-Time and Reliable 3D Object Detector Based On 4D mmWave Imaging Radarcited by 1
  5. 2025Da Yu: Towards USV-Based Image Captioning for Waterway Surveillance and Scene Understandingcited by 0
  6. 2026WaterVideoQA: ASV-Centric Perception and Rule-Compliant Reasoning via Multi-Modal Agentscited by 0
  7. 2026RCVLA: 4D Radar-Grounded Semantic Reasoning and Trajectory Arbitration for Autonomous Drivingcited by 0