PAANI : On Device Visual Evidence Fusion and Explainable Guidance for River Robot Simulation
Not on the map. Why?
Abstract (arXiv)
Mobile river monitoring robots must interpret obstacles and water boundaries that geographic waypoints alone cannot describe. On resource constrained platforms, converting imperfect visual predictions into timely and inspectable guidance is a distinct challenge. An object label or steering command does not explain which evidence supports a decision or when that evidence is unreliable. We present PAANI, an on-device perception to guidance architecture that combines a project trained YOLO11n detector and a custom MobileNetV3 Small semantic segmenter with timestamp aligned evidence fusion on Arduino UNO Q. Bounded tracking supplies object persistence, while an explicit corridor policy combines surface labels, accepted detections, urgency and mask uncertainty. Each final advisory exposes its contributing evidence and policy reasons. ROS 2 interfaces connect the local AI pipeline to a separate Gazebo vessel, localization and control testbed. Training uses 10,000 WaterScenes images for four-class detection and 1,127 MaSTr1325 images for segmentation, including 198 segmentation validation images. The selected FP32 ONNX models occupy 14.817 MB. Detector checkpoint test mAP at 0.5 IoU is 0.7388, while the separately evaluated rectangular ONNX export achieves validation mAP at 0.5 IoU of 0.7367. Segmentation ONNX validation mIoU is 0.9750. A five-minute UNO Q recording produced median and 95th percentile pipeline latencies of 467.8 ms and 580.3 ms at a configured 0.5 Hz cadence. The evaluation also identifies black input misclassification and a sampling rate mismatch that prevents the diagnostic apparent motion estimator from collecting sufficient evidence. These results support an inspectable and reusable edge robotics foundation while clearly distinguishing model accuracy and on-board execution from validated on-water collision avoidance.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 29 references that are in the map. First posted on arXiv 17 Sep 2026.
Builds on
19 of 29 references.
References · 19
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
- 2019Searching for MobileNetV3cited by 1,994
- 2016Simple Online and Realtime Trackingcited by 868
- 2022Robot Operating System 2: Design, Architecture, and Uses In The Wildcited by 199
- 2021SeaDronesSee: A Maritime Benchmark for Detecting Humans in Open Watercited by 61
- 2023WaterScenes: A Multi-Task 4D Radar-Camera Fusion Dataset and Benchmarks for Autonomous Driving on Water Surfacescited by 35
- 2021MODS -- A USV-oriented object detection and obstacle segmentation benchmarkcited by 27
- 2023LaRS: A Diverse Panoptic Maritime Obstacle Detection Dataset and Benchmarkcited by 19
7 more
- 2021Explainable Autonomous Robots: A Survey and Perspectivecited by 15
- 2022Survey of Deep Learning for Autonomous Surface Vehicles in the Marine Environmentcited by 11
- 2022Temporal Context for Robust Maritime Obstacle Detectioncited by 10
- 2021Learning Maritime Obstacle Detection from Weak Annotations by Scaffoldingcited by 8
- 2023The 2nd Workshop on Maritime Computer Vision (MaCVi) 2024cited by 7
- 2020A water-obstacle separation and refinement network for unmanned surface vehiclescited by 5
- 2023eWaSR -- an embedded-compute-ready maritime obstacle detection networkcited by 5
Built on by
Not cited yet.