Energy Constrained Hierarchical Underwater Monitoring via Local Multi-Agent RAG
Not on the map. Why?
Abstract (arXiv)
Marine life monitoring is limited by strict energy constraints, poor underwater connectivity, and the high cost of transmitting raw multimodal data from remote deployments. This paper proposes a low-consumption underwater monitoring architecture that combines always-on edge sensing with selective high-performance local reasoning. The system follows a hierarchical master--satellite design in which ultra-low-power MAX78000/MAX78002 microcontrollers continuously monitor visual and acoustic signals, while an NVIDIA Jetson Orin NX is activated only for scheduled processing, event-driven analysis, or researcher interaction. Once active, the Jetson executes a fully local multimodal pipeline for data ingestion, visual target extraction, embedding-based indexing, species identification, retrieval-augmented reasoning, and automated reporting. BioCLIP/OpenCLIP embeddings are used to organize mission data, marine taxonomic references, scientific documents, and operational metadata in local ChromaDB collections. A dedicated identification layer combines visual similarity search, centroid-based classification, and supervised classifiers to support adaptive species recognition. A LangChain-based multi-agent framework coordinates query routing, structured analysis, energy management, hardware reconfiguration, and report generation. The architecture is evaluated through visual and acoustic monitoring case studies. The proposed system bridges ultra-low-power continuous sensing with local multimodal intelligence, enabling underwater stations to produce structured, researcher-ready knowledge while compressing local data for flexible acoustic, optical, or satellite transmission, minimizing both energy use and communication overhead.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 27 references that are in the map. First posted on arXiv 27 Jul 2026.
Builds on
14 of 27 references.
References · 14
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2024YOLO-World: Real-Time Open-Vocabulary Object Detectioncited by 498
- 2020MCUNet: Tiny Deep Learning on IoT Devicescited by 269
- 2023BioCLIP: A Vision Foundation Model for the Tree of Lifecited by 159
- 2024BioTrove: A Large Curated Image Dataset Enabling AI for Biodiversitycited by 19
- 2023TinyissimoYOLO: A Quantized, Low-Memory Footprint, TinyML Object Detection Network for Low Power Microcontrollerscited by 18
- 2024CLIBD: Bridging Vision and Genomics for Biodiversity Monitoring at Scalecited by 18
- 2023Flexible and Fully Quantized Ultra-Lightweight TinyissimoYOLO for Ultra-Low-Power Edge Systemscited by 11
- 2024Fish-Vista: A Multi-Purpose Dataset for Understanding & Identification of Traits from Imagescited by 9
- 2025AquaticCLIP: A Vision-Language Foundation Model for Underwater Scene Analysiscited by 7
- 2025Benchmarking Ultra-Low-Power μNPUscited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Composing Open-domain Vision with RAG for Ocean Monitoring and Conservation
- 2025DREAM: Domain-aware Reasoning for Efficient Autonomous Underwater Monitoring
- 2025FishDetector-R1: Unified MLLM-Based Framework with Reinforcement Fine-Tuning for Weakly Supervised Fish Detection, Segmentation, and Counting
- 2026CORAL: COntextual Reasoning And Local Planning in A Hierarchical VLM Framework for Underwater Monitoring
- 2025YH-MINER: Multimodal Intelligent System for Natural Ecological Reef Metric Extraction
- 2026Beyond detection: cooperative multi-agent reasoning for rapid onboard EO crisis response
- 2024Multi-Objective-Optimization Assisted Data Collection Framework for IoUT Based on Offline Reinforcement
- 2025Advancing Shared and Multi-Agent Autonomy in Underwater Missions: Integrating Knowledge Graphs and Retrieval-Augmented Generation