mlsanityData to 14 Oct 2026

Distributed AI Agents for Cognitive Underwater Robot Autonomy

arXiv 2507.23735 ↗First posted 31 Jul 2025cs.RO cs.AI cs.MAcited by 4

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Achieving robust cognitive autonomy in robots navigating complex, unpredictable environments remains a fundamental challenge in robotics. This paper presents Underwater Robot Self-Organizing Autonomy (UROSA), a groundbreaking architecture leveraging distributed Large Language Model AI agents integrated within the Robot Operating System 2 (ROS 2) framework to enable advanced cognitive capabilities in Autonomous Underwater Vehicles. UROSA decentralises cognition into specialised AI agents responsible for multimodal perception, adaptive reasoning, dynamic mission planning, and real-time decision-making. Central innovations include flexible agents dynamically adapting their roles, retrieval-augmented generation utilising vector databases for efficient knowledge management, reinforcement learning-driven behavioural optimisation, and autonomous on-the-fly ROS 2 node generation for runtime functional extensibility. Extensive empirical validation demonstrates UROSA's promising adaptability and reliability through realistic underwater missions in simulation and real-world deployments, showing significant advantages over traditional rule-based architectures in handling unforeseen scenarios, environmental uncertainties, and novel mission objectives. This work not only advances underwater autonomy but also establishes a scalable, safe, and versatile cognitive robotics framework capable of generalising to a diverse array of real-world applications.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 19 of its 60 references that are in the map. First posted on arXiv 31 Jul 2025.

Builds on

19 of 60 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024Enabling Novel Mission Operations and Interactions with ROSA: The Robot Operating System Agent9 Oct
  2. 2024Agent AI: Surveying the Horizons of Multimodal Interaction7 Jan

Other references · 17

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2023GPT-4 Technical Reportcited by 18,396
  5. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  6. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  7. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
  8. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  9. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  10. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
  11. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  12. 2022Survey of Hallucination in Natural Language Generationcited by 2,075
5 more
  1. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
  2. 2023Large Language Model Alignment: A Surveycited by 243
  3. 2025Stonefish: Supporting Machine Learning Research in Marine Roboticscited by 11
  4. 2021From market-ready ROVs to low-cost AUVscited by 4
  5. 2025Context-Aware Behavior Learning with Heuristic Motion Memory for Underwater Manipulationcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 1.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Advancing Shared and Multi-Agent Autonomy in Underwater Missions: Integrating Knowledge Graphs and Retrieval-Augmented Generation
  2. 2026Underwater Embodied Intelligence for Autonomous Robots: A Constraint-Coupled Perspective on Planning, Control, and Deployment ↗
  3. 2026A Cognitive Architecture for Shared Autonomy in AUV Operations ↗
  4. 2025UnderwaterVLA: Dual-brain Vision-Language-Action architecture for Autonomous Underwater Navigation
  5. 2026RACAS: Controlling Diverse Robots With a Single Agentic System
  6. 2025OceanGym: A Benchmark Environment for Underwater Embodied Agents
  7. 2026AquaCap: A Training-Free Underwater Embodied Agent with Code-as-Policy ↗
  8. 2025Shared Autonomy through LLMs and Reinforcement Learning for Applications to Ship Hull Inspections ↗