ROSBag MCP Server: Analyzing Robot Data with LLMs for Agentic Embodied AI Applications
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Agentic AI systems and Physical or Embodied AI systems have been two key research verticals at the forefront of Artificial Intelligence and Robotics, with Model Context Protocol (MCP) increasingly becoming a key component and enabler of agentic applications. However, the literature at the intersection of these verticals, i.e., Agentic Embodied AI, remains scarce. This paper introduces an MCP server for analyzing ROS and ROS 2 bags, allowing for analyzing, visualizing and processing robot data with natural language through LLMs and VLMs. We describe specific tooling built with robotics domain knowledge, with our initial release focused on mobile robotics and supporting natively the analysis of trajectories, laser scan data, transforms, or time series data. This is in addition to providing an interface to standard ROS 2 CLI tools ("ros2 bag list" or "ros2 bag info"), as well as the ability to filter bags with a subset of topics or trimmed in time. Coupled with the MCP server, we provide a lightweight UI that allows the benchmarking of the tooling with different LLMs, both proprietary (Anthropic, OpenAI) and open-source (through Groq). Our experimental results include the analysis of tool calling capabilities of eight different state-of-the-art LLM/VLM models, both proprietary and open-source, large and small. Our experiments indicate that there is a large divide in tool calling capabilities, with Kimi K2 and Claude Sonnet 4 demonstrating clearly superior performance. We also conclude that there are multiple factors affecting the success rates, from the tool description schema to the number of arguments, as well as the number of tools available to the models. The code is available with a permissive license at https://github.com/binabik-ai/mcp-rosbags.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 15 of its 22 references that are in the map. First posted on arXiv 5 Nov 2025.
Builds on
15 of 22 references.
Closest ancestors · 4
Same direction, newest first
- 2025Towards Embodied Agentic AI: Review and Classification of LLM- and VLM-Driven Robot Autonomy and Interaction7 Aug
- 2025RAI: Flexible Agent Framework for Embodied AI12 May
- 2024Enabling Novel Mission Operations and Interactions with ROSA: The Robot Operating System Agent9 Oct
- 2023RoboCat: A Self-Improving Generalist Agent for Robotic Manipulation20 Jun
Other references · 11
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2020Sim-to-Real Transfer in Deep Reinforcement Learning for Robotics: a Surveycited by 388
- 2023ChatGPT for Robotics: Design Principles and Model Abilitiescited by 296
- 2023NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language Modelscited by 274
- 2023Large Language Models for Robotics: A Surveycited by 132
- 2025Vision-Language-Action Models for Robotics: A Review Towards Real-World Applicationscited by 82
- 2024BUMBLE: Unifying Reasoning and Acting with Vision-Language Models for Building-wide Mobile Manipulationcited by 31
- 2024ROS-LLM: A ROS framework for embodied AI with task feedback and structured reasoningcited by 27
- 2024Enhancing Cooperation through Selective Interaction and Long-term Experiences in Multi-Agent Reinforcement Learningcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025RoboNeuron: A Middle-Layer Infrastructure for Agent-Driven Orchestration in Embodied AI
- 2026ROSClaw: An OpenClaw ROS 2 Framework for Agentic Robot Control and Interaction
- 2026The Robot Data Factory ↗
- 2026Embodied.cpp: A Portable Inference Runtime of Embodied AI Models on Heterogeneous Robots
- 2025Embodied AI: From LLMs to World Models
- 2026Bridging Thought and Action: Taming Long-Horizon Instability in Open-Source LLM Agents with a MetaTool-Enhanced ROS Framework
- 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AI
- 2025Embodied AI with Foundation Models for Mobile Service Robots: A Systematic Review