EmbodiedBrain: Expanding Performance Boundaries of Task Planning for Embodied Intelligence
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
The realization of Artificial General Intelligence (AGI) necessitates Embodied AI agents capable of robust spatial perception, effective task planning, and adaptive execution in physical environments. However, current large language models (LLMs) and multimodal LLMs (MLLMs) for embodied tasks suffer from key limitations, including a significant gap between model design and agent requirements, an unavoidable trade-off between real-time latency and performance, and the use of unauthentic, offline evaluation metrics. To address these challenges, we propose EmbodiedBrain, a novel vision-language foundation model available in both 7B and 32B parameter sizes. Our framework features an agent-aligned data structure and employs a powerful training methodology that integrates large-scale Supervised Fine-Tuning (SFT) with Step-Augumented Group Relative Policy Optimization (Step-GRPO), which boosts long-horizon task success by integrating preceding steps as Guided Precursors. Furthermore, we incorporate a comprehensive reward system, including a Generative Reward Model (GRM) accelerated at the infrastructure level, to improve training efficiency. For enable thorough validation, we establish a three-part evaluation system encompassing General, Planning, and End-to-End Simulation Benchmarks, highlighted by the proposal and open-sourcing of a novel, challenging simulation environment. Experimental results demonstrate that EmbodiedBrain achieves superior performance across all metrics, establishing a new state-of-the-art for embodied foundation models. Towards paving the way for the next generation of generalist embodied agents, we open-source all of our data, model weight, and evaluating methods, which are available at https://zterobot.github.io/EmbodiedBrain.github.io.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 22 of its 24 references that are in the map. First posted on arXiv 23 Oct 2025.
Builds on
22 of 24 references.
Closest ancestors · 5
Same direction, newest first
- 2025One RL to See Them All: Visual Triple Unified Reinforcement Learning23 May
- 2024EgoPlan-Bench2: A Benchmark for Multimodal Large Language Model Planning in Real-World Scenarios5 Dec
- 2024EmbSpatial-Bench: Benchmarking Spatial Understanding for Embodied Tasks with Large Vision-Language Models9 Jun
- 2023EgoPlan-Bench: Benchmarking Multimodal Large Language Models for Human-Level Planning11 Dec
- 2023EgoThink: Evaluating First-Person Perspective Thinking Capability of Vision-Language Models27 Nov
Other references · 17
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
- 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 914
- 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 869
- 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 838
- 2016A Diagram Is Worth A Dozen Imagescited by 804
- 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 783
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 550
- 2020Rescaling Egocentric Visioncited by 540
- 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 476
5 more
- 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 455
- 2025Embodied-Reasoner: Synergizing Visual Search, Reasoning, and Action for Embodied Interactive Taskscited by 44
- 2025QuestA: Expanding Reasoning Capacity in LLMs via Question Augmentationcited by 44
- 2025MM-IFEngine: Towards Multimodal Instruction Followingcited by 42
- 2025Making VLMs More Robot-Friendly: Self-Critical Distillation of Low-Level Procedural Reasoningcited by 4
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026RoboAgent: Chaining Basic Capabilities for Embodied Task Planningcited by 7
- 2026BrainMem: Brain-Inspired Evolving Memory for Embodied Agent Task Planningcited by 2
- 2026UniETP: Unifying Environments for Generalizable Embodied Task Planningcited by 0
- 2026EmbodiedMind: Adaptive Data Curation and Prefix-Tree Reinforcement Learning for Efficient Embodied Intelligencecited by 0
- 2026EmbodiedMind: Adaptive Data Curation and Prefix-Tree Reinforcement Learning for Efficient Embodied Intelligence17 Sep 2026
- 2026UniETP: Unifying Environments for Generalizable Embodied Task Planning20 Jul 2026
- 2026RoboAgent: Chaining Basic Capabilities for Embodied Task Planning9 Apr 2026
- 2026BrainMem: Brain-Inspired Evolving Memory for Embodied Agent Task Planning12 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025Generative AI in Embodied Systems: System-Level Analysis of Performance, Efficiency and Scalability
- 2023EmbodiedGPT: Vision-Language Pre-Training via Embodied Chain of Thought
- 2025ManiTaskGen: A Comprehensive Task Generator for Benchmarking and Improving Vision-Language Agents on Embodied Decision-Making
- 2026GigaBrain-0.7: Scaling Embodied Foundation Models to Emergent Capabilities with a Three-System Architecture
- 2025Large Model Empowered Embodied AI: A Survey on Decision-Making and Embodied Learning
- 2026Towards general embodied intelligence: integrating large language models, knowledge bases, and reasoning capabilities to build the next generation of AI agents
- 2026GEM: Generative Supervision Helps Embodied Intelligence
- 2025EmbodiedBench: Comprehensive Benchmarking Multi-modal Large Language Models for Vision-Driven Embodied Agents