EmboMatrix: A Scalable Training-Ground for Embodied Decision-Making
Not on the map. Why?
Abstract (arXiv)
Embodied decision-making enables agents to translate high-level goals into executable actions through continuous interactions within the physical world, forming a cornerstone of general-purpose embodied intelligence. Large language models (LLMs), with their general decision-making capabilities, offer a promising path to realize this potential; however, LLMs trained solely on language lack exposure to physical environments, limiting their true embodied understanding. To bridge this gap, we propose the concept of a training ground: a comprehensive infrastructure that provides task and scene simulation, embodied interaction, and feedback signals, offering a one-stop solution for LLM acquire genuine embodied decision-making skills. In this work, we present EmboMatrix, the first training ground of its kind, providing massive and diverse tasks with efficient simulation and precise rewards. EmboMatrix incorporates a series of novel techniques: a multi-agent data engine for large-scale task and scene generation, a distributed heterogeneous-hardware system for scalable simulation, and a multi-level reward architecture for precise supervision. Leveraging EmboMatrix, we cultivate EmboBrain, an LLM whose embodied decision-making abilities emerge from extensive embodied interactions. Experiments show that EmboBrain-7B surpasses the 671B DeepSeek-R1 baseline by 9.5% on two challenging embodied decision-making benchmarks, demonstrating the power of interactive, environment-grounded learning for building truly intelligent embodied agents.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 56 of its 60 references that are in the map. First posted on arXiv 14 Oct 2025.
Builds on
56 of 60 references.
References · 56
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
- 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,168
- 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,029
- 2023Reasoning with Language Model is Planning with World Modelcited by 846
- 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 773
38 more
- 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 669
- 2023Safe RLHF: Safe Reinforcement Learning from Human Feedbackcited by 630
- 2023RLAIF vs. RLHF: Scaling Reinforcement Learning from Human Feedback with AI Feedbackcited by 615
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
- 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 598
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 584
- 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 482
- 2018VirtualHome: Simulating Household Activities via Programscited by 411
- 2022VIMA: General Robot Manipulation with Multimodal Promptscited by 403
- 2023Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agentscited by 396
- 2023Understanding the Effects of RLHF on LLM Generalisation and Diversitycited by 386
- 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 369
- 2023ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skillscited by 313
- 2025Reinforcement Learning for Reasoning in Large Language Models with One Training Examplecited by 288
- 2023EmbodiedGPT: Vision-Language Pre-Training via Embodied Chain of Thoughtcited by 276
- 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 257
- 2023Nash Learning from Human Feedbackcited by 220
- 2025EmbodiedBench: Comprehensive Benchmarking Multi-modal Large Language Models for Vision-Driven Embodied Agentscited by 213
- 2023RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulationcited by 206
- 2021ManiSkill: Generalizable Manipulation Skill Benchmark with Large-Scale Demonstrationscited by 193
- 2021iGibson 2.0: Object-Centric Simulation for Robot Learning of Everyday Household Taskscited by 191
- 2021BEHAVIOR: Benchmark for Everyday Household Activities in Virtual, Interactive, and Ecological Environmentscited by 161
- 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesiscited by 159
- 2025Cosmos-Reason1: From Physical Common Sense To Embodied Reasoningcited by 159
- 2024Embodied Agent Interface: Benchmarking LLMs for Embodied Decision Makingcited by 142
- 2023Task and Motion Planning with Large Language Models for Object Rearrangementcited by 140
- 2024BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulationcited by 140
- 2025RoboBrain: A Unified Brain Model for Robotic Manipulation from Abstract to Concretecited by 134
- 2020SoftGym: Benchmarking Deep Reinforcement Learning for Deformable Object Manipulationcited by 118
- 2019Interactive Gibson Benchmark (iGibson 0.5): A Benchmark for Interactive Navigation in Cluttered Environmentscited by 89
- 2023Embodied Task Planning with Large Language Modelscited by 84
- 2024Real-Time Anomaly Detection and Reactive Planning with Large Language Modelscited by 67
- 2021The ThreeDWorld Transport Challenge: A Visually Guided Task-and-Motion Planning Benchmark for Physically Realistic Embodied AIcited by 64
- 2023Group Preference Optimization: Few-Shot Alignment of Large Language Modelscited by 61
- 2024Plan-Seq-Learn: Language Model Guided RL for Solving Long Horizon Robotics Taskscited by 51
- 2023SayCanPay: Heuristic Planning with Large Language Models using Learnable Domain Knowledgecited by 49
- 2024Architect: Generating Vivid and Interactive 3D Scenes with Hierarchical 2D Inpaintingcited by 37
- 2024Learning to Learn Faster from Human Feedback with Language Model Predictive Controlcited by 25
50 most cited of 56 All 56 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026How Foundational Skills Influence VLM-based Embodied Agents:A Native Perspective
- 2025EmbodiedBrain: Expanding Performance Boundaries of Task Planning for Embodied Intelligence
- 2025Large Model Empowered Embodied AI: A Survey on Decision-Making and Embodied Learning
- 2025Beyond Description: Cognitively Benchmarking Fine-Grained Action for Embodied Agents
- 2026GigaBrain-0.7: Scaling Embodied Foundation Models to Emergent Capabilities with a Three-System Architecture
- 2024OPEx: A Component-Wise Analysis of LLM-Centric Agents in Embodied Instruction Following
- 2023Plan, Eliminate, and Track -- Language Models are Good Teachers for Embodied Agents
- 2025BLM1: A Boundless Large Model for Cross-Space, Cross-Task, and Cross-Embodiment Learning