mlsanityData to 7 Oct 2026

EmboMatrix: A Scalable Training-Ground for Embodied Decision-Making

arXiv 2510.12072 ↗First posted 14 Oct 2025cs.AI cs.ROcited by 3

Not on the map. Why?

Abstract (arXiv)

Embodied decision-making enables agents to translate high-level goals into executable actions through continuous interactions within the physical world, forming a cornerstone of general-purpose embodied intelligence. Large language models (LLMs), with their general decision-making capabilities, offer a promising path to realize this potential; however, LLMs trained solely on language lack exposure to physical environments, limiting their true embodied understanding. To bridge this gap, we propose the concept of a training ground: a comprehensive infrastructure that provides task and scene simulation, embodied interaction, and feedback signals, offering a one-stop solution for LLM acquire genuine embodied decision-making skills. In this work, we present EmboMatrix, the first training ground of its kind, providing massive and diverse tasks with efficient simulation and precise rewards. EmboMatrix incorporates a series of novel techniques: a multi-agent data engine for large-scale task and scene generation, a distributed heterogeneous-hardware system for scalable simulation, and a multi-level reward architecture for precise supervision. Leveraging EmboMatrix, we cultivate EmboBrain, an LLM whose embodied decision-making abilities emerge from extensive embodied interactions. Experiments show that EmboBrain-7B surpasses the 671B DeepSeek-R1 baseline by 9.5% on two challenging embodied decision-making benchmarks, demonstrating the power of interactive, environment-grounded learning for building truly intelligent embodied agents.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 56 of its 60 references that are in the map. First posted on arXiv 14 Oct 2025.

Builds on

56 of 60 references.

References · 56

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  3. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  4. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  5. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  6. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
  7. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
  8. 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
  9. 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,168
  10. 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,029
  11. 2023Reasoning with Language Model is Planning with World Modelcited by 846
  12. 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 773
38 more
  1. 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 669
  2. 2023Safe RLHF: Safe Reinforcement Learning from Human Feedbackcited by 630
  3. 2023RLAIF vs. RLHF: Scaling Reinforcement Learning from Human Feedback with AI Feedbackcited by 615
  4. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
  5. 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 598
  6. 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 584
  7. 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 482
  8. 2018VirtualHome: Simulating Household Activities via Programscited by 411
  9. 2022VIMA: General Robot Manipulation with Multimodal Promptscited by 403
  10. 2023Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agentscited by 396
  11. 2023Understanding the Effects of RLHF on LLM Generalisation and Diversitycited by 386
  12. 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 369
  13. 2023ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skillscited by 313
  14. 2025Reinforcement Learning for Reasoning in Large Language Models with One Training Examplecited by 288
  15. 2023EmbodiedGPT: Vision-Language Pre-Training via Embodied Chain of Thoughtcited by 276
  16. 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 257
  17. 2023Nash Learning from Human Feedbackcited by 220
  18. 2025EmbodiedBench: Comprehensive Benchmarking Multi-modal Large Language Models for Vision-Driven Embodied Agentscited by 213
  19. 2023RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulationcited by 206
  20. 2021ManiSkill: Generalizable Manipulation Skill Benchmark with Large-Scale Demonstrationscited by 193
  21. 2021iGibson 2.0: Object-Centric Simulation for Robot Learning of Everyday Household Taskscited by 191
  22. 2021BEHAVIOR: Benchmark for Everyday Household Activities in Virtual, Interactive, and Ecological Environmentscited by 161
  23. 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesiscited by 159
  24. 2025Cosmos-Reason1: From Physical Common Sense To Embodied Reasoningcited by 159
  25. 2024Embodied Agent Interface: Benchmarking LLMs for Embodied Decision Makingcited by 142
  26. 2023Task and Motion Planning with Large Language Models for Object Rearrangementcited by 140
  27. 2024BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulationcited by 140
  28. 2025RoboBrain: A Unified Brain Model for Robotic Manipulation from Abstract to Concretecited by 134
  29. 2020SoftGym: Benchmarking Deep Reinforcement Learning for Deformable Object Manipulationcited by 118
  30. 2019Interactive Gibson Benchmark (iGibson 0.5): A Benchmark for Interactive Navigation in Cluttered Environmentscited by 89
  31. 2023Embodied Task Planning with Large Language Modelscited by 84
  32. 2024Real-Time Anomaly Detection and Reactive Planning with Large Language Modelscited by 67
  33. 2021The ThreeDWorld Transport Challenge: A Visually Guided Task-and-Motion Planning Benchmark for Physically Realistic Embodied AIcited by 64
  34. 2023Group Preference Optimization: Few-Shot Alignment of Large Language Modelscited by 61
  35. 2024Plan-Seq-Learn: Language Model Guided RL for Solving Long Horizon Robotics Taskscited by 51
  36. 2023SayCanPay: Heuristic Planning with Large Language Models using Learnable Domain Knowledgecited by 49
  37. 2024Architect: Generating Vivid and Interactive 3D Scenes with Hierarchical 2D Inpaintingcited by 37
  38. 2024Learning to Learn Faster from Human Feedback with Language Model Predictive Controlcited by 25

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026How Foundational Skills Influence VLM-based Embodied Agents:A Native Perspective
  2. 2025EmbodiedBrain: Expanding Performance Boundaries of Task Planning for Embodied Intelligence
  3. 2025Large Model Empowered Embodied AI: A Survey on Decision-Making and Embodied Learning
  4. 2025Beyond Description: Cognitively Benchmarking Fine-Grained Action for Embodied Agents
  5. 2026GigaBrain-0.7: Scaling Embodied Foundation Models to Emergent Capabilities with a Three-System Architecture
  6. 2024OPEx: A Component-Wise Analysis of LLM-Centric Agents in Embodied Instruction Following
  7. 2023Plan, Eliminate, and Track -- Language Models are Good Teachers for Embodied Agents
  8. 2025BLM1: A Boundless Large Model for Cross-Space, Cross-Task, and Cross-Embodiment Learning