ABot-ER: Unified Embodied Reasoning through Agentic Data-Model Co-Evolution
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
We introduce ABot Embodied Reasoning (ABot-ER), a unified embodied reasoning foundation model that breaks the tension between breadth and depth in embodied reasoning. Embodied intelligence demands the joint mastery of perception, planning, and execution, yet reconciling generality with specialization across this spectrum remains an open challenge. Within a single unified model, ABot-ER commands specialist-level depth across all three competencies, spanning spatial, scene, and temporal reasoning in perception; long-horizon action organization in planning; and point grounding and affordance in execution. The Agentic Data-Model Self-Evolution Engine continuously adapts data strategies to the model's evolving capability state. The Task-Conditioned Adaptive Training Strategy uses task tokens to activate lightweight low-rank residuals over a shared backbone, separating updates from heterogeneous output formats while retaining shared embodied knowledge. Across a systematic evaluation on twelve benchmarks covering three core competencies and five capability dimensions, ABot-ER achieves state-of-the-art overall performance across perception, planning, and execution within a unified parametric framework, demonstrating that breadth and depth can coexist in unified embodied reasoning.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 66 of its 70 references that are in the map. First posted on arXiv 13 Oct 2026.
Builds on
66 of 70 references.
Closest ancestors · 3
Same direction, newest first
- 2025EmbodiedBench: Comprehensive Benchmarking Multi-modal Large Language Models for Vision-Driven Embodied Agents13 Feb
- 2023An Embodied Generalist Agent in 3D World18 Nov
- 2023RoboCat: A Self-Improving Generalist Agent for Robotic Manipulation20 Jun
Other references · 63
- 2017Attention Is All You Needcited by 60,361
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023Visual Instruction Tuningcited by 7,869
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
- 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,301
- 2020Gradient Surgery for Multi-Task Learningcited by 1,256
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,210
38 more
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
- 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 783
- 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilitiescited by 706
- 2024Self-Rewarding Language Modelscited by 681
- 2023DataComp: In search of the next generation of multimodal datasetscited by 644
- 2021CLIPort: What and Where Pathways for Robotic Manipulationcited by 622
- 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 611
- 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 611
- 2024LESS: Selecting Influential Data for Targeted Instruction Tuningcited by 532
- 2021Conflict-Averse Gradient Descent for Multi-task Learningcited by 459
- 2023DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretrainingcited by 399
- 2017Embodied Question Answeringcited by 336
- 2022HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interactioncited by 327
- 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Modelscited by 311
- 2023EmbodiedGPT: Vision-Language Pre-Training via Embodied Chain of Thoughtcited by 279
- 2024RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Roboticscited by 251
- 2023Proving Test Set Contamination in Black Box Language Modelscited by 230
- 2023Affordances from Human Videos as a Versatile Representation for Roboticscited by 226
- 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AIcited by 179
- 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 165
- 2025Cosmos-Reason1: From Physical Common Sense To Embodied Reasoningcited by 164
- 2023ManipLLM: Embodied Multimodal Large Language Model for Object-Centric Robotic Manipulationcited by 162
- 2018Categorizing Variants of Goodhart's Lawcited by 149
- 2025Cambrian-S: Towards Spatial Supersensing in Videocited by 134
- 2025RoboRefer: Towards Spatial Referring with Reasoning in Vision-Language Models for Roboticscited by 127
- 2023RoboVQA: Multimodal Long-Horizon Reasoning for Roboticscited by 120
- 2024EmbSpatial-Bench: Benchmarking Spatial Understanding for Embodied Tasks with Large Vision-Language Modelscited by 107
- 2026ABot-M0: VLA Foundation Model for Robotic Manipulation with Action Manifold Learningcited by 103
- 2025RoboBrain 2.0 Technical Reportcited by 89
- 2023EgoPlan-Bench: Benchmarking Multimodal Large Language Models for Human-Level Planningcited by 69
- 2025Scaling Text-Rich Image Understanding via Code-Guided Synthetic Multimodal Data Generationcited by 58
- 2024A Survey on Robotics with Foundation Models: toward Embodied AIcited by 56
- 2023HANDAL: A Dataset of Real-World Manipulable Object Categories with Pose Annotations, Affordances, and Reconstructionscited by 48
- 2023VL-Grasp: a 6-Dof Interactive Grasp Policy for Language-Oriented Objects in Cluttered Indoor Scenescited by 42
- 2025MM-IFEngine: Towards Multimodal Instruction Followingcited by 42
- 2025RoboFAC: A Comprehensive Framework for Robotic Failure Analysis and Correctioncited by 41
50 most cited of 63 All 63 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Pelican-Unify 1.0: A Unified Embodied Intelligence Model for Understanding, Reasoning, Imagination and Action
- 2026ParallelWorld: Test-Time Scaling for Embodied Reasoning
- 2026HY-Embodied-0.5: Embodied Foundation Models for Real-World Agents
- 2026Capek 0.5: An Execution-Centric Vision-Language Model for Embodied Intelligence
- 2026Embodied-R1.5: Evolving Physical Intelligence via Embodied Foundation Models
- 2026Hy-Embodied-VLM-1.0: Efficient Physical-World Agents
- 2025Embodied-Reasoner: Synergizing Visual Search, Reasoning, and Action for Embodied Interactive Tasks
- 2026Towards general embodied intelligence: integrating large language models, knowledge bases, and reasoning capabilities to build the next generation of AI agents