mlsanityData to 14 Oct 2026

ABot-ER: Unified Embodied Reasoning through Agentic Data-Model Co-Evolution

arXiv 2610.18355 ↗First posted 13 Oct 2026cs.AIcited by 0

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

We introduce ABot Embodied Reasoning (ABot-ER), a unified embodied reasoning foundation model that breaks the tension between breadth and depth in embodied reasoning. Embodied intelligence demands the joint mastery of perception, planning, and execution, yet reconciling generality with specialization across this spectrum remains an open challenge. Within a single unified model, ABot-ER commands specialist-level depth across all three competencies, spanning spatial, scene, and temporal reasoning in perception; long-horizon action organization in planning; and point grounding and affordance in execution. The Agentic Data-Model Self-Evolution Engine continuously adapts data strategies to the model's evolving capability state. The Task-Conditioned Adaptive Training Strategy uses task tokens to activate lightweight low-rank residuals over a shared backbone, separating updates from heterogeneous output formats while retaining shared embodied knowledge. Across a systematic evaluation on twelve benchmarks covering three core competencies and five capability dimensions, ABot-ER achieves state-of-the-art overall performance across perception, planning, and execution within a unified parametric framework, demonstrating that breadth and depth can coexist in unified embodied reasoning.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 66 of its 70 references that are in the map. First posted on arXiv 13 Oct 2026.

Builds on

66 of 70 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025EmbodiedBench: Comprehensive Benchmarking Multi-modal Large Language Models for Vision-Driven Embodied Agents13 Feb
  2. 2023An Embodied Generalist Agent in 3D World18 Nov
  3. 2023RoboCat: A Self-Improving Generalist Agent for Robotic Manipulation20 Jun

Other references · 63

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2023Visual Instruction Tuningcited by 7,869
  4. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  5. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  6. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  7. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
  8. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  9. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
  10. 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,301
  11. 2020Gradient Surgery for Multi-Task Learningcited by 1,256
  12. 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,210
38 more
  1. 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
  2. 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
  3. 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
  4. 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 783
  5. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilitiescited by 706
  6. 2024Self-Rewarding Language Modelscited by 681
  7. 2023DataComp: In search of the next generation of multimodal datasetscited by 644
  8. 2021CLIPort: What and Where Pathways for Robotic Manipulationcited by 622
  9. 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 611
  10. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 611
  11. 2024LESS: Selecting Influential Data for Targeted Instruction Tuningcited by 532
  12. 2021Conflict-Averse Gradient Descent for Multi-task Learningcited by 459
  13. 2023DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretrainingcited by 399
  14. 2017Embodied Question Answeringcited by 336
  15. 2022HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interactioncited by 327
  16. 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Modelscited by 311
  17. 2023EmbodiedGPT: Vision-Language Pre-Training via Embodied Chain of Thoughtcited by 279
  18. 2024RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Roboticscited by 251
  19. 2023Proving Test Set Contamination in Black Box Language Modelscited by 230
  20. 2023Affordances from Human Videos as a Versatile Representation for Roboticscited by 226
  21. 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AIcited by 179
  22. 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 165
  23. 2025Cosmos-Reason1: From Physical Common Sense To Embodied Reasoningcited by 164
  24. 2023ManipLLM: Embodied Multimodal Large Language Model for Object-Centric Robotic Manipulationcited by 162
  25. 2018Categorizing Variants of Goodhart's Lawcited by 149
  26. 2025Cambrian-S: Towards Spatial Supersensing in Videocited by 134
  27. 2025RoboRefer: Towards Spatial Referring with Reasoning in Vision-Language Models for Roboticscited by 127
  28. 2023RoboVQA: Multimodal Long-Horizon Reasoning for Roboticscited by 120
  29. 2024EmbSpatial-Bench: Benchmarking Spatial Understanding for Embodied Tasks with Large Vision-Language Modelscited by 107
  30. 2026ABot-M0: VLA Foundation Model for Robotic Manipulation with Action Manifold Learningcited by 103
  31. 2025RoboBrain 2.0 Technical Reportcited by 89
  32. 2023EgoPlan-Bench: Benchmarking Multimodal Large Language Models for Human-Level Planningcited by 69
  33. 2025Scaling Text-Rich Image Understanding via Code-Guided Synthetic Multimodal Data Generationcited by 58
  34. 2024A Survey on Robotics with Foundation Models: toward Embodied AIcited by 56
  35. 2023HANDAL: A Dataset of Real-World Manipulable Object Categories with Pose Annotations, Affordances, and Reconstructionscited by 48
  36. 2023VL-Grasp: a 6-Dof Interactive Grasp Policy for Language-Oriented Objects in Cluttered Indoor Scenescited by 42
  37. 2025MM-IFEngine: Towards Multimodal Instruction Followingcited by 42
  38. 2025RoboFAC: A Comprehensive Framework for Robotic Failure Analysis and Correctioncited by 41

50 most cited of 63 All 63 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Pelican-Unify 1.0: A Unified Embodied Intelligence Model for Understanding, Reasoning, Imagination and Action
  2. 2026ParallelWorld: Test-Time Scaling for Embodied Reasoning
  3. 2026HY-Embodied-0.5: Embodied Foundation Models for Real-World Agents
  4. 2026Capek 0.5: An Execution-Centric Vision-Language Model for Embodied Intelligence
  5. 2026Embodied-R1.5: Evolving Physical Intelligence via Embodied Foundation Models
  6. 2026Hy-Embodied-VLM-1.0: Efficient Physical-World Agents
  7. 2025Embodied-Reasoner: Synergizing Visual Search, Reasoning, and Action for Embodied Interactive Tasks
  8. 2026Towards general embodied intelligence: integrating large language models, knowledge bases, and reasoning capabilities to build the next generation of AI agents