mlsanityData to 14 Oct 2026

ETA: A New Agentic Paradigm for Embodied Tasks

arXiv 2608.03924 ↗First posted 4 Aug 2026cs.ROcited by 7

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

When will robots have their ChatGPT moment? Such a breakthrough requires a general-purpose robot that can handle unfamiliar tasks in unfamiliar environments, remain controllable over long interactions, and learn from experience. Today's embodied systems largely follow an end-to-end observation-to-action path. Despite rapid progress, they remain far from this goal: their generalization depends heavily on the coverage of robot training data, while long task execution remains difficult to control and inspect. To realize this goal, we introduce the Embodied Task Agent (ETA), a new paradigm for extending digital agents into the physical world, and release OpenETA as its open-source implementation. ETA centers the robot around a Planner that chooses one Tool call at a time, an Interface that controls execution, and a World that returns the result and a fresh observation. This loop allows the agent to verify outcomes, adapt its plan, and turn successful and failed interactions into reusable experience. OpenETA provides replaceable Planners, composable Tools and Skills, auditable memory, replayable trajectories, and common interfaces for simulation and real robots. For Codex, OpenETA can operate as a lightweight plugin that exposes only observe, mark_point, and move_to.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 42 of its 48 references that are in the map. First posted on arXiv 4 Aug 2026.

Builds on

42 of 48 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026Advancing Omnimodal Embodied Agents from Isolated Skills to Everyday Physical Autonomy25 Jun
  2. 2023Creative Robot Tool Use with Large Language Models19 Oct

Other references · 40

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  3. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  4. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  5. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  6. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  7. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
  8. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  9. 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
  10. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
  11. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
  12. 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,210
28 more
  1. 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
  2. 2025SAM 3: Segment Anything with Conceptscited by 906
  3. 2023ExpeL: LLM Agents Are Experiential Learnerscited by 876
  4. 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 750
  5. 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 611
  6. 2026World Action Models are Zero-shot Policiescited by 465
  7. 2024ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulationcited by 315
  8. 2023ChatGPT for Robotics: Design Principles and Model Abilitiescited by 299
  9. 2023SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task Planningcited by 294
  10. 2023Text2Motion: From Natural Language Instructions to Feasible Planscited by 224
  11. 2021Contact-GraspNet: Efficient 6-DoF Grasp Generation in Cluttered Scenescited by 218
  12. 2022AnyGrasp: Robust and Efficient Grasp Perception in Spatial and Temporal Domainscited by 208
  13. 2025LIBERO-PRO: Towards Robust and Fair Evaluation of Vision-Language-Action Models Beyond Memorizationcited by 179
  14. 2026DreamDojo: A Generalist Robot World Model from Large-Scale Human Videoscited by 135
  15. 2024MOKA: Open-World Robotic Manipulation through Mark-Based Visual Promptingcited by 129
  16. 2023Instruct2Act: Mapping Multi-modality Instructions to Robotic Actions with Large Language Modelcited by 116
  17. 2024CoPa: General Robotic Manipulation through Spatial Constraints of Parts with Foundation Modelscited by 99
  18. 2024Manipulate-Anything: Automating Real-World Robots using Vision-Language Modelscited by 83
  19. 2025OmniManip: Towards General Robotic Manipulation via Object-Centric Interaction Primitives as Spatial Constraintscited by 59
  20. 2024RoboCodeX: Multimodal Code Generation for Robotic Behavior Synthesiscited by 58
  21. 2026Hyperagentscited by 56
  22. 2023cuRobo: Parallelized Collision-Free Minimum-Jerk Robot Motion Generationcited by 52
  23. 2026World Action Models: The Next Frontier in Embodied AIcited by 50
  24. 2025Reflective Planning: Vision-Language Models for Multi-Stage Long-Horizon Robotic Manipulationcited by 42
  25. 2024RoboScript: Code Generation for Free-Form Manipulation Tasks across Real and Simulationcited by 26
  26. 2025AnyPlace: Learning Generalized Object Placement for Robot Manipulationcited by 11
  27. 2026cuRoboV2: Dynamics-Aware Motion Generation with Depth-Fused Distance Fields for High-DoF Robotscited by 8
  28. 2026CoRE-VLA: Towards Scalable and Robust Vision-Language-Action Modeling via Conditional Routing of Expertscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 7.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Embodied Skill Bench: Benchmarking How Well Agents with Embodied Skills Perform on Physical Tasks
  2. 2026ABot-Claw: A Foundation for Persistent, Cooperative, and Self-Evolving Robotic Agents
  3. 2025P3: Toward Versatile Embodied Agents
  4. 2026Towards the Harness of Embodied Agents
  5. 2023Toward Open-ended Embodied Tasks Solving
  6. 2026HoloAgent-0: A Unified Embodied Agent Framework with 3D Spatial Memory
  7. 2026Compiling and Benchmarking Task-State Horizons for Embodied Agents
  8. 2026RoboBridge: A Self-Evolving Embodied Agent Framework for Sim-to-Real Transfer