ETA: A New Agentic Paradigm for Embodied Tasks
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
When will robots have their ChatGPT moment? Such a breakthrough requires a general-purpose robot that can handle unfamiliar tasks in unfamiliar environments, remain controllable over long interactions, and learn from experience. Today's embodied systems largely follow an end-to-end observation-to-action path. Despite rapid progress, they remain far from this goal: their generalization depends heavily on the coverage of robot training data, while long task execution remains difficult to control and inspect. To realize this goal, we introduce the Embodied Task Agent (ETA), a new paradigm for extending digital agents into the physical world, and release OpenETA as its open-source implementation. ETA centers the robot around a Planner that chooses one Tool call at a time, an Interface that controls execution, and a World that returns the result and a fresh observation. This loop allows the agent to verify outcomes, adapt its plan, and turn successful and failed interactions into reusable experience. OpenETA provides replaceable Planners, composable Tools and Skills, auditable memory, replayable trajectories, and common interfaces for simulation and real robots. For Codex, OpenETA can operate as a lightweight plugin that exposes only observe, mark_point, and move_to.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 42 of its 48 references that are in the map. First posted on arXiv 4 Aug 2026.
Builds on
42 of 48 references.
Closest ancestors · 2
Same direction, newest first
- 2026Advancing Omnimodal Embodied Agents from Isolated Skills to Everyday Physical Autonomy25 Jun
- 2023Creative Robot Tool Use with Large Language Models19 Oct
Other references · 40
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,210
28 more
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
- 2025SAM 3: Segment Anything with Conceptscited by 906
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 876
- 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 750
- 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 611
- 2026World Action Models are Zero-shot Policiescited by 465
- 2024ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulationcited by 315
- 2023ChatGPT for Robotics: Design Principles and Model Abilitiescited by 299
- 2023SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task Planningcited by 294
- 2023Text2Motion: From Natural Language Instructions to Feasible Planscited by 224
- 2021Contact-GraspNet: Efficient 6-DoF Grasp Generation in Cluttered Scenescited by 218
- 2022AnyGrasp: Robust and Efficient Grasp Perception in Spatial and Temporal Domainscited by 208
- 2025LIBERO-PRO: Towards Robust and Fair Evaluation of Vision-Language-Action Models Beyond Memorizationcited by 179
- 2026DreamDojo: A Generalist Robot World Model from Large-Scale Human Videoscited by 135
- 2024MOKA: Open-World Robotic Manipulation through Mark-Based Visual Promptingcited by 129
- 2023Instruct2Act: Mapping Multi-modality Instructions to Robotic Actions with Large Language Modelcited by 116
- 2024CoPa: General Robotic Manipulation through Spatial Constraints of Parts with Foundation Modelscited by 99
- 2024Manipulate-Anything: Automating Real-World Robots using Vision-Language Modelscited by 83
- 2025OmniManip: Towards General Robotic Manipulation via Object-Centric Interaction Primitives as Spatial Constraintscited by 59
- 2024RoboCodeX: Multimodal Code Generation for Robotic Behavior Synthesiscited by 58
- 2026Hyperagentscited by 56
- 2023cuRobo: Parallelized Collision-Free Minimum-Jerk Robot Motion Generationcited by 52
- 2026World Action Models: The Next Frontier in Embodied AIcited by 50
- 2025Reflective Planning: Vision-Language Models for Multi-Stage Long-Horizon Robotic Manipulationcited by 42
- 2024RoboScript: Code Generation for Free-Form Manipulation Tasks across Real and Simulationcited by 26
- 2025AnyPlace: Learning Generalized Object Placement for Robot Manipulationcited by 11
- 2026cuRoboV2: Dynamics-Aware Motion Generation with Depth-Fused Distance Fields for High-DoF Robotscited by 8
- 2026CoRE-VLA: Towards Scalable and Robust Vision-Language-Action Modeling via Conditional Routing of Expertscited by 4
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026HarnessPAI: An Evolving Harness for Physical AIcited by 5
- 20262AM: Grounding Agent-Side Memory as Guidance for Steerable Action Models in Long-Horizon Manipulationcited by 2
- 2026RoboRSI: Stable, efficient, and reusable robot self-evolution in complex real-world environmentscited by 2
- 2026In-Context Learning for Robots: Methods and Applicationscited by 1
- 2026CodeActionBench: Evaluating Agentic Code-as-Policy for Embodied Manipulationcited by 0
- 2026MotorMind: Scaffolding General Vision Language Models for Zero-Shot Robot Manipulationcited by 0
- 2026DynaHarness: A Dynamic Physical Harness for Self-Evolving Robot Agentscited by 0
- 2026RoboRSI: Stable, efficient, and reusable robot self-evolution in complex real-world environments8 Oct 2026
- 2026DynaHarness: A Dynamic Physical Harness for Self-Evolving Robot Agents30 Sep 2026
- 2026MotorMind: Scaffolding General Vision Language Models for Zero-Shot Robot Manipulation29 Sep 2026
- 2026In-Context Learning for Robots: Methods and Applications28 Sep 2026
- 2026CodeActionBench: Evaluating Agentic Code-as-Policy for Embodied Manipulation27 Sep 2026
- 2026HarnessPAI: An Evolving Harness for Physical AI24 Sep 2026
- 20262AM: Grounding Agent-Side Memory as Guidance for Steerable Action Models in Long-Horizon Manipulation10 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026Embodied Skill Bench: Benchmarking How Well Agents with Embodied Skills Perform on Physical Tasks
- 2026ABot-Claw: A Foundation for Persistent, Cooperative, and Self-Evolving Robotic Agents
- 2025P3: Toward Versatile Embodied Agents
- 2026Towards the Harness of Embodied Agents
- 2023Toward Open-ended Embodied Tasks Solving
- 2026HoloAgent-0: A Unified Embodied Agent Framework with 3D Spatial Memory
- 2026Compiling and Benchmarking Task-State Horizons for Embodied Agents
- 2026RoboBridge: A Self-Evolving Embodied Agent Framework for Sim-to-Real Transfer