EmbodiedSWE: Coding Agents for Long Horizon Dexterous Robotics
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
We study coding agents for long-horizon, dexterous robotics and ask whether their solutions can provide scalable supervision for learning general robot policies. To test this, we develop EMBODIEDSWE-BENCH, a simulation benchmark for coding agents spanning contact-rich manipulation, deformable objects, and long-horizon tasks requiring up to half an hour of continuous interaction. We find that frontier coding agents can solve complex long-horizon tasks and transfer prior solutions across both tasks and embodiments. We also design supporting tools that help agents more effectively solve these tasks. However, the resulting solutions require substantial iterative interaction and are typically specialized to individual task instances. We therefore introduce EMBODIEDSWE-GEN, which expands a single solution from coding agent into large diverse trajectories for training a VLA. VLA performance improves with more generated demonstrations, and agent-aided diversification improves generalization to held-out task variations. We also show that a VLA finetuned solely on coding-agent-generated simulation demonstrations completes a long-horizon task on real robot. Together, our framework uses coding agents to solve complex robotics tasks and turn verified solutions into scalable supervision for robot policies.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 52 of its 57 references that are in the map. First posted on arXiv 23 Sep 2026.
Builds on
52 of 57 references.
Closest ancestors · 7
Same direction, newest first
- 2026EmbodiedGen V2: An Agentic, Simulation-Ready 3D World Engine for Embodied AI8 Jul
- 2026ASPIRE: Agentic /Skills Discovery for Robotics30 Jun
- 2026ENPIRE: Agentic Robot Policy Self-Improvement in the Real World18 Jun
- 2026RHO: Your Coding Agent is Secretly a Roboticist15 Jun
- 2026SimWorld Studio: Automatic Environment Generation with Evolving Coding Agent for Embodied Agent Learning10 May
- 2026CaP-X: A Framework for Benchmarking and Improving Coding Agents for Robot Manipulation23 Mar
- 2026Demonstration-Free Robotic Control via LLM Agents28 Jan
Other references · 45
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2018DeepMind Control Suitecited by 935
- 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 733
- 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 669
- 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 598
- 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 564
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 507
- 2020robosuite: A Modular Simulation Framework and Benchmark for Robot Learningcited by 484
- 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 391
33 more
- 2016The CMA Evolution Strategy: A Tutorialcited by 364
- 2023MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrationscited by 308
- 2025Hi Robot: Open-Ended Instruction Following with Hierarchical Vision-Language-Action Modelscited by 216
- 2023RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulationcited by 206
- 2021ManiSkill: Generalizable Manipulation Skill Benchmark with Large-Scale Demonstrationscited by 193
- 2017DART: Noise Injection for Robust Imitation Learningcited by 187
- 2025Ctrl-World: A Controllable Generative World Model for Robot Manipulationcited by 149
- 2023GenSim: Generating Robotic Simulation Tasks via Large Language Modelscited by 120
- 2023RoboVQA: Multimodal Long-Horizon Reasoning for Roboticscited by 116
- 2024DexMimicGen: Automated Data Generation for Bimanual Dexterous Manipulation via Imitation Learningcited by 104
- 2025Gemini Robotics 1.5: Pushing the Frontier of Generalist Robots with Advanced Embodied Reasoning, Thinking, and Motion Transfercited by 86
- 2025DemoGen: Synthetic Demonstration Generation for Data-Efficient Visuomotor Policy Learningcited by 64
- 2025RoboMonkey: Scaling Test-Time Sampling and Verification for Vision-Language-Action Modelscited by 56
- 2024RoboCodeX: Multimodal Code Generation for Robotic Behavior Synthesiscited by 55
- 2024GenSim2: Scaling Robot Data Generation with Multi-modal and Reasoning LLMscited by 48
- 2024SkillMimicGen: Automated Demonstration Generation for Efficient Skill Learning and Deploymentcited by 48
- 2025RoboVerse: Towards a Unified Platform, Dataset and Benchmark for Scalable and Generalizable Robot Learningcited by 48
- 2025InternData-A1: Pioneering High-Fidelity Synthetic Data for Pre-training Generalist Policycited by 46
- 2026Qwen-VLA: Unifying Vision-Language-Action Modeling across Tasks, Environments, and Robot Embodimentscited by 42
- 2025Real2Render2Real: Scaling Robot Data Without Dynamics Simulation or Robot Hardwarecited by 41
- 2025Task adaptation of Vision-Language-Action model: 1st Place Solution for the 2025 BEHAVIOR Challengecited by 13
- 2025AutoCode: LLMs as Problem Setters for Competitive Programmingcited by 11
- 2026SimFoundry: Modular and Automated Scene Generation for Policy Learning and Evaluationcited by 11
- 2025Openpi Comet: Competition Solution For 2025 BEHAVIOR Challengecited by 8
- 2026RoboCurate: Harnessing Diversity with Action-Verified Neural Trajectory for Robot Learningcited by 7
- 2026Addressing the Orchestration Gap in Generalist Robots via Physical Agencycited by 7
- 2025FieldGen: From Teleoperated Pre-Manipulation Trajectories to Field-Guided Data Generationcited by 4
- 2026Lucid-XR: An Extended-Reality Data Engine for Robotic Manipulationcited by 4
- 2026FrontierSmith: Synthesizing Open-Ended Coding Problems at Scalecited by 3
- 2026AffordGen: Generating Diverse Demonstrations for Generalizable Object Manipulation with Afford Correspondencecited by 2
- 2026QDTraj: Exploration of Diverse Trajectory Primitives for Articulated Objects Robotic Manipulationcited by 1
- 2026RDGen: Demonstration Generation for High-Quality Robot Learning via Reinforcement Learningcited by 1
- 2026Visual Verification Enables Inference-time Steering and Autonomous Policy Improvementcited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026RLE-Bench: A Qualifying Exam for Coding Agents as Robot Learning Engineers
- 2026CodeActionBench: Evaluating Agentic Code-as-Policy for Embodied Manipulation
- 2026RAPID: Robot Agentic Programming from Demonstrations
- 20262AM: Grounding Agent-Side Memory as Guidance for Steerable Action Models in Long-Horizon Manipulation
- 2025EmbodiedCoder: Parameterized Embodied Mobile Manipulation via Modern Coding Model
- 2026Cortex: A Bidirectionally Aligned Embodied Agent Framework for Long-horizon Manipulation
- 2026SkillWeaver: Agentic Exploration over Neural Interaction Skills for Scalable Robot Data Generation
- 2025Robotic Long-Horizon Manipulation with Progressive In-Context Code Generation and Episodic Feedback