mlsanityData to 14 Oct 2026

Generative Flow on Symbolic Abstractions for Embodiment Capability Discovery

arXiv 2610.17174 ↗First posted 12 Oct 2026cs.RO cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Achieving complex, long-horizon robot behavior remains challenging because successful execution depends on skills grounded in a robot's physical affordances. Existing training-task distributions are often handcrafted or sampled from large language models (LLMs), relying on semantic plausibility rather than embodiment-specific feasibility. This mismatch can produce curricula that are too difficult, redundant, or blind to non-obvious but learnable behaviors. We propose Generative Flow on Symbolic Abstractions (FOSA), a framework for discovering embodiment-specific capabilities by learning a grounded task generator. FOSA parameterizes an abstract policy as a Generative Flow Network that constructs symbolic task skeletons. Each skeleton is compiled into a simulation environment, where low-level policy-learning performance provides the reward signal for the abstract policy. Across heterogeneous robot platforms, FOSA discovers diverse and executable tasks near the robot's empirical capability frontier. After distilling the discovered task policies into a single language-conditioned policy, FOSA improves performance on unseen complex and long-horizon tasks. The code and demonstration videos are available at https://www.youwei-yu.com/fosa.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 54 of its 60 references that are in the map. First posted on arXiv 12 Oct 2026.

Builds on

54 of 60 references.

References · 54

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  3. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  4. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
  5. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
  6. 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,498
  7. 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,353
  8. 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,210
  9. 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
  10. 2018Exploration by Random Network Distillationcited by 993
  11. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
  12. 2018Diversity is All You Need: Learning Skills without a Reward Functioncited by 752
38 more
  1. 2019Solving Rubik's Cube with a Robot Handcited by 734
  2. 2017Sim-to-Real Transfer of Robotic Control with Dynamics Randomizationcited by 672
  3. 2023Eureka: Human-Level Reward Design via Coding Large Language Modelscited by 571
  4. 2021RMA: Rapid Motor Adaptation for Legged Robotscited by 508
  5. 2019Learning agile and dynamic motor skills for legged robotscited by 504
  6. 2018Texygen: A Benchmarking Platform for Text Generation Modelscited by 491
  7. 2018Data-Efficient Hierarchical Reinforcement Learningcited by 455
  8. 2016The Option-Critic Architecturecited by 448
  9. 2019Relay Policy Learning: Solving Long-Horizon Tasks via Imitation and Reinforcement Learningcited by 384
  10. 2018Sim-to-Real: Learning Agile Locomotion For Quadruped Robotscited by 319
  11. 2020Integrated Task and Motion Planningcited by 290
  12. 2021GFlowNet Foundationscited by 290
  13. 2020Emergent Complexity and Zero-shot Transfer via Unsupervised Environment Designcited by 275
  14. 2017Automatic Goal Generation for Reinforcement Learning Agentscited by 259
  15. 2022Trajectory balance: Improved credit assignment in GFlowNetscited by 251
  16. 2020Accelerating Reinforcement Learning with Learned Skill Priorscited by 223
  17. 2023RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulationcited by 218
  18. 2020Prioritized Level Replaycited by 198
  19. 2019Paired Open-Ended Trailblazer (POET): Endlessly Generating Increasingly Complex and Diverse Learning Environments and Their Solutionscited by 192
  20. 2022Evolving Curricula with Regret-Based Environment Designcited by 173
  21. 2020OPAL: Offline Primitive Discovery for Accelerating Offline Reinforcement Learningcited by 166
  22. 2023Extreme Parkour with Legged Robotscited by 164
  23. 2021Monte Carlo Tree Search: A Review of Recent Modifications and Applicationscited by 161
  24. 2023Text2Reward: Reward Shaping with Language Models for Reinforcement Learningcited by 160
  25. 2023ANYmal Parkour: Learning Agile Navigation for Quadrupedal Robotscited by 152
  26. 2020Automatic Curriculum Learning For Deep RL: A Short Surveycited by 150
  27. 2023GenSim: Generating Robotic Simulation Tasks via Large Language Modelscited by 125
  28. 2020Explore, Discover and Learn: Unsupervised Discovery of State-Covering Skillscited by 122
  29. 2021APS: Active Pretraining with Successor Featurescited by 112
  30. 2022MetaMorph: Learning Universal Controllers with Transformerscited by 89
  31. 2020Automatic Curriculum Learning through Value Disagreementcited by 87
  32. 2024DrEureka: Language Model Guided Sim-To-Real Transfercited by 83
  33. 2022CIC: Contrastive Intrinsic Control for Unsupervised Skill Discoverycited by 68
  34. 2023DexArt: Benchmarking Generalizable Dexterous Manipulation with Articulated Objectscited by 66
  35. 2026SAGE: Scalable Agentic 3D Scene Generation for Embodied AIcited by 50
  36. 2023Local Search GFlowNetscited by 48
  37. 2021Adversarial Skill Chaining for Long-Horizon Robot Manipulation via Terminal State Regularizationcited by 46
  38. 2021Transform2Act: Learning a Transform-and-Control Policy for Efficient Agent Designcited by 38

50 most cited of 54 All 54 (JSON)

Built on by

Not cited yet.