mlsanityData to 14 Oct 2026

Toward Open-ended Embodied Tasks Solving

arXiv 2312.05822 ↗First posted 10 Dec 2023cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

Empowering embodied agents, such as robots, with Artificial Intelligence (AI) has become increasingly important in recent years. A major challenge is task open-endedness. In practice, robots often need to perform tasks with novel goals that are multifaceted, dynamic, lack a definitive "end-state", and were not encountered during training. To tackle this problem, this paper introduces textitDiffusion for Open-ended Goals (DOG), a novel framework designed to enable embodied AI to plan and act flexibly and dynamically for open-ended task goals. DOG synergizes the generative prowess of diffusion models with state-of-the-art, training-free guidance techniques to adaptively perform online planning and control. Our evaluations demonstrate that DOG can handle various kinds of novel task goals not seen during training, in both maze navigation and robot control problems. Our work sheds light on enhancing embodied AI's adaptability and competency in tackling open-ended goals.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 48 of its 59 references that are in the map. First posted on arXiv 10 Dec 2023.

Builds on

48 of 59 references.

References · 48

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  5. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  6. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  8. 2023Segment Anythingcited by 8,234
  9. 2022Classifier-Free Diffusion Guidancecited by 5,847
  10. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
  11. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  12. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
36 more
  1. 2020Conservative Q-Learning for Offline Reinforcement Learningcited by 1,809
  2. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
  3. 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,546
  4. 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,434
  5. 2020D4RL: Datasets for Deep Data-Driven Reinforcement Learningcited by 1,427
  6. 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,416
  7. 2021Offline Reinforcement Learning with Implicit Q-Learningcited by 1,293
  8. 2022Planning with Diffusion for Flexible Behavior Synthesiscited by 1,061
  9. 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 750
  10. 2017Learning Complex Dexterous Manipulation with Deep Reinforcement Learning and Demonstrationscited by 715
  11. 2021Offline Reinforcement Learning as One Big Sequence Modeling Problemcited by 644
  12. 2020MOPO: Model-based Offline Policy Optimizationcited by 636
  13. 2020MOReL : Model-Based Offline Reinforcement Learningcited by 590
  14. 2023Learning Universal Policies via Text-Guided Video Generationcited by 522
  15. 2022Is Conditional Generative Modeling all you need for Decision-Making?cited by 516
  16. 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledgecited by 478
  17. 2021MetaICL: Learning to Learn In Contextcited by 454
  18. 2019Learning Latent Plans from Playcited by 316
  19. 2019Dynamics-Aware Unsupervised Discovery of Skillscited by 313
  20. 2023Language to Rewards for Robotic Skill Synthesiscited by 312
  21. 2023FreeDoM: Training-Free Energy-Guided Conditional Diffusion Modelcited by 294
  22. 2023Imitating Human Behaviour with Diffusion Modelscited by 263
  23. 2021Open-Ended Learning Leads to Generally Capable Agentscited by 182
  24. 2021Embodied Intelligence via Learning and Evolutioncited by 163
  25. 2022Goal-Conditioned Reinforcement Learning: Problems and Solutionscited by 158
  26. 2023AdaptDiffuser: Diffusion Models as Adaptive Self-evolving Plannerscited by 149
  27. 2023Human-Timescale Adaptation in an Open-Ended Task Spacecited by 138
  28. 2021Discovering and Achieving Goals via World Modelscited by 131
  29. 2020Model-Based Offline Planningcited by 129
  30. 2022Latent Plans for Task-Agnostic Offline Reinforcement Learningcited by 81
  31. 2022How Far I'll Go: Offline Goal-Conditioned Reinforcement Learning via f-Advantage Regressioncited by 66
  32. 2019PIPPS: Flexible Model-Based Policy Search Robust to the Curse of Chaoscited by 56
  33. 2022Predictive Sampling: Real-time Behaviour Synthesis with MuJoCocited by 47
  34. 2023Diffusion Model-Augmented Behavioral Cloningcited by 38
  35. 2022Chain of Thought Imitation with Procedure Cloningcited by 30
  36. 2020PlaNet of the Bayesians: Reconsidering and Improving Deep Planning Network by Incorporating Bayesian Inferencecited by 23

Built on by

Cited by year

Citing papers per year: 2024: 2; 2025: 1.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026ETA: A New Agentic Paradigm for Embodied Tasks
  2. 2023Planning as In-Painting: A Diffusion-Based Embodied Task Planning Framework for Environments under Uncertainty
  3. 2026ABot-Claw: A Foundation for Persistent, Cooperative, and Self-Evolving Robotic Agents
  4. 2024Embodied Instruction Following in Unknown Environments
  5. 2025A Survey: Learning Embodied Intelligence from Physical Simulators and World Models
  6. 2026ACE-Brain-0.5: A Unified Embodied Foundational Model for Physical Agentic AI
  7. 2025OmniEVA: Embodied Versatile Planner via Task-Adaptive 3D-Grounded and Embodiment-aware Reasoning
  8. 2025ManiTaskGen: A Comprehensive Task Generator for Benchmarking and Improving Vision-Language Agents on Embodied Decision-Making