Toward Open-ended Embodied Tasks Solving
Not on the map. Why?
Abstract (arXiv)
Empowering embodied agents, such as robots, with Artificial Intelligence (AI) has become increasingly important in recent years. A major challenge is task open-endedness. In practice, robots often need to perform tasks with novel goals that are multifaceted, dynamic, lack a definitive "end-state", and were not encountered during training. To tackle this problem, this paper introduces textitDiffusion for Open-ended Goals (DOG), a novel framework designed to enable embodied AI to plan and act flexibly and dynamically for open-ended task goals. DOG synergizes the generative prowess of diffusion models with state-of-the-art, training-free guidance techniques to adaptively perform online planning and control. Our evaluations demonstrate that DOG can handle various kinds of novel task goals not seen during training, in both maze navigation and robot control problems. Our work sheds light on enhancing embodied AI's adaptability and competency in tackling open-ended goals.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 48 of its 59 references that are in the map. First posted on arXiv 10 Dec 2023.
Builds on
48 of 59 references.
References · 48
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2023Segment Anythingcited by 8,234
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
36 more
- 2020Conservative Q-Learning for Offline Reinforcement Learningcited by 1,809
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
- 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,546
- 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,434
- 2020D4RL: Datasets for Deep Data-Driven Reinforcement Learningcited by 1,427
- 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,416
- 2021Offline Reinforcement Learning with Implicit Q-Learningcited by 1,293
- 2022Planning with Diffusion for Flexible Behavior Synthesiscited by 1,061
- 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 750
- 2017Learning Complex Dexterous Manipulation with Deep Reinforcement Learning and Demonstrationscited by 715
- 2021Offline Reinforcement Learning as One Big Sequence Modeling Problemcited by 644
- 2020MOPO: Model-based Offline Policy Optimizationcited by 636
- 2020MOReL : Model-Based Offline Reinforcement Learningcited by 590
- 2023Learning Universal Policies via Text-Guided Video Generationcited by 522
- 2022Is Conditional Generative Modeling all you need for Decision-Making?cited by 516
- 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledgecited by 478
- 2021MetaICL: Learning to Learn In Contextcited by 454
- 2019Learning Latent Plans from Playcited by 316
- 2019Dynamics-Aware Unsupervised Discovery of Skillscited by 313
- 2023Language to Rewards for Robotic Skill Synthesiscited by 312
- 2023FreeDoM: Training-Free Energy-Guided Conditional Diffusion Modelcited by 294
- 2023Imitating Human Behaviour with Diffusion Modelscited by 263
- 2021Open-Ended Learning Leads to Generally Capable Agentscited by 182
- 2021Embodied Intelligence via Learning and Evolutioncited by 163
- 2022Goal-Conditioned Reinforcement Learning: Problems and Solutionscited by 158
- 2023AdaptDiffuser: Diffusion Models as Adaptive Self-evolving Plannerscited by 149
- 2023Human-Timescale Adaptation in an Open-Ended Task Spacecited by 138
- 2021Discovering and Achieving Goals via World Modelscited by 131
- 2020Model-Based Offline Planningcited by 129
- 2022Latent Plans for Task-Agnostic Offline Reinforcement Learningcited by 81
- 2022How Far I'll Go: Offline Goal-Conditioned Reinforcement Learning via f-Advantage Regressioncited by 66
- 2019PIPPS: Flexible Model-Based Policy Search Robust to the Curse of Chaoscited by 56
- 2022Predictive Sampling: Real-time Behaviour Synthesis with MuJoCocited by 47
- 2023Diffusion Model-Augmented Behavioral Cloningcited by 38
- 2022Chain of Thought Imitation with Procedure Cloningcited by 30
- 2020PlaNet of the Bayesians: Reconsidering and Improving Deep Planning Network by Incorporating Bayesian Inferencecited by 23
Built on by
Citing papers per year: 2024: 2; 2025: 1.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026ETA: A New Agentic Paradigm for Embodied Tasks
- 2023Planning as In-Painting: A Diffusion-Based Embodied Task Planning Framework for Environments under Uncertainty
- 2026ABot-Claw: A Foundation for Persistent, Cooperative, and Self-Evolving Robotic Agents
- 2024Embodied Instruction Following in Unknown Environments
- 2025A Survey: Learning Embodied Intelligence from Physical Simulators and World Models
- 2026ACE-Brain-0.5: A Unified Embodied Foundational Model for Physical Agentic AI
- 2025OmniEVA: Embodied Versatile Planner via Task-Adaptive 3D-Grounded and Embodiment-aware Reasoning
- 2025ManiTaskGen: A Comprehensive Task Generator for Benchmarking and Improving Vision-Language Agents on Embodied Decision-Making