Towards Robust One-shot Task Execution using Knowledge Graph Embeddings
Not on the map. Why?
Abstract (arXiv)
Requiring multiple demonstrations of a task plan presents a burden to end-users of robots. However, robustly executing tasks plans from a single end-user demonstration is an ongoing challenge in robotics. We address the problem of one-shot task execution, in which a robot must generalize a single demonstration or prototypical example of a task plan to a new execution environment. Our approach integrates task plans with domain knowledge to infer task plan constituents for new execution environments. Our experimental evaluations show that our knowledge representation makes more relevant generalizations that result in significantly higher success rates over tested baselines. We validated the approach on a physical platform, which resulted in the successful generalization of initial task plans to 38 of 50 execution environments with errors resulting from autonomous robot operation included.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 13 of its 39 references that are in the map. First posted on arXiv 10 May 2021.
Builds on
13 of 39 references.
References · 13
- 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,067
- 2018VirtualHome: Simulating Household Activities via Programscited by 415
- 2015A Review of Relational Machine Learning for Knowledge Graphscited by 265
- 2017One-Shot Imitation Learningcited by 233
- 2017Analogical Inference for Multi-Relational Embeddingscited by 69
- 2018One-Shot Hierarchical Imitation Learning of Compound Visuomotor Taskscited by 33
- 2018One-Shot Learning of Multi-Step Tasks from Observation via Activity Localization in Auxiliary Videocited by 16
- 2014RoboBrain: Large-Scale Knowledge Engine for Robotscited by 13
- 2019A Mobile Manipulation System for One-Shot Teaching of Complex Tasks in Homescited by 12
- 2019RoboCSE: Robot Common Sense Embeddingcited by 9
- 2020A Motion Taxonomy for Manipulation Embeddingcited by 9
- 2020Taking Recoveries to Task: Recovery-Driven Development for Recipe-based Robot Taskscited by 4
Built on by
Citing papers per year: 2022: 1; 2023: 4; 2024: 2; 2025: 1.
8 papers.
- 2023Getting aligned on representational alignmentcited by 143
- 2023Aligning Robot and Human Representationscited by 11
- 2023From Cooking Recipes to Robot Task Trees -- Improving Planning Correctness and Task Efficiency by Leveraging LLMs with a Knowledge Networkcited by 9
- 2024Consolidating Trees of Robotic Plans Generated Using Large Language Models to Improve Reliabilitycited by 6
- 2024Interactive Continual Learning Architecture for Long-Term Personalization of Home Service Robotscited by 6
- 2022Explainable Knowledge Graph Embedding: Inference Reconciliation for Knowledge Inferences Supporting Robot Actionscited by 5
- 2023Graph learning in robotics: a surveycited by 5
- 2025AdaptBot: Combining LLM with Knowledge Graphs and Human Input for Generic-to-Specific Task Decomposition and Knowledge Refinementcited by 3
- 2025AdaptBot: Combining LLM with Knowledge Graphs and Human Input for Generic-to-Specific Task Decomposition and Knowledge Refinement4 Feb 2025
- 2024Interactive Continual Learning Architecture for Long-Term Personalization of Home Service Robots6 Mar 2024
- 2024Consolidating Trees of Robotic Plans Generated Using Large Language Models to Improve Reliability15 Jan 2024
- 2023Getting aligned on representational alignment18 Oct 2023
- 2023Graph learning in robotics: a survey6 Oct 2023
- 2023From Cooking Recipes to Robot Task Trees -- Improving Planning Correctness and Task Efficiency by Leveraging LLMs with a Knowledge Network17 Sep 2023
- 2023Aligning Robot and Human Representations3 Feb 2023
- 2022Explainable Knowledge Graph Embedding: Inference Reconciliation for Knowledge Inferences Supporting Robot Actions4 May 2022