One-Shot Visual Imitation Learning via Meta-Learning
Not on the map. Why?
Cited by 113 in Offline RL and imitation learning from data, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
In order for a robot to be a generalist that can perform a wide range of jobs, it must be able to acquire a wide variety of skills quickly and efficiently in complex unstructured environments. High-capacity models such as deep neural networks can enable a robot to represent complex skills, but learning each skill from scratch then becomes infeasible. In this work, we present a meta-imitation learning method that enables a robot to learn how to learn more efficiently, allowing it to acquire new skills from just a single demonstration. Unlike prior methods for one-shot imitation, our method can scale to raw pixel inputs and requires data from significantly fewer prior tasks for effective learning of new skills. Our experiments on both simulated and real robot platforms demonstrate the ability to learn new tasks, end-to-end, from a single visual demonstration.
Key facts. Cited by 228 papers in the map (data through 14 Oct 2026). First posted on arXiv 14 Sep 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2018: 6; 2019: 14; 2020: 10; 2021: 35; 2022: 31; 2023: 42; 2024: 50; 2025: 29; 2026: 11.
228 papers.
Sort:
By area:
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2021What Matters in Learning from Offline Human Demonstrations for Robot Manipulationcited by 725
- 2022BC-Z: Zero-Shot Task Generalization with Robotic Imitation Learningcited by 523
- 2018An Algorithmic Perspective on Imitation Learningcited by 459
- 2022VIMA: General Robot Manipulation with Multimodal Promptscited by 407
- 2024Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperationcited by 391
- 2021Transformers Can Do Bayesian Inferencecited by 360
- 2023MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrationscited by 327
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 303
- 2021Bridge Data: Boosting Generalization of Robotic Skills with Cross-Domain Datasetscited by 250
- 2021MT-Opt: Continuous Multi-Task Robotic Reinforcement Learning at Scalecited by 229
- 2023MimicPlay: Long-Horizon Imitation Learning by Watching Human Playcited by 223
38 more
- 2021How to Train Your Robot with Deep Reinforcement Learning; Lessons We've Learnedcited by 213
- 2023RH20T: A Comprehensive Robotic Dataset for Learning Diverse Skills in One-Shotcited by 183
- 2024EgoMimic: Scaling Imitation Learning via Egocentric Videocited by 175
- 2022Human-to-Robot Imitation in the Wildcited by 161
- 2024DexCap: Scalable and Portable Mocap Data Collection System for Dexterous Manipulationcited by 160
- 2024Gen2Act: Human Video Generation in Novel Scenarios enables Generalizable Robot Manipulationcited by 153
- 2022Prompting Decision Transformer for Few-Shot Policy Generalizationcited by 146
- 2018Reinforcement and Imitation Learning for Diverse Visuomotor Skillscited by 126
- 2024Track2Act: Predicting Point Tracks from Internet Videos enables Generalizable Robot Manipulationcited by 124
- 2021Learning Language-Conditioned Robot Behavior from Offline Data and Crowd-Sourced Annotationcited by 118
- 2024DexMimicGen: Automated Data Generation for Bimanual Dexterous Manipulation via Imitation Learningcited by 116
- 2021ThriftyDAgger: Budget-Aware Novelty and Risk Gating for Interactive Imitation Learningcited by 108
- 2021Generalized Decision Transformer for Offline Hindsight Information Matchingcited by 106
- 2023Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysiscited by 103
- 2022Instruction-driven history-aware policies for robotic manipulationscited by 94
- 2019Recent Advances in Imitation Learning from Observationcited by 93
- 2020Offline Meta-Reinforcement Learning with Advantage Weightingcited by 93
- 2021Coarse-to-Fine Imitation Learning: Robot Manipulation from a Single Demonstrationcited by 93
- 2024Vision Language Models are In-Context Value Learnerscited by 90
- 2022DexVIP: Learning Dexterous Grasping with Human Hand Pose Priors from Videocited by 89
- 2022You Only Demonstrate Once: Category-Level Manipulation from Single Visual Demonstrationcited by 81
- 2023XSkill: Cross Embodiment Skill Discoverycited by 75
- 2024EquiBot: SIM(3)-Equivariant Diffusion Policy for Generalizable and Data Efficient Learningcited by 75
- 2024Exploring the Adversarial Vulnerabilities of Vision-Language-Action Models in Roboticscited by 73
- 20243D-ViTac: Learning Fine-Grained Manipulation with Visuo-Tactile Sensingcited by 72
- 2022CACTI: A Framework for Scalable Multi-Task Multi-Scene Visual Imitation Learningcited by 71
- 2023SkillDiffuser: Interpretable Hierarchical Planning via Skill Abstractions in Diffusion-Based Task Executioncited by 70
- 2024In-Context Imitation Learning via Next-Token Predictioncited by 70
- 2023Imitating Task and Motion Planning with Visuomotor Transformerscited by 66
- 2023Advances and Challenges in Meta-Learning: A Technical Reviewcited by 65
- 2023Behavior Retrieval: Few-Shot Imitation Learning by Querying Unlabeled Datasetscited by 58
- 2024RAM: Retrieval-Based Affordance Transfer for Generalizable Zero-Shot Robotic Manipulationcited by 58
- 2024Robot See Robot Do: Imitating Articulated Object Manipulation with Monocular 4D Reconstructioncited by 54
- 2023Towards Generalizable Zero-Shot Manipulation via Translating Human Interaction Planscited by 52
- 2024SkillMimicGen: Automated Demonstration Generation for Efficient Skill Learning and Deploymentcited by 52
- 2023Zero-Shot Robot Manipulation from Passive Human Videoscited by 51
- 2019Meta-Inverse Reinforcement Learning with Probabilistic Context Variablescited by 50
- 2020Deep Imitation Learning for Bimanual Robotic Manipulationcited by 50
50 most cited of 228 All 228 (JSON)
- 2026In-Context Learning for Robots: Methods and Applications28 Sep 2026
- 2026POIL: Point-based One-Shot Imitation Learning with Stable Dynamical Systems24 Sep 2026
- 2026Improving Imitation Learning Efficiency for Manipulation through Geometric Prior Pretraining11 Sep 2026
- 2026VLA-Corrector: Stage-Aware Observable State Understanding for Prompt-Based Closed-Loop Recovery of Vision-Language-Action Policies6 Sep 2026
- 2026Adaptation of Generalist Robot Policies with Minimal Data11 Aug 2026
- 2026Generalize and Guide: Decomposing Rewards for Few-Shot Inverse Reinforcement Learning20 Jul 2026
- 2026When Dynamics Shift, Robust Task Inference Wins: Offline Imitation Learning with Behavior Foundation Models Revisited16 May 2026
- 2026NS-VLA: Towards Neuro-Symbolic Vision-Language-Action Models10 Mar 2026
- 2026A Generalized Apprenticeship Learning Framework for Capturing Evolving Student Pedagogical Strategies24 Feb 2026
- 2026Meta-Learning and Meta-Reinforcement Learning -- Tracing the Path towards DeepMind's Adaptive Agent23 Feb 2026
- 2026A Systematic Study of Data Modalities and Strategies for Co-training Large Behavior Models for Robot Manipulation1 Feb 2026
- 2025Posterior Behavioral Cloning: Pretraining BC Policies for Efficient RL Finetuning18 Dec 2025
38 more
- 2025ManiLong-Shot: Interaction-Aware One-Shot Imitation Learning for Long-Horizon Manipulation18 Dec 2025
- 2025Context Representation via Action-Free Transformer encoder-decoder for Meta Reinforcement Learning16 Dec 2025
- 2025See Once, Then Act: Vision-Language-Action Model with Task Learning from One-Shot Video Demonstrations8 Dec 2025
- 2025Mechanistic Finetuning of Vision-Language-Action Models via Few-Shot Demonstrations27 Nov 2025
- 2025TraceGen: World Modeling in 3D Trace Space Enables Learning from Cross-Embodiment Videos26 Nov 2025
- 2025From Power to Precision: Learning Fine-grained Dexterity for Multi-fingered Robotic Hands17 Nov 2025
- 2025Balance Equation-based Distributionally Robust Offline Imitation Learning11 Nov 2025
- 2025Cross-Platform Learnable Fuzzy Gain-Scheduled Proportional-Integral-Derivative Controller Tuning via Physics-Constrained Meta-Learning and Reinforcement Learning Adaptation9 Nov 2025
- 2025Blindfolded Experts Generalize Better: Insights from Robotic Manipulation and Videogames28 Oct 2025
- 2025Consistent Zero-Shot Imitation with Contrastive Goal Inference20 Oct 2025
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Model11 Oct 2025
- 2025Long-Horizon Visual Imitation Learning via Plan and Code Reflection4 Sep 2025
- 2025MimicFunc: Imitating Tool Manipulation from a Single Human Video via Functional Correspondence19 Aug 2025
- 2025Safety-Aware Imitation Learning via MPC-Guided Disturbance Injection5 Aug 2025
- 2025Touch in the Wild: Learning Fine-Grained Manipulation with a Portable Visuo-Tactile Gripper20 Jul 2025
- 2025Behavioral Exploration: Learning to Explore via In-Context Adaptation11 Jul 2025
- 2025Robotic Manipulation by Imitating Generated Videos Without Physical Demonstrations1 Jul 2025
- 2025A Survey on Imitation Learning for Contact-Rich Tasks in Robotics16 Jun 2025
- 2025Revealing the Challenges of Sim-to-Real Transfer in Model-Based Reinforcement Learning via Latent Space Modeling15 Jun 2025
- 2025Robot-Gated Interactive Imitation Learning with Adaptive Intervention Mechanism10 Jun 2025
- 2025Few-Shot Vision-Language Action-Incremental Policy Learning22 Apr 2025
- 2025Sim-and-Real Co-Training: A Simple Recipe for Vision-Based Robotic Manipulation31 Mar 2025
- 2025Learning Predictive Visuomotor Coordination30 Mar 2025
- 2025Efficient Continual Adaptation of Pretrained Robotic Policy with Online Meta-Learned Adapters24 Mar 2025
- 2025One-Shot Dual-Arm Imitation Learning10 Mar 2025
- 2025Look Before You Leap: Using Serialized State Machine for Language Conditioned Robotic Manipulation7 Mar 2025
- 2025FUNCTO: Function-Centric One-Shot Imitation Learning for Tool Manipulation17 Feb 2025
- 2025Force-Based Robotic Imitation Learning: A Two-Phase Approach for Construction Assembly Tasks24 Jan 2025
- 2024Imitation Learning from Suboptimal Demonstrations via Meta-Learning An Action Ranker28 Dec 2024
- 2024Memory-Reduced Meta-Learning with Guaranteed Convergence16 Dec 2024
- 2024Visual IRL for Human-Like Robotic Manipulation16 Dec 2024
- 2024AdaptAgent: Adapting Multimodal Web Agents with Few-Shot Learning from Human Demonstrations20 Nov 2024
- 2024Exploring the Adversarial Vulnerabilities of Vision-Language-Action Models in Robotics18 Nov 2024
- 2024Few-Shot Task Learning through Inverse Generative Modeling7 Nov 2024
- 2024Vision Language Models are In-Context Value Learners7 Nov 2024
- 2024RT-Affordance: Affordances are Versatile Intermediate Representations for Robot Manipulation5 Nov 2024
- 2024EgoMimic: Scaling Imitation Learning via Egocentric Video31 Oct 2024
- 2024DexMimicGen: Automated Data Generation for Bimanual Dexterous Manipulation via Imitation Learning31 Oct 2024
50 newest of 228 All 228 (JSON)
- 2021What Matters in Learning from Offline Human Demonstrations for Robot Manipulationcited by 725
- 2018An Algorithmic Perspective on Imitation Learningcited by 459
- 2024Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperationcited by 391
- 2023MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrationscited by 327
- 2023MimicPlay: Long-Horizon Imitation Learning by Watching Human Playcited by 223
- 2024EgoMimic: Scaling Imitation Learning via Egocentric Videocited by 175
- 2024DexCap: Scalable and Portable Mocap Data Collection System for Dexterous Manipulationcited by 160
- 2022Prompting Decision Transformer for Few-Shot Policy Generalizationcited by 146
- 2018Reinforcement and Imitation Learning for Diverse Visuomotor Skillscited by 126
- 2024DexMimicGen: Automated Data Generation for Bimanual Dexterous Manipulation via Imitation Learningcited by 116
- 2021ThriftyDAgger: Budget-Aware Novelty and Risk Gating for Interactive Imitation Learningcited by 108
- 2021Generalized Decision Transformer for Offline Hindsight Information Matchingcited by 106
12 most cited of 108 All 108 (JSON)
- 2026POIL: Point-based One-Shot Imitation Learning with Stable Dynamical Systems24 Sep 2026
- 2026Improving Imitation Learning Efficiency for Manipulation through Geometric Prior Pretraining11 Sep 2026
- 2026Generalize and Guide: Decomposing Rewards for Few-Shot Inverse Reinforcement Learning20 Jul 2026
- 2026When Dynamics Shift, Robust Task Inference Wins: Offline Imitation Learning with Behavior Foundation Models Revisited16 May 2026
- 2025Posterior Behavioral Cloning: Pretraining BC Policies for Efficient RL Finetuning18 Dec 2025
- 2025ManiLong-Shot: Interaction-Aware One-Shot Imitation Learning for Long-Horizon Manipulation18 Dec 2025
- 2025Balance Equation-based Distributionally Robust Offline Imitation Learning11 Nov 2025
- 2025Blindfolded Experts Generalize Better: Insights from Robotic Manipulation and Videogames28 Oct 2025
- 2025Consistent Zero-Shot Imitation with Contrastive Goal Inference20 Oct 2025
- 2025Long-Horizon Visual Imitation Learning via Plan and Code Reflection4 Sep 2025
- 2025Safety-Aware Imitation Learning via MPC-Guided Disturbance Injection5 Aug 2025
- 2025A Survey on Imitation Learning for Contact-Rich Tasks in Robotics16 Jun 2025
12 newest of 108 All 108 (JSON)
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 303
- 2024Exploring the Adversarial Vulnerabilities of Vision-Language-Action Models in Roboticscited by 73
- 2026A Systematic Study of Data Modalities and Strategies for Co-training Large Behavior Models for Robot Manipulationcited by 22
- 2025See Once, Then Act: Vision-Language-Action Model with Task Learning from One-Shot Video Demonstrationscited by 6
- 2025Few-Shot Vision-Language Action-Incremental Policy Learningcited by 3
- 2026NS-VLA: Towards Neuro-Symbolic Vision-Language-Action Modelscited by 2
- 2026Adaptation of Generalist Robot Policies with Minimal Datacited by 1
- 2026VLA-Corrector: Stage-Aware Observable State Understanding for Prompt-Based Closed-Loop Recovery of Vision-Language-Action Policiescited by 0
- 2026VLA-Corrector: Stage-Aware Observable State Understanding for Prompt-Based Closed-Loop Recovery of Vision-Language-Action Policies6 Sep 2026
- 2026Adaptation of Generalist Robot Policies with Minimal Data11 Aug 2026
- 2026NS-VLA: Towards Neuro-Symbolic Vision-Language-Action Models10 Mar 2026
- 2026A Systematic Study of Data Modalities and Strategies for Co-training Large Behavior Models for Robot Manipulation1 Feb 2026
- 2025See Once, Then Act: Vision-Language-Action Model with Task Learning from One-Shot Video Demonstrations8 Dec 2025
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Model11 Oct 2025
- 2025Few-Shot Vision-Language Action-Incremental Policy Learning22 Apr 2025
- 2024Exploring the Adversarial Vulnerabilities of Vision-Language-Action Models in Robotics18 Nov 2024
- 2024Track2Act: Predicting Point Tracks from Internet Videos enables Generalizable Robot Manipulationcited by 124
- 2026A Generalized Apprenticeship Learning Framework for Capturing Evolving Student Pedagogical Strategiescited by 2
- 2025Revealing the Challenges of Sim-to-Real Transfer in Model-Based Reinforcement Learning via Latent Space Modelingcited by 1
- 2025Cross-Platform Learnable Fuzzy Gain-Scheduled Proportional-Integral-Derivative Controller Tuning via Physics-Constrained Meta-Learning and Reinforcement Learning Adaptationcited by 0
- 2025Context Representation via Action-Free Transformer encoder-decoder for Meta Reinforcement Learningcited by 0
- 2026Meta-Learning and Meta-Reinforcement Learning -- Tracing the Path towards DeepMind's Adaptive Agentcited by 0
- 2026A Generalized Apprenticeship Learning Framework for Capturing Evolving Student Pedagogical Strategies24 Feb 2026
- 2026Meta-Learning and Meta-Reinforcement Learning -- Tracing the Path towards DeepMind's Adaptive Agent23 Feb 2026
- 2025Context Representation via Action-Free Transformer encoder-decoder for Meta Reinforcement Learning16 Dec 2025
- 2025Cross-Platform Learnable Fuzzy Gain-Scheduled Proportional-Integral-Derivative Controller Tuning via Physics-Constrained Meta-Learning and Reinforcement Learning Adaptation9 Nov 2025
- 2025Revealing the Challenges of Sim-to-Real Transfer in Model-Based Reinforcement Learning via Latent Space Modeling15 Jun 2025
- 2024Track2Act: Predicting Point Tracks from Internet Videos enables Generalizable Robot Manipulation2 May 2024
- 2024EquiBot: SIM(3)-Equivariant Diffusion Policy for Generalizable and Data Efficient Learningcited by 75
- 2023SkillDiffuser: Interpretable Hierarchical Planning via Skill Abstractions in Diffusion-Based Task Executioncited by 70
- 2024Don't Start from Scratch: Behavioral Refinement via Interpolant-based Policy Diffusioncited by 21
- 2023C3DM: Constrained-Context Conditional Diffusion Models for Imitation Learningcited by 8
- 2023R2-Diff: Denoising by diffusion as a refinement of retrieved motion for image-based motion predictioncited by 3
- 2024EquiBot: SIM(3)-Equivariant Diffusion Policy for Generalizable and Data Efficient Learning1 Jul 2024
- 2024Don't Start from Scratch: Behavioral Refinement via Interpolant-based Policy Diffusion25 Feb 2024
- 2023SkillDiffuser: Interpretable Hierarchical Planning via Skill Abstractions in Diffusion-Based Task Execution18 Dec 2023
- 2023C3DM: Constrained-Context Conditional Diffusion Models for Imitation Learning2 Nov 2023
- 2023R2-Diff: Denoising by diffusion as a refinement of retrieved motion for image-based motion prediction15 Jun 2023
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024Vision Language Models are In-Context Value Learnerscited by 90
- 2024AdaptAgent: Adapting Multimodal Web Agents with Few-Shot Learning from Human Demonstrationscited by 19
- 2025Mechanistic Finetuning of Vision-Language-Action Models via Few-Shot Demonstrationscited by 15
- 2025Mechanistic Finetuning of Vision-Language-Action Models via Few-Shot Demonstrations27 Nov 2025
- 2024AdaptAgent: Adapting Multimodal Web Agents with Few-Shot Learning from Human Demonstrations20 Nov 2024
- 2024Vision Language Models are In-Context Value Learners7 Nov 2024
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul 2023
- 2022VIMA: General Robot Manipulation with Multimodal Promptscited by 407
- 2021Transformers Can Do Bayesian Inferencecited by 360
- 2021Bridge Data: Boosting Generalization of Robotic Skills with Cross-Domain Datasetscited by 250
- 2021MT-Opt: Continuous Multi-Task Robotic Reinforcement Learning at Scalecited by 229
- 2021How to Train Your Robot with Deep Reinforcement Learning; Lessons We've Learnedcited by 213
- 2023RH20T: A Comprehensive Robotic Dataset for Learning Diverse Skills in One-Shotcited by 183
- 2022Human-to-Robot Imitation in the Wildcited by 161
- 2024Gen2Act: Human Video Generation in Novel Scenarios enables Generalizable Robot Manipulationcited by 153
- 2021Learning Language-Conditioned Robot Behavior from Offline Data and Crowd-Sourced Annotationcited by 118
- 2023Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysiscited by 103
- 2022Instruction-driven history-aware policies for robotic manipulationscited by 94
- 2022DexVIP: Learning Dexterous Grasping with Human Hand Pose Priors from Videocited by 89
12 most cited of 94 All 94 (JSON)
- 2026In-Context Learning for Robots: Methods and Applications28 Sep 2026
- 2025From Power to Precision: Learning Fine-grained Dexterity for Multi-fingered Robotic Hands17 Nov 2025
- 2025MimicFunc: Imitating Tool Manipulation from a Single Human Video via Functional Correspondence19 Aug 2025
- 2025Touch in the Wild: Learning Fine-Grained Manipulation with a Portable Visuo-Tactile Gripper20 Jul 2025
- 2025Behavioral Exploration: Learning to Explore via In-Context Adaptation11 Jul 2025
- 2025Robotic Manipulation by Imitating Generated Videos Without Physical Demonstrations1 Jul 2025
- 2025Sim-and-Real Co-Training: A Simple Recipe for Vision-Based Robotic Manipulation31 Mar 2025
- 2025Learning Predictive Visuomotor Coordination30 Mar 2025
- 2025Efficient Continual Adaptation of Pretrained Robotic Policy with Online Meta-Learned Adapters24 Mar 2025
- 2025Force-Based Robotic Imitation Learning: A Two-Phase Approach for Construction Assembly Tasks24 Jan 2025
- 2024Memory-Reduced Meta-Learning with Guaranteed Convergence16 Dec 2024
- 2024Visual IRL for Human-Like Robotic Manipulation16 Dec 2024
12 newest of 94 All 94 (JSON)