Multi-Modal Imitation Learning from Unstructured Demonstrations using Generative Adversarial Nets
Not on the map. Why?
Cited by 43 in Offline RL and imitation learning from data, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Imitation learning has traditionally been applied to learn a single task from demonstrations thereof. The requirement of structured and isolated demonstrations limits the scalability of imitation learning approaches as they are difficult to apply to real-world scenarios, where robots have to be able to execute a multitude of tasks. In this paper, we propose a multi-modal imitation learning framework that is able to segment and imitate skills from unlabelled and unstructured demonstrations by learning skill segmentation and imitation learning jointly. The extensive simulation results indicate that our method can efficiently separate the demonstrations into individual skills and learn to imitate them using a single multi-modal policy. The video of our experiments is available at http://sites.google.com/view/nips17intentiongan
Key facts. Cited by 64 papers in the map (data through 14 Oct 2026). First posted on arXiv 30 May 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2018: 8; 2019: 8; 2020: 3; 2021: 10; 2022: 10; 2023: 5; 2024: 8; 2025: 6; 2026: 6.
64 papers.
Sort:
By area:
- 2022Behavior Transformers: Cloning k modes with one stonecited by 304
- 20243D Diffuser Actor: Policy Diffusion with 3D Scene Representationscited by 282
- 2021MT-Opt: Continuous Multi-Task Robotic Reinforcement Learning at Scalecited by 229
- 2020Language Conditioned Imitation Learning over Unstructured Datacited by 209
- 2019Imitation Learning via Off-Policy Distribution Matchingcited by 183
- 2019Imitation Learning as f-Divergence Minimizationcited by 123
- 2019Meta-Inverse Reinforcement Learning with Probabilistic Context Variablescited by 50
- 2022Imitation Learning by Estimating Expertise of Demonstratorscited by 50
- 2021Visual Adversarial Imitation Learning using Variational Modelscited by 42
- 2021Learning Multimodal Rewards from Rankingscited by 41
- 2018Learning a Prior over Intent via Meta-Inverse Reinforcement Learningcited by 36
- 2018Sample-Efficient Imitation Learning via Generative Adversarial Netscited by 36
38 more
- 2018One-Shot Hierarchical Imitation Learning of Compound Visuomotor Taskscited by 33
- 2018Generative Adversarial Self-Imitation Learningcited by 25
- 2021MORAL: Aligning AI with Human Norms through Multi-Objective Reinforced Active Learningcited by 25
- 2022Eliciting Compatible Demonstrations for Multi-Human Imitation Learningcited by 23
- 2018Multi-task Maximum Entropy Inverse Reinforcement Learningcited by 20
- 2022An Independently Learnable Hierarchical Model for Bilateral Control-Based Imitation Learning Applicationscited by 14
- 2024STEER: Flexible Robotic Manipulation via Dense Language Groundingcited by 14
- 2021Recent Advances in Leveraging Human Guidance for Sequential Decision-Making Taskscited by 13
- 2019VILD: Variational Imitation Learning with Diverse-quality Demonstrationscited by 12
- 2018Maximum Causal Tsallis Entropy Imitation Learningcited by 10
- 2022Learning from Guided Play: Improving Exploration for Adversarial Imitation Learning with Simple Auxiliary Taskscited by 10
- 2025Learning Coordinated Bimanual Manipulation Policies using State Diffusion and Inverse Dynamics Modelscited by 9
- 2025Intention-Conditioned Flow Occupancy Modelscited by 9
- 2025VFP: Variational Flow-Matching Policy for Multi-Modal Robot Manipulationcited by 9
- 2018CompILE: Compositional Imitation Learning and Executioncited by 7
- 2019Integration of Imitation Learning using GAIL and Reinforcement Learning using Task-achievement Rewards via Probabilistic Graphical Modelcited by 7
- 2024Crowd-PrefRL: Preference-Based Reward Learning from Crowdscited by 7
- 2021Deep Adaptive Multi-Intention Inverse Reinforcement Learningcited by 6
- 2022SAFER: Data-Efficient and Safe Reinforcement Learning via Skill Acquisitioncited by 6
- 2022ASE: Large-Scale Reusable Adversarial Skill Embeddings for Physically Simulated Characterscited by 6
- 2022Diverse Imitation Learning via Self-Organizing Generative Modelscited by 5
- 2023Learning Models of Adversarial Agent Behavior under Partial Observabilitycited by 5
- 2024IDIL: Imitation Learning of Intent-Driven Expert Behaviorcited by 5
- 2019Situated GAIL: Multitask imitation using task-conditioned adversarial inverse reinforcement learningcited by 4
- 2021Learning without Knowing: Unobserved Context in Continuous Transfer Reinforcement Learningcited by 4
- 2024Diverse Policies Recovering via Pointwise Mutual Information Weighted Imitation Learningcited by 4
- 2020oIRL: Robust Adversarial Inverse Reinforcement Learning with Temporally Extended Actionscited by 3
- 2021Learning from Guided Play: A Scheduled Hierarchical Approach for Improving Exploration in Adversarial Imitation Learningcited by 3
- 2023Curriculum-Based Imitation of Versatile Skillscited by 3
- 2023Hierarchical Imitation Learning for Stochastic Environmentscited by 3
- 2020Generalization Guarantees for Imitation Learningcited by 2
- 2022Modular Adaptive Policy Selection for Multi-Task Imitation Learning through Task Divisioncited by 2
- 2024Navigation with QPHIL: Quantizing Planner for Hierarchical Implicit Q-Learningcited by 2
- 2025Hierarchical Imitation Learning of Team Behavior from Heterogeneous Demonstrationscited by 2
- 2025Offline Learning of Controllable Diverse Behaviorscited by 2
- 2026CoMI-IRL: Contrastive Multi-Intention Inverse Reinforcement Learningcited by 2
- 2026A Generalized Apprenticeship Learning Framework for Capturing Evolving Student Pedagogical Strategiescited by 2
- 2026Behavioral Mode Discovery for Fine-tuning Multimodal Generative Policiescited by 2
50 most cited of 64 All 64 (JSON)
- 2026Geometric Entropy: When Trajectory Diversity Helps and Hurts in Imitation Learning18 Jun 2026
- 2026Behavioral Mode Discovery for Fine-tuning Multimodal Generative Policies12 May 2026
- 2026Hierarchical Apprenticeship Learning from Imperfect Demonstrations with Evolving Rewards31 Mar 2026
- 2026A Generalized Apprenticeship Learning Framework for Capturing Evolving Student Pedagogical Strategies24 Feb 2026
- 2026CoMI-IRL: Contrastive Multi-Intention Inverse Reinforcement Learning7 Feb 2026
- 2026Offline Reinforcement Learning of High-Quality Behaviors Under Robust Style Alignment30 Jan 2026
- 2025VFP: Variational Flow-Matching Policy for Multi-Modal Robot Manipulation3 Aug 2025
- 2025Intention-Conditioned Flow Occupancy Models10 Jun 2025
- 2025Offline Learning of Controllable Diverse Behaviors25 Apr 2025
- 2025Learning Coordinated Bimanual Manipulation Policies using State Diffusion and Inverse Dynamics Models30 Mar 2025
- 2025Hierarchical Imitation Learning of Team Behavior from Heterogeneous Demonstrations24 Feb 2025
- 2025Composite Gaussian Processes Flows for Learning Discontinuous Multimodal Policies4 Feb 2025
38 more
- 2024Navigation with QPHIL: Quantizing Planner for Hierarchical Implicit Q-Learning12 Nov 2024
- 2024STEER: Flexible Robotic Manipulation via Dense Language Grounding5 Nov 2024
- 2024Diverse Policies Recovering via Pointwise Mutual Information Weighted Imitation Learning21 Oct 2024
- 2024Learning Strategy Representation for Imitation Learning in Multi-Agent Games28 Sep 2024
- 2024IDIL: Imitation Learning of Intent-Driven Expert Behavior25 Apr 2024
- 2024Geometric Generative Models based on Morphological Equivariant PDEs and GANs22 Mar 2024
- 20243D Diffuser Actor: Policy Diffusion with 3D Scene Representations16 Feb 2024
- 2024Crowd-PrefRL: Preference-Based Reward Learning from Crowds17 Jan 2024
- 2023Verifiable Learned Behaviors via Motion Primitive Composition: Applications to Scooping of Granular Media26 Sep 2023
- 2023Hierarchical Imitation Learning for Stochastic Environments25 Sep 2023
- 2023Learning Models of Adversarial Agent Behavior under Partial Observability19 Jun 2023
- 2023An Offline Time-aware Apprenticeship Learning Framework for Evolving Reward Functions15 May 2023
- 2023Curriculum-Based Imitation of Versatile Skills11 Apr 2023
- 2022Learning from Guided Play: Improving Exploration for Adversarial Imitation Learning with Simple Auxiliary Tasks30 Dec 2022
- 2022Dual Generator Offline Reinforcement Learning2 Nov 2022
- 2022Eliciting Compatible Demonstrations for Multi-Human Imitation Learning14 Oct 2022
- 2022Behavior Transformers: Cloning k modes with one stone22 Jun 2022
- 2022Diverse Imitation Learning via Self-Organizing Generative Models6 May 2022
- 2022ASE: Large-Scale Reusable Adversarial Skill Embeddings for Physically Simulated Characters4 May 2022
- 2022Modular Adaptive Policy Selection for Multi-Task Imitation Learning through Task Division28 Mar 2022
- 2022An Independently Learnable Hierarchical Model for Bilateral Control-Based Imitation Learning Applications16 Mar 2022
- 2022SAFER: Data-Efficient and Safe Reinforcement Learning via Skill Acquisition10 Feb 2022
- 2022Imitation Learning by Estimating Expertise of Demonstrators2 Feb 2022
- 2021MORAL: Aligning AI with Human Norms through Multi-Objective Reinforced Active Learning30 Dec 2021
- 2021Learning from Guided Play: A Scheduled Hierarchical Approach for Improving Exploration in Adversarial Imitation Learning16 Dec 2021
- 2021Sample Efficient Imitation Learning via Reward Function Trained in Advance23 Nov 2021
- 2021Learning Multimodal Rewards from Rankings27 Sep 2021
- 2021Semi-Supervised Imitation Learning with Mixed Qualities of Demonstrations for Autonomous Driving23 Sep 2021
- 2021Visual Adversarial Imitation Learning using Variational Models16 Jul 2021
- 2021Deep Adaptive Multi-Intention Inverse Reinforcement Learning14 Jul 2021
- 2021Recent Advances in Leveraging Human Guidance for Sequential Decision-Making Tasks13 Jul 2021
- 2021Learning without Knowing: Unobserved Context in Continuous Transfer Reinforcement Learning7 Jun 2021
- 2021MT-Opt: Continuous Multi-Task Robotic Reinforcement Learning at Scale16 Apr 2021
- 2020Generalization Guarantees for Imitation Learning5 Aug 2020
- 2020Language Conditioned Imitation Learning over Unstructured Data15 May 2020
- 2020oIRL: Robust Adversarial Inverse Reinforcement Learning with Temporally Extended Actions20 Feb 2020
- 2019Relational Mimic for Visual Adversarial Imitation Learning18 Dec 2019
- 2019Imitation Learning via Off-Policy Distribution Matching10 Dec 2019
50 newest of 64 All 64 (JSON)
- 2022Behavior Transformers: Cloning k modes with one stonecited by 304
- 2020Language Conditioned Imitation Learning over Unstructured Datacited by 209
- 2019Imitation Learning via Off-Policy Distribution Matchingcited by 183
- 2019Imitation Learning as f-Divergence Minimizationcited by 123
- 2019Meta-Inverse Reinforcement Learning with Probabilistic Context Variablescited by 50
- 2022Imitation Learning by Estimating Expertise of Demonstratorscited by 50
- 2021Visual Adversarial Imitation Learning using Variational Modelscited by 42
- 2018Learning a Prior over Intent via Meta-Inverse Reinforcement Learningcited by 36
- 2018Sample-Efficient Imitation Learning via Generative Adversarial Netscited by 36
- 2018One-Shot Hierarchical Imitation Learning of Compound Visuomotor Taskscited by 33
- 2018Generative Adversarial Self-Imitation Learningcited by 25
- 2022Eliciting Compatible Demonstrations for Multi-Human Imitation Learningcited by 23
12 most cited of 42 All 42 (JSON)
- 2026Geometric Entropy: When Trajectory Diversity Helps and Hurts in Imitation Learning18 Jun 2026
- 2026CoMI-IRL: Contrastive Multi-Intention Inverse Reinforcement Learning7 Feb 2026
- 2026Offline Reinforcement Learning of High-Quality Behaviors Under Robust Style Alignment30 Jan 2026
- 2025Offline Learning of Controllable Diverse Behaviors25 Apr 2025
- 2025Hierarchical Imitation Learning of Team Behavior from Heterogeneous Demonstrations24 Feb 2025
- 2024Navigation with QPHIL: Quantizing Planner for Hierarchical Implicit Q-Learning12 Nov 2024
- 2024Diverse Policies Recovering via Pointwise Mutual Information Weighted Imitation Learning21 Oct 2024
- 2024Learning Strategy Representation for Imitation Learning in Multi-Agent Games28 Sep 2024
- 2024IDIL: Imitation Learning of Intent-Driven Expert Behavior25 Apr 2024
- 2023Hierarchical Imitation Learning for Stochastic Environments25 Sep 2023
- 2022Learning from Guided Play: Improving Exploration for Adversarial Imitation Learning with Simple Auxiliary Tasks30 Dec 2022
- 2022Dual Generator Offline Reinforcement Learning2 Nov 2022
12 newest of 42 All 42 (JSON)
- 2023Curriculum-Based Imitation of Versatile Skillscited by 3
- 2023Curriculum-Based Imitation of Versatile Skills11 Apr 2023
- 2021MT-Opt: Continuous Multi-Task Robotic Reinforcement Learning at Scalecited by 229
- 2024STEER: Flexible Robotic Manipulation via Dense Language Groundingcited by 14
- 2021Recent Advances in Leveraging Human Guidance for Sequential Decision-Making Taskscited by 13
- 2025Learning Coordinated Bimanual Manipulation Policies using State Diffusion and Inverse Dynamics Modelscited by 9
- 2025Intention-Conditioned Flow Occupancy Modelscited by 9
- 2022SAFER: Data-Efficient and Safe Reinforcement Learning via Skill Acquisitioncited by 6
- 2022ASE: Large-Scale Reusable Adversarial Skill Embeddings for Physically Simulated Characterscited by 6
- 2023Learning Models of Adversarial Agent Behavior under Partial Observabilitycited by 5
- 2023An Offline Time-aware Apprenticeship Learning Framework for Evolving Reward Functionscited by 1
- 2023Verifiable Learned Behaviors via Motion Primitive Composition: Applications to Scooping of Granular Mediacited by 1
- 2024Geometric Generative Models based on Morphological Equivariant PDEs and GANscited by 1
- 2025Composite Gaussian Processes Flows for Learning Discontinuous Multimodal Policiescited by 0
12 most cited of 13 All 13 (JSON)
- 2026Hierarchical Apprenticeship Learning from Imperfect Demonstrations with Evolving Rewards31 Mar 2026
- 2025Intention-Conditioned Flow Occupancy Models10 Jun 2025
- 2025Learning Coordinated Bimanual Manipulation Policies using State Diffusion and Inverse Dynamics Models30 Mar 2025
- 2025Composite Gaussian Processes Flows for Learning Discontinuous Multimodal Policies4 Feb 2025
- 2024STEER: Flexible Robotic Manipulation via Dense Language Grounding5 Nov 2024
- 2024Geometric Generative Models based on Morphological Equivariant PDEs and GANs22 Mar 2024
- 2023Verifiable Learned Behaviors via Motion Primitive Composition: Applications to Scooping of Granular Media26 Sep 2023
- 2023Learning Models of Adversarial Agent Behavior under Partial Observability19 Jun 2023
- 2023An Offline Time-aware Apprenticeship Learning Framework for Evolving Reward Functions15 May 2023
- 2022ASE: Large-Scale Reusable Adversarial Skill Embeddings for Physically Simulated Characters4 May 2022
- 2022SAFER: Data-Efficient and Safe Reinforcement Learning via Skill Acquisition10 Feb 2022
- 2021Recent Advances in Leveraging Human Guidance for Sequential Decision-Making Tasks13 Jul 2021
12 newest of 13 All 13 (JSON)