Adversarial Imitation Learning with Trajectorial Augmentation and Correction
On the map: Offline RL and imitation learning from data → Imitation learning methods
Abstract (arXiv)
Deep Imitation Learning requires a large number of expert demonstrations, which are not always easy to obtain, especially for complex tasks. A way to overcome this shortage of labels is through data augmentation. However, this cannot be easily applied to control tasks due to the sequential nature of the problem. In this work, we introduce a novel augmentation method which preserves the success of the augmented trajectories. To achieve this, we introduce a semi-supervised correction network that aims to correct distorted expert actions. To adequately test the abilities of the correction network, we develop an adversarial data augmented imitation architecture to train an imitation agent using synthetic experts. Additionally, we introduce a metric to measure diversity in trajectory datasets. Experiments show that our data augmentation strategy can improve accuracy and convergence time of adversarial imitation while preserving the diversity between the generated and real trajectories.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in Imitation learning methods, one of 13 directions in Offline RL and imitation learning from data. Builds on 30 of its 45 references that are in the map. First posted on arXiv 25 Mar 2021.
Builds on
30 of 45 references.
Closest ancestors · 1
Same direction, newest first
Other references · 29
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2015Continuous control with deep reinforcement learningcited by 3,279
- 2015Trust Region Policy Optimizationcited by 2,503
- 2016OpenAI Gymcited by 1,684
- 2016Understanding deep learning requires rethinking generalizationcited by 1,657
- 2016Generative Adversarial Imitation Learningcited by 1,576
- 2017Random Erasing Data Augmentationcited by 1,235
- 2016End to End Learning for Self-Driving Carscited by 1,000
- 2017Learning Complex Dexterous Manipulation with Deep Reinforcement Learning and Demonstrationscited by 685
- 2017Deep Mutual Learningcited by 621
- 2017Zero-Shot Learning -- The Good, the Bad and the Uglycited by 254
- 2017One-Shot Imitation Learningcited by 232
17 more
- 2017One-Shot Visual Imitation Learning via Meta-Learningcited by 225
- 2018Low-Shot Learning from Imaginary Datacited by 181
- 2015Learning Continuous Control Policies by Stochastic Value Gradientscited by 156
- 2017Learning From Noisy Large-Scale Datasets With Minimal Supervisioncited by 115
- 2018GAN Augmentation: Augmenting Training Data using Generative Adversarial Networkscited by 107
- 2017Vision-Based Multi-Task Manipulation for Inexpensive Robots Using End-To-End Learning from Demonstrationcited by 100
- 2017Robust Imitation of Diverse Behaviorscited by 85
- 2017DeLiGAN : Generative Adversarial Networks for Diverse and Limited Datacited by 77
- 2019Small Data Challenges in Big Data Era: A Survey of Recent Progress on Unsupervised and Semi-Supervised Methodscited by 62
- 2019Data Augmentation Using GANscited by 58
- 2017Zero-Shot Deep Domain Adaptationcited by 35
- 2018Adversarial Teacher-Student Learning for Unsupervised Domain Adaptationcited by 27
- 2019AC-Teach: A Bayesian Actor-Critic Method for Policy Learning with an Ensemble of Suboptimal Teacherscited by 27
- 2018Task-Oriented Hand Motion Retargeting for Dexterous Manipulation Imitationcited by 25
- 2019Conditional Vehicle Trajectories Prediction in CARLA Urban Environmentcited by 6
- 2018Imitation Learning for End to End Vehicle Longitudinal Control with Forward Cameracited by 5
- 2017Exact Mean Computation in Dynamic Time Warping Spacescited by 4
Built on by
Citing papers per year: 2021: 1; 2022: 3; 2023: 2; 2024: 1; 2025: 1; 2026: 3.
11 papers.
- 2025Dexterous Manipulation through Imitation Learning: A Surveycited by 18
- 2021Demonstration-Efficient Guided Policy Search via Imitation of Robust Tube MPCcited by 10
- 2023Offline Imitation Learning with Variational Counterfactual Reasoningcited by 7
- 2024Fusion Dynamical Systems with Machine Learning in Imitation Learning: A Comprehensive Overviewcited by 3
- 2022Modular Adaptive Policy Selection for Multi-Task Imitation Learning through Task Divisioncited by 2
- 2022Output Feedback Tube MPC-Guided Data Augmentation for Robust, Efficient Sensorimotor Policy Learningcited by 2
- 2022Evaluating the Effectiveness of Corrective Demonstrations and a Low-Cost Sensor for Dexterous Manipulationcited by 0
- 2023Simple Noisy Environment Augmentation for Reinforcement Learningcited by 0
- 2026PhysHanDI: Physics-Based Reconstruction of Hand-Deformable Object Interactionscited by 0
- 2026Dynamic Full-body Motion Agent with Object Interaction via Blending Pre-trained Modular Controllerscited by 0
- 2026A Systematic Approach for Selecting Trajectories for Data Augmentationcited by 0
- 2026A Systematic Approach for Selecting Trajectories for Data Augmentation9 Jun 2026
- 2026Dynamic Full-body Motion Agent with Object Interaction via Blending Pre-trained Modular Controllers12 May 2026
- 2026PhysHanDI: Physics-Based Reconstruction of Hand-Deformable Object Interactions10 May 2026
- 2025Dexterous Manipulation through Imitation Learning: A Survey4 Apr 2025
- 2024Fusion Dynamical Systems with Machine Learning in Imitation Learning: A Comprehensive Overview29 Mar 2024
- 2023Offline Imitation Learning with Variational Counterfactual Reasoning7 Oct 2023
- 2023Simple Noisy Environment Augmentation for Reinforcement Learning4 May 2023
- 2022Output Feedback Tube MPC-Guided Data Augmentation for Robust, Efficient Sensorimotor Policy Learning18 Oct 2022
- 2022Evaluating the Effectiveness of Corrective Demonstrations and a Low-Cost Sensor for Dexterous Manipulation15 Apr 2022
- 2022Modular Adaptive Policy Selection for Multi-Task Imitation Learning through Task Division28 Mar 2022
- 2021Demonstration-Efficient Guided Policy Search via Imitation of Robust Tube MPC21 Sep 2021
Similar, not cited
Close in wording, no citation either way
- 2023Unlabeled Imperfect Demonstrations in Adversarial Imitation Learning
- 2023Sample-efficient Adversarial Imitation Learning
- 2021A Pragmatic Look at Deep Imitation Learning
- 2019Sample-efficient Adversarial Imitation Learning from Observation
- 2022Latent Policies for Adversarial Imitation Learning
- 2023Improving Generalization in Game Agents with Data Augmentation in Imitation Learning
- 2018Sample-Efficient Imitation Learning via Generative Adversarial Nets
- 2026Latent Wasserstein Adversarial Imitation Learning