mlsanityData to 14 Oct 2026

Variable-Speed Teaching-Playback as Real-World Data Augmentation for Imitation Learning

arXiv 2412.03252 ↗First posted 4 Dec 2024cs.RO cs.LGcited by 2

On the map: Offline RL and imitation learning from data → Robot manipulation imitation learning

Abstract (arXiv)

Because imitation learning relies on human demonstrations in hard-to-simulate settings, the inclusion of force control in this method has resulted in a shortage of training data, even with a simple change in speed. Although the field of data augmentation has addressed the lack of data, conventional methods of data augmentation for robot manipulation are limited to simulation-based methods or downsampling for position control. This paper proposes a novel method of data augmentation that is applicable to force control and preserves the advantages of real-world datasets. We applied teaching-playback at variable speeds as real-world data augmentation to increase both the quantity and quality of environmental reactions at variable speeds. An experiment was conducted on bilateral control-based imitation learning using a method of imitation learning equipped with position-force control. We evaluated the effect of real-world data augmentation on two tasks, pick-and-place and wiping, at variable speeds, each from two human demonstrations at fixed speed. The results showed a maximum 55% increase in success rate from a simple change in speed of real-world reactions and improved accuracy along the duration/frequency command by gathering environmental reactions at variable speeds.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Robot manipulation imitation learning, one of 13 directions in Offline RL and imitation learning from data. Builds on 16 of its 36 references that are in the map. First posted on arXiv 4 Dec 2024.

Builds on

16 of 36 references.

Closest ancestors · 8

Same direction, newest first

  1. 2024DABI: Evaluation of Data Augmentation Methods Using Downsampling in Bilateral Control-Based Imitation Learning with Images6 Oct
  2. 2024Bi-ACT: Bilateral Control-Based Imitation Learning via Action Chunking with Transformer31 Jan
  3. 2024ILBiT: Imitation Learning for Robot Using Position and Torque Information based on Bilateral Control with Transformer30 Jan
  4. 2023Soft and Rigid Object Grasping With Cross-Structure Hand Using Bilateral Control-Based Imitation Learning16 Nov
  5. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardware23 Apr
  6. 2022Imitation Learning for Nonprehensile Manipulation through Self-Supervised Learning Considering Motion Speed21 Jun
  7. 2021A New Autoregressive Neural Network Model with Command Compensation for Imitation Learning Based on Bilateral Control16 Mar
  8. 2021Imitation Learning for Variable Speed Contact Motion for Operation up to Control Bandwidth20 Feb

Other references · 8

  1. 2018An Algorithmic Perspective on Imitation Learningcited by 459
  2. 2016Learning Hand-Eye Coordination for Robotic Grasping with Deep Learning and Large-Scale Data Collectioncited by 316
  3. 2017Deep Imitation Learning for Complex Manipulation Tasks from Virtual Reality Teleoperationcited by 289
  4. 2023Scaling Robot Learning with Semantically Imagined Experiencecited by 177
  5. 2021GAN-Based Data Augmentation and Anonymization for Skin-Lesion Analysis: A Critical Reviewcited by 25
  6. 2018Imitation Learning for Object Manipulation Based on Position/Force Information Using Bilateral Controlcited by 21
  7. 2022Data Augmentation for Manipulationcited by 16
  8. 2023Real-time Motion Generation and Data Augmentation for Grasping Moving Objects with Dynamic Speed and Position Changescited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026MinInter: Minimizing Trajectory Interpolation During Data Augmentation for Imitation Learning
  2. 2024VITAL: Interactive Few-Shot Imitation Learning via Visual Human-in-the-Loop Corrections
  3. 2025How to Train Your Robots? The Impact of Demonstration Modality on Imitation Learning
  4. 2021Imitation learning for variable speed motion generation over multiple actions
  5. 2024Data Scaling Laws in Imitation Learning for Robotic Manipulation
  6. 2022Learning and Retrieval from Prior Data for Skill-based Imitation Learning
  7. 2020Visual Imitation Made Easy
  8. 2024RoCoDA: Counterfactual Data Augmentation for Data-Efficient Robot Learning from Demonstrations