One ACT Play: Single Demonstration Behavior Cloning with Action Chunking Transformers
On the map: Offline RL and imitation learning from data → Imitation learning methods
Abstract (arXiv)
Learning from human demonstrations (behavior cloning) is a cornerstone of robot learning. However, most behavior cloning algorithms require a large number of demonstrations to learn a task, especially for general tasks that have a large variety of initial conditions. Humans, however, can learn to complete tasks, even complex ones, after only seeing one or two demonstrations. Our work seeks to emulate this ability, using behavior cloning to learn a task given only a single human demonstration. We achieve this goal by using linear transforms to augment the single demonstration, generating a set of trajectories for a wide range of initial conditions. With these demonstrations, we are able to train a behavior cloning agent to successfully complete three block manipulation tasks. Additionally, we developed a novel addition to the temporal ensembling method used by action chunking agents during inference. By incorporating the standard deviation of the action predictions into the ensembling method, our approach is more robust to unforeseen changes in the environment, resulting in significant performance improvements.
Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). Placed in Imitation learning methods, one of 13 directions in Offline RL and imitation learning from data. Builds on 19 of its 38 references that are in the map. First posted on arXiv 18 Sep 2023.
Builds on
19 of 38 references.
Closest ancestors · 2
Same direction, newest first
- 2021On the Sample Complexity of Stability Constrained Imitation Learning18 Feb
- 2018Behavioral Cloning from Observation4 May
Other references · 17
- 2017Attention Is All You Needcited by 60,361
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
- 2016End to End Learning for Self-Driving Carscited by 1,009
- 2021What Matters in Learning from Offline Human Demonstrations for Robot Manipulationcited by 725
- 2017Overcoming Exploration in Reinforcement Learning with Demonstrationscited by 340
- 2022Behavior Transformers: Cloning k modes with one stonecited by 304
- 2017Deep Imitation Learning for Complex Manipulation Tasks from Virtual Reality Teleoperationcited by 289
- 2017Reverse Curriculum Generation for Reinforcement Learningcited by 198
- 2023RoboAgent: Generalization and Efficiency in Robot Manipulation via Semantic Augmentations and Action Chunkingcited by 169
- 2018Learning Montezuma's Revenge from a Single Demonstrationcited by 80
- 2023Diffusion Model-Augmented Behavioral Cloningcited by 38
5 more
- 2022Back to the Manifold: Recovering from Out-of-Distribution Statescited by 20
- 2023OpenVR: Teleoperation for Manipulationcited by 8
- 2022Minimizing Human Assistance: Augmenting a Single Demonstration for Deep Reinforcement Learningcited by 5
- 2023RoboChop: Autonomous Framework for Fruit and Vegetable Chopping Leveraging Foundational Modelscited by 5
- 2019Creativity in Robot Manipulation with Deep Reinforcement Learningcited by 3
Built on by
Citing papers per year: 2024: 7; 2025: 5; 2026: 5.
17 papers.
Sort:
By area:
- 2025Real-Time Execution of Action Chunking Flow Policiescited by 216
- 2025Reinforcement Learning with Action Chunkingcited by 107
- 2024Bidirectional Decoding: Improving Action Chunking via Guided Test-Time Samplingcited by 52
- 2024Bi-ACT: Bilateral Control-Based Imitation Learning via Action Chunking with Transformercited by 27
- 2024VITaL Pretraining: Visuo-Tactile Pretraining for Tactile and Non-Tactile Manipulation Policiescited by 15
- 2024SculptDiff: Learning Robotic Clay Sculpting from Humans with Goal Conditioned Diffusion Policycited by 7
- 2025RT-Cache: Training-Free Retrieval for Real-Time Manipulationcited by 6
- 2026StreamingVLA: Streaming Vision-Language-Action Model with Action Flow Matching and Adaptive Early Observationcited by 6
- 2024ARCADE: Scalable Demonstration Collection and Generation via Augmented Reality for Imitation Learningcited by 5
- 2026Closed-Loop Action Chunks with Dynamic Corrections for Training-Free Diffusion Policycited by 3
- 2024Subconscious Robotic Imitation Learningcited by 2
- 2024ALPHA-α and Bi-ACT Are All You Need: Importance of Position and Force Information/Control for Imitation Learning of Unimanual and Bimanual Robotic Manipulation with Low-Cost Systemcited by 1
5 more
- 2025What Do You Need for Compositional Generalization in Diffusion Planning?cited by 0
- 2025One-shot Adaptation of Humanoid Whole-body Motion with Walking Priorscited by 0
- 2026Expert Behavior Prior Reinforcement Learningcited by 0
- 2026Improving Online Reinforcement Learning via Bidirectional Behavior Prior Distillationcited by 0
- 2026REACT: Rolling Denoising and Dual Decoupling for Reactive Robot Control with VLA Modelscited by 0
- 2026REACT: Rolling Denoising and Dual Decoupling for Reactive Robot Control with VLA Models8 Oct 2026
- 2026Improving Online Reinforcement Learning via Bidirectional Behavior Prior Distillation29 Jul 2026
- 2026Expert Behavior Prior Reinforcement Learning23 Jul 2026
- 2026StreamingVLA: Streaming Vision-Language-Action Model with Action Flow Matching and Adaptive Early Observation30 Mar 2026
- 2026Closed-Loop Action Chunks with Dynamic Corrections for Training-Free Diffusion Policy2 Mar 2026
- 2025One-shot Adaptation of Humanoid Whole-body Motion with Walking Priors29 Oct 2025
- 2025Reinforcement Learning with Action Chunking10 Jul 2025
- 2025Real-Time Execution of Action Chunking Flow Policies9 Jun 2025
- 2025What Do You Need for Compositional Generalization in Diffusion Planning?23 May 2025
- 2025RT-Cache: Training-Free Retrieval for Real-Time Manipulation14 May 2025
- 2024Subconscious Robotic Imitation Learning29 Dec 2024
- 2024ALPHA-α and Bi-ACT Are All You Need: Importance of Position and Force Information/Control for Imitation Learning of Unimanual and Bimanual Robotic Manipulation with Low-Cost System15 Nov 2024
5 more
- 2024ARCADE: Scalable Demonstration Collection and Generation via Augmented Reality for Imitation Learning21 Oct 2024
- 2024Bidirectional Decoding: Improving Action Chunking via Guided Test-Time Sampling30 Aug 2024
- 2024VITaL Pretraining: Visuo-Tactile Pretraining for Tactile and Non-Tactile Manipulation Policies18 Mar 2024
- 2024SculptDiff: Learning Robotic Clay Sculpting from Humans with Goal Conditioned Diffusion Policy15 Mar 2024
- 2024Bi-ACT: Bilateral Control-Based Imitation Learning via Action Chunking with Transformer31 Jan 2024
- 2025Reinforcement Learning with Action Chunkingcited by 107
- 2024Bi-ACT: Bilateral Control-Based Imitation Learning via Action Chunking with Transformercited by 27
- 2024VITaL Pretraining: Visuo-Tactile Pretraining for Tactile and Non-Tactile Manipulation Policiescited by 15
- 2024ARCADE: Scalable Demonstration Collection and Generation via Augmented Reality for Imitation Learningcited by 5
- 2024Subconscious Robotic Imitation Learningcited by 2
- 2024ALPHA-α and Bi-ACT Are All You Need: Importance of Position and Force Information/Control for Imitation Learning of Unimanual and Bimanual Robotic Manipulation with Low-Cost Systemcited by 1
- 2025What Do You Need for Compositional Generalization in Diffusion Planning?cited by 0
- 2025Reinforcement Learning with Action Chunking10 Jul 2025
- 2025What Do You Need for Compositional Generalization in Diffusion Planning?23 May 2025
- 2024Subconscious Robotic Imitation Learning29 Dec 2024
- 2024ALPHA-α and Bi-ACT Are All You Need: Importance of Position and Force Information/Control for Imitation Learning of Unimanual and Bimanual Robotic Manipulation with Low-Cost System15 Nov 2024
- 2024ARCADE: Scalable Demonstration Collection and Generation via Augmented Reality for Imitation Learning21 Oct 2024
- 2024VITaL Pretraining: Visuo-Tactile Pretraining for Tactile and Non-Tactile Manipulation Policies18 Mar 2024
- 2024Bi-ACT: Bilateral Control-Based Imitation Learning via Action Chunking with Transformer31 Jan 2024
- 2025Real-Time Execution of Action Chunking Flow Policiescited by 216
- 2024Bidirectional Decoding: Improving Action Chunking via Guided Test-Time Samplingcited by 52
- 2025RT-Cache: Training-Free Retrieval for Real-Time Manipulationcited by 6
- 2025One-shot Adaptation of Humanoid Whole-body Motion with Walking Priorscited by 0
- 2025One-shot Adaptation of Humanoid Whole-body Motion with Walking Priors29 Oct 2025
- 2025Real-Time Execution of Action Chunking Flow Policies9 Jun 2025
- 2025RT-Cache: Training-Free Retrieval for Real-Time Manipulation14 May 2025
- 2024Bidirectional Decoding: Improving Action Chunking via Guided Test-Time Sampling30 Aug 2024
Similar, not cited
Close in wording, no citation either way
- 2025CLASS: Contrastive Learning via Action Sequence Supervision for Robot Manipulation
- 2020Concurrent Training Improves the Performance of Behavioral Cloning from Observation
- 2025Action Chunking and Exploratory Data Collection Yield Exponential Improvements in Behavior Cloning for Continuous Control
- 2025R2BC: Multi-Agent Imitation Learning from Single-Agent Demonstrations
- 2025Counterfactual Behavior Cloning: Offline Imitation Learning from Imperfect Human Demonstrations
- 2020Imitating Unknown Policies via Exploration
- 2025Learning a Thousand Tasks in a Day
- 2025Improving Generative Behavior Cloning via Self-Guidance and Adaptive Chunking