mlsanityData to 14 Oct 2026

KiRAS: Keyframe Guided Self-Imitation for Robust and Adaptive Skill Learning in Quadruped Robots

arXiv 2603.15179 ↗First posted 16 Mar 2026cs.ROcited by 0

On the map: Offline RL and imitation learning from data → Robot manipulation imitation learning

also in 1 more
Abstract (arXiv)

With advances in reinforcement learning and imitation learning, quadruped robots can acquire diverse skills within a single policy by imitating multiple skill-specific datasets. However, the lack of datasets on complex terrains limits the ability of such multi-skill policies to generalize effectively in unstructured environments. Inspired by animation, we adopt keyframes as minimal and universal skill representations, relaxing dataset constraints and enabling the integration of terrain adaptability with skill diversity. We propose Keyframe Guided Self-Imitation for Robust and Adaptive Skill Learning (KiRAS), an end-to-end framework for acquiring and transitioning between diverse skill primitives on complex terrains. KiRAS first learns diverse skills on flat terrain through keyframe-guided self-imitation, eliminating the need for expert datasets; then continues training the same policy network on rough terrains to enhance robustness. To eliminate catastrophic forgetting, a proficiency-based Skill Initialization Technique is introduced. Experiments on Solo-8 and Unitree Go1 robots show that KiRAS enables robust skill acquisition and smooth transitions across challenging terrains. This framework demonstrates its potential as a lightweight platform for multi-skill generation and dataset collection. It further enables flexible skill transitions that enhance locomotion on challenging terrains.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Robot manipulation imitation learning, one of 13 directions in Offline RL and imitation learning from data. Builds on 24 of its 27 references that are in the map. First posted on arXiv 16 Mar 2026.

Builds on

24 of 27 references.

References · 24

  1. 2016Generative Adversarial Imitation Learningcited by 1,597
  2. 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 998
  3. 2018Learning to Learn without Forgetting by Maximizing Transfer and Minimizing Interferencecited by 521
  4. 2021Learning to Walk in Minutes Using Massively Parallel Deep Reinforcement Learningcited by 512
  5. 2021RMA: Rapid Motor Adaptation for Legged Robotscited by 508
  6. 2022Learning robust perceptive locomotion for quadrupedal robots in the wildcited by 382
  7. 2018Self-Imitation Learningcited by 138
  8. 2022Walk These Ways: Tuning Robot Control for Generalization with Multiplicity of Behaviorcited by 138
  9. 2022Concurrent Training of a Control Policy and a State Estimator for Dynamic and Robust Legged Locomotioncited by 88
  10. 2023DreamWaQ: Learning Robust Quadrupedal Locomotion With Implicit Terrain Imagination via Deep Reinforcement Learningcited by 66
  11. 2022Learning Agile Skills via Adversarial Imitation of Rough Partial Demonstrationscited by 45
  12. 2023Hybrid Internal Model: Learning Agile Legged Locomotion with Simulated Robot Responsecited by 39
12 more
  1. 2022Advanced Skills through Multiple Adversarial Motion Priors in Reinforcement Learningcited by 37
  2. 2023Lifelike Agility and Play in Quadrupedal Robots using Reinforcement Learning and Generative Pre-trained Modelscited by 37
  3. 2022OPT-Mimic: Imitation of Optimized Trajectories for Dynamic Quadruped Behaviorscited by 35
  4. 2024CaT: Constraints as Terminations for Legged Locomotion Reinforcement Learningcited by 23
  5. 2025MoE-Loco: Mixture of Experts for Multitask Locomotioncited by 23
  6. 2019An Open Torque-Controlled Modular Robot Architecture for Legged Locomotion Researchcited by 22
  7. 2022Versatile Skill Control via Self-supervised Adversarial Imitation of Unlabeled Mixed Motionscited by 21
  8. 2024FLD: Fourier Latent Dynamics for Structured Motion Representation and Learningcited by 18
  9. 2024RobotKeyframing: Learning Locomotion with High-Level Objectives via Mixture of Dense and Sparse Rewardscited by 18
  10. 2025Human2LocoMan: Learning Versatile Quadrupedal Manipulation with Human Pretrainingcited by 9
  11. 2025Motion Priors Reimagined: Adapting Flat-Terrain Skills for Complex Quadruped Mobilitycited by 5
  12. 2025Continuous Control of Diverse Skills in Quadruped Robots Without Complete Expert Datasetscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Diverse Skill Discovery for Quadruped Robots via Unsupervised Learning
  2. 2026Agile perceptive multi-skill locomotion for quadrupedal robots in the wild
  3. 2024Constrained Skill Discovery: Quadruped Locomotion with Unsupervised Reinforcement Learning
  4. 2023Learning Terrain-Adaptive Locomotion with Agile Behaviors by Imitating Animals
  5. 2026MimicAgent: Quadruped Skills via Prompt-to-Trajectory Generation
  6. 2024Learning from 10 Demos: Generalisable and Sample-Efficient Policy Learning with Oriented Affordance Frames
  7. 2026Learning Task-Invariant Properties via Dreamer: Enabling Efficient Policy Transfer for Quadruped Robots
  8. 2021Learning Coordinated Terrain-Adaptive Locomotion by Imitating a Centroidal Dynamics Planner