# MimicKit: A Reinforcement Learning Framework for Motion Imitation and Control

arXiv: https://arxiv.org/abs/2510.13794 · HTML: https://mlsanity.com/paper/2510.13794/

## Key facts

- Cited by 10 papers in the map (data through 14 Oct 2026).
- Placed in RL for robot locomotion and manipulation, one of 15 directions in Deep reinforcement learning methods.
- Builds on 2 of its 10 references that are in the map.
- First posted on arXiv 15 Oct 2025.

## Placed in

- Deep reinforcement learning methods / [RL for robot locomotion and manipulation](https://mlsanity.com/deeprl/rl-for-robot-locomotion-and-manipulation/)

## Builds on (most cited first, 2 of 2)

- [Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learning](https://mlsanity.com/paper/2108.10470/) (2021)
- [Advantage-Weighted Regression: Simple and Scalable Off-Policy Reinforcement Learning](https://mlsanity.com/paper/1910.00177/) (2019)

## Built on by (most cited first, 10 of 10)

- [RigidFormer: Learning Rigid Dynamics using Transformers](https://mlsanity.com/paper/2605.09196/) (2026)
- [PDF-HR: Pose Distance Fields for Humanoid Robots](https://mlsanity.com/paper/2602.04851/) (2026)
- [EmbodMocap: In-the-Wild 4D Human-Scene Reconstruction for Embodied Agents](https://mlsanity.com/paper/2602.23205/) (2026)
- [SynAgent: Generalizable Cooperative Humanoid Manipulation via Solo-to-Cooperative Agent Synergy](https://mlsanity.com/paper/2604.18557/) (2026)
- [SWIM: Compact Environment Representation for Reinforcement Learning Human Swimming](https://mlsanity.com/paper/2605.31120/) (2026)
- [Kine2Go: Kinematic dataset for the Unitree Go2 robot with diverse gaits and motions](https://mlsanity.com/paper/2606.14433/) (2026)
- [Policy-as-Data: Learning Generalizable HOI Diffusion Models from Simulated Physics](https://mlsanity.com/paper/2606.22806/) (2026)
- [PFM-HR: Pose Flow Matching for Humanoid Robots](https://mlsanity.com/paper/2608.03227/) (2026)
- [Flow-Matched Motion Priors: Online Optimal-Transport Rewards for Imitation Learning](https://mlsanity.com/paper/2609.15631/) (2026)
- [DSD: Learning Diverse and Reusable Motor Skills via Diffusion Skill Discovery](https://mlsanity.com/paper/2609.17682/) (2026)

## Abstract (arXiv)

MimicKit is an open-source framework for training motion controllers using motion imitation and reinforcement learning. The codebase provides implementations of commonly-used motion-imitation techniques and RL algorithms. This framework is intended to support research and applications in computer graphics and robotics by providing a unified training framework, along with standardized environment, agent, and data structures. The codebase is designed to be modular and easily configurable, enabling convenient modification and extension to new characters and tasks. The open-source codebase is available at: https://github.com/xbpeng/MimicKit.