# LAMP: Latent Motion Prior-Guided Real-World Learning for Dexterous Hand Manipulation

arXiv: https://arxiv.org/abs/2607.06323 · HTML: https://mlsanity.com/paper/2607.06323/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 7 Jul 2026.

## Built on by (most cited first, 2 of 2)

- [Direct Experience World-Model Optimization: Learning the World Beyond Action Imitation](https://mlsanity.com/paper/2609.37398/) (2026)
- [EigenDEXplore: Structured Exploration for Dexterous Manipulation with Human Priors](https://mlsanity.com/paper/2610.07681/) (2026)

## Abstract (arXiv)

Real-world learning for dexterous hands remains brittle because high-dimensional hand actions amplify imitation errors and make reinforcement-learning exploration prone to contact-breaking motion. While combining imitation learning (IL) with online reinforcement learning (RL) can reduce manual supervision, unconstrained exploration in raw hand-action spaces is sample-inefficient and risky for physical hardware. We introduce a latent motion prior module (prior) that maps recent hand-action histories to a compact, history-conditioned latent prior and decodes continuous latent commands into executable high-dimensional hand targets. Built on this prior, method is a three-stage real-world dexterous learning framework: it pretrains prior from demonstrations, trains a visuomotor policy that predicts native arm commands and latent hand-action offsets, and improves the policy with online residual RL in the same latent hand-action space. This shared, decodable interface lets residual exploration make local corrections near demonstrated, contact-consistent hand motions rather than perturbing every finger joint independently. We evaluate method on four real-robot dexterous manipulation tasks against raw, linear, and discrete hand-action interfaces. Starting from small task-specific demonstration sets, method achieves a 56.25% average IL success rate and raises it to 98.75% after online RL, reaching 100% final success on three tasks and 95% on the remaining task.