mlsanityData to 14 Oct 2026

OmniHumanoid: Streaming Cross-Embodiment Video Generation with Paired-Free Adaptation

arXiv 2605.12038 ↗First posted 12 May 2026cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

Cross-embodiment video generation aims to transfer motions across different humanoid embodiments, such as human-to-robot and robot-to-robot, enabling scalable data generation for embodied intelligence. A major challenge in this setting is that motion dynamics are partly transferable across embodiments, whereas appearance and morphology remain embodiment-specific. Existing approaches often entangle these factors, and many require paired data for every target embodiment, which limits scalability to new robots. We present OmniHumanoid, a framework that factorizes transferable motion learning and embodiment-specific adaptation. Our method learns a shared motion transfer model from motion-aligned paired videos spanning multiple embodiments, while adapting to a new embodiment using only unpaired videos through lightweight embodiment-specific adapters. To reduce interference between motion transfer and embodiment adaptation, we further introduce a branch-isolated attention design that separates motion conditioning from embodiment-specific modulation. In addition, we construct a synthetic cross-embodiment dataset with motion-aligned paired videos rendered across diverse humanoid assets, scenes, and viewpoints. Experiments on both synthetic and real-world benchmarks show that OmniHumanoid achieves strong motion fidelity and embodiment consistency, while enabling scalable adaptation to unseen humanoid embodiments without retraining the shared motion model.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 36 of its 48 references that are in the map. First posted on arXiv 12 May 2026.

Builds on

36 of 48 references.

References · 36

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  4. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  5. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  6. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  7. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  8. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  9. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 477
  10. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?cited by 349
  11. 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 314
  12. 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 300
24 more
  1. 2025Unified Video Action Modelcited by 205
  2. 2024EgoMimic: Scaling Imitation Learning via Egocentric Videocited by 175
  3. 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 174
  4. 2023MotionDirector: Motion Customization of Text-to-Video Diffusion Modelscited by 173
  5. 2025EgoVLA: Learning Vision-Language-Action Models from Egocentric Human Videoscited by 128
  6. 2018To Create What You Tell: Generating Videos from Captionscited by 84
  7. 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuningcited by 81
  8. 2024CSGO: Content-Style Composition in Text-to-Image Generationcited by 78
  9. 2025Humanoid Policy ~ Human Policycited by 78
  10. 2025Phantom: Training Robots Without Robots Using Only Human Videoscited by 70
  11. 2025MakeAnything: Harnessing Diffusion Transformers for Multi-Domain Procedural Sequence Generationcited by 45
  12. 2025LayerTracer: Cognitive-Aligned Layered SVG Synthesis via Diffusion Transformercited by 43
  13. 2025Masquerade: Learning from In-the-wild Human Videos using Data-Editingcited by 43
  14. 2024ProcessPainter: Learn Painting Process from Sequence Datacited by 38
  15. 2025Learning Video Generation for Robotic Manipulation with Collaborative Trajectory Controlcited by 34
  16. 2025OmniConsistency: Learning Style-Agnostic Consistency from Paired Stylization Datacited by 32
  17. 2025PhotoDoodle: Learning Artistic Image Editing from Few-Shot Pairwise Datacited by 24
  18. 2025TransAnimate: Taming Layer Diffusion to Generate RGBA Videocited by 24
  19. 2025Mitty: Diffusion-based Human-to-Robot Video Generationcited by 14
  20. 2025X-Humanoid: Robotize Human Videos to Generate Humanoid Videos at Scalecited by 12
  21. 2025WorldWander: Bridging Egocentric and Exocentric Worlds in Video Generationcited by 9
  22. 2025H2R-Grounder: A Paired-Data-Free Paradigm for Translating Human Interaction Videos into Physically Grounded Robot Videoscited by 9
  23. 2025IC-Effect: Precise and Efficient Video Effects Editing via In-Context Learningcited by 4
  24. 2025Loom: Diffusion-Transformer for Interleaved Generationcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.