OmniHumanoid: Streaming Cross-Embodiment Video Generation with Paired-Free Adaptation
Not on the map. Why?
Abstract (arXiv)
Cross-embodiment video generation aims to transfer motions across different humanoid embodiments, such as human-to-robot and robot-to-robot, enabling scalable data generation for embodied intelligence. A major challenge in this setting is that motion dynamics are partly transferable across embodiments, whereas appearance and morphology remain embodiment-specific. Existing approaches often entangle these factors, and many require paired data for every target embodiment, which limits scalability to new robots. We present OmniHumanoid, a framework that factorizes transferable motion learning and embodiment-specific adaptation. Our method learns a shared motion transfer model from motion-aligned paired videos spanning multiple embodiments, while adapting to a new embodiment using only unpaired videos through lightweight embodiment-specific adapters. To reduce interference between motion transfer and embodiment adaptation, we further introduce a branch-isolated attention design that separates motion conditioning from embodiment-specific modulation. In addition, we construct a synthetic cross-embodiment dataset with motion-aligned paired videos rendered across diverse humanoid assets, scenes, and viewpoints. Experiments on both synthetic and real-world benchmarks show that OmniHumanoid achieves strong motion fidelity and embodiment consistency, while enabling scalable adaptation to unseen humanoid embodiments without retraining the shared motion model.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 36 of its 48 references that are in the map. First posted on arXiv 12 May 2026.
Builds on
36 of 48 references.
References · 36
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 477
- 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?cited by 349
- 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 314
- 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 300
24 more
- 2025Unified Video Action Modelcited by 205
- 2024EgoMimic: Scaling Imitation Learning via Egocentric Videocited by 175
- 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 174
- 2023MotionDirector: Motion Customization of Text-to-Video Diffusion Modelscited by 173
- 2025EgoVLA: Learning Vision-Language-Action Models from Egocentric Human Videoscited by 128
- 2018To Create What You Tell: Generating Videos from Captionscited by 84
- 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuningcited by 81
- 2024CSGO: Content-Style Composition in Text-to-Image Generationcited by 78
- 2025Humanoid Policy ~ Human Policycited by 78
- 2025Phantom: Training Robots Without Robots Using Only Human Videoscited by 70
- 2025MakeAnything: Harnessing Diffusion Transformers for Multi-Domain Procedural Sequence Generationcited by 45
- 2025LayerTracer: Cognitive-Aligned Layered SVG Synthesis via Diffusion Transformercited by 43
- 2025Masquerade: Learning from In-the-wild Human Videos using Data-Editingcited by 43
- 2024ProcessPainter: Learn Painting Process from Sequence Datacited by 38
- 2025Learning Video Generation for Robotic Manipulation with Collaborative Trajectory Controlcited by 34
- 2025OmniConsistency: Learning Style-Agnostic Consistency from Paired Stylization Datacited by 32
- 2025PhotoDoodle: Learning Artistic Image Editing from Few-Shot Pairwise Datacited by 24
- 2025TransAnimate: Taming Layer Diffusion to Generate RGBA Videocited by 24
- 2025Mitty: Diffusion-based Human-to-Robot Video Generationcited by 14
- 2025X-Humanoid: Robotize Human Videos to Generate Humanoid Videos at Scalecited by 12
- 2025WorldWander: Bridging Egocentric and Exocentric Worlds in Video Generationcited by 9
- 2025H2R-Grounder: A Paired-Data-Free Paradigm for Translating Human Interaction Videos into Physically Grounded Robot Videoscited by 9
- 2025IC-Effect: Precise and Efficient Video Effects Editing via In-Context Learningcited by 4
- 2025Loom: Diffusion-Transformer for Interleaved Generationcited by 4
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026StreamingEffect: Real-Time Human-Centric Video Effect Generationcited by 8
- 2026PAI-Studio: Cinematic Video Background Replacement with Camera-Aware Motioncited by 8
- 2026SWEET: Sparse World Modeling with Image Editing for Embodied Task Executioncited by 1
- 2026PAI-Actor: Cinematic Multi-Character Replacement in Dynamic Scenescited by 0
- 2026PAI-Actor: Cinematic Multi-Character Replacement in Dynamic Scenes5 Sep 2026
- 2026PAI-Studio: Cinematic Video Background Replacement with Camera-Aware Motion31 May 2026
- 2026SWEET: Sparse World Modeling with Image Editing for Embodied Task Execution19 May 2026
- 2026StreamingEffect: Real-Time Human-Centric Video Effect Generation16 May 2026