CrossPortrait: Cross-Species Portrait Animation via Adversarial Motion Alignment
Not on the map. Why?
Abstract (arXiv)
Cross-species portrait animation, which aims to animate a source portrait of species A using a driving video of species B, is particularly challenging due to substantial anatomical differences in facial structures across species. Previous works typically fine-tune human portrait animation models on animal video datasets but often suffer from driving-species leakage. To address this, we propose CrossPortrait, a novel framework for expressive cross-species portrait animation, supporting diverse scenarios including human-to-animal, animal-to-human and cross-species animal-to-animal (e.g. cat-to-dog) animation. Specifically, we decompose the portrait motion into rigid head poses and expression keypoints. To accommodate species-specific facial structures while facilitating cross-species expression alignment, we introduce a species-routed expression encoder that incorporates species-specific LoRAs into a unified expression encoder. Furthermore, we introduce expression-level adversarial domain adaptation (Ex-ADA) to suppress driving-species-specific information in the expression latents, thereby mitigating species leakage and promoting a shared expression space across species. Extensive experiments show that our method enables expressive and identity-preserving portrait animation across diverse species and outperforms other state-of-the-art approaches.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 34 of its 40 references that are in the map. First posted on arXiv 13 Oct 2026.
Builds on
34 of 40 references.
References · 34
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2022A ConvNet for the 2020scited by 3,579
- 2015Domain-Adversarial Training of Neural Networkscited by 3,044
- 2020First Order Motion Model for Image Animationcited by 704
- 2017Learning multiple visual domains with residual adapterscited by 557
- 2020One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencingcited by 444
- 2016Domain Separation Networkscited by 320
- 2021Motion Representations for Articulated Animationcited by 255
- 2022Thin-Plate Spline Motion Model for Image Animationcited by 210
- 2024LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Controlcited by 206
- 2021PIRenderer: Controllable Portrait Image Generation via Semantic Neural Renderingcited by 203
22 more
- 2018Multi-Adversarial Domain Adaptationcited by 196
- 2023NeRSemble: Multi-view Radiance Field Reconstruction of Human Headscited by 194
- 2022VFHQ: A High-Quality Dataset and Benchmark for Video Face Super-Resolutioncited by 176
- 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 174
- 2025VideoREPA: Learning Physics for Video Generation through Relational Alignment with Foundation Modelscited by 98
- 2024X-Portrait: Expressive Portrait Animation with Hierarchical Motion Attentioncited by 91
- 2024MOFA-Video: Controllable Image Animation via Generative Motion Field Adaptions in Frozen Image-to-Video Diffusion Modelcited by 89
- 2024Animate-X: Universal Character Image Animation with Enhanced Motion Representationcited by 88
- 2024SMIRK: 3D Facial Expressions through Analysis-by-Neural-Synthesiscited by 84
- 2024EMOPortraits: Emotion-enhanced Multimodal One-shot Head Avatarscited by 66
- 2025HunyuanPortrait: Implicit Condition Control for Enhanced Portrait Animationcited by 59
- 2023DPE: Disentanglement of Pose and Expression for General Video Portrait Editingcited by 46
- 2025Follow-Your-Emoji-Faster: Towards Efficient, Fine-Controllable, and Expressive Freestyle Portrait Animationcited by 43
- 2025X-NeMo: Expressive Neural Motion Reenactment via Disentangled Latent Attentioncited by 28
- 2023Towards Real-World Blind Face Restoration with Generative Diffusion Priorcited by 22
- 2025FaceShot: Bring Any Character into Lifecited by 13
- 2025FantasyPortrait: Enhancing Multi-Character Portrait Animation with Expression-Augmented Diffusion Transformerscited by 13
- 2025DeX-Portrait: Disentangled and Expressive Portrait Animation via Explicit and Latent Motion Representationscited by 4
- 2026Wan-Animate-2: Pushing the Application Boundaries of Character Animationcited by 4
- 2024AnimateZoo: Zero-shot Video Generation of Cross-Species Animation via Subject Alignmentcited by 3
- 2026Enhancing Video Physical Consistency via Role-aware Joint Training and Modality-decoupled Denoisingcited by 3
- 2026FG-Portrait: 3D Flow Guided Editable Portrait Animationcited by 1
Built on by
Not cited yet.