DreamActor-M2: Universal Character Image Animation via Spatiotemporal In-Context Learning
Not on the map. Why?
Abstract (arXiv)
Character image animation aims to synthesize high-fidelity videos by transferring motion from a driving sequence to a static reference image. Despite recent advancements, existing methods suffer from two fundamental challenges: (1) suboptimal motion injection strategies that lead to a trade-off between identity preservation and motion consistency, manifesting as a "see-saw", and (2) an over-reliance on explicit pose priors (e.g., skeletons), which inadequately capture intricate dynamics and hinder generalization to arbitrary, non-humanoid characters. To address these challenges, we present DreamActor-M2, a universal animation framework that reimagines motion conditioning as an in-context learning problem. Our approach follows a two-stage paradigm. First, we bridge the input modality gap by fusing reference appearance and motion cues into a unified latent space, enabling the model to jointly reason about spatial identity and temporal dynamics by leveraging the generative prior of foundational models. Second, we introduce a self-bootstrapped data synthesis pipeline that curates pseudo cross-identity training pairs, facilitating a seamless transition from pose-dependent control to direct, end-to-end RGB-driven animation. This strategy significantly enhances generalization across diverse characters and motion scenarios. To facilitate comprehensive evaluation, we further introduce AW Bench, a versatile benchmark encompassing a wide spectrum of characters types and motion scenarios. Extensive experiments demonstrate that DreamActor-M2 achieves state-of-the-art performance, delivering superior visual fidelity and robust cross-domain generalization. Project Page: https://grisoon.github.io/DreamActor-M2/
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 47 of its 61 references that are in the map. First posted on arXiv 29 Jan 2026.
Builds on
47 of 61 references.
References · 47
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
35 more
- 2022A Survey on In-context Learningcited by 721
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
- 2021Learning To Retrieve Prompts for In-Context Learningcited by 648
- 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Modelcited by 330
- 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 311
- 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 272
- 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 259
- 2021Motion Representations for Articulated Animationcited by 255
- 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidancecited by 198
- 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motioncited by 188
- 2024In-Context LoRA for Diffusion Transformerscited by 158
- 2023DisCo: Disentangled Control for Realistic Human Dance Generationcited by 142
- 2023MagicPose: Realistic Human Poses and Facial Expressions Retargeting with Identity-aware Diffusioncited by 117
- 2019DwNet: Dense warp-based network for pose-guided human video generationcited by 115
- 2024Animate-X: Universal Character Image Animation with Enhanced Motion Representationcited by 88
- 2024StableAnimator: High-Quality Identity-Preserving Human Image Animationcited by 88
- 2025Seaweed-7B: Cost-Effective Training of Video Generation Foundation Modelcited by 82
- 2025Wan-Animate: Unified Character Animation and Replacement with Holistic Replicationcited by 80
- 2025Video-Bench: Human-Aligned Video Generation Benchmarkcited by 57
- 2024On the Content Bias in Fr'echet Video Distancecited by 52
- 2025Waver: Wave Your Way to Lifelike Video Generationcited by 52
- 2025UniAnimate-DiT: Human Image Animation with Large-Scale Video Diffusion Transformercited by 42
- 2025HumanDiT: Pose-Guided Diffusion Transformer for Long-form Human Motion Video Generationcited by 39
- 2025VisualCloze: A Universal Image Generation Framework via Visual In-Context Learningcited by 39
- 2025DreamActor-M1: Holistic, Expressive and Robust Human Image Animation with Hybrid Guidancecited by 36
- 2024DisPose: Disentangling Pose Guidance for Controllable Human Image Animationcited by 35
- 2025FlexiAct: Towards Flexible Action Control in Heterogeneous Scenarioscited by 25
- 2024Group Diffusion Transformers are Unsupervised Multitask Learnerscited by 22
- 2025X-Dyna: Expressive Dynamic Human Image Animationcited by 18
- 2024X-Prompt: Towards Universal In-Context Image Generation in Auto-Regressive Vision Language Foundation Modelscited by 15
- 2025X-UniMotion: Animating Human Images with Expressive, Unified and Identity-Agnostic Motion Latentscited by 13
- 2025SCAIL: Towards Studio-Grade Character Animation via In-Context Learning of 3D-Consistent Pose Representationscited by 13
- 2025Animate-X++: Universal Character Image Animation with Dynamic Backgroundscited by 10
- 2025PoseGen: In-Context LoRA Finetuning for Pose-Controllable Long Human Video Generationcited by 9
- 2024In-Context Learning Improves Compositional Understanding of Vision-Language Modelscited by 1
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026SCAIL-2: Unifying Controlled Character Animation with End-to-End In-Context Conditioningcited by 8
- 2026Wan-Animate-2: Pushing the Application Boundaries of Character Animationcited by 4
- 2026Vorch-IR: Long-Form Unified Multimodal Identity Replacement Video Generationcited by 0
- 2026WeLike2Party! In-Context Motion Transfer for Multi-Human Image Animationcited by 0
- 2026PixReenact: Pixel-Conditioned Causal Video Diffusion for Streaming Head-Avatar Reenactmentcited by 0
- 2026PixReenact: Pixel-Conditioned Causal Video Diffusion for Streaming Head-Avatar Reenactment4 Oct 2026
- 2026WeLike2Party! In-Context Motion Transfer for Multi-Human Image Animation29 Sep 2026
- 2026Wan-Animate-2: Pushing the Application Boundaries of Character Animation6 Aug 2026
- 2026Vorch-IR: Long-Form Unified Multimodal Identity Replacement Video Generation6 Aug 2026
- 2026SCAIL-2: Unifying Controlled Character Animation with End-to-End In-Context Conditioning9 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026IM-Animation: An Implicit Motion Representation for Identity-decoupled Character Animation
- 2025FramePrompt: In-context Controllable Animation with Zero Structural Changes
- 2026MultiAnimate: Pose-Guided Image Animation Made Extensible
- 2026RASA: Disentangled Spatial-Motional Priors for Cross-Identity Character Animation
- 2025One-to-All Animation: Alignment-Free Character Animation and Image Pose Transfer
- 2026AnyCrowd: Instance-Isolated Identity-Pose Binding for Arbitrary Multi-Character Animation
- 2023LEO: Generative Latent Image Animator for Human Video Synthesis
- 2024VividPose: Advancing Stable Video Diffusion for Realistic Human Image Animation