PhysAnimator: Physics-Guided Generative Cartoon Animation
Not on the map. Why?
Abstract (arXiv)
Creating hand-drawn animation sequences is labor-intensive and demands professional expertise. We introduce PhysAnimator, a novel approach for generating physically plausible meanwhile anime-stylized animation from static anime illustrations. Our method seamlessly integrates physics-based simulations with data-driven generative models to produce dynamic and visually compelling animations. To capture the fluidity and exaggeration characteristic of anime, we perform image-space deformable body simulations on extracted mesh geometries. We enhance artistic control by introducing customizable energy strokes and incorporating rigging point support, enabling the creation of tailored animation effects such as wind interactions. Finally, we extract and warp sketches from the simulation sequence, generating a texture-agnostic representation, and employ a sketch-guided video diffusion model to synthesize high-quality animation frames. The resulting animations exhibit temporal consistency and visual plausibility, demonstrating the effectiveness of our method in creating dynamic anime-style animations. See our project page for more demos: https://xpandora.github.io/PhysAnimator/
Key facts. Cited by 40 papers in the map (data through 7 Oct 2026). Builds on 65 of its 89 references that are in the map. First posted on arXiv 27 Jan 2025.
Builds on
65 of 89 references.
References · 65
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2023Segment Anythingcited by 8,158
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2022Video Diffusion Modelscited by 2,280
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
- 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 589
38 more
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 463
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 440
- 2022Latent Video Diffusion Models for High-Fidelity Long Video Generationcited by 385
- 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 368
- 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
- 2023Preserve Your Own Correlation: A Noise Prior for Video Diffusion Modelscited by 284
- 2020Softmax Splatting for Video Frame Interpolationcited by 276
- 2023DragNUWA: Fine-grained Control in Video Generation by Integrating Text, Image, and Trajectorycited by 260
- 2023SEINE: Short-to-Long Video Diffusion Model for Generative Transition and Predictioncited by 231
- 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 215
- 2024Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modelingcited by 209
- 2023A Survey on Video Diffusion Modelscited by 203
- 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidancecited by 196
- 2024VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generationcited by 190
- 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motioncited by 186
- 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 185
- 2023StableVideo: Text-driven Consistency-aware Diffusion Video Editingcited by 182
- 2024VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Realitycited by 175
- 2023MotionDirector: Motion Customization of Text-to-Video Diffusion Modelscited by 172
- 2023SparseCtrl: Adding Sparse Controls to Text-to-Video Diffusion Modelscited by 172
- 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 169
- 2019Style Transfer by Relaxed Optimal Transport and Self-Similaritycited by 167
- 2024Direct-a-Video: Customized Video Generation with User-Directed Camera Movement and Object Motioncited by 167
- 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 167
- 2024Tora: Trajectory-oriented Diffusion Transformer for Video Generationcited by 161
- 2024DragAnything: Motion Control for Anything using Entity Representationcited by 159
- 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 151
- 2024ReconX: Reconstruct Any Scene from Sparse Views with Video Diffusion Modelcited by 139
- 2024Learning Temporally Consistent Video Depth from Video Diffusion Priorscited by 100
- 2023Generative Image Dynamicscited by 93
- 2023Animate-A-Story: Storytelling with Retrieval-Augmented Video Generationcited by 89
- 2024V3D: Video Diffusion Models are Effective 3D Generatorscited by 88
- 2024MOFA-Video: Controllable Image Animation via Generative Motion Field Adaptions in Frozen Image-to-Video Diffusion Modelcited by 87
- 2023VMC: Video Motion Customization using Temporal Attention Adaption for Text-to-Video Diffusion Modelscited by 86
- 2022Learning to generate line drawings that convey geometry and semanticscited by 82
- 2023VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondencecited by 69
- 2024ToonCrafter: Generative Cartoon Interpolationcited by 68
50 most cited of 65 All 65 (JSON)
Built on by
Citing papers per year: 2025: 18; 2026: 22.
40 papers.
Sort:
By area:
- 2025VideoREPA: Learning Physics for Video Generation through Relational Alignment with Foundation Modelscited by 88
- 2025NewtonGen: Physics-Consistent and Controllable Text-to-Video Generation via Neural Newtonian Dynamicscited by 40
- 2025PhysCtrl: Generative Physics for Controllable and Physics-Grounded Video Generationcited by 39
- 2025RoboScape: Physics-informed Embodied World Modelcited by 38
- 2025Exploring the Evolution of Physics Cognition in Video Generation: A Surveycited by 31
- 2025What about gravity in video generation? Post-Training Newton's Laws with Verifiable Rewardscited by 23
- 2026PhysRVG: Physics-Aware Unified Reinforcement Learning for Video Generative Modelscited by 15
- 2025Enhancing Physical Plausibility in Video Generation by Reasoning the Implausibilitycited by 13
- 2025MoAlign: Motion-Centric Representation Alignment for Video Diffusion Modelscited by 13
- 2025RULER-Bench: Probing Rule-based Reasoning Abilities of Next-level Video Generation Models for Vision Foundation Intelligencecited by 12
- 2026Physical Simulator In-the-Loop Video Generationcited by 12
- 2025ProPhy: Progressive Physical Alignment for Dynamic World Simulationcited by 11
28 more
- 2025PhysMaster: Mastering Physical Representation for Video Generation via Reinforcement Learningcited by 10
- 2026Phantom: Physics-Infused Video Generation via Joint Modeling of Visual and Latent Physical Dynamicscited by 10
- 2026NEWTON: Agentic Planning for Physically Grounded Video Generationcited by 10
- 2025PhysChoreo: Physics-Controllable Video Generation with Part-Aware Semantic Groundingcited by 9
- 2025AceVFI: A Comprehensive Survey of Advances in Video Frame Interpolationcited by 8
- 2026Learning Physics-Grounded 4D Dynamics with Neural Gaussian Force Fieldscited by 5
- 2026PhyCo: Learning Controllable Physical Priors for Generative Motioncited by 5
- 2025SeeU: Seeing the Unseen World via 4D Dynamics-aware Generationcited by 3
- 2026PhysAlign: Physics-Coherent Image-to-Video Generation through Feature and 3D Representation Alignmentcited by 3
- 2026Learning Explicit Physical Parameter Control and Benchmarking for Video Generationcited by 3
- 2025From Rigging to Waving: 3D-Guided Diffusion for Natural Animation of Hand-Drawn Characterscited by 2
- 2025ControlHair: Synergizing Physics Simulator and Video Diffusion for Controllable Dynamic Hair Renderingcited by 2
- 2025Birth of a Painting: Differentiable Brushstroke Reconstructioncited by 1
- 2025PhysFire-WM: A Physics-Informed World Model for Emulating Fire Spread Dynamicscited by 1
- 2026Workflow-Aware Structured Layer Decomposition for Illustration Productioncited by 1
- 2026InstanceAnimator: Multi-Instance Sketch Video Colorizationcited by 1
- 2026Tempered Self-Similarity Alignment for Physically Plausible Video Generationcited by 1
- 2026Streaming Video Generation with Streaming Force Controlcited by 1
- 2026NEXUS: Neural Energy Fields for Physically Consistent Contact-Rich 3D Object Dynamicscited by 1
- 2026PhysStream: Streaming Physics-Grounded Video Generation with Structured Scene Memory and Fine-Grained Motion Controlcited by 1
- 2026ProxyImg: Towards Highly-Controllable Image Representation via Hierarchical Disentangled Proxy Embeddingcited by 0
- 2026Neural Assistive Impulses: Synthesizing Exaggerated Motions for Physics-based Characterscited by 0
- 2026CausalGS: Learning Physical Causality of 3D Dynamic Scenes with Gaussian Representationscited by 0
- 2026SIFT: Self-Imagination Fine-Tuning for Physically Plausible Motion in Video Diffusion Modelscited by 0
- 2026BendTwin: Robust Dense-to-Sparse Physical Reconstruction with Bending-Aware Differentiable Spring-Mass Modelscited by 0
- 2026UBone3D: Physics-Rectified Conditional Flow Matching for Anatomical 3D Shape Completion from Ultrasoundcited by 0
- 2026Reimagine Video Dynamicscited by 0
- 2026Fluid-Gen-Zero: Grounding Pretrained Video Generators in Physics without Trainingcited by 0
- 2026Fluid-Gen-Zero: Grounding Pretrained Video Generators in Physics without Training7 Oct 2026
- 2026Reimagine Video Dynamics29 Sep 2026
- 2026PhysStream: Streaming Physics-Grounded Video Generation with Structured Scene Memory and Fine-Grained Motion Control15 Sep 2026
- 2026UBone3D: Physics-Rectified Conditional Flow Matching for Anatomical 3D Shape Completion from Ultrasound10 Sep 2026
- 2026BendTwin: Robust Dense-to-Sparse Physical Reconstruction with Bending-Aware Differentiable Spring-Mass Models6 Aug 2026
- 2026Learning Explicit Physical Parameter Control and Benchmarking for Video Generation21 Jul 2026
- 2026SIFT: Self-Imagination Fine-Tuning for Physically Plausible Motion in Video Diffusion Models26 Jun 2026
- 2026NEXUS: Neural Energy Fields for Physically Consistent Contact-Rich 3D Object Dynamics12 Jun 2026
- 2026Streaming Video Generation with Streaming Force Control5 Jun 2026
- 2026Tempered Self-Similarity Alignment for Physically Plausible Video Generation24 May 2026
- 2026NEWTON: Agentic Planning for Physically Grounded Video Generation18 May 2026
- 2026CausalGS: Learning Physical Causality of 3D Dynamic Scenes with Gaussian Representations11 May 2026
28 more
- 2026PhyCo: Learning Controllable Physical Priors for Generative Motion30 Apr 2026
- 2026Phantom: Physics-Infused Video Generation via Joint Modeling of Visual and Latent Physical Dynamics9 Apr 2026
- 2026Neural Assistive Impulses: Synthesizing Exaggerated Motions for Physics-based Characters7 Apr 2026
- 2026InstanceAnimator: Multi-Instance Sketch Video Colorization26 Mar 2026
- 2026Workflow-Aware Structured Layer Decomposition for Illustration Production16 Mar 2026
- 2026PhysAlign: Physics-Coherent Image-to-Video Generation through Feature and 3D Representation Alignment14 Mar 2026
- 2026Physical Simulator In-the-Loop Video Generation6 Mar 2026
- 2026ProxyImg: Towards Highly-Controllable Image Representation via Hierarchical Disentangled Proxy Embedding2 Feb 2026
- 2026Learning Physics-Grounded 4D Dynamics with Neural Gaussian Force Fields29 Jan 2026
- 2026PhysRVG: Physics-Aware Unified Reinforcement Learning for Video Generative Models16 Jan 2026
- 2025PhysFire-WM: A Physics-Informed World Model for Emulating Fire Spread Dynamics19 Dec 2025
- 2025ProPhy: Progressive Physical Alignment for Dynamic World Simulation5 Dec 2025
- 2025SeeU: Seeing the Unseen World via 4D Dynamics-aware Generation3 Dec 2025
- 2025RULER-Bench: Probing Rule-based Reasoning Abilities of Next-level Video Generation Models for Vision Foundation Intelligence2 Dec 2025
- 2025What about gravity in video generation? Post-Training Newton's Laws with Verifiable Rewards29 Nov 2025
- 2025PhysChoreo: Physics-Controllable Video Generation with Part-Aware Semantic Grounding25 Nov 2025
- 2025Birth of a Painting: Differentiable Brushstroke Reconstruction17 Nov 2025
- 2025MoAlign: Motion-Centric Representation Alignment for Video Diffusion Models21 Oct 2025
- 2025PhysMaster: Mastering Physical Representation for Video Generation via Reinforcement Learning15 Oct 2025
- 2025Enhancing Physical Plausibility in Video Generation by Reasoning the Implausibility29 Sep 2025
- 2025ControlHair: Synergizing Physics Simulator and Video Diffusion for Controllable Dynamic Hair Rendering25 Sep 2025
- 2025NewtonGen: Physics-Consistent and Controllable Text-to-Video Generation via Neural Newtonian Dynamics25 Sep 2025
- 2025PhysCtrl: Generative Physics for Controllable and Physics-Grounded Video Generation24 Sep 2025
- 2025From Rigging to Waving: 3D-Guided Diffusion for Natural Animation of Hand-Drawn Characters8 Sep 2025
- 2025RoboScape: Physics-informed Embodied World Model29 Jun 2025
- 2025AceVFI: A Comprehensive Survey of Advances in Video Frame Interpolation1 Jun 2025
- 2025VideoREPA: Learning Physics for Video Generation through Relational Alignment with Foundation Models29 May 2025
- 2025Exploring the Evolution of Physics Cognition in Video Generation: A Survey27 Mar 2025
- 2025VideoREPA: Learning Physics for Video Generation through Relational Alignment with Foundation Modelscited by 88
- 2025PhysCtrl: Generative Physics for Controllable and Physics-Grounded Video Generationcited by 39
- 2025Exploring the Evolution of Physics Cognition in Video Generation: A Surveycited by 31
- 2025What about gravity in video generation? Post-Training Newton's Laws with Verifiable Rewardscited by 23
- 2025Enhancing Physical Plausibility in Video Generation by Reasoning the Implausibilitycited by 13
- 2025MoAlign: Motion-Centric Representation Alignment for Video Diffusion Modelscited by 13
- 2026Physical Simulator In-the-Loop Video Generationcited by 12
- 2026PhyCo: Learning Controllable Physical Priors for Generative Motioncited by 5
- 2026PhysAlign: Physics-Coherent Image-to-Video Generation through Feature and 3D Representation Alignmentcited by 3
- 2025From Rigging to Waving: 3D-Guided Diffusion for Natural Animation of Hand-Drawn Characterscited by 2
- 2025ControlHair: Synergizing Physics Simulator and Video Diffusion for Controllable Dynamic Hair Renderingcited by 2
- 2026InstanceAnimator: Multi-Instance Sketch Video Colorizationcited by 1
12 most cited of 13 All 13 (JSON)
- 2026SIFT: Self-Imagination Fine-Tuning for Physically Plausible Motion in Video Diffusion Models26 Jun 2026
- 2026PhyCo: Learning Controllable Physical Priors for Generative Motion30 Apr 2026
- 2026InstanceAnimator: Multi-Instance Sketch Video Colorization26 Mar 2026
- 2026PhysAlign: Physics-Coherent Image-to-Video Generation through Feature and 3D Representation Alignment14 Mar 2026
- 2026Physical Simulator In-the-Loop Video Generation6 Mar 2026
- 2025What about gravity in video generation? Post-Training Newton's Laws with Verifiable Rewards29 Nov 2025
- 2025MoAlign: Motion-Centric Representation Alignment for Video Diffusion Models21 Oct 2025
- 2025Enhancing Physical Plausibility in Video Generation by Reasoning the Implausibility29 Sep 2025
- 2025ControlHair: Synergizing Physics Simulator and Video Diffusion for Controllable Dynamic Hair Rendering25 Sep 2025
- 2025PhysCtrl: Generative Physics for Controllable and Physics-Grounded Video Generation24 Sep 2025
- 2025From Rigging to Waving: 3D-Guided Diffusion for Natural Animation of Hand-Drawn Characters8 Sep 2025
- 2025VideoREPA: Learning Physics for Video Generation through Relational Alignment with Foundation Models29 May 2025
12 newest of 13 All 13 (JSON)
- 2025NewtonGen: Physics-Consistent and Controllable Text-to-Video Generation via Neural Newtonian Dynamicscited by 40
- 2026PhysRVG: Physics-Aware Unified Reinforcement Learning for Video Generative Modelscited by 15
- 2025ProPhy: Progressive Physical Alignment for Dynamic World Simulationcited by 11
- 2026Phantom: Physics-Infused Video Generation via Joint Modeling of Visual and Latent Physical Dynamicscited by 10
- 2025PhysChoreo: Physics-Controllable Video Generation with Part-Aware Semantic Groundingcited by 9
- 2025AceVFI: A Comprehensive Survey of Advances in Video Frame Interpolationcited by 8
- 2026Learning Physics-Grounded 4D Dynamics with Neural Gaussian Force Fieldscited by 5
- 2025SeeU: Seeing the Unseen World via 4D Dynamics-aware Generationcited by 3
- 2026Learning Explicit Physical Parameter Control and Benchmarking for Video Generationcited by 3
- 2025Birth of a Painting: Differentiable Brushstroke Reconstructioncited by 1
- 2026Workflow-Aware Structured Layer Decomposition for Illustration Productioncited by 1
- 2026Tempered Self-Similarity Alignment for Physically Plausible Video Generationcited by 1
12 most cited of 22 All 22 (JSON)
- 2026Fluid-Gen-Zero: Grounding Pretrained Video Generators in Physics without Training7 Oct 2026
- 2026Reimagine Video Dynamics29 Sep 2026
- 2026PhysStream: Streaming Physics-Grounded Video Generation with Structured Scene Memory and Fine-Grained Motion Control15 Sep 2026
- 2026UBone3D: Physics-Rectified Conditional Flow Matching for Anatomical 3D Shape Completion from Ultrasound10 Sep 2026
- 2026BendTwin: Robust Dense-to-Sparse Physical Reconstruction with Bending-Aware Differentiable Spring-Mass Models6 Aug 2026
- 2026Learning Explicit Physical Parameter Control and Benchmarking for Video Generation21 Jul 2026
- 2026NEXUS: Neural Energy Fields for Physically Consistent Contact-Rich 3D Object Dynamics12 Jun 2026
- 2026Streaming Video Generation with Streaming Force Control5 Jun 2026
- 2026Tempered Self-Similarity Alignment for Physically Plausible Video Generation24 May 2026
- 2026CausalGS: Learning Physical Causality of 3D Dynamic Scenes with Gaussian Representations11 May 2026
- 2026Phantom: Physics-Infused Video Generation via Joint Modeling of Visual and Latent Physical Dynamics9 Apr 2026
- 2026Neural Assistive Impulses: Synthesizing Exaggerated Motions for Physics-based Characters7 Apr 2026
12 newest of 22 All 22 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2026AniMatrix: An Anime Video Generation Model that Thinks in Art, Not Physics
- 2023InsActor: Instruction-driven Physics-based Characters
- 2025AnimaMimic: Imitating 3D Animation from Video Priors
- 2025Generative AI for Character Animation: A Comprehensive Survey of Techniques, Applications, and Future Directions
- 2025Interactive Drawing Guidance for Anime Illustrations with Diffusion Model
- 2025PhysX-Anything: Simulation-Ready Physical 3D Assets from Single Image
- 2026Sketch2Motion: Text-driven 2D Sketch to 3D Animation via Diffusion-guided Skeleton Optimization
- 2025Articulated Kinematics Distillation from Video Diffusion Models