mlsanityData to 14 Oct 2026

AniMatrix: An Anime Video Generation Model that Thinks in Art, Not Physics

arXiv 2605.03652 ↗First posted 5 May 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Video generation models internalize physical realism as their prior. Anime deliberately violates physics: smears, impact frames, chibi shifts; and its thousands of coexisting artistic conventions yield no single "physics of anime" a model can absorb. Physics-biased models therefore flatten the artistry that defines the medium or collapse under its stylistic variance. We present AniMatrix, a video generation model that targets artistic rather than physical correctness through a dual-channel conditioning mechanism and a three-step transition: redefine correctness, override the physics prior, and distinguish art from failure. First, a Production Knowledge System encodes anime as a structured taxonomy of controllable production variables (Style, Motion, Camera, VFX), and AniCaption infers these variables from pixels as directorial directives. A trainable tag encoder preserves the field-value structure of this taxonomy while a frozen T5 encoder handles free-form narrative; dual-path injection (cross-attention for fine-grained control, AdaLN modulation for global enforcement) ensures categorical directives are never diluted by open-ended text. Second, a style-motion-deformation curriculum transitions the model from near-physical motion to full anime expressiveness. Third, deformation-aware preference optimization with a domain-specific reward model separates intentional artistry from pathological collapse. On an anime-specific human evaluation with five production dimensions scored by professional animators, AniMatrix ranks first on four of five, with the largest gains over Seedance-Pro 1.0 on Prompt Understanding (+0.70, +22.4 percent) and Artistic Motion (+0.55, +16.9 percent). We are preparing accompanying resources for public release to support reproducibility and follow-up research.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 50 of its 56 references that are in the map. First posted on arXiv 5 May 2026.

Builds on

50 of 56 references.

References · 50

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2022Training language models to follow instructions with human feedbackcited by 15,971
  6. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  7. 2020Denoising Diffusion Implicit Modelscited by 9,781
  8. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  9. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  10. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  11. 2022Scalable Diffusion Models with Transformerscited by 6,054
  12. 2022Classifier-Free Diffusion Guidancecited by 5,847
38 more
  1. 2022Flow Matching for Generative Modelingcited by 5,702
  2. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  3. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  4. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,073
  5. 2025Qwen3-VL Technical Reportcited by 2,793
  6. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  7. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
  8. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  9. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  10. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  11. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  12. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
  13. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  14. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  15. 2021YOLOX: Exceeding YOLO Series in 2021cited by 1,071
  16. 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
  17. 2017Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learningcited by 950
  18. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
  19. 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 790
  20. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
  21. 2022Compositional Visual Generation with Composable Diffusion Modelscited by 624
  22. 2020TabTransformer: Tabular Data Modeling Using Contextual Embeddingscited by 409
  23. 2024Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teacherscited by 393
  24. 2023PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Trackingcited by 276
  25. 2022Unifying Flow, Stereo and Depth Estimationcited by 275
  26. 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 259
  27. 2025SkyReels-V2: Infinite-length Film Generative Modelcited by 229
  28. 2020TransNet V2: An effective deep network architecture for fast shot transition detectioncited by 171
  29. 2024Vidu: a Highly Consistent, Dynamic and Skilled Text-to-Video Generator with Diffusion Modelscited by 160
  30. 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 160
  31. 2025VLM2Vec-V2: Advancing Multimodal Embedding for Videos, Images, and Visual Documentscited by 116
  32. 2024VideoDPO: Omni-Preference Alignment for Video Diffusion Generationcited by 108
  33. 2025Kling-Omni Technical Reportcited by 71
  34. 2024ToonCrafter: Generative Cartoon Interpolationcited by 68
  35. 2024Denoising Task Difficulty-based Curriculum for Training Diffusion Modelscited by 27
  36. 2026SkyReels-V4: Multi-modal Video-Audio Generation, Inpainting and Editing modelcited by 12
  37. 2025Aligning Anime Video Generation with Human Feedbackcited by 9
  38. 2024AniSora: Exploring the Frontiers of Animation Video Generation in the Sora Eracited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025AnimeShooter: A Multi-Shot Animation Dataset for Reference-Guided Video Generation
  2. 2025PhysAnimator: Physics-Guided Generative Cartoon Animation
  3. 2024Sakuga-42M Dataset: Scaling Up Cartoon Research
  4. 2026CogOmniControl: Reasoning-Driven Controllable Video Generation via Creative Intent Cognition
  5. 2026AnimeAdapter: A Modular Adapter for Appearance-Consistent Anime Character Generation
  6. 2025AnimeDL-2M: Million-Scale AI-Generated Anime Image Detection and Localization in Diffusion Era
  7. 2025LayerAnimate: Layer-level Control for Animation
  8. 2025FairyGen: Storied Cartoon Video from a Single Child-Drawn Character