AniMatrix: An Anime Video Generation Model that Thinks in Art, Not Physics
Not on the map. Why?
Abstract (arXiv)
Video generation models internalize physical realism as their prior. Anime deliberately violates physics: smears, impact frames, chibi shifts; and its thousands of coexisting artistic conventions yield no single "physics of anime" a model can absorb. Physics-biased models therefore flatten the artistry that defines the medium or collapse under its stylistic variance. We present AniMatrix, a video generation model that targets artistic rather than physical correctness through a dual-channel conditioning mechanism and a three-step transition: redefine correctness, override the physics prior, and distinguish art from failure. First, a Production Knowledge System encodes anime as a structured taxonomy of controllable production variables (Style, Motion, Camera, VFX), and AniCaption infers these variables from pixels as directorial directives. A trainable tag encoder preserves the field-value structure of this taxonomy while a frozen T5 encoder handles free-form narrative; dual-path injection (cross-attention for fine-grained control, AdaLN modulation for global enforcement) ensures categorical directives are never diluted by open-ended text. Second, a style-motion-deformation curriculum transitions the model from near-physical motion to full anime expressiveness. Third, deformation-aware preference optimization with a domain-specific reward model separates intentional artistry from pathological collapse. On an anime-specific human evaluation with five production dimensions scored by professional animators, AniMatrix ranks first on four of five, with the largest gains over Seedance-Pro 1.0 on Prompt Understanding (+0.70, +22.4 percent) and Artistic Motion (+0.55, +16.9 percent). We are preparing accompanying resources for public release to support reproducibility and follow-up research.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 50 of its 56 references that are in the map. First posted on arXiv 5 May 2026.
Builds on
50 of 56 references.
References · 50
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Classifier-Free Diffusion Guidancecited by 5,847
38 more
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,073
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2021YOLOX: Exceeding YOLO Series in 2021cited by 1,071
- 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
- 2017Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learningcited by 950
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
- 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 790
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
- 2022Compositional Visual Generation with Composable Diffusion Modelscited by 624
- 2020TabTransformer: Tabular Data Modeling Using Contextual Embeddingscited by 409
- 2024Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teacherscited by 393
- 2023PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Trackingcited by 276
- 2022Unifying Flow, Stereo and Depth Estimationcited by 275
- 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 259
- 2025SkyReels-V2: Infinite-length Film Generative Modelcited by 229
- 2020TransNet V2: An effective deep network architecture for fast shot transition detectioncited by 171
- 2024Vidu: a Highly Consistent, Dynamic and Skilled Text-to-Video Generator with Diffusion Modelscited by 160
- 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 160
- 2025VLM2Vec-V2: Advancing Multimodal Embedding for Videos, Images, and Visual Documentscited by 116
- 2024VideoDPO: Omni-Preference Alignment for Video Diffusion Generationcited by 108
- 2025Kling-Omni Technical Reportcited by 71
- 2024ToonCrafter: Generative Cartoon Interpolationcited by 68
- 2024Denoising Task Difficulty-based Curriculum for Training Diffusion Modelscited by 27
- 2026SkyReels-V4: Multi-modal Video-Audio Generation, Inpainting and Editing modelcited by 12
- 2025Aligning Anime Video Generation with Human Feedbackcited by 9
- 2024AniSora: Exploring the Frontiers of Animation Video Generation in the Sora Eracited by 8
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025AnimeShooter: A Multi-Shot Animation Dataset for Reference-Guided Video Generation
- 2025PhysAnimator: Physics-Guided Generative Cartoon Animation
- 2024Sakuga-42M Dataset: Scaling Up Cartoon Research
- 2026CogOmniControl: Reasoning-Driven Controllable Video Generation via Creative Intent Cognition
- 2026AnimeAdapter: A Modular Adapter for Appearance-Consistent Anime Character Generation
- 2025AnimeDL-2M: Million-Scale AI-Generated Anime Image Detection and Localization in Diffusion Era
- 2025LayerAnimate: Layer-level Control for Animation
- 2025FairyGen: Storied Cartoon Video from a Single Child-Drawn Character