mlsanityData to 7 Oct 2026

Matten: Video Generation with Mamba-Attention

arXiv 2405.03025 ↗First posted 5 May 2024cs.CVcited by 24

On the map: Diffusion models → Video generation

also in 1 more
Abstract (arXiv)

In this paper, we introduce Matten, a cutting-edge latent diffusion model with Mamba-Attention architecture for video generation. With minimal computational cost, Matten employs spatial-temporal attention for local video content modeling and bidirectional Mamba for global video content modeling. Our comprehensive experimental evaluation demonstrates that Matten has competitive performance with the current Transformer-based and GAN-based models in benchmark performance, achieving superior FVD scores and efficiency. Additionally, we observe a direct positive correlation between the complexity of our designed model and the improvement in video quality, indicating the excellent scalability of Matten.

Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 66 of its 72 references that are in the map. First posted on arXiv 5 May 2024.

Builds on

66 of 72 references.

Closest ancestors · 14

Same direction, newest first

  1. 2024Latte: Latent Diffusion Transformer for Video Generation5 Jan
  2. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
  3. 2023SEINE: Short-to-Long Video Diffusion Model for Generative Transition and Prediction31 Oct
  4. 2023A Survey on Video Diffusion Models16 Oct
  5. 2023LAVIE: High-Quality Video Generation with Cascaded Latent Diffusion Models26 Sep
  6. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning10 Jul
  7. 2023VDT: General-purpose Video Diffusion Transformers via Mask Modeling22 May
  8. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models18 Apr
  9. 2023Video Probabilistic Diffusion Models in Projected Latent Space15 Feb
  10. 2022VIDM: Video Implicit Diffusion Models1 Dec
  11. 2022Latent Video Diffusion Models for High-Fidelity Long Video Generation23 Nov
  12. 2022Flexible Diffusion Modeling of Long Videos23 May
2 more
  1. 2022MCVD: Masked Conditional Video Diffusion for Prediction, Generation, and Interpolation19 May
  2. 2022Video Diffusion Models7 Apr

Other references · 52

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2022Scalable Diffusion Models with Transformerscited by 5,931
  4. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  5. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  6. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
  7. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
  8. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  9. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
  10. 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,051
  11. 2024VMamba: Visual State Space Modelcited by 955
  12. 2022Simplified State Space Layers for Sequence Modelingcited by 776
38 more
  1. 2020First Order Motion Model for Image Animationcited by 698
  2. 2021VideoGPT: Video Generation using VQ-VAE and Transformerscited by 651
  3. 2021Combining Recurrent, Convolutional, and Continuous-time Models with Linear State-Space Layerscited by 607
  4. 2020HiPPO: Recurrent Memory with Optimal Polynomial Projectionscited by 600
  5. 2017MoCoGAN: Decomposing Motion and Content for Video Generationcited by 523
  6. 2022All are Worth Words: A ViT Backbone for Diffusion Modelscited by 498
  7. 2022Hungry Hungry Hippos: Towards Language Modeling with State Space Modelscited by 495
  8. 2022On the Parameterization and Initialization of Diagonal State Space Modelscited by 418
  9. 2024U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentationcited by 412
  10. 2016Generating Videos with Scene Dynamicscited by 376
  11. 2022Diagonal State Spaces are as Effective as Structured State Spacescited by 350
  12. 2024VideoMamba: State Space Model for Efficient Video Understandingcited by 325
  13. 2021StyleGAN-V: A Continuous Video Generator with the Price, Image Quality and Perks of StyleGAN2cited by 300
  14. 2022Long Range Language Modeling via Gated State Spacescited by 265
  15. 2022Long Video Generation with Time-Agnostic VQGAN and Time-Sensitive Transformercited by 244
  16. 2016Temporal Generative Adversarial Nets with Singular Value Clippingcited by 198
  17. 2019Scaling Autoregressive Video Modelscited by 189
  18. 2022Mega: Moving Average Equipped Gated Attentioncited by 178
  19. 2024PointMamba: A Simple State Space Model for Point Cloud Analysiscited by 166
  20. 2021A Good Image Generator Is What You Need for High-Resolution Video Synthesiscited by 162
  21. 2018FaceForensics: A Large-scale Video Dataset for Forgery Detection in Human Facescited by 118
  22. 2020Latent Video Transformercited by 106
  23. 2024Video Mamba Suite: State Space Model as a Versatile Alternative for Video Understandingcited by 106
  24. 2024Cobra: Extending Mamba to Multi-Modal Large Language Model for Efficient Inferencecited by 97
  25. 2017Learning to Generate Time-Lapse Videos Using Multi-Stage Dynamic Generative Adversarial Networkscited by 88
  26. 2024Mamba-ND: Selective State Space Modeling for Multi-Dimensional Datacited by 84
  27. 2024Graph Mamba: Towards Learning on Graphs with State Space Modelscited by 84
  28. 2024Mamba-360: Survey of State Space Models as Transformer Alternative for Long Sequence Modelling: Methods, Applications, and Challengescited by 63
  29. 2024State Space Model for New-Generation Network Alternative to Transformers: A Surveycited by 59
  30. 2024MambaByte: Token-free Selective State Space Modelcited by 58
  31. 2024A Survey on Visual Mambacited by 50
  32. 2024Scalable Diffusion Models with State Space Backbonecited by 45
  33. 2024Visual Mamba: A Survey and New Outlookscited by 41
  34. 2023LEO: Generative Latent Image Animator for Human Video Synthesiscited by 40
  35. 2024U-shaped Vision Mamba for Single Image Dehazingcited by 40
  36. 2019Lower Dimensional Kernels for Video Discriminatorscited by 37
  37. 2022Efficient Long Sequence Modeling via State Space Augmented Transformercited by 37
  38. 2023MoStGAN-V: Video Generation with Temporal Motion Stylescited by 37

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 7; 2025: 14; 2026: 3.

24 papers.

Sort:

By area:

  1. 2025Autoregressive Adversarial Post-Training for Real-Time Interactive Video Generationcited by 84
  2. 2025Long-Context State-Space Video World Modelscited by 59
  3. 2024Vision Mamba: A Comprehensive Survey and Taxonomycited by 53
  4. 2024Hamba: Single-view 3D Hand Reconstruction with Graph-guided Bi-Scanning Mambacited by 45
  5. 2024ACDiT: Interpolating Autoregressive Conditional Modeling and Diffusion Transformercited by 45
  6. 2024LinGen: Towards High-Resolution Minute-Length Text-to-Video Generation with Linear Computational Complexitycited by 41
  7. 2024A Survey of Mambacited by 39
  8. 2025Error Analyses of Auto-Regressive Video Diffusion Models: A Unified Frameworkcited by 20
  9. 2024Mamba in Vision: A Comprehensive Survey of Techniques and Applicationscited by 18
  10. 2025Exploring Diffusion Transformer Designs via Graftingcited by 12
  11. 2025M4V: Multimodal Mamba for Efficient Text-to-Video Generationcited by 11
  12. 2026SVG-EAR: Parameter-Free Linear Compensation for Sparse Video Generation via Error-aware Routingcited by 9
12 more
  1. 2025Forecasting When to Forecast: Accelerating Diffusion Models with Confidence-Gated Taylorcited by 6
  2. 2026Evolution of Video Generative Foundationscited by 6
  3. 2024LaMamba-Diff: Linear-Time High-Fidelity Diffusion Models Based on Local Attention and Mambacited by 4
  4. 2025MobileI2V: Fast and High-Resolution Image-to-Video on Mobile Devicescited by 4
  5. 2025Diffusion Transformer-to-Mamba Distillation for High-Resolution Image Generationcited by 3
  6. 2025Consistent and Controllable Image Animation with Motion Linear Diffusion Transformerscited by 3
  7. 2025Technologies on Effectiveness and Efficiency: A Survey of State Spaces Modelscited by 2
  8. 2025Dual Mamba for Node-Specific Representation Learning: Tackling Over-Smoothing with Selective State Space Modelingcited by 1
  9. 2025Chameleon: Benchmarking Detection and Backtracking on Commercial-Grade AI-Generated Videoscited by 0
  10. 2025SISMA: Semantic Face Image Synthesis with Mambacited by 0
  11. 2025Gather-Scatter Mamba: Accelerating Propagation with Efficient State Space Modelcited by 0
  12. 2026EchoCache: Energy-Guided Cross-Modal Caching for Efficient Audio-Driven Video Generationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Scaling Diffusion Mamba with Bidirectional SSMs for Efficient Image and Video Generation
  2. 2026FrameDiT: Diffusion Transformer with Matrix Attention for Efficient Video Generation
  3. 2026MobileWan: Closing the Quality Gap for Mobile Video Diffusion
  4. 2024Efficient Video Diffusion Models via Content-Frame Motion-Latent Decomposition
  5. 2025Attention Surgery: An Efficient Recipe to Linearize Your Video Diffusion Transformer
  6. 2024OSV: One Step is Enough for High-Quality Image to Video Generation
  7. 2023PEEKABOO: Interactive Video Generation via Masked-Diffusion
  8. 2025DraftAttention: Fast Video Diffusion via Low-Resolution Attention Guidance