mlsanityData to 7 Oct 2026

Sol Video Inference Engine: Agent-Native Full-Stack Acceleration Framework for Efficient Video Generation

arXiv 2606.23743 ↗First posted 21 Jun 2026cs.CV cs.AI cs.LGcited by 6

On the map: Diffusion models → Video generation

Abstract (arXiv)

Modern video diffusion models achieve higher generation quality through scaling, but this also increases inference cost. Although many acceleration methods have been proposed, a central challenge is that the most effective acceleration strategy is highly instance-specific: a recipe that works well for one combination of model, hardware, and inference configuration often does not transfer to another. Different models vary in architecture, numerical sensitivity, and attention concentration patterns. Inference settings differ in spatial and temporal resolution and video duration, while hardware platforms differ in memory hierarchy, supported numerical formats, and kernel throughput. These factors create a large tuning space, making manual performance engineering costly. We present Sol Video Inference Engine, an agentic, native, training-free acceleration framework for video diffusion models. It organizes five broadly applicable techniques, cache, sparse attention, token pruning, quantization, and kernel fusion, into an agentic acceleration stack for instance-specific optimization. For a concrete deployment target defined by a model, hardware platform, and serving configuration, parallel skill agents optimize the implementation of each technique, an agent integrator composes them into a global acceleration stack, and a human validator provides feedback on generation quality. We instantiate this workflow on three video models with different sizes and architectures: 64B Cosmos3-Super, 22B LTX-2.3, and 2B SANA-Video. With little human effort, the full stack achieves more than 2x end-to-end acceleration while maintaining near-lossless VBench quality, demonstrating the effectiveness of the agent framework for video diffusion acceleration.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 44 of its 52 references that are in the map. First posted on arXiv 21 Jun 2026.

Builds on

44 of 52 references.

Closest ancestors · 15

Same direction, newest first

  1. 2026LongLive-2.0: An NVFP4 Parallel Infrastructure for Long Video Generation18 May
  2. 2026Temporal Aware Pruning for Efficient Diffusion-based Video Generation18 May
  3. 2026PISA: Piecewise Sparse Attention Is Wiser for Efficient Diffusion Transformers1 Feb
  4. 2025SANA-Video: Efficient Video Generation with Block Linear Diffusion Transformer29 Sep
  5. 2025Less is Enough: Training-Free Video Diffusion Acceleration via Runtime-Adaptive Caching3 Jul
  6. 2025Radial Attention: O(nlog n) Sparse Attention with Energy Decay for Long Video Generation24 Jun
  7. 2025Astraea: A Token-wise Acceleration Framework for Video Diffusion Transformers5 Jun
  8. 2025Sparse VideoGen2: Accelerate Video Generation with Sparse Attention via Semantic-Aware Permutation24 May
  9. 2025VSA: Faster Video Diffusion with Trainable Sparse Attention19 May
  10. 2025DraftAttention: Fast Video Diffusion via Low-Resolution Attention Guidance17 May
  11. 2025Fast Video Generation with Sliding Tile Attention6 Feb
  12. 2025Sparse VideoGen: Accelerating Video Diffusion Transformers with Spatial-Temporal Sparsity3 Feb
3 more
  1. 2024Timestep Embedding Tells: It's Time to Cache for Video Diffusion Model28 Nov
  2. 2024Pyramidal Flow Matching for Efficient Video Generative Modeling8 Oct
  3. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug

Other references · 29

  1. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  2. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  3. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
  4. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  5. 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
  6. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
  7. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
  8. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
  9. 2024Agentless: Demystifying LLM-based Software Engineering Agentscited by 400
  10. 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentationcited by 339
  11. 2024AutoCodeRover: Autonomous Program Improvementcited by 272
  12. 2023Token Merging for Fast Stable Diffusioncited by 220
17 more
  1. 2024SageAttention: Accurate 8-Bit Attention for Plug-and-play Inference Accelerationcited by 158
  2. 2024Real-Time Video Generation with Pyramid Attention Broadcastcited by 140
  3. 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 137
  4. 2025XAttention: Block Sparse Attention with Antidiagonal Scoringcited by 131
  5. 2025From Reusing to Forecasting: Accelerating Diffusion Models with TaylorSeerscited by 124
  6. 2024SageAttention2: Efficient Attention with Thorough Outlier Smoothing and Per-thread INT4 Quantizationcited by 113
  7. 2024ViDiT-Q: Efficient and Accurate Quantization of Diffusion Transformers for Image and Video Generationcited by 110
  8. 2024Q-DiT: Accurate Post-Training Quantization for Diffusion Transformerscited by 91
  9. 2024PTQ4DiT: Post-training Quantization for Diffusion Transformerscited by 77
  10. 2025SageAttention3: Microscaling FP4 Attention for Inference and An Exploration of 8-Bit Trainingcited by 63
  11. 2025CudaForge: An Agent Framework with Hardware Feedback for CUDA Kernel Optimizationcited by 42
  12. 2025CUDA-LLM: LLMs Can Write Efficient CUDA Kernelscited by 33
  13. 2022ByteTransformer: A High-Performance Transformer Boosted for Variable-Length Inputscited by 32
  14. 2026AI Harness Engineering: A Runtime Substrate for Foundation-Model Software Agentscited by 18
  15. 2026CODA: Rewriting Transformer Blocks as GEMM-Epilogue Programscited by 5
  16. 2026FP4 Explore, BF16 Train: Diffusion Reinforcement Learning via Efficient Rollout Scalingcited by 2
  17. 2026CoReDiT: Spatial Coherence-Guided Token Pruning and Reconstruction for Efficient Diffusion Transformerscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026SPADE: An Input-Adaptive Sparse Attention Engine for Fast Video Diffusion Models Inference
  2. 2025Playing with Transformer at 30+ FPS via Next-Frame Diffusion
  3. 2025LightCache: Memory-Efficient, Training-Free Acceleration for Video Generation
  4. 2024Fast and Memory-Efficient Video Diffusion Using Streamlined Inference
  5. 2026Efficient Video Diffusion Models: Advancements and Challenges
  6. 2026A2RD: Agentic Autoregressive Diffusion for Long Video Consistency
  7. 2026Flex-Forcing: Towards a Unified Autoregressive and Bidirectional Video Diffusion Model
  8. 2026RhymeFlow: Training-Free Acceleration for Video Generation with Asynchronous Denoising Flow Scheduling