Sol Video Inference Engine: Agent-Native Full-Stack Acceleration Framework for Efficient Video Generation
On the map: Diffusion models → Video generation
Abstract (arXiv)
Modern video diffusion models achieve higher generation quality through scaling, but this also increases inference cost. Although many acceleration methods have been proposed, a central challenge is that the most effective acceleration strategy is highly instance-specific: a recipe that works well for one combination of model, hardware, and inference configuration often does not transfer to another. Different models vary in architecture, numerical sensitivity, and attention concentration patterns. Inference settings differ in spatial and temporal resolution and video duration, while hardware platforms differ in memory hierarchy, supported numerical formats, and kernel throughput. These factors create a large tuning space, making manual performance engineering costly. We present Sol Video Inference Engine, an agentic, native, training-free acceleration framework for video diffusion models. It organizes five broadly applicable techniques, cache, sparse attention, token pruning, quantization, and kernel fusion, into an agentic acceleration stack for instance-specific optimization. For a concrete deployment target defined by a model, hardware platform, and serving configuration, parallel skill agents optimize the implementation of each technique, an agent integrator composes them into a global acceleration stack, and a human validator provides feedback on generation quality. We instantiate this workflow on three video models with different sizes and architectures: 64B Cosmos3-Super, 22B LTX-2.3, and 2B SANA-Video. With little human effort, the full stack achieves more than 2x end-to-end acceleration while maintaining near-lossless VBench quality, demonstrating the effectiveness of the agent framework for video diffusion acceleration.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 44 of its 52 references that are in the map. First posted on arXiv 21 Jun 2026.
Builds on
44 of 52 references.
Closest ancestors · 15
Same direction, newest first
- 2026LongLive-2.0: An NVFP4 Parallel Infrastructure for Long Video Generation18 May
- 2026Temporal Aware Pruning for Efficient Diffusion-based Video Generation18 May
- 2026PISA: Piecewise Sparse Attention Is Wiser for Efficient Diffusion Transformers1 Feb
- 2025SANA-Video: Efficient Video Generation with Block Linear Diffusion Transformer29 Sep
- 2025Less is Enough: Training-Free Video Diffusion Acceleration via Runtime-Adaptive Caching3 Jul
- 2025Radial Attention: O(nlog n) Sparse Attention with Energy Decay for Long Video Generation24 Jun
- 2025Astraea: A Token-wise Acceleration Framework for Video Diffusion Transformers5 Jun
- 2025Sparse VideoGen2: Accelerate Video Generation with Sparse Attention via Semantic-Aware Permutation24 May
- 2025VSA: Faster Video Diffusion with Trainable Sparse Attention19 May
- 2025DraftAttention: Fast Video Diffusion via Low-Resolution Attention Guidance17 May
- 2025Fast Video Generation with Sliding Tile Attention6 Feb
- 2025Sparse VideoGen: Accelerating Video Diffusion Transformers with Spatial-Temporal Sparsity3 Feb
3 more
Other references · 29
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
- 2024Agentless: Demystifying LLM-based Software Engineering Agentscited by 400
- 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentationcited by 339
- 2024AutoCodeRover: Autonomous Program Improvementcited by 272
- 2023Token Merging for Fast Stable Diffusioncited by 220
17 more
- 2024SageAttention: Accurate 8-Bit Attention for Plug-and-play Inference Accelerationcited by 158
- 2024Real-Time Video Generation with Pyramid Attention Broadcastcited by 140
- 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 137
- 2025XAttention: Block Sparse Attention with Antidiagonal Scoringcited by 131
- 2025From Reusing to Forecasting: Accelerating Diffusion Models with TaylorSeerscited by 124
- 2024SageAttention2: Efficient Attention with Thorough Outlier Smoothing and Per-thread INT4 Quantizationcited by 113
- 2024ViDiT-Q: Efficient and Accurate Quantization of Diffusion Transformers for Image and Video Generationcited by 110
- 2024Q-DiT: Accurate Post-Training Quantization for Diffusion Transformerscited by 91
- 2024PTQ4DiT: Post-training Quantization for Diffusion Transformerscited by 77
- 2025SageAttention3: Microscaling FP4 Attention for Inference and An Exploration of 8-Bit Trainingcited by 63
- 2025CudaForge: An Agent Framework with Hardware Feedback for CUDA Kernel Optimizationcited by 42
- 2025CUDA-LLM: LLMs Can Write Efficient CUDA Kernelscited by 33
- 2022ByteTransformer: A High-Performance Transformer Boosted for Variable-Length Inputscited by 32
- 2026AI Harness Engineering: A Runtime Substrate for Foundation-Model Software Agentscited by 18
- 2026CODA: Rewriting Transformer Blocks as GEMM-Epilogue Programscited by 5
- 2026FP4 Explore, BF16 Train: Diffusion Reinforcement Learning via Efficient Rollout Scalingcited by 2
- 2026CoReDiT: Spatial Coherence-Guided Token Pruning and Reconstruction for Efficient Diffusion Transformerscited by 2
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Sol-Attn: Accelerating Video Generation Inference via On-the-Fly Attention Sparsificationcited by 6
- 2026SANA-Video 2.0: Hybrid Linear Attention with Attention Residuals for Efficient Video Generationcited by 2
- 2026CachedSearch: Training-Free Cached Exploration for Test-Time Search in Video Diffusioncited by 2
- 2026CAST: Reconstruction-Coupled Acceleration of Interactive World Modelscited by 0
- 2026Sol-H3: Recursive Self-Improvement for MiniMax-H3 Inference Acceleration on Sol-Engine across Cloud and Edgecited by 0
- 2026SoL-Refiner: Speed-of-Light One-Step Refinement for High-Resolution Videocited by 0
- 2026SoL-Refiner: Speed-of-Light One-Step Refinement for High-Resolution Video29 Sep 2026
- 2026Sol-H3: Recursive Self-Improvement for MiniMax-H3 Inference Acceleration on Sol-Engine across Cloud and Edge28 Sep 2026
- 2026CAST: Reconstruction-Coupled Acceleration of Interactive World Models28 Sep 2026
- 2026Sol-Attn: Accelerating Video Generation Inference via On-the-Fly Attention Sparsification27 Jul 2026
- 2026CachedSearch: Training-Free Cached Exploration for Test-Time Search in Video Diffusion25 Jul 2026
- 2026SANA-Video 2.0: Hybrid Linear Attention with Attention Residuals for Efficient Video Generation23 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026SPADE: An Input-Adaptive Sparse Attention Engine for Fast Video Diffusion Models Inference
- 2025Playing with Transformer at 30+ FPS via Next-Frame Diffusion
- 2025LightCache: Memory-Efficient, Training-Free Acceleration for Video Generation
- 2024Fast and Memory-Efficient Video Diffusion Using Streamlined Inference
- 2026Efficient Video Diffusion Models: Advancements and Challenges
- 2026A2RD: Agentic Autoregressive Diffusion for Long Video Consistency
- 2026Flex-Forcing: Towards a Unified Autoregressive and Bidirectional Video Diffusion Model
- 2026RhymeFlow: Training-Free Acceleration for Video Generation with Asynchronous Denoising Flow Scheduling