Sol-H3: Recursive Self-Improvement for MiniMax-H3 Inference Acceleration on Sol-Engine across Cloud and Edge
On the map: Diffusion models → Video generation also fits: Diffusion foundations and sampling
also in 1 more
Abstract (arXiv)
Video diffusion models are rapidly scaling and exhibiting enhanced generation capabilities. Among these recent advancements, MiniMax-H3 stands out as a highly capable, production-level open-source model. However, its 33-billion parameters and multi-step iterative denoising process introduce substantial computational overhead. Consequently, their practical production is hindered by generation latency in the cloud deployment like NVIDIA-GB200, alongside strict memory limits that pose further challenges at the edge device like DGX-Spark. To address these diverse hardware bottlenecks from cloud to edge device, we present a full-stack inference pipeline that integrates efficient algorithmic design with optimized operator implementations. Algorithmically, we introduce a cross-resolution two-stage generation scheduler that exploits the step-wise nature of diffusion: early low-resolution steps rapidly establish the global layout, while later high-resolution steps focus refinements of local and perceptual details. These stages are connected by a learned latent-to-latent mapping module, completely eliminating the computationally expensive VAE decode-reencode cycle for resolution transferring cross different resolutions. For operator implementation, we deploy a Recursive Self-Improvement (RSI) loop that searches kernel fusions and memory layouts, evaluating latency together with numerical agreement. Together, these optimizations deliver up to 30x end-to-end speedup and 20% lower memory: a 5-second 1344x768 video with audio is generated 3.5x faster than real time on an 8xGB200 node, and in under a minute fully memory-resident on a single DGX Spark.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 64 of its 83 references that are in the map. First posted on arXiv 28 Sep 2026.
Builds on
64 of 83 references.
Closest ancestors · 18
Same direction, newest first
- 2026Video DeltaNet: A Video-Native Hybrid Attention for Livestream Video Generation17 Sep
- 2026Parallel Decoding Distillation for Fast Image and Video Generation28 Jul
- 2026Sol-Attn: Accelerating Video Generation Inference via On-the-Fly Attention Sparsification27 Jul
- 2026Sol Video Inference Engine: Agent-Native Full-Stack Acceleration Framework for Efficient Video Generation21 Jun
- 2026LongLive-2.0: An NVFP4 Parallel Infrastructure for Long Video Generation18 May
- 2026Temporal Aware Pruning for Efficient Diffusion-based Video Generation18 May
- 2026PISA: Piecewise Sparse Attention Is Wiser for Efficient Diffusion Transformers1 Feb
- 2025SANA-Video: Efficient Video Generation with Block Linear Diffusion Transformer29 Sep
- 2025Less is Enough: Training-Free Video Diffusion Acceleration via Runtime-Adaptive Caching3 Jul
- 2025Astraea: A Token-wise Acceleration Framework for Video Diffusion Transformers5 Jun
- 2025Sparse VideoGen2: Accelerate Video Generation with Sparse Attention via Semantic-Aware Permutation24 May
- 2025VSA: Faster Video Diffusion with Trainable Sparse Attention19 May
6 more
- 2025DraftAttention: Fast Video Diffusion via Low-Resolution Attention Guidance17 May
- 2025Fast Video Generation with Sliding Tile Attention6 Feb
- 2025Sparse VideoGen: Accelerating Video Diffusion Transformers with Spatial-Temporal Sparsity3 Feb
- 2024Timestep Embedding Tells: It's Time to Cache for Video Diffusion Model28 Nov
- 2024Pyramidal Flow Matching for Efficient Video Generative Modeling8 Oct
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
Other references · 46
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2023Consistency Modelscited by 1,778
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2023AWQ: Activation-aware Weight Quantization for LLM Compression and Accelerationcited by 1,234
34 more
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
- 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
- 2023SGLang: Efficient Execution of Structured Language Model Programscited by 1,107
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
- 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 826
- 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 763
- 2023Adversarial Diffusion Distillationcited by 741
- 2024Agentless: Demystifying LLM-based Software Engineering Agentscited by 400
- 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentationcited by 339
- 2024AutoCodeRover: Autonomous Program Improvementcited by 272
- 2023DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Modelscited by 239
- 2023Token Merging for Fast Stable Diffusioncited by 220
- 2025KernelBench: Can LLMs Write Efficient GPU Kernels?cited by 206
- 2024SageAttention: Accurate 8-Bit Attention for Plug-and-play Inference Accelerationcited by 158
- 2024Real-Time Video Generation with Pyramid Attention Broadcastcited by 140
- 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 137
- 2025XAttention: Block Sparse Attention with Antidiagonal Scoringcited by 131
- 2025From Reusing to Forecasting: Accelerating Diffusion Models with TaylorSeerscited by 124
- 2024SageAttention2: Efficient Attention with Thorough Outlier Smoothing and Per-thread INT4 Quantizationcited by 113
- 2024ViDiT-Q: Efficient and Accurate Quantization of Diffusion Transformers for Image and Video Generationcited by 110
- 2024Q-DiT: Accurate Post-Training Quantization for Diffusion Transformerscited by 91
- 2024PTQ4DiT: Post-training Quantization for Diffusion Transformerscited by 77
- 2025SageAttention3: Microscaling FP4 Attention for Inference and An Exploration of 8-Bit Trainingcited by 63
- 2025CudaForge: An Agent Framework with Hardware Feedback for CUDA Kernel Optimizationcited by 42
- 2025CUDA-LLM: LLMs Can Write Efficient CUDA Kernelscited by 33
- 2022ByteTransformer: A High-Performance Transformer Boosted for Variable-Length Inputscited by 32
- 2025AccelOpt: A Self-Improving LLM Agentic System for AI Accelerator Kernel Optimizationcited by 21
- 2026AI Harness Engineering: A Runtime Substrate for Foundation-Model Software Agentscited by 18
- 2026CODA: Rewriting Transformer Blocks as GEMM-Epilogue Programscited by 5
- 2026FP4 Explore, BF16 Train: Diffusion Reinforcement Learning via Efficient Rollout Scalingcited by 2
- 2026CoReDiT: Spatial Coherence-Guided Token Pruning and Reconstruction for Efficient Diffusion Transformerscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025EC-Diff: Fast and High-Quality Edge-Cloud Collaborative Inference for Diffusion Models
- 2026Accelerating Diffusion via Hybrid Data-Pipeline Parallelism Based on Conditional Guidance Scheduling
- 2026NanoSD: Edge Efficient Foundation Model for Real Time Image Restoration
- 2024Hybrid SD: Edge-Cloud Collaborative Inference for Stable Diffusion Models
- 2025H3AE: High Compression, High Speed, and High Quality AutoEncoder for Video Diffusion Models
- 2025Training-free Diffusion Acceleration with Bottleneck Sampling
- 2026AoiZora: Topology-Aware Auto-Parallel Optimization for Inference of Diffusion Transformers
- 2026Dynamic-in-Few-Step: Unifying Dynamic Computation and Few-Step Distillation for Efficient Video Generation